Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260927 15:05:52.675783 804 test_util.cc:268] Using random seed: 1226580894
2026-09-27T15:05:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-27T15:05:52Z Disabled control of system clock
I20260927 15:05:52.708082 804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
/tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.62:41167
--webserver_interface=127.0.201.62
--webserver_port=0
--builtin_ntp_servers=127.0.201.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260927 15:05:53.042140 812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:05:53.042445 812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:05:53.042526 812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:05:53.050211 812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:05:53.050333 812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:05:53.050382 812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:05:53.050437 812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:05:53.059748 812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.201.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.62:41167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.201.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 27 Sep 2026 13:46:26 UTC on ccycloud.quasar-xkqhuq.root.comops.site
build id 4676080
ASAN enabled
I20260927 15:05:53.061054 812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:05:53.062842 812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:05:53.075763 817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:53.075845 818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:53.075809 820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:05:53.077030 812 server_base.cc:1034] running on GCE node
I20260927 15:05:53.077778 812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:05:53.079180 812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:05:53.080389 812 hybrid_clock.cc:648] HybridClock initialized: now 1790521553080298 us; error 66 us; skew 500 ppm
I20260927 15:05:53.080662 812 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 15:05:53.087482 812 webserver.cc:460] Webserver started at http://127.0.201.62:41209/ using document root <none> and password file <none>
I20260927 15:05:53.088111 812 fs_manager.cc:359] Metadata directory not provided
I20260927 15:05:53.088212 812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:05:53.088459 812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:05:53.091035 812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data/instance:
uuid: "dbf522d70373412b87815d33c0f1f745"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:05:53.091747 812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal/instance:
uuid: "dbf522d70373412b87815d33c0f1f745"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:05:53.096639 812 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260927 15:05:53.099786 826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:53.101004 812 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260927 15:05:53.101176 812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data,/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
uuid: "dbf522d70373412b87815d33c0f1f745"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:05:53.101330 812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:05:53.121935 812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:05:53.122905 812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:05:53.123175 812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:05:53.141815 812 rpc_server.cc:307] RPC server started. Bound to: 127.0.201.62:41167
I20260927 15:05:53.141844 877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.201.62:41167 every 8 connection(s)
I20260927 15:05:53.143286 812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data/info.pb
I20260927 15:05:53.144819 804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu as pid 812
I20260927 15:05:53.145092 804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal/instance
I20260927 15:05:53.147464 804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
/tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.61:43763
--webserver_interface=127.0.201.61
--webserver_port=0
--builtin_ntp_servers=127.0.201.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260927 15:05:53.147790 878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:53.153720 878 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:05:53.173625 878 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } has no permanent_uuid. Determining permanent_uuid...
W20260927 15:05:53.175040 830 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.201.61:43763: connect: Connection refused (error 111)
W20260927 15:05:53.177060 878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.61:43763: Network error: Client connection negotiation failed: client connection to 127.0.201.61:43763: connect: Connection refused (error 111)
I20260927 15:05:53.226491 878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } attempt: 1
W20260927 15:05:53.228638 878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.61:43763: Network error: Client connection negotiation failed: client connection to 127.0.201.61:43763: connect: Connection refused (error 111)
I20260927 15:05:53.296891 878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } attempt: 2
W20260927 15:05:53.299618 878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.61:43763: Network error: Client connection negotiation failed: client connection to 127.0.201.61:43763: connect: Connection refused (error 111)
I20260927 15:05:53.390945 878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } attempt: 3
W20260927 15:05:53.392921 878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.61:43763: Network error: Client connection negotiation failed: client connection to 127.0.201.61:43763: connect: Connection refused (error 111)
W20260927 15:05:53.509585 880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:05:53.509873 880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:05:53.509953 880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:05:53.517562 880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:05:53.517663 880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:05:53.517704 880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:05:53.517764 880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:05:53.527276 880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.201.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.61:43763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.201.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 27 Sep 2026 13:46:26 UTC on ccycloud.quasar-xkqhuq.root.comops.site
build id 4676080
ASAN enabled
I20260927 15:05:53.528517 880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:05:53.530174 880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:05:53.536175 878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } attempt: 4
W20260927 15:05:53.538015 878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.61:43763: Network error: Client connection negotiation failed: client connection to 127.0.201.61:43763: connect: Connection refused (error 111)
W20260927 15:05:53.541831 888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:53.541862 889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:53.541802 891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:05:53.542946 880 server_base.cc:1034] running on GCE node
I20260927 15:05:53.543697 880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:05:53.545002 880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:05:53.546592 880 hybrid_clock.cc:648] HybridClock initialized: now 1790521553546157 us; error 36 us; skew 500 ppm
I20260927 15:05:53.546976 880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 15:05:53.549072 880 webserver.cc:460] Webserver started at http://127.0.201.61:45701/ using document root <none> and password file <none>
I20260927 15:05:53.549736 880 fs_manager.cc:359] Metadata directory not provided
I20260927 15:05:53.549860 880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:05:53.550171 880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:05:53.552811 880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/data/instance:
uuid: "6b6a41e027f0448cafe3365f23103f92"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:05:53.553553 880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/wal/instance:
uuid: "6b6a41e027f0448cafe3365f23103f92"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:05:53.558736 880 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260927 15:05:53.562143 897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:53.563422 880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:05:53.563592 880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/data,/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/wal
uuid: "6b6a41e027f0448cafe3365f23103f92"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:05:53.563791 880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:05:53.582077 880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:05:53.583063 880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:05:53.583369 880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:05:53.602396 880 rpc_server.cc:307] RPC server started. Bound to: 127.0.201.61:43763
I20260927 15:05:53.602413 948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.201.61:43763 every 8 connection(s)
I20260927 15:05:53.603832 880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/data/info.pb
I20260927 15:05:53.607586 949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:53.608619 804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu as pid 880
I20260927 15:05:53.608783 804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-1/wal/instance
I20260927 15:05:53.610105 804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
/tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.60:46799
--webserver_interface=127.0.201.60
--webserver_port=0
--builtin_ntp_servers=127.0.201.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260927 15:05:53.616540 949 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:05:53.630549 949 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:05:53.641142 949 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } has no permanent_uuid. Determining permanent_uuid...
W20260927 15:05:53.642115 898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
W20260927 15:05:53.643662 949 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.60:46799: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
I20260927 15:05:53.692976 949 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } attempt: 1
W20260927 15:05:53.695005 949 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.60:46799: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
I20260927 15:05:53.763280 949 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } attempt: 2
W20260927 15:05:53.765412 949 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.60:46799: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
I20260927 15:05:53.837458 878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } attempt: 5
I20260927 15:05:53.844587 878 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } has no permanent_uuid. Determining permanent_uuid...
W20260927 15:05:53.846313 878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.60:46799: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
I20260927 15:05:53.856673 949 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } attempt: 3
W20260927 15:05:53.859097 949 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.60:46799: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
I20260927 15:05:53.897521 878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } attempt: 1
W20260927 15:05:53.899422 878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.60:46799: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
W20260927 15:05:53.937379 951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:05:53.937716 951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:05:53.937871 951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:05:53.945003 951 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:05:53.945138 951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:05:53.945231 951 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:05:53.945312 951 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:05:53.954680 951 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.201.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.60:46799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.201.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 27 Sep 2026 13:46:26 UTC on ccycloud.quasar-xkqhuq.root.comops.site
build id 4676080
ASAN enabled
I20260927 15:05:53.955993 951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:05:53.957741 951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:05:53.968042 878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } attempt: 2
W20260927 15:05:53.969573 959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:53.969605 960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:53.969805 962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:53.970340 878 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.60:46799: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
I20260927 15:05:53.971064 951 server_base.cc:1034] running on GCE node
I20260927 15:05:53.971807 951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:05:53.973086 951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:05:53.974332 951 hybrid_clock.cc:648] HybridClock initialized: now 1790521553974268 us; error 41 us; skew 500 ppm
I20260927 15:05:53.974645 951 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 15:05:53.976807 951 webserver.cc:460] Webserver started at http://127.0.201.60:39943/ using document root <none> and password file <none>
I20260927 15:05:53.977452 951 fs_manager.cc:359] Metadata directory not provided
I20260927 15:05:53.977591 951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:05:53.977888 951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:05:53.980418 951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data/instance:
uuid: "2a122de3662f485f8f44b0a5e4b29862"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:05:53.981137 951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal/instance:
uuid: "2a122de3662f485f8f44b0a5e4b29862"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:05:53.985992 951 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260927 15:05:53.989720 968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:53.990989 951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:05:53.991176 951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data,/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
uuid: "2a122de3662f485f8f44b0a5e4b29862"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:05:53.991365 951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:05:54.002326 949 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } attempt: 4
W20260927 15:05:54.004508 949 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.0.201.60:46799: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
I20260927 15:05:54.024869 951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:05:54.025677 951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:05:54.025925 951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:05:54.044952 951 rpc_server.cc:307] RPC server started. Bound to: 127.0.201.60:46799
I20260927 15:05:54.044973 1019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.201.60:46799 every 8 connection(s)
I20260927 15:05:54.046276 951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data/info.pb
I20260927 15:05:54.047626 804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu as pid 951
I20260927 15:05:54.047813 804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal/instance
I20260927 15:05:54.049943 1020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:54.058627 1020 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:05:54.073805 1020 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:05:54.076568 878 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } attempt: 3
I20260927 15:05:54.082196 1020 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } has no permanent_uuid. Determining permanent_uuid...
I20260927 15:05:54.093761 878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: Bootstrap starting.
I20260927 15:05:54.093987 1020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: Bootstrap starting.
I20260927 15:05:54.096874 878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:54.096961 1020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:54.097853 878 log.cc:824] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: Log is configured to *not* fsync() on all Append() calls
I20260927 15:05:54.097898 1020 log.cc:824] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: Log is configured to *not* fsync() on all Append() calls
I20260927 15:05:54.101836 878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: No bootstrap required, opened a new log
I20260927 15:05:54.101855 1020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: No bootstrap required, opened a new log
I20260927 15:05:54.109464 878 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:54.109757 878 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:54.109639 1020 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:54.109885 878 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf522d70373412b87815d33c0f1f745, State: Initialized, Role: FOLLOWER
I20260927 15:05:54.110008 1020 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:54.110119 1020 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a122de3662f485f8f44b0a5e4b29862, State: Initialized, Role: FOLLOWER
I20260927 15:05:54.110540 878 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:54.110592 1020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:54.111423 1031 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.111503 1032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.111845 1032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:05:54.111974 1031 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:05:54.112548 878 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:05:54.112550 1020 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [sys.catalog]: configured and running, proceeding with master startup.
W20260927 15:05:54.125810 832 tablet.cc:2369] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260927 15:05:54.132845 1048 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:05:54.133090 1048 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:05:54.122581 812 master_runner.cc:186] Error getting master registration for 127.0.201.61:43763: OK, instance_id { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" instance_seqno: 1790521553597239 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:05:54.133621 812 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260927 15:05:54.135242 1054 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:05:54.135365 1054 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:05:54.127898 951 master_runner.cc:186] Error getting master registration for 127.0.201.61:43763: OK, instance_id { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" instance_seqno: 1790521553597239 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:05:54.138666 951 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260927 15:05:54.277945 974 tablet.cc:2369] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:05:54.303726 949 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } attempt: 5
I20260927 15:05:54.317214 949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Bootstrap starting.
I20260927 15:05:54.321269 949 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:54.323138 949 log.cc:824] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Log is configured to *not* fsync() on all Append() calls
I20260927 15:05:54.326632 949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: No bootstrap required, opened a new log
I20260927 15:05:54.337571 949 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:54.337950 949 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:54.338056 949 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6a41e027f0448cafe3365f23103f92, State: Initialized, Role: FOLLOWER
I20260927 15:05:54.338738 949 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:54.339699 1058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.340188 1058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:05:54.341054 949 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:05:54.360364 880 master_runner.cc:263] No leader master found from master 6b6a41e027f0448cafe3365f23103f92
I20260927 15:05:54.360505 880 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260927 15:05:54.365548 1069 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260927 15:05:54.365779 1069 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260927 15:05:54.491181 1058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:54.491523 1058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:54.493194 1058 leader_election.cc:288] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbf522d70373412b87815d33c0f1f745 (127.0.201.62:41167), 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799)
I20260927 15:05:54.494468 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b6a41e027f0448cafe3365f23103f92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a122de3662f485f8f44b0a5e4b29862" is_pre_election: true
I20260927 15:05:54.495334 853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b6a41e027f0448cafe3365f23103f92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbf522d70373412b87815d33c0f1f745" is_pre_election: true
I20260927 15:05:54.495746 995 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6a41e027f0448cafe3365f23103f92 in term 0.
I20260927 15:05:54.495847 853 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6a41e027f0448cafe3365f23103f92 in term 0.
I20260927 15:05:54.496613 898 leader_election.cc:302] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6a41e027f0448cafe3365f23103f92, dbf522d70373412b87815d33c0f1f745; no voters:
I20260927 15:05:54.497350 1058 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:54.497491 1058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:54.497591 1058 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:54.503120 1058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:54.504400 853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b6a41e027f0448cafe3365f23103f92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbf522d70373412b87815d33c0f1f745"
I20260927 15:05:54.504666 853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:54.508134 853 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6a41e027f0448cafe3365f23103f92 in term 1.
I20260927 15:05:54.508651 898 leader_election.cc:302] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6a41e027f0448cafe3365f23103f92, dbf522d70373412b87815d33c0f1f745; no voters:
I20260927 15:05:54.515528 1058 leader_election.cc:288] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [CANDIDATE]: Term 1 election: Requested vote from peers dbf522d70373412b87815d33c0f1f745 (127.0.201.62:41167), 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799)
I20260927 15:05:54.516068 1058 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:54.516742 1058 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [term 1 LEADER]: Becoming Leader. State: Replica: 6b6a41e027f0448cafe3365f23103f92, State: Running, Role: LEADER
I20260927 15:05:54.517910 1058 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:54.526858 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b6a41e027f0448cafe3365f23103f92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a122de3662f485f8f44b0a5e4b29862"
I20260927 15:05:54.527100 995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:54.530167 995 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6a41e027f0448cafe3365f23103f92 in term 1.
I20260927 15:05:54.532466 1071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b6a41e027f0448cafe3365f23103f92. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.532950 1071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: This master's current role is: LEADER
I20260927 15:05:54.547363 1073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260927 15:05:54.549870 1073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260927 15:05:54.572750 995 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 1 FOLLOWER]: Refusing update from remote peer 6b6a41e027f0448cafe3365f23103f92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:54.574136 1058 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:05:54.576175 853 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Refusing update from remote peer 6b6a41e027f0448cafe3365f23103f92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:54.577948 1058 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:05:54.586123 903 tablet.cc:2369] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:05:54.593731 1032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b6a41e027f0448cafe3365f23103f92. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.594048 1032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:05:54.596094 1074 mvcc.cc:205] Tried to move back new op lower bound from 7333976287516549120 to 7333976287315013632. Current Snapshot: MvccSnapshot[applied={T|T < 7333976287516549120}]
I20260927 15:05:54.611075 1032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.611330 1032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:05:54.617498 1071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.617786 1071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: This master's current role is: LEADER
I20260927 15:05:54.619719 1073 catalog_manager.cc:1347] Generated new cluster ID: a08215f58a7f46c68a561816e301758f
I20260927 15:05:54.619836 1073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260927 15:05:54.621556 1031 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b6a41e027f0448cafe3365f23103f92. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.621836 1031 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:05:54.639319 1058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.639657 1058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: This master's current role is: LEADER
I20260927 15:05:54.640040 1031 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:54.640282 1031 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:05:54.640829 1073 catalog_manager.cc:1370] Generated new certificate authority record
I20260927 15:05:54.642617 1073 catalog_manager.cc:1504] Loading token signing keys...
I20260927 15:05:54.666143 1073 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Generated new TSK 0
I20260927 15:05:54.667685 1073 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260927 15:05:54.692888 804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
/tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.201.1:0
--local_ip_for_outbound_sockets=127.0.201.1
--webserver_interface=127.0.201.1
--webserver_port=0
--tserver_master_addrs=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--builtin_ntp_servers=127.0.201.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260927 15:05:55.018983 1084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:05:55.019299 1084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:05:55.019464 1084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:05:55.027055 1084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:05:55.027279 1084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.201.1
I20260927 15:05:55.036656 1084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.201.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.201.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.201.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.201.1
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 27 Sep 2026 13:46:26 UTC on ccycloud.quasar-xkqhuq.root.comops.site
build id 4676080
ASAN enabled
I20260927 15:05:55.037952 1084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:05:55.039669 1084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:05:55.054390 1089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:55.054388 1090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:05:55.055473 1084 server_base.cc:1034] running on GCE node
W20260927 15:05:55.055626 1092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:05:55.056285 1084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:05:55.057241 1084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:05:55.058491 1084 hybrid_clock.cc:648] HybridClock initialized: now 1790521555058412 us; error 37 us; skew 500 ppm
I20260927 15:05:55.058781 1084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 15:05:55.061126 1084 webserver.cc:460] Webserver started at http://127.0.201.1:39325/ using document root <none> and password file <none>
I20260927 15:05:55.061784 1084 fs_manager.cc:359] Metadata directory not provided
I20260927 15:05:55.061879 1084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:05:55.062098 1084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:05:55.064621 1084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/data/instance:
uuid: "c4264874db964ff2830b7894c2b3d61c"
format_stamp: "Formatted at 2026-09-27 15:05:55 on dist-test-slave-65dj"
I20260927 15:05:55.065346 1084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/instance:
uuid: "c4264874db964ff2830b7894c2b3d61c"
format_stamp: "Formatted at 2026-09-27 15:05:55 on dist-test-slave-65dj"
I20260927 15:05:55.070339 1084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260927 15:05:55.074029 1098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:55.075453 1084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260927 15:05:55.075579 1084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/data,/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal
uuid: "c4264874db964ff2830b7894c2b3d61c"
format_stamp: "Formatted at 2026-09-27 15:05:55 on dist-test-slave-65dj"
I20260927 15:05:55.075744 1084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:05:55.093003 1084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:05:55.093993 1084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:05:55.094318 1084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:05:55.095450 1084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:05:55.096803 1084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:05:55.096873 1084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:55.096952 1084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:05:55.097018 1084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:55.132318 1084 rpc_server.cc:307] RPC server started. Bound to: 127.0.201.1:46757
I20260927 15:05:55.132349 1210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.201.1:46757 every 8 connection(s)
I20260927 15:05:55.133595 1084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/data/info.pb
I20260927 15:05:55.135327 1048 catalog_manager.cc:1259] Loaded cluster ID: a08215f58a7f46c68a561816e301758f
I20260927 15:05:55.135416 1048 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: loading cluster ID for follower catalog manager: success
I20260927 15:05:55.136996 1054 catalog_manager.cc:1259] Loaded cluster ID: a08215f58a7f46c68a561816e301758f
I20260927 15:05:55.137111 1054 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: loading cluster ID for follower catalog manager: success
I20260927 15:05:55.139497 804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu as pid 1084
I20260927 15:05:55.139710 804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/instance
I20260927 15:05:55.140836 1054 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: acquiring CA information for follower catalog manager: success
I20260927 15:05:55.143149 1054 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 15:05:55.148584 804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
/tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.201.2:0
--local_ip_for_outbound_sockets=127.0.201.2
--webserver_interface=127.0.201.2
--webserver_port=0
--tserver_master_addrs=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--builtin_ntp_servers=127.0.201.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260927 15:05:55.152632 1048 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: acquiring CA information for follower catalog manager: success
I20260927 15:05:55.162585 1048 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260927 15:05:55.176151 1211 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:05:55.176433 1211 heartbeater.cc:464] Registering TS with master...
I20260927 15:05:55.176568 1222 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b6a41e027f0448cafe3365f23103f92)
I20260927 15:05:55.176816 1222 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:55.176990 1213 heartbeater.cc:347] Connected to a master server at 127.0.201.61:43763
I20260927 15:05:55.177177 1213 heartbeater.cc:464] Registering TS with master...
I20260927 15:05:55.177435 1211 heartbeater.cc:511] Master 127.0.201.60:46799 requested a full tablet report, sending...
I20260927 15:05:55.177722 1213 heartbeater.cc:511] Master 127.0.201.61:43763 requested a full tablet report, sending...
I20260927 15:05:55.178494 1222 leader_election.cc:288] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b6a41e027f0448cafe3365f23103f92 (127.0.201.61:43763), 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799)
I20260927 15:05:55.179064 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dbf522d70373412b87815d33c0f1f745" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a122de3662f485f8f44b0a5e4b29862" is_pre_election: true
I20260927 15:05:55.179323 924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dbf522d70373412b87815d33c0f1f745" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b6a41e027f0448cafe3365f23103f92" is_pre_election: true
I20260927 15:05:55.180224 985 ts_manager.cc:194] Registered new tserver with Master: c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:05:55.180661 914 ts_manager.cc:194] Registered new tserver with Master: c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:05:55.180809 1212 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:05:55.180922 1212 heartbeater.cc:464] Registering TS with master...
I20260927 15:05:55.181351 1212 heartbeater.cc:511] Master 127.0.201.62:41167 requested a full tablet report, sending...
I20260927 15:05:55.182518 914 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.201.1:54519
I20260927 15:05:55.182610 843 ts_manager.cc:194] Registered new tserver with Master: c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:05:55.183284 830 leader_election.cc:302] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbf522d70373412b87815d33c0f1f745; no voters: 2a122de3662f485f8f44b0a5e4b29862, 6b6a41e027f0448cafe3365f23103f92
I20260927 15:05:55.183647 1222 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260927 15:05:55.512349 1221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:05:55.512732 1221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:05:55.512903 1221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:05:55.520771 1221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:05:55.521023 1221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.201.2
I20260927 15:05:55.530758 1221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.201.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.201.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.201.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.201.2
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 27 Sep 2026 13:46:26 UTC on ccycloud.quasar-xkqhuq.root.comops.site
build id 4676080
ASAN enabled
I20260927 15:05:55.532160 1221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:05:55.533980 1221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:05:55.547587 1228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:55.548187 1230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:05:55.548899 1221 server_base.cc:1034] running on GCE node
W20260927 15:05:55.549145 1227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:05:55.549940 1221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:05:55.551040 1221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:05:55.552263 1221 hybrid_clock.cc:648] HybridClock initialized: now 1790521555552174 us; error 65 us; skew 500 ppm
I20260927 15:05:55.552585 1221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 15:05:55.555189 1221 webserver.cc:460] Webserver started at http://127.0.201.2:33895/ using document root <none> and password file <none>
I20260927 15:05:55.555928 1221 fs_manager.cc:359] Metadata directory not provided
I20260927 15:05:55.556057 1221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:05:55.556396 1221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:05:55.559166 1221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/data/instance:
uuid: "4769a710b72a4b49b816725a5921e86e"
format_stamp: "Formatted at 2026-09-27 15:05:55 on dist-test-slave-65dj"
I20260927 15:05:55.559950 1221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/instance:
uuid: "4769a710b72a4b49b816725a5921e86e"
format_stamp: "Formatted at 2026-09-27 15:05:55 on dist-test-slave-65dj"
I20260927 15:05:55.565359 1221 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260927 15:05:55.568975 1236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:55.570448 1221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260927 15:05:55.570591 1221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/data,/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal
uuid: "4769a710b72a4b49b816725a5921e86e"
format_stamp: "Formatted at 2026-09-27 15:05:55 on dist-test-slave-65dj"
I20260927 15:05:55.570770 1221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:05:55.574110 1237 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b6a41e027f0448cafe3365f23103f92)
I20260927 15:05:55.574314 1237 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:55.575639 1237 leader_election.cc:288] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbf522d70373412b87815d33c0f1f745 (127.0.201.62:41167), 6b6a41e027f0448cafe3365f23103f92 (127.0.201.61:43763)
I20260927 15:05:55.576206 924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a122de3662f485f8f44b0a5e4b29862" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b6a41e027f0448cafe3365f23103f92" is_pre_election: true
I20260927 15:05:55.576243 853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a122de3662f485f8f44b0a5e4b29862" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbf522d70373412b87815d33c0f1f745" is_pre_election: true
I20260927 15:05:55.576953 969 leader_election.cc:302] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a122de3662f485f8f44b0a5e4b29862; no voters: 6b6a41e027f0448cafe3365f23103f92, dbf522d70373412b87815d33c0f1f745
I20260927 15:05:55.577332 1237 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:05:55.587728 1221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:05:55.588600 1221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:05:55.588908 1221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:05:55.589867 1221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:05:55.591403 1221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:05:55.591477 1221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:55.591650 1221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:05:55.591701 1221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:55.636166 1221 rpc_server.cc:307] RPC server started. Bound to: 127.0.201.2:39515
I20260927 15:05:55.636199 1349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.201.2:39515 every 8 connection(s)
I20260927 15:05:55.637467 1221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/data/info.pb
I20260927 15:05:55.645295 804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu as pid 1221
I20260927 15:05:55.645500 804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/instance
I20260927 15:05:55.650635 804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
/tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.201.3:0
--local_ip_for_outbound_sockets=127.0.201.3
--webserver_interface=127.0.201.3
--webserver_port=0
--tserver_master_addrs=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--builtin_ntp_servers=127.0.201.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260927 15:05:55.656994 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:05:55.657529 1351 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:05:55.657526 1350 heartbeater.cc:464] Registering TS with master...
I20260927 15:05:55.657610 1352 heartbeater.cc:347] Connected to a master server at 127.0.201.61:43763
I20260927 15:05:55.657725 1351 heartbeater.cc:464] Registering TS with master...
I20260927 15:05:55.657749 1352 heartbeater.cc:464] Registering TS with master...
I20260927 15:05:55.658536 1352 heartbeater.cc:511] Master 127.0.201.61:43763 requested a full tablet report, sending...
I20260927 15:05:55.659710 1350 heartbeater.cc:511] Master 127.0.201.60:46799 requested a full tablet report, sending...
I20260927 15:05:55.659731 1351 heartbeater.cc:511] Master 127.0.201.62:41167 requested a full tablet report, sending...
I20260927 15:05:55.660195 914 ts_manager.cc:194] Registered new tserver with Master: 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:55.660753 985 ts_manager.cc:194] Registered new tserver with Master: 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:55.660961 843 ts_manager.cc:194] Registered new tserver with Master: 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:55.661320 914 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.201.2:45511
I20260927 15:05:55.686375 1213 heartbeater.cc:503] Master 127.0.201.61:43763 was elected leader, sending a full tablet report...
I20260927 15:05:55.741722 1358 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b6a41e027f0448cafe3365f23103f92)
I20260927 15:05:55.741902 1358 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:55.742659 1358 leader_election.cc:288] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b6a41e027f0448cafe3365f23103f92 (127.0.201.61:43763), 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799)
I20260927 15:05:55.743243 924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dbf522d70373412b87815d33c0f1f745" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b6a41e027f0448cafe3365f23103f92" is_pre_election: true
I20260927 15:05:55.743348 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dbf522d70373412b87815d33c0f1f745" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a122de3662f485f8f44b0a5e4b29862" is_pre_election: true
I20260927 15:05:55.743997 827 leader_election.cc:302] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbf522d70373412b87815d33c0f1f745; no voters: 2a122de3662f485f8f44b0a5e4b29862, 6b6a41e027f0448cafe3365f23103f92
I20260927 15:05:55.744284 1358 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260927 15:05:56.004842 1357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:05:56.005167 1357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:05:56.005324 1357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260927 15:05:56.013033 1357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:05:56.013257 1357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.201.3
I20260927 15:05:56.022603 1357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.201.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.201.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.201.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.201.3
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 27 Sep 2026 13:46:26 UTC on ccycloud.quasar-xkqhuq.root.comops.site
build id 4676080
ASAN enabled
I20260927 15:05:56.024015 1357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:05:56.025779 1357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260927 15:05:56.039405 1364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:56.039441 1366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:05:56.039481 1363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:05:56.040820 1357 server_base.cc:1034] running on GCE node
I20260927 15:05:56.041440 1357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:05:56.042349 1357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:05:56.043610 1357 hybrid_clock.cc:648] HybridClock initialized: now 1790521556043515 us; error 57 us; skew 500 ppm
I20260927 15:05:56.043884 1357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 15:05:56.046350 1357 webserver.cc:460] Webserver started at http://127.0.201.3:43503/ using document root <none> and password file <none>
I20260927 15:05:56.047149 1357 fs_manager.cc:359] Metadata directory not provided
I20260927 15:05:56.047278 1357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:05:56.047586 1357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260927 15:05:56.050233 1357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/data/instance:
uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
format_stamp: "Formatted at 2026-09-27 15:05:56 on dist-test-slave-65dj"
I20260927 15:05:56.051059 1357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/instance:
uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
format_stamp: "Formatted at 2026-09-27 15:05:56 on dist-test-slave-65dj"
I20260927 15:05:56.056171 1357 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260927 15:05:56.060077 1372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:56.061465 1357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260927 15:05:56.061640 1357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/data,/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal
uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
format_stamp: "Formatted at 2026-09-27 15:05:56 on dist-test-slave-65dj"
I20260927 15:05:56.061820 1357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:05:56.078217 1357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:05:56.079147 1357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:05:56.079417 1357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:05:56.080395 1357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260927 15:05:56.081766 1357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260927 15:05:56.081840 1357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:56.082005 1357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260927 15:05:56.082072 1357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260927 15:05:56.117620 1357 rpc_server.cc:307] RPC server started. Bound to: 127.0.201.3:41269
I20260927 15:05:56.117637 1484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.201.3:41269 every 8 connection(s)
I20260927 15:05:56.119043 1357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/data/info.pb
I20260927 15:05:56.123049 804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu as pid 1357
I20260927 15:05:56.123222 804 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/instance
I20260927 15:05:56.137566 1486 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:05:56.137864 1485 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:05:56.137895 1486 heartbeater.cc:464] Registering TS with master...
I20260927 15:05:56.138090 1487 heartbeater.cc:347] Connected to a master server at 127.0.201.61:43763
I20260927 15:05:56.138132 1485 heartbeater.cc:464] Registering TS with master...
I20260927 15:05:56.138221 1487 heartbeater.cc:464] Registering TS with master...
I20260927 15:05:56.139269 1487 heartbeater.cc:511] Master 127.0.201.61:43763 requested a full tablet report, sending...
I20260927 15:05:56.139281 1485 heartbeater.cc:511] Master 127.0.201.60:46799 requested a full tablet report, sending...
I20260927 15:05:56.139305 1486 heartbeater.cc:511] Master 127.0.201.62:41167 requested a full tablet report, sending...
I20260927 15:05:56.140841 914 ts_manager.cc:194] Registered new tserver with Master: fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:56.141328 985 ts_manager.cc:194] Registered new tserver with Master: fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:56.141359 843 ts_manager.cc:194] Registered new tserver with Master: fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:56.141872 914 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.201.3:60991
I20260927 15:05:56.153966 804 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260927 15:05:56.163516 1352 heartbeater.cc:503] Master 127.0.201.61:43763 was elected leader, sending a full tablet report...
I20260927 15:05:56.183748 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_939ad26c69cc4727b52d83c7b7479d2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:56.184690 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_66add63502b542c7baa701e7d05b42c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:56.185288 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_94bb3e1390774954825b47cc5a9740d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.199349 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94bb3e1390774954825b47cc5a9740d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:56.199440 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_939ad26c69cc4727b52d83c7b7479d2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.185402 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a34345df72de415fba382f89d0aa545a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.202021 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a34345df72de415fba382f89d0aa545a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.189109 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2bc96116116e475ebe286f7db807893b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.203985 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bc96116116e475ebe286f7db807893b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.204486 1510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b6a41e027f0448cafe3365f23103f92)
I20260927 15:05:56.204923 1510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:05:56.189124 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2695e0bca9004712b31060e95d250e05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.205924 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2695e0bca9004712b31060e95d250e05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.206415 853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a122de3662f485f8f44b0a5e4b29862" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbf522d70373412b87815d33c0f1f745" is_pre_election: true
I20260927 15:05:56.192736 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8c056841172e40af81848120dbc7e490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.207854 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c056841172e40af81848120dbc7e490 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.207947 924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2a122de3662f485f8f44b0a5e4b29862" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b6a41e027f0448cafe3365f23103f92" is_pre_election: true
I20260927 15:05:56.208717 972 leader_election.cc:302] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a122de3662f485f8f44b0a5e4b29862; no voters: 6b6a41e027f0448cafe3365f23103f92, dbf522d70373412b87815d33c0f1f745
I20260927 15:05:56.209476 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_694d24f3396a46e0a983f0957f4e75d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.210412 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_694d24f3396a46e0a983f0957f4e75d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.184298 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_582d4ae5514e46df9bc56c0e03cd4c9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.213238 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66add63502b542c7baa701e7d05b42c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:56.213387 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_582d4ae5514e46df9bc56c0e03cd4c9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.183506 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fab82d25cc724ebd87e105dfef1b53f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:56.216296 1510 leader_election.cc:288] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbf522d70373412b87815d33c0f1f745 (127.0.201.62:41167), 6b6a41e027f0448cafe3365f23103f92 (127.0.201.61:43763)
W20260927 15:05:56.216722 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fab82d25cc724ebd87e105dfef1b53f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.216502 1510 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:05:56.250506 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_939ad26c69cc4727b52d83c7b7479d2c" } new_table_name: "default.Table_3baf2db8f6c44ebfb15cf4f39f4c05d6" modify_external_catalogs: true
I20260927 15:05:56.334944 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8c056841172e40af81848120dbc7e490" } new_table_name: "default.Table_804c4b270985427cb69cc7381cc86cb5" modify_external_catalogs: true
W20260927 15:05:56.334944 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 307b02ef8c224999b4b8865022b7f368 consensus state has no leader
I20260927 15:05:56.335322 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2bc96116116e475ebe286f7db807893b" } new_table_name: "default.Table_b55776c4bcb047ddb6c6d03b3b5aa66f" modify_external_catalogs: true
I20260927 15:05:56.342120 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a34345df72de415fba382f89d0aa545a" } new_table_name: "default.Table_ad16dccb70e84472ad8f18eb900fe3e6" modify_external_catalogs: true
I20260927 15:05:56.342476 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fab82d25cc724ebd87e105dfef1b53f4" } modify_external_catalogs: true
I20260927 15:05:56.344658 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fab82d25cc724ebd87e105dfef1b53f4" } modify_external_catalogs: true
I20260927 15:05:56.342722 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_582d4ae5514e46df9bc56c0e03cd4c9e" } modify_external_catalogs: true
I20260927 15:05:56.344928 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_582d4ae5514e46df9bc56c0e03cd4c9e" } modify_external_catalogs: true
I20260927 15:05:56.344587 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_694d24f3396a46e0a983f0957f4e75d7" } modify_external_catalogs: true
I20260927 15:05:56.343248 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_66add63502b542c7baa701e7d05b42c4" } modify_external_catalogs: true
I20260927 15:05:56.344612 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_94bb3e1390774954825b47cc5a9740d0" } modify_external_catalogs: true
I20260927 15:05:56.346668 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_94bb3e1390774954825b47cc5a9740d0" } modify_external_catalogs: true
I20260927 15:05:56.347136 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_66add63502b542c7baa701e7d05b42c4" } modify_external_catalogs: true
I20260927 15:05:56.347745 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_694d24f3396a46e0a983f0957f4e75d7" } modify_external_catalogs: true
I20260927 15:05:56.355214 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2695e0bca9004712b31060e95d250e05" } new_table_name: "default.Table_78e91d79695d4e34b7860aa90b95b932" modify_external_catalogs: true
W20260927 15:05:56.360397 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 668320fafe5145e7ac72d15959c608af has no consensus state
I20260927 15:05:56.369129 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 307b02ef8c224999b4b8865022b7f368 (DEFAULT_TABLE table=default.Table_3baf2db8f6c44ebfb15cf4f39f4c05d6 [id=ba1ee00f53164d94be57db428fb14125]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:05:56.372314 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82f6cfd9f4c0424d86df223b0eaab4f7 has no consensus state
I20260927 15:05:56.374117 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 307b02ef8c224999b4b8865022b7f368. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:56.379489 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5e7a34dce584f2fa7732ee9fc402740 has no consensus state
I20260927 15:05:56.379842 909 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet ef92530dbbc1411abfb1d44bf7e69064
I20260927 15:05:56.380101 912 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 8cbd5febd5724a7891f44d5e47be0580
I20260927 15:05:56.379513 913 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f06f23ab3c1d473a9f66ef068ed8e297
I20260927 15:05:56.365160 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 307b02ef8c224999b4b8865022b7f368 (DEFAULT_TABLE table=default.Table_3baf2db8f6c44ebfb15cf4f39f4c05d6 [id=ba1ee00f53164d94be57db428fb14125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.388355 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 307b02ef8c224999b4b8865022b7f368. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:56.389257 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 668320fafe5145e7ac72d15959c608af (table default.Table_804c4b270985427cb69cc7381cc86cb5 [id=0b5fd26bed7748fe941da0a7d1fa1dec], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 668320fafe5145e7ac72d15959c608af has no consensus state
I20260927 15:05:56.396787 905 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet cae98c8373e6412eadeaafc1d6a60c10
W20260927 15:05:56.397383 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet baafd4f49c7543018f87f5ad81d43a6c has no consensus state
I20260927 15:05:56.399729 911 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 848e653c290f45888e5426513df19196
I20260927 15:05:56.404222 1552 tablet_bootstrap.cc:492] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:56.408890 1284 tablet_service.cc:1467] Processing CreateTablet for tablet baafd4f49c7543018f87f5ad81d43a6c (DEFAULT_TABLE table=default.Table_78e91d79695d4e34b7860aa90b95b932 [id=f06d678811dc49d58d59f1b34e9c7346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.409049 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (DEFAULT_TABLE table=default.Table_b55776c4bcb047ddb6c6d03b3b5aa66f [id=861d1dea54204625a6d1ad99fb8f6873]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.409356 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baafd4f49c7543018f87f5ad81d43a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.409657 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82f6cfd9f4c0424d86df223b0eaab4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.414754 1418 tablet_service.cc:1467] Processing CreateTablet for tablet baafd4f49c7543018f87f5ad81d43a6c (DEFAULT_TABLE table=default.Table_78e91d79695d4e34b7860aa90b95b932 [id=f06d678811dc49d58d59f1b34e9c7346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.415301 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baafd4f49c7543018f87f5ad81d43a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.416024 1282 tablet_service.cc:1467] Processing CreateTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 (DEFAULT_TABLE table=default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.416414 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e7a34dce584f2fa7732ee9fc402740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.419243 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 668320fafe5145e7ac72d15959c608af (DEFAULT_TABLE table=default.Table_804c4b270985427cb69cc7381cc86cb5 [id=0b5fd26bed7748fe941da0a7d1fa1dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.419870 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 668320fafe5145e7ac72d15959c608af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.423380 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 668320fafe5145e7ac72d15959c608af (DEFAULT_TABLE table=default.Table_804c4b270985427cb69cc7381cc86cb5 [id=0b5fd26bed7748fe941da0a7d1fa1dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.423933 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 668320fafe5145e7ac72d15959c608af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.424646 1416 tablet_service.cc:1467] Processing CreateTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 (DEFAULT_TABLE table=default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.425124 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e7a34dce584f2fa7732ee9fc402740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.437470 1144 tablet_service.cc:1467] Processing CreateTablet for tablet baafd4f49c7543018f87f5ad81d43a6c (DEFAULT_TABLE table=default.Table_78e91d79695d4e34b7860aa90b95b932 [id=f06d678811dc49d58d59f1b34e9c7346]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.439131 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 307b02ef8c224999b4b8865022b7f368 (DEFAULT_TABLE table=default.Table_3baf2db8f6c44ebfb15cf4f39f4c05d6 [id=ba1ee00f53164d94be57db428fb14125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.440856 1556 tablet_bootstrap.cc:492] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:56.441574 1142 tablet_service.cc:1467] Processing CreateTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 (DEFAULT_TABLE table=default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.443005 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 668320fafe5145e7ac72d15959c608af (DEFAULT_TABLE table=default.Table_804c4b270985427cb69cc7381cc86cb5 [id=0b5fd26bed7748fe941da0a7d1fa1dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.443493 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 307b02ef8c224999b4b8865022b7f368 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.444432 804 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu pid 812
I20260927 15:05:56.445254 1556 tablet_bootstrap.cc:654] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.445420 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (DEFAULT_TABLE table=default.Table_b55776c4bcb047ddb6c6d03b3b5aa66f [id=861d1dea54204625a6d1ad99fb8f6873]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.445830 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82f6cfd9f4c0424d86df223b0eaab4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.446592 1556 log.cc:824] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: Log is configured to *not* fsync() on all Append() calls
I20260927 15:05:56.449386 873 generic_service.cc:196] Checking for leaks (request via RPC)
I20260927 15:05:56.450881 908 master_service.cc:946] ReplaceTablet: received request to replace tablet b5e7a34dce584f2fa7732ee9fc402740 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.451701 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baafd4f49c7543018f87f5ad81d43a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.452438 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e7a34dce584f2fa7732ee9fc402740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.450902 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fe0efb011aa24f7f9d3c4e947a8fadc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.453500 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe0efb011aa24f7f9d3c4e947a8fadc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.453583 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 307b02ef8c224999b4b8865022b7f368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.437374 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (DEFAULT_TABLE table=default.Table_b55776c4bcb047ddb6c6d03b3b5aa66f [id=861d1dea54204625a6d1ad99fb8f6873]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.454900 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82f6cfd9f4c0424d86df223b0eaab4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.455688 913 master_service.cc:946] ReplaceTablet: received request to replace tablet b5e7a34dce584f2fa7732ee9fc402740 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.456290 912 master_service.cc:946] ReplaceTablet: received request to replace tablet b5e7a34dce584f2fa7732ee9fc402740 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.456717 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 307b02ef8c224999b4b8865022b7f368 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.457976 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 307b02ef8c224999b4b8865022b7f368
I20260927 15:05:56.458731 911 catalog_manager.cc:6565] ReplaceTablet: tablet 307b02ef8c224999b4b8865022b7f368 deleted and replaced by tablet 1ada5178a90b497aa086286bd1d15601
I20260927 15:05:56.463370 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 307b02ef8c224999b4b8865022b7f368 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ada5178a90b497aa086286bd1d15601) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.466012 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 668320fafe5145e7ac72d15959c608af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.469770 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b5e7a34dce584f2fa7732ee9fc402740
I20260927 15:05:56.470310 908 catalog_manager.cc:6565] ReplaceTablet: tablet b5e7a34dce584f2fa7732ee9fc402740 deleted and replaced by tablet 3663d8a6672c4a9ca5c05a48700c6128
I20260927 15:05:56.471120 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 with delete_type TABLET_DATA_DELETED (replaced by tablet 3663d8a6672c4a9ca5c05a48700c6128) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:56.474783 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 with delete_type TABLET_DATA_DELETED (replaced by tablet 3663d8a6672c4a9ca5c05a48700c6128) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.482987 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 1ada5178a90b497aa086286bd1d15601 (DEFAULT_TABLE table=default.Table_3baf2db8f6c44ebfb15cf4f39f4c05d6 [id=ba1ee00f53164d94be57db428fb14125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.483821 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ada5178a90b497aa086286bd1d15601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.486034 1556 tablet_bootstrap.cc:492] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:56.486351 1556 ts_tablet_manager.cc:1397] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.000s
I20260927 15:05:56.419220 1552 tablet_bootstrap.cc:654] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.487077 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 307b02ef8c224999b4b8865022b7f368 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ada5178a90b497aa086286bd1d15601) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.487730 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 with delete_type TABLET_DATA_DELETED (replaced by tablet 3663d8a6672c4a9ca5c05a48700c6128) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.488323 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 1ada5178a90b497aa086286bd1d15601 (DEFAULT_TABLE table=default.Table_3baf2db8f6c44ebfb15cf4f39f4c05d6 [id=ba1ee00f53164d94be57db428fb14125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.488626 1552 log.cc:824] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: Log is configured to *not* fsync() on all Append() calls
I20260927 15:05:56.488788 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ada5178a90b497aa086286bd1d15601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.494612 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 1ada5178a90b497aa086286bd1d15601 (DEFAULT_TABLE table=default.Table_3baf2db8f6c44ebfb15cf4f39f4c05d6 [id=ba1ee00f53164d94be57db428fb14125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.495102 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ada5178a90b497aa086286bd1d15601. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:56.495215 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b5e7a34dce584f2fa7732ee9fc402740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e7a34dce584f2fa7732ee9fc402740 already in progress: creating tablet
I20260927 15:05:56.497123 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 (DEFAULT_TABLE table=default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.497560 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3663d8a6672c4a9ca5c05a48700c6128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.497408 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2cd46c4b4f5e423395c63968fd316229"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.497961 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cd46c4b4f5e423395c63968fd316229 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:56.498509 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 307b02ef8c224999b4b8865022b7f368 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 307b02ef8c224999b4b8865022b7f368 already in progress: creating tablet
I20260927 15:05:56.499881 1556 raft_consensus.cc:348] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.500312 1556 raft_consensus.cc:374] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.500402 1556 raft_consensus.cc:729] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.500543 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_817637f69c9a40eda1a54ec015d7cb32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.501006 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_817637f69c9a40eda1a54ec015d7cb32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:56.502452 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b5e7a34dce584f2fa7732ee9fc402740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e7a34dce584f2fa7732ee9fc402740 already in progress: creating tablet
I20260927 15:05:56.503216 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 (DEFAULT_TABLE table=default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.503693 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3663d8a6672c4a9ca5c05a48700c6128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.506008 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 570a0ee2154d4aca9dbaa2f5057def9d (DEFAULT_TABLE table=default.Table_fe0efb011aa24f7f9d3c4e947a8fadc8 [id=f301a482365b4cf2b752fccd860a8d2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.506507 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 570a0ee2154d4aca9dbaa2f5057def9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.512048 1556 consensus_queue.cc:260] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.512449 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d79fcaff2293478dbb022ec032b91f44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:56.512785 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 570a0ee2154d4aca9dbaa2f5057def9d (DEFAULT_TABLE table=default.Table_fe0efb011aa24f7f9d3c4e947a8fadc8 [id=f301a482365b4cf2b752fccd860a8d2d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:05:56.513072 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d79fcaff2293478dbb022ec032b91f44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.513175 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 570a0ee2154d4aca9dbaa2f5057def9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.513408 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7df3939469d744798289afe55352f822"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.514009 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7df3939469d744798289afe55352f822 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.512800 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cf28f9953e0a4b19aca1608003f96d39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.515797 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf28f9953e0a4b19aca1608003f96d39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.517676 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 570a0ee2154d4aca9dbaa2f5057def9d (DEFAULT_TABLE table=default.Table_fe0efb011aa24f7f9d3c4e947a8fadc8 [id=f301a482365b4cf2b752fccd860a8d2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.518146 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 570a0ee2154d4aca9dbaa2f5057def9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.527276 1561 tablet_bootstrap.cc:492] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:56.530645 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 (DEFAULT_TABLE table=default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.531966 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3663d8a6672c4a9ca5c05a48700c6128. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.533118 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b321105bbaa54a76a1aaa286b0cecb00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.533880 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b321105bbaa54a76a1aaa286b0cecb00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.535168 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e18ae6da23bf41dba8730661160b1008"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.535764 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e18ae6da23bf41dba8730661160b1008 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.533244 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c2fe882538414522a90058bd9d307bed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.537655 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2fe882538414522a90058bd9d307bed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.537916 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 307b02ef8c224999b4b8865022b7f368 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ada5178a90b497aa086286bd1d15601) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:56.539898 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 307b02ef8c224999b4b8865022b7f368 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 307b02ef8c224999b4b8865022b7f368 already in progress: creating tablet
I20260927 15:05:56.542747 1552 tablet_bootstrap.cc:492] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:56.547195 1561 tablet_bootstrap.cc:654] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.549052 1561 log.cc:824] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: Log is configured to *not* fsync() on all Append() calls
W20260927 15:05:56.549124 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 307b02ef8c224999b4b8865022b7f368 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 307b02ef8c224999b4b8865022b7f368 already in progress: creating tablet
W20260927 15:05:56.549464 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b5e7a34dce584f2fa7732ee9fc402740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e7a34dce584f2fa7732ee9fc402740 already in progress: creating tablet
I20260927 15:05:56.550326 1552 ts_tablet_manager.cc:1397] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.146s user 0.005s sys 0.005s
I20260927 15:05:56.550635 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_73dd6ebc6fb44e5f89698a56ff8bd376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.551757 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73dd6ebc6fb44e5f89698a56ff8bd376 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.551187 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3baf2db8f6c44ebfb15cf4f39f4c05d6" } new_table_name: "default.Table_fc5fdb39096646f1b45f6bbfa57a8133" modify_external_catalogs: true
I20260927 15:05:56.560743 1487 heartbeater.cc:503] Master 127.0.201.61:43763 was elected leader, sending a full tablet report...
I20260927 15:05:56.560720 1556 ts_tablet_manager.cc:1428] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.074s user 0.017s sys 0.020s
I20260927 15:05:56.564785 1556 tablet_bootstrap.cc:492] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:56.566880 1552 raft_consensus.cc:348] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.567495 1552 raft_consensus.cc:374] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.567664 1552 raft_consensus.cc:729] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.568346 1552 consensus_queue.cc:260] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.569059 1556 tablet_bootstrap.cc:654] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.572695 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_b55776c4bcb047ddb6c6d03b3b5aa66f [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 1 got 0
I20260927 15:05:56.572978 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 1ada5178a90b497aa086286bd1d15601 (table default.Table_3baf2db8f6c44ebfb15cf4f39f4c05d6 [id=ba1ee00f53164d94be57db428fb14125]). Expected version 1 got 0
I20260927 15:05:56.573239 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 3663d8a6672c4a9ca5c05a48700c6128 (table default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]). Expected version 1 got 0
I20260927 15:05:56.573413 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 668320fafe5145e7ac72d15959c608af (table default.Table_804c4b270985427cb69cc7381cc86cb5 [id=0b5fd26bed7748fe941da0a7d1fa1dec]). Expected version 1 got 0
I20260927 15:05:56.573724 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet baafd4f49c7543018f87f5ad81d43a6c (table default.Table_78e91d79695d4e34b7860aa90b95b932 [id=f06d678811dc49d58d59f1b34e9c7346]). Expected version 1 got 0
I20260927 15:05:56.575793 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 3a30cef3b4c2436c8c222f35b244fd06 (DEFAULT_TABLE table=default.Table_817637f69c9a40eda1a54ec015d7cb32 [id=7f0fdeabadf2411196e949e581b7337c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.575815 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 3a30cef3b4c2436c8c222f35b244fd06 (DEFAULT_TABLE table=default.Table_817637f69c9a40eda1a54ec015d7cb32 [id=7f0fdeabadf2411196e949e581b7337c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.576335 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a30cef3b4c2436c8c222f35b244fd06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.576390 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a30cef3b4c2436c8c222f35b244fd06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.594036 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 3a30cef3b4c2436c8c222f35b244fd06 (DEFAULT_TABLE table=default.Table_817637f69c9a40eda1a54ec015d7cb32 [id=7f0fdeabadf2411196e949e581b7337c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.594473 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a30cef3b4c2436c8c222f35b244fd06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.594518 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 9a7989e2b91044dab1d3e327958a051a (DEFAULT_TABLE table=default.Table_d79fcaff2293478dbb022ec032b91f44 [id=b1106aee6c804da4a603364cee1c1116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.595068 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a7989e2b91044dab1d3e327958a051a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.595607 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 538516912cf14ebfb0bfb31f706b66fc (DEFAULT_TABLE table=default.Table_2cd46c4b4f5e423395c63968fd316229 [id=ea5cc262555840bbb18aba64e7cce780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.596429 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538516912cf14ebfb0bfb31f706b66fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.600091 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 9a7989e2b91044dab1d3e327958a051a (DEFAULT_TABLE table=default.Table_d79fcaff2293478dbb022ec032b91f44 [id=b1106aee6c804da4a603364cee1c1116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.600296 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 538516912cf14ebfb0bfb31f706b66fc (DEFAULT_TABLE table=default.Table_2cd46c4b4f5e423395c63968fd316229 [id=ea5cc262555840bbb18aba64e7cce780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.600474 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a7989e2b91044dab1d3e327958a051a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:56.600538 912 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 1ada5178a90b497aa086286bd1d15601 (table default.Table_fc5fdb39096646f1b45f6bbfa57a8133 [id=ba1ee00f53164d94be57db428fb14125], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 1ada5178a90b497aa086286bd1d15601 consensus state has no leader
I20260927 15:05:56.600651 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538516912cf14ebfb0bfb31f706b66fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:56.600761 912 catalog_manager.cc:5687] Failed to send AlterTable RPC for tablet 3663d8a6672c4a9ca5c05a48700c6128 (table default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3663d8a6672c4a9ca5c05a48700c6128 consensus state has no leader
I20260927 15:05:56.603160 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 538516912cf14ebfb0bfb31f706b66fc (DEFAULT_TABLE table=default.Table_2cd46c4b4f5e423395c63968fd316229 [id=ea5cc262555840bbb18aba64e7cce780]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.603500 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538516912cf14ebfb0bfb31f706b66fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.603732 913 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet baafd4f49c7543018f87f5ad81d43a6c (table default.Table_78e91d79695d4e34b7860aa90b95b932 [id=f06d678811dc49d58d59f1b34e9c7346]). Expected version 1 got 0
I20260927 15:05:56.604349 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2cd46c4b4f5e423395c63968fd316229" } new_table_name: "default.Table_92c6318423b147e6984c2c78960a5476" modify_external_catalogs: true
I20260927 15:05:56.606132 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d79fcaff2293478dbb022ec032b91f44" } new_table_name: "default.Table_a9e848bee97745b5921d0e7a68683430" modify_external_catalogs: true
I20260927 15:05:56.607303 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cf28f9953e0a4b19aca1608003f96d39" } modify_external_catalogs: true
I20260927 15:05:56.607406 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 with delete_type TABLET_DATA_DELETED (replaced by tablet 3663d8a6672c4a9ca5c05a48700c6128) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.607530 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cf28f9953e0a4b19aca1608003f96d39" } modify_external_catalogs: true
I20260927 15:05:56.608613 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_804c4b270985427cb69cc7381cc86cb5" } modify_external_catalogs: true
I20260927 15:05:56.608803 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_804c4b270985427cb69cc7381cc86cb5" } modify_external_catalogs: true
I20260927 15:05:56.609345 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b55776c4bcb047ddb6c6d03b3b5aa66f" } new_table_name: "default.Table_a1ab17cc48c44273aca48706dde174c9" modify_external_catalogs: true
I20260927 15:05:56.610009 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e18ae6da23bf41dba8730661160b1008" } modify_external_catalogs: true
I20260927 15:05:56.610185 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e18ae6da23bf41dba8730661160b1008" } modify_external_catalogs: true
I20260927 15:05:56.611168 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_817637f69c9a40eda1a54ec015d7cb32" } modify_external_catalogs: true
I20260927 15:05:56.611320 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_817637f69c9a40eda1a54ec015d7cb32" } modify_external_catalogs: true
I20260927 15:05:56.612524 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b321105bbaa54a76a1aaa286b0cecb00" } new_table_name: "default.Table_e0637f13993b42ccb6ccf6fd2ac388f3" modify_external_catalogs: true
W20260927 15:05:56.614168 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b5e7a34dce584f2fa7732ee9fc402740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e7a34dce584f2fa7732ee9fc402740 already in progress: creating tablet
W20260927 15:05:56.614771 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ada5178a90b497aa086286bd1d15601 consensus state has no leader
I20260927 15:05:56.615383 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c2fe882538414522a90058bd9d307bed" } modify_external_catalogs: true
I20260927 15:05:56.615672 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c2fe882538414522a90058bd9d307bed" } modify_external_catalogs: true
I20260927 15:05:56.615715 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 9a7989e2b91044dab1d3e327958a051a (DEFAULT_TABLE table=default.Table_d79fcaff2293478dbb022ec032b91f44 [id=b1106aee6c804da4a603364cee1c1116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.616379 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a7989e2b91044dab1d3e327958a051a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.617439 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 307b02ef8c224999b4b8865022b7f368 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ada5178a90b497aa086286bd1d15601) from {username='slave'} at 127.0.0.1:49234
W20260927 15:05:56.618088 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 307b02ef8c224999b4b8865022b7f368 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 307b02ef8c224999b4b8865022b7f368 already in progress: creating tablet
I20260927 15:05:56.621963 1556 tablet_bootstrap.cc:492] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:56.624854 1556 ts_tablet_manager.cc:1397] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.060s user 0.010s sys 0.006s
W20260927 15:05:56.625819 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 538516912cf14ebfb0bfb31f706b66fc consensus state has no leader
I20260927 15:05:56.626024 1556 raft_consensus.cc:348] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.626245 1556 raft_consensus.cc:374] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.626336 1556 raft_consensus.cc:729] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
W20260927 15:05:56.623142 1488 tablet.cc:2369] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:05:56.626691 1556 consensus_queue.cc:260] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.627189 1556 ts_tablet_manager.cc:1428] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:05:56.627501 1556 tablet_bootstrap.cc:492] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:56.629074 1556 tablet_bootstrap.cc:654] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.632601 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 with delete_type TABLET_DATA_DELETED (replaced by tablet 3663d8a6672c4a9ca5c05a48700c6128) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.632856 1559 tablet_replica.cc:330] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:56.633309 1559 raft_consensus.cc:2229] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:56.633809 1559 raft_consensus.cc:2258] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:05:56.635219 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a7989e2b91044dab1d3e327958a051a consensus state has no leader
I20260927 15:05:56.635569 1559 ts_tablet_manager.cc:1905] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:56.636806 911 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet eb8ea6d3941c4ee196add5e694495a43
I20260927 15:05:56.639076 1561 tablet_bootstrap.cc:492] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:56.639362 1561 ts_tablet_manager.cc:1397] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.113s user 0.018s sys 0.016s
I20260927 15:05:56.649537 1559 ts_tablet_manager.cc:1918] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:56.649662 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 668320fafe5145e7ac72d15959c608af
I20260927 15:05:56.650632 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 668320fafe5145e7ac72d15959c608af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.651182 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 668320fafe5145e7ac72d15959c608af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:05:56.651829 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 668320fafe5145e7ac72d15959c608af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 668320fafe5145e7ac72d15959c608af already in progress: creating tablet
I20260927 15:05:56.652143 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 668320fafe5145e7ac72d15959c608af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:56.652774 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 668320fafe5145e7ac72d15959c608af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 668320fafe5145e7ac72d15959c608af already in progress: creating tablet
I20260927 15:05:56.656447 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3a30cef3b4c2436c8c222f35b244fd06
W20260927 15:05:56.656702 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82f6cfd9f4c0424d86df223b0eaab4f7 consensus state has no leader
W20260927 15:05:56.657177 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3e4e18e695f54d85b25958330717c713 has no consensus state
I20260927 15:05:56.657214 1559 log.cc:1196] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/b5e7a34dce584f2fa7732ee9fc402740
I20260927 15:05:56.657763 1559 ts_tablet_manager.cc:1939] T b5e7a34dce584f2fa7732ee9fc402740 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:56.657799 906 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 2695838a17ca4d7e8039ce94b9449caf
I20260927 15:05:56.657989 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a30cef3b4c2436c8c222f35b244fd06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.658409 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a30cef3b4c2436c8c222f35b244fd06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.660035 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet b5e7a34dce584f2fa7732ee9fc402740 (table default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
W20260927 15:05:56.660604 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 3a30cef3b4c2436c8c222f35b244fd06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a30cef3b4c2436c8c222f35b244fd06 already in progress: creating tablet
I20260927 15:05:56.660812 905 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 047da22298b747b89dd90c55063bcc9d
W20260927 15:05:56.660990 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 668320fafe5145e7ac72d15959c608af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 668320fafe5145e7ac72d15959c608af already in progress: creating tablet
I20260927 15:05:56.661001 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a30cef3b4c2436c8c222f35b244fd06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:56.661652 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3a30cef3b4c2436c8c222f35b244fd06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a30cef3b4c2436c8c222f35b244fd06 already in progress: creating tablet
W20260927 15:05:56.661795 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3a30cef3b4c2436c8c222f35b244fd06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a30cef3b4c2436c8c222f35b244fd06 already in progress: creating tablet
I20260927 15:05:56.673190 1556 tablet_bootstrap.cc:492] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:56.673372 1556 ts_tablet_manager.cc:1397] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.005s
I20260927 15:05:56.674124 1556 raft_consensus.cc:348] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.674360 1556 raft_consensus.cc:374] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.674443 1556 raft_consensus.cc:729] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.674718 1556 consensus_queue.cc:260] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.675267 1556 ts_tablet_manager.cc:1428] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:05:56.675542 1556 tablet_bootstrap.cc:492] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:56.677093 1556 tablet_bootstrap.cc:654] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.681242 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 307b02ef8c224999b4b8865022b7f368 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ada5178a90b497aa086286bd1d15601) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.681489 1559 tablet_replica.cc:330] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:56.681690 1559 raft_consensus.cc:2229] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:56.681844 1559 raft_consensus.cc:2258] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:56.682472 1559 ts_tablet_manager.cc:1905] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:56.692582 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6a021cc079fa4b88a16c5cf24359ea84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.693533 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a021cc079fa4b88a16c5cf24359ea84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.696049 1552 ts_tablet_manager.cc:1428] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.146s user 0.063s sys 0.051s
I20260927 15:05:56.696583 1559 ts_tablet_manager.cc:1918] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:56.696611 1552 tablet_bootstrap.cc:492] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:56.696729 1559 log.cc:1196] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/307b02ef8c224999b4b8865022b7f368
I20260927 15:05:56.697052 1559 ts_tablet_manager.cc:1939] T 307b02ef8c224999b4b8865022b7f368 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:56.698010 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 307b02ef8c224999b4b8865022b7f368 (table default.Table_fc5fdb39096646f1b45f6bbfa57a8133 [id=ba1ee00f53164d94be57db428fb14125]) successfully deleted
I20260927 15:05:56.698218 1552 tablet_bootstrap.cc:654] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.699436 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 3663d8a6672c4a9ca5c05a48700c6128 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.699777 912 master_service.cc:946] ReplaceTablet: received request to replace tablet b5e7a34dce584f2fa7732ee9fc402740 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.700332 907 master_service.cc:946] ReplaceTablet: received request to replace tablet 3663d8a6672c4a9ca5c05a48700c6128 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.700613 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 570a0ee2154d4aca9dbaa2f5057def9d from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.700929 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 307b02ef8c224999b4b8865022b7f368 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ada5178a90b497aa086286bd1d15601) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:56.701256 1560 tablet_replica.cc:330] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:56.701784 1560 raft_consensus.cc:2229] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:56.702262 1560 raft_consensus.cc:2258] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:56.704244 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 61339e532e6c431babb15422a08f7aa6 (DEFAULT_TABLE table=default.Table_73dd6ebc6fb44e5f89698a56ff8bd376 [id=48ac6a07f3ca402aa8396ac2a1874134]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.704656 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61339e532e6c431babb15422a08f7aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.704860 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 3e4e18e695f54d85b25958330717c713 (DEFAULT_TABLE table=default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.705368 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e4e18e695f54d85b25958330717c713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.705703 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 604c05acf3864fc697758208de68da18 (DEFAULT_TABLE table=default.Table_7df3939469d744798289afe55352f822 [id=7edfbbe676dd491a81129debceebd914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.706070 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 604c05acf3864fc697758208de68da18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.707580 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 61339e532e6c431babb15422a08f7aa6 (DEFAULT_TABLE table=default.Table_73dd6ebc6fb44e5f89698a56ff8bd376 [id=48ac6a07f3ca402aa8396ac2a1874134]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.708050 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61339e532e6c431babb15422a08f7aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.711426 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 3e4e18e695f54d85b25958330717c713 (DEFAULT_TABLE table=default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.711820 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e4e18e695f54d85b25958330717c713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.713454 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 3e4e18e695f54d85b25958330717c713 (DEFAULT_TABLE table=default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.713562 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 604c05acf3864fc697758208de68da18 (DEFAULT_TABLE table=default.Table_7df3939469d744798289afe55352f822 [id=7edfbbe676dd491a81129debceebd914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.713747 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 604c05acf3864fc697758208de68da18 (DEFAULT_TABLE table=default.Table_7df3939469d744798289afe55352f822 [id=7edfbbe676dd491a81129debceebd914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.713910 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 604c05acf3864fc697758208de68da18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.713939 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e4e18e695f54d85b25958330717c713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.713454 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 61339e532e6c431babb15422a08f7aa6 (DEFAULT_TABLE table=default.Table_73dd6ebc6fb44e5f89698a56ff8bd376 [id=48ac6a07f3ca402aa8396ac2a1874134]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.714344 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61339e532e6c431babb15422a08f7aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.717656 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 604c05acf3864fc697758208de68da18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.722898 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 668320fafe5145e7ac72d15959c608af from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.723201 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 570a0ee2154d4aca9dbaa2f5057def9d
I20260927 15:05:56.723614 914 catalog_manager.cc:6565] ReplaceTablet: tablet 570a0ee2154d4aca9dbaa2f5057def9d deleted and replaced by tablet 0781c9c8b4ad498bb27573939b7d06b2
I20260927 15:05:56.724639 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 570a0ee2154d4aca9dbaa2f5057def9d with delete_type TABLET_DATA_DELETED (replaced by tablet 0781c9c8b4ad498bb27573939b7d06b2) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.724747 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 570a0ee2154d4aca9dbaa2f5057def9d with delete_type TABLET_DATA_DELETED (replaced by tablet 0781c9c8b4ad498bb27573939b7d06b2) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.725096 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3663d8a6672c4a9ca5c05a48700c6128
W20260927 15:05:56.725530 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 570a0ee2154d4aca9dbaa2f5057def9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 570a0ee2154d4aca9dbaa2f5057def9d already in progress: creating tablet
I20260927 15:05:56.726037 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 with delete_type TABLET_DATA_DELETED (replaced by tablet d6925d0369524e7eb1ac3c20ad699ded) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.725553 910 catalog_manager.cc:6565] ReplaceTablet: tablet 3663d8a6672c4a9ca5c05a48700c6128 deleted and replaced by tablet d6925d0369524e7eb1ac3c20ad699ded
W20260927 15:05:56.727057 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 3663d8a6672c4a9ca5c05a48700c6128 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3663d8a6672c4a9ca5c05a48700c6128 already in progress: creating tablet
I20260927 15:05:56.727205 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 with delete_type TABLET_DATA_DELETED (replaced by tablet d6925d0369524e7eb1ac3c20ad699ded) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:56.727363 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 with delete_type TABLET_DATA_DELETED (replaced by tablet d6925d0369524e7eb1ac3c20ad699ded) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.727432 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 570a0ee2154d4aca9dbaa2f5057def9d with delete_type TABLET_DATA_DELETED (replaced by tablet 0781c9c8b4ad498bb27573939b7d06b2) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:56.729274 1560 ts_tablet_manager.cc:1905] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:56.729444 1561 raft_consensus.cc:348] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:56.732089 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 570a0ee2154d4aca9dbaa2f5057def9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 570a0ee2154d4aca9dbaa2f5057def9d already in progress: creating tablet
I20260927 15:05:56.731925 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bfeb38d1ec214c8989fc01c677d5daef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.732688 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfeb38d1ec214c8989fc01c677d5daef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.732642 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d560270327c14e809f06e2cb7e0ecc11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:56.733104 1561 raft_consensus.cc:374] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:05:56.733142 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d560270327c14e809f06e2cb7e0ecc11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.733215 1561 raft_consensus.cc:729] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:05:56.734215 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3663d8a6672c4a9ca5c05a48700c6128 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3663d8a6672c4a9ca5c05a48700c6128 already in progress: creating tablet
I20260927 15:05:56.737900 1560 ts_tablet_manager.cc:1918] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:56.738631 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9112f8699da541b58056a9f60137658e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.739117 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9112f8699da541b58056a9f60137658e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.739468 1556 tablet_bootstrap.cc:492] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:56.739614 1556 ts_tablet_manager.cc:1397] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.000s
I20260927 15:05:56.740338 1556 raft_consensus.cc:348] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.740597 1556 raft_consensus.cc:374] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.740701 1556 raft_consensus.cc:729] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.740926 1556 consensus_queue.cc:260] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.741358 1560 log.cc:1196] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/307b02ef8c224999b4b8865022b7f368
I20260927 15:05:56.741475 1556 ts_tablet_manager.cc:1428] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:05:56.741778 1556 tablet_bootstrap.cc:492] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:56.741932 1560 ts_tablet_manager.cc:1939] T 307b02ef8c224999b4b8865022b7f368 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:56.743355 1556 tablet_bootstrap.cc:654] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.744038 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 307b02ef8c224999b4b8865022b7f368 (table default.Table_fc5fdb39096646f1b45f6bbfa57a8133 [id=ba1ee00f53164d94be57db428fb14125]) successfully deleted
I20260927 15:05:56.744261 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 668320fafe5145e7ac72d15959c608af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:05:56.744330 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3663d8a6672c4a9ca5c05a48700c6128 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3663d8a6672c4a9ca5c05a48700c6128 already in progress: creating tablet
I20260927 15:05:56.744613 1559 tablet_replica.cc:330] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:05:56.744629 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 570a0ee2154d4aca9dbaa2f5057def9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 570a0ee2154d4aca9dbaa2f5057def9d already in progress: creating tablet
I20260927 15:05:56.744859 1559 raft_consensus.cc:2229] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:56.745123 1559 raft_consensus.cc:2258] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:56.745846 1559 ts_tablet_manager.cc:1905] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:56.751076 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fec3b495edd448798c5ddda6ff4c4464"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.751645 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fec3b495edd448798c5ddda6ff4c4464 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.752919 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0cf38c5a77d943628b2d20226904801d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.753518 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cf38c5a77d943628b2d20226904801d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.753751 1559 ts_tablet_manager.cc:1918] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:56.754097 1559 log.cc:1196] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/668320fafe5145e7ac72d15959c608af
I20260927 15:05:56.754658 1559 ts_tablet_manager.cc:1939] T 668320fafe5145e7ac72d15959c608af P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:56.756018 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 668320fafe5145e7ac72d15959c608af (table default.Table_804c4b270985427cb69cc7381cc86cb5 [id=0b5fd26bed7748fe941da0a7d1fa1dec]) successfully deleted
I20260927 15:05:56.760347 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_16724ccc8d1c4311a5e47f148a6148d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.761070 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16724ccc8d1c4311a5e47f148a6148d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.771638 1561 consensus_queue.cc:260] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.778028 1561 ts_tablet_manager.cc:1428] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.139s user 0.011s sys 0.004s
I20260927 15:05:56.778630 1552 tablet_bootstrap.cc:492] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:56.778803 1552 ts_tablet_manager.cc:1397] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.082s user 0.018s sys 0.036s
I20260927 15:05:56.778815 1556 tablet_bootstrap.cc:492] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:56.779100 1556 ts_tablet_manager.cc:1397] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.013s
I20260927 15:05:56.779724 1552 raft_consensus.cc:348] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.779970 1552 raft_consensus.cc:374] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.780560 1552 raft_consensus.cc:729] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.780887 1552 consensus_queue.cc:260] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.779927 1556 raft_consensus.cc:348] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.781318 1556 raft_consensus.cc:374] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.781407 1552 ts_tablet_manager.cc:1428] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:05:56.781437 1556 raft_consensus.cc:729] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.781054 1561 tablet_bootstrap.cc:492] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:56.781728 1552 tablet_bootstrap.cc:492] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:56.782024 1556 consensus_queue.cc:260] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.782171 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 8966721a788d4e64ad5e495b5a69b74d (DEFAULT_TABLE table=default.Table_9112f8699da541b58056a9f60137658e [id=d2fe03ba4bf141ef982f5a6b86fae022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.782593 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8966721a788d4e64ad5e495b5a69b74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.783344 1552 tablet_bootstrap.cc:654] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.783712 1561 tablet_bootstrap.cc:654] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.785657 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 8966721a788d4e64ad5e495b5a69b74d (DEFAULT_TABLE table=default.Table_9112f8699da541b58056a9f60137658e [id=d2fe03ba4bf141ef982f5a6b86fae022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.786018 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8966721a788d4e64ad5e495b5a69b74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.788326 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_a1ab17cc48c44273aca48706dde174c9 [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 2 got 0
I20260927 15:05:56.788766 1420 tablet_service.cc:1467] Processing CreateTablet for tablet ac3b1d765caf40a1a7593cdb19defcab (DEFAULT_TABLE table=default.Table_d560270327c14e809f06e2cb7e0ecc11 [id=6368f21af56d44f09f5cf1ec2d19f2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.789086 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3b1d765caf40a1a7593cdb19defcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.789726 1143 tablet_service.cc:1467] Processing CreateTablet for tablet ac3b1d765caf40a1a7593cdb19defcab (DEFAULT_TABLE table=default.Table_d560270327c14e809f06e2cb7e0ecc11 [id=6368f21af56d44f09f5cf1ec2d19f2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.790153 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3b1d765caf40a1a7593cdb19defcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.791831 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 with delete_type TABLET_DATA_DELETED (replaced by tablet 3663d8a6672c4a9ca5c05a48700c6128) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:56.792418 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 8966721a788d4e64ad5e495b5a69b74d (DEFAULT_TABLE table=default.Table_9112f8699da541b58056a9f60137658e [id=d2fe03ba4bf141ef982f5a6b86fae022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.792888 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8966721a788d4e64ad5e495b5a69b74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.794332 1556 ts_tablet_manager.cc:1428] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260927 15:05:56.795001 1560 tablet_replica.cc:330] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:56.795243 1560 raft_consensus.cc:2229] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:56.795436 1560 raft_consensus.cc:2258] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:56.795802 1145 tablet_service.cc:1467] Processing CreateTablet for tablet da8215167ad74dbfb2cc1c8d50a76ed5 (DEFAULT_TABLE table=default.Table_bfeb38d1ec214c8989fc01c677d5daef [id=9ed827c5b3234624bc1c68aec0d7fc73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.796144 1556 tablet_bootstrap.cc:492] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:56.796190 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da8215167ad74dbfb2cc1c8d50a76ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.797725 1556 tablet_bootstrap.cc:654] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.797950 1560 ts_tablet_manager.cc:1905] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:56.799547 1575 raft_consensus.cc:482] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:56.799850 1575 raft_consensus.cc:504] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.801859 1575 leader_election.cc:288] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:56.802165 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8b630852db2d4e56a631bd41ba399fa2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.802920 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b630852db2d4e56a631bd41ba399fa2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.804059 1417 tablet_service.cc:1467] Processing CreateTablet for tablet da8215167ad74dbfb2cc1c8d50a76ed5 (DEFAULT_TABLE table=default.Table_bfeb38d1ec214c8989fc01c677d5daef [id=9ed827c5b3234624bc1c68aec0d7fc73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.804394 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da8215167ad74dbfb2cc1c8d50a76ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.805277 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 43552776a19a4e75aa2d6f3d983e3432 (DEFAULT_TABLE table=default.Table_6a021cc079fa4b88a16c5cf24359ea84 [id=5c4f0f47acd14538b67f8c8d579b0696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.805634 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43552776a19a4e75aa2d6f3d983e3432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.808971 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 43552776a19a4e75aa2d6f3d983e3432 (DEFAULT_TABLE table=default.Table_6a021cc079fa4b88a16c5cf24359ea84 [id=5c4f0f47acd14538b67f8c8d579b0696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.809376 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43552776a19a4e75aa2d6f3d983e3432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.809294 1283 tablet_service.cc:1467] Processing CreateTablet for tablet da8215167ad74dbfb2cc1c8d50a76ed5 (DEFAULT_TABLE table=default.Table_bfeb38d1ec214c8989fc01c677d5daef [id=9ed827c5b3234624bc1c68aec0d7fc73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.809747 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da8215167ad74dbfb2cc1c8d50a76ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.811182 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 0781c9c8b4ad498bb27573939b7d06b2 (DEFAULT_TABLE table=default.Table_fe0efb011aa24f7f9d3c4e947a8fadc8 [id=f301a482365b4cf2b752fccd860a8d2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.811254 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 0781c9c8b4ad498bb27573939b7d06b2 (DEFAULT_TABLE table=default.Table_fe0efb011aa24f7f9d3c4e947a8fadc8 [id=f301a482365b4cf2b752fccd860a8d2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.811499 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0781c9c8b4ad498bb27573939b7d06b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.811728 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0781c9c8b4ad498bb27573939b7d06b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.814989 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_a1ab17cc48c44273aca48706dde174c9 [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 2 got 0
I20260927 15:05:56.818607 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d10d83c1c2754cc2b108f2adc4e208cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.819201 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d10d83c1c2754cc2b108f2adc4e208cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.820186 1285 tablet_service.cc:1467] Processing CreateTablet for tablet ac3b1d765caf40a1a7593cdb19defcab (DEFAULT_TABLE table=default.Table_d560270327c14e809f06e2cb7e0ecc11 [id=6368f21af56d44f09f5cf1ec2d19f2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.820663 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3b1d765caf40a1a7593cdb19defcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.821264 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_73dd6ebc6fb44e5f89698a56ff8bd376" } new_table_name: "default.Table_1281d82fca13492ca9d09e032408682d" modify_external_catalogs: true
I20260927 15:05:56.827764 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fe0efb011aa24f7f9d3c4e947a8fadc8" } new_table_name: "default.Table_61e5b4b2f11846a6b353ad02a4bc4473" modify_external_catalogs: true
I20260927 15:05:56.829872 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_40a2a7eaf0264954bccee55880a74fa6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.830562 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40a2a7eaf0264954bccee55880a74fa6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:56.838083 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61339e532e6c431babb15422a08f7aa6 consensus state has no leader
W20260927 15:05:56.840817 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0781c9c8b4ad498bb27573939b7d06b2 consensus state has no leader
I20260927 15:05:56.841529 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ad16dccb70e84472ad8f18eb900fe3e6" } new_table_name: "default.Table_1168b8b224f14d868316d417ab56fef1" modify_external_catalogs: true
I20260927 15:05:56.842437 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fc5fdb39096646f1b45f6bbfa57a8133" } modify_external_catalogs: true
I20260927 15:05:56.842621 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fc5fdb39096646f1b45f6bbfa57a8133" } modify_external_catalogs: true
I20260927 15:05:56.804768 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 43552776a19a4e75aa2d6f3d983e3432 (DEFAULT_TABLE table=default.Table_6a021cc079fa4b88a16c5cf24359ea84 [id=5c4f0f47acd14538b67f8c8d579b0696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.844317 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43552776a19a4e75aa2d6f3d983e3432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.805859 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 0781c9c8b4ad498bb27573939b7d06b2 (DEFAULT_TABLE table=default.Table_fe0efb011aa24f7f9d3c4e947a8fadc8 [id=f301a482365b4cf2b752fccd860a8d2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.847132 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0781c9c8b4ad498bb27573939b7d06b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.847754 1145 tablet_service.cc:1467] Processing CreateTablet for tablet d6925d0369524e7eb1ac3c20ad699ded (DEFAULT_TABLE table=default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.849083 1281 tablet_service.cc:1467] Processing CreateTablet for tablet d6925d0369524e7eb1ac3c20ad699ded (DEFAULT_TABLE table=default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.849514 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6925d0369524e7eb1ac3c20ad699ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.851225 1417 tablet_service.cc:1467] Processing CreateTablet for tablet d6925d0369524e7eb1ac3c20ad699ded (DEFAULT_TABLE table=default.Table_ad16dccb70e84472ad8f18eb900fe3e6 [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.851666 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6925d0369524e7eb1ac3c20ad699ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.852283 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fec3b495edd448798c5ddda6ff4c4464" } modify_external_catalogs: true
I20260927 15:05:56.852504 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fec3b495edd448798c5ddda6ff4c4464" } modify_external_catalogs: true
I20260927 15:05:56.854007 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1ada5178a90b497aa086286bd1d15601
I20260927 15:05:56.855581 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ada5178a90b497aa086286bd1d15601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:05:56.856292 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1ada5178a90b497aa086286bd1d15601 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ada5178a90b497aa086286bd1d15601 already in progress: creating tablet
I20260927 15:05:56.860332 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7df3939469d744798289afe55352f822" } modify_external_catalogs: true
I20260927 15:05:56.860513 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7df3939469d744798289afe55352f822" } modify_external_catalogs: true
I20260927 15:05:56.861207 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9112f8699da541b58056a9f60137658e" } modify_external_catalogs: true
I20260927 15:05:56.861419 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9112f8699da541b58056a9f60137658e" } modify_external_catalogs: true
I20260927 15:05:56.862185 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_78e91d79695d4e34b7860aa90b95b932" } new_table_name: "default.Table_67c327241b1843eb973938ae7ac1d0b7" modify_external_catalogs: true
I20260927 15:05:56.863018 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bfeb38d1ec214c8989fc01c677d5daef" } modify_external_catalogs: true
I20260927 15:05:56.863174 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bfeb38d1ec214c8989fc01c677d5daef" } modify_external_catalogs: true
I20260927 15:05:56.864346 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a9e848bee97745b5921d0e7a68683430" } new_table_name: "default.Table_e6b64fb416dd492caadccd2e9d65a802" modify_external_catalogs: true
I20260927 15:05:56.865063 910 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet fe8b6eabaa1b4507bce5a79eac9502b2
W20260927 15:05:56.865064 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6925d0369524e7eb1ac3c20ad699ded consensus state has no leader
I20260927 15:05:56.868749 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ada5178a90b497aa086286bd1d15601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:56.870589 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 604c05acf3864fc697758208de68da18
I20260927 15:05:56.872120 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 604c05acf3864fc697758208de68da18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:56.872938 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 604c05acf3864fc697758208de68da18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.874208 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8966721a788d4e64ad5e495b5a69b74d
W20260927 15:05:56.875998 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 604c05acf3864fc697758208de68da18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 604c05acf3864fc697758208de68da18 already in progress: creating tablet
I20260927 15:05:56.876134 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 8966721a788d4e64ad5e495b5a69b74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.876760 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 8966721a788d4e64ad5e495b5a69b74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:56.876756 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8966721a788d4e64ad5e495b5a69b74d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8966721a788d4e64ad5e495b5a69b74d already in progress: creating tablet
I20260927 15:05:56.878309 1560 ts_tablet_manager.cc:1918] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:56.878515 1560 log.cc:1196] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/b5e7a34dce584f2fa7732ee9fc402740
I20260927 15:05:56.879004 1560 ts_tablet_manager.cc:1939] T b5e7a34dce584f2fa7732ee9fc402740 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:56.879995 1552 tablet_bootstrap.cc:492] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:56.880157 1552 ts_tablet_manager.cc:1397] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.098s user 0.037s sys 0.053s
I20260927 15:05:56.881034 1552 raft_consensus.cc:348] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.881312 1552 raft_consensus.cc:374] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.881407 1552 raft_consensus.cc:729] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.881773 1552 consensus_queue.cc:260] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.882117 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet b5e7a34dce584f2fa7732ee9fc402740 (table default.Table_1168b8b224f14d868316d417ab56fef1 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
W20260927 15:05:56.882366 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1ada5178a90b497aa086286bd1d15601 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ada5178a90b497aa086286bd1d15601 already in progress: creating tablet
I20260927 15:05:56.882400 1552 ts_tablet_manager.cc:1428] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260927 15:05:56.882658 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 604c05acf3864fc697758208de68da18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 604c05acf3864fc697758208de68da18 already in progress: creating tablet
I20260927 15:05:56.882716 1552 tablet_bootstrap.cc:492] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:05:56.882867 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8966721a788d4e64ad5e495b5a69b74d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8966721a788d4e64ad5e495b5a69b74d already in progress: creating tablet
I20260927 15:05:56.884287 1552 tablet_bootstrap.cc:654] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.886711 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 604c05acf3864fc697758208de68da18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.889066 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 668320fafe5145e7ac72d15959c608af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:05:56.889860 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 604c05acf3864fc697758208de68da18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 604c05acf3864fc697758208de68da18 already in progress: creating tablet
I20260927 15:05:56.890174 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 8966721a788d4e64ad5e495b5a69b74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.890400 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ada5178a90b497aa086286bd1d15601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.890856 1562 tablet_replica.cc:330] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:56.891387 1562 raft_consensus.cc:2229] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:56.892197 1562 raft_consensus.cc:2258] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:05:56.893551 1353 tablet.cc:2369] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:05:56.894968 1562 ts_tablet_manager.cc:1905] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:56.895699 1556 tablet_bootstrap.cc:492] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:56.895838 1556 ts_tablet_manager.cc:1397] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.100s user 0.000s sys 0.014s
I20260927 15:05:56.896582 1556 raft_consensus.cc:348] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.896823 1556 raft_consensus.cc:374] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.896917 1556 raft_consensus.cc:729] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.897210 1556 consensus_queue.cc:260] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.901268 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 with delete_type TABLET_DATA_DELETED (replaced by tablet d6925d0369524e7eb1ac3c20ad699ded) from {username='slave'} at 127.0.0.1:49234
W20260927 15:05:56.901871 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3663d8a6672c4a9ca5c05a48700c6128 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3663d8a6672c4a9ca5c05a48700c6128 already in progress: creating tablet
I20260927 15:05:56.902464 1556 ts_tablet_manager.cc:1428] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260927 15:05:56.902871 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6925d0369524e7eb1ac3c20ad699ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.905474 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 with delete_type TABLET_DATA_DELETED (replaced by tablet d6925d0369524e7eb1ac3c20ad699ded) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:56.905706 1559 tablet_replica.cc:330] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:56.905884 1559 raft_consensus.cc:2229] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:56.906068 1559 raft_consensus.cc:2258] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:56.906453 1556 tablet_bootstrap.cc:492] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:56.907112 1559 ts_tablet_manager.cc:1905] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:56.908144 1556 tablet_bootstrap.cc:654] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.914461 1561 tablet_bootstrap.cc:492] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:56.914659 1561 ts_tablet_manager.cc:1397] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.134s user 0.003s sys 0.014s
I20260927 15:05:56.915920 1561 raft_consensus.cc:348] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.916141 1561 raft_consensus.cc:374] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.916260 1561 raft_consensus.cc:729] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.916656 1561 consensus_queue.cc:260] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.917299 1561 ts_tablet_manager.cc:1428] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 15:05:56.919889 1561 tablet_bootstrap.cc:492] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:56.923822 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e7a34dce584f2fa7732ee9fc402740 with delete_type TABLET_DATA_DELETED (replaced by tablet 3663d8a6672c4a9ca5c05a48700c6128) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.916033 1559 ts_tablet_manager.cc:1918] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:56.924378 1559 log.cc:1196] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3663d8a6672c4a9ca5c05a48700c6128
I20260927 15:05:56.924813 1559 ts_tablet_manager.cc:1939] T 3663d8a6672c4a9ca5c05a48700c6128 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:56.924821 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "668320fafe5145e7ac72d15959c608af" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:56.927136 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 3663d8a6672c4a9ca5c05a48700c6128 (table default.Table_1168b8b224f14d868316d417ab56fef1 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
I20260927 15:05:56.927697 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2481967ffd2f4c30bfb57bdf8d5940e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.927945 1102 leader_election.cc:341] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:05:56.928300 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2481967ffd2f4c30bfb57bdf8d5940e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:56.930466 1099 leader_election.cc:341] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 668320fafe5145e7ac72d15959c608af
I20260927 15:05:56.930605 1099 leader_election.cc:302] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:05:56.930990 1099 raft_consensus.cc:2670] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 15:05:56.931887 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 3e4e18e695f54d85b25958330717c713 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.933547 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 3e4e18e695f54d85b25958330717c713 from {username='slave'} at 127.0.0.1:49800
W20260927 15:05:56.934296 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a7989e2b91044dab1d3e327958a051a consensus state has no leader
I20260927 15:05:56.937721 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet da8215167ad74dbfb2cc1c8d50a76ed5
I20260927 15:05:56.939195 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet da8215167ad74dbfb2cc1c8d50a76ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:56.939275 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet da8215167ad74dbfb2cc1c8d50a76ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:56.940533 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet da8215167ad74dbfb2cc1c8d50a76ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:05:56.941823 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet da8215167ad74dbfb2cc1c8d50a76ed5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da8215167ad74dbfb2cc1c8d50a76ed5 already in progress: creating tablet
I20260927 15:05:56.945221 913 master_service.cc:946] ReplaceTablet: received request to replace tablet 3663d8a6672c4a9ca5c05a48700c6128 from {username='slave'} at 127.0.0.1:49800
W20260927 15:05:56.946419 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet da8215167ad74dbfb2cc1c8d50a76ed5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da8215167ad74dbfb2cc1c8d50a76ed5 already in progress: creating tablet
I20260927 15:05:56.947256 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_762e4939259748a28b16279e147a5ada"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.947810 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_762e4939259748a28b16279e147a5ada in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.949025 1561 tablet_bootstrap.cc:654] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.944617 905 master_service.cc:946] ReplaceTablet: received request to replace tablet 8966721a788d4e64ad5e495b5a69b74d from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.951159 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 43552776a19a4e75aa2d6f3d983e3432 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:56.951390 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7f379286c2f240ce8b30aa735ecbdd18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.952081 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f379286c2f240ce8b30aa735ecbdd18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.954567 1563 raft_consensus.cc:482] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:56.954861 1563 raft_consensus.cc:504] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.944594 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fa494510445b4a31894f0d2313650f59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.955402 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa494510445b4a31894f0d2313650f59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.955931 1562 ts_tablet_manager.cc:1918] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:56.956115 1562 log.cc:1196] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/668320fafe5145e7ac72d15959c608af
I20260927 15:05:56.956684 1562 ts_tablet_manager.cc:1939] T 668320fafe5145e7ac72d15959c608af P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:56.956785 1563 leader_election.cc:288] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:56.958720 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 668320fafe5145e7ac72d15959c608af (table default.Table_804c4b270985427cb69cc7381cc86cb5 [id=0b5fd26bed7748fe941da0a7d1fa1dec]) successfully deleted
W20260927 15:05:56.959830 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8966721a788d4e64ad5e495b5a69b74d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8966721a788d4e64ad5e495b5a69b74d already in progress: creating tablet
W20260927 15:05:56.961107 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1ada5178a90b497aa086286bd1d15601 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ada5178a90b497aa086286bd1d15601 already in progress: creating tablet
I20260927 15:05:56.961723 1562 tablet_replica.cc:330] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:56.962021 1562 raft_consensus.cc:2229] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:56.963092 1562 raft_consensus.cc:2258] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:56.962885 1561 tablet_bootstrap.cc:492] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:56.964164 1561 ts_tablet_manager.cc:1397] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.002s
I20260927 15:05:56.964156 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5b8a3913769d4b7bb8dbb76cea120fc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.964607 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b8a3913769d4b7bb8dbb76cea120fc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.964932 1561 raft_consensus.cc:348] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.965183 1561 raft_consensus.cc:374] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.965255 1561 raft_consensus.cc:729] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.965449 1561 consensus_queue.cc:260] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.966902 1556 tablet_bootstrap.cc:492] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:56.967136 1556 ts_tablet_manager.cc:1397] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.061s user 0.022s sys 0.010s
I20260927 15:05:56.967939 1561 ts_tablet_manager.cc:1428] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:05:56.968024 1556 raft_consensus.cc:348] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.968324 1556 raft_consensus.cc:374] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:56.968412 1556 raft_consensus.cc:729] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:56.968641 1556 consensus_queue.cc:260] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:56.969135 1556 ts_tablet_manager.cc:1428] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:05:56.969817 1556 tablet_bootstrap.cc:492] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:56.969991 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_63d3ae8aa61f4fcd80a58e28f2104a21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.970551 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63d3ae8aa61f4fcd80a58e28f2104a21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.971571 1556 tablet_bootstrap.cc:654] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.973346 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cad30ab7948d46e684534f9f30dc59d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:56.973943 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cad30ab7948d46e684534f9f30dc59d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:56.978399 1561 tablet_bootstrap.cc:492] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:56.980682 1562 ts_tablet_manager.cc:1905] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:56.983124 912 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet baafd4f49c7543018f87f5ad81d43a6c (table default.Table_78e91d79695d4e34b7860aa90b95b932 [id=f06d678811dc49d58d59f1b34e9c7346]). Expected version 1 got 0
I20260927 15:05:56.981894 1561 tablet_bootstrap.cc:654] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:56.983649 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet baafd4f49c7543018f87f5ad81d43a6c (table default.Table_78e91d79695d4e34b7860aa90b95b932 [id=f06d678811dc49d58d59f1b34e9c7346]). Expected version 1 got 0
W20260927 15:05:56.984086 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet baafd4f49c7543018f87f5ad81d43a6c consensus state has no leader
I20260927 15:05:56.986785 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 7d31bf920f0d41478863959d49400731 (DEFAULT_TABLE table=default.Table_8b630852db2d4e56a631bd41ba399fa2 [id=b28d0e08cf944e17a720641dab1f23f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.986960 908 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet baafd4f49c7543018f87f5ad81d43a6c (table default.Table_67c327241b1843eb973938ae7ac1d0b7 [id=f06d678811dc49d58d59f1b34e9c7346]). Expected version 2 got 0
I20260927 15:05:56.987218 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d31bf920f0d41478863959d49400731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.987481 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 7d31bf920f0d41478863959d49400731 (DEFAULT_TABLE table=default.Table_8b630852db2d4e56a631bd41ba399fa2 [id=b28d0e08cf944e17a720641dab1f23f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.987572 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 67ad68a0adad407a92b2335f43e67227 (DEFAULT_TABLE table=default.Table_d10d83c1c2754cc2b108f2adc4e208cb [id=55619382de684277879287b56f6bce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.987841 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d31bf920f0d41478863959d49400731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.987769 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 67ad68a0adad407a92b2335f43e67227 (DEFAULT_TABLE table=default.Table_d10d83c1c2754cc2b108f2adc4e208cb [id=55619382de684277879287b56f6bce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.988101 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67ad68a0adad407a92b2335f43e67227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.988152 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67ad68a0adad407a92b2335f43e67227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.991451 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet baafd4f49c7543018f87f5ad81d43a6c (table default.Table_67c327241b1843eb973938ae7ac1d0b7 [id=f06d678811dc49d58d59f1b34e9c7346]). Expected version 2 got 0
I20260927 15:05:56.991513 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 7d31bf920f0d41478863959d49400731 (DEFAULT_TABLE table=default.Table_8b630852db2d4e56a631bd41ba399fa2 [id=b28d0e08cf944e17a720641dab1f23f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.991875 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d31bf920f0d41478863959d49400731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:56.998270 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 67ad68a0adad407a92b2335f43e67227 (DEFAULT_TABLE table=default.Table_d10d83c1c2754cc2b108f2adc4e208cb [id=55619382de684277879287b56f6bce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:56.998700 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67ad68a0adad407a92b2335f43e67227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.003827 1145 tablet_service.cc:1467] Processing CreateTablet for tablet b122f1436fde4c5da7f0afa3a1c24c70 (DEFAULT_TABLE table=default.Table_0cf38c5a77d943628b2d20226904801d [id=df10d723c97d47dd82747afd6899372d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.004267 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b122f1436fde4c5da7f0afa3a1c24c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.008219 1552 tablet_bootstrap.cc:492] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:57.008487 1552 ts_tablet_manager.cc:1397] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.126s user 0.020s sys 0.043s
I20260927 15:05:57.009852 1552 raft_consensus.cc:348] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.012490 1552 raft_consensus.cc:374] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.015702 1417 tablet_service.cc:1467] Processing CreateTablet for tablet b122f1436fde4c5da7f0afa3a1c24c70 (DEFAULT_TABLE table=default.Table_0cf38c5a77d943628b2d20226904801d [id=df10d723c97d47dd82747afd6899372d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.016007 1552 raft_consensus.cc:729] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.016458 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b122f1436fde4c5da7f0afa3a1c24c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.016775 1552 consensus_queue.cc:260] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.019910 912 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_a1ab17cc48c44273aca48706dde174c9 [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 2 got 0
I20260927 15:05:57.021085 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3e4e18e695f54d85b25958330717c713
I20260927 15:05:57.021495 914 catalog_manager.cc:6565] ReplaceTablet: tablet 3e4e18e695f54d85b25958330717c713 deleted and replaced by tablet 6c7a8bf15c48423ea9ff14c46645a33b
I20260927 15:05:57.022002 1552 ts_tablet_manager.cc:1428] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260927 15:05:57.022085 1281 tablet_service.cc:1467] Processing CreateTablet for tablet e188f28304604cf2a96a606811900ca5 (DEFAULT_TABLE table=default.Table_16724ccc8d1c4311a5e47f148a6148d3 [id=88ccf418a4e24b07830f6fdabe341176]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.022332 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e4e18e695f54d85b25958330717c713 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c7a8bf15c48423ea9ff14c46645a33b) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.022485 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e188f28304604cf2a96a606811900ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.022552 1145 tablet_service.cc:1467] Processing CreateTablet for tablet e188f28304604cf2a96a606811900ca5 (DEFAULT_TABLE table=default.Table_16724ccc8d1c4311a5e47f148a6148d3 [id=88ccf418a4e24b07830f6fdabe341176]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.022974 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e188f28304604cf2a96a606811900ca5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.023196 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3e4e18e695f54d85b25958330717c713 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e4e18e695f54d85b25958330717c713 already in progress: creating tablet
I20260927 15:05:57.023480 910 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_a1ab17cc48c44273aca48706dde174c9 [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 2 got 0
I20260927 15:05:57.024503 1552 tablet_bootstrap.cc:492] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:57.024727 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 43552776a19a4e75aa2d6f3d983e3432
I20260927 15:05:57.025103 911 catalog_manager.cc:6565] ReplaceTablet: tablet 43552776a19a4e75aa2d6f3d983e3432 deleted and replaced by tablet 34822e9f900f4d04b59b810d59e6aa49
I20260927 15:05:57.025772 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 43552776a19a4e75aa2d6f3d983e3432 with delete_type TABLET_DATA_DELETED (replaced by tablet 34822e9f900f4d04b59b810d59e6aa49) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:57.026482 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 43552776a19a4e75aa2d6f3d983e3432 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43552776a19a4e75aa2d6f3d983e3432 already in progress: creating tablet
I20260927 15:05:57.026571 1552 tablet_bootstrap.cc:654] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.027225 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 43552776a19a4e75aa2d6f3d983e3432 with delete_type TABLET_DATA_DELETED (replaced by tablet 34822e9f900f4d04b59b810d59e6aa49) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.028996 1285 tablet_service.cc:1467] Processing CreateTablet for tablet b122f1436fde4c5da7f0afa3a1c24c70 (DEFAULT_TABLE table=default.Table_0cf38c5a77d943628b2d20226904801d [id=df10d723c97d47dd82747afd6899372d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.029343 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b122f1436fde4c5da7f0afa3a1c24c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.030557 1561 tablet_bootstrap.cc:492] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.030694 1561 ts_tablet_manager.cc:1397] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260927 15:05:57.031487 1561 raft_consensus.cc:348] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.031735 1561 raft_consensus.cc:374] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.031786 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e4e18e695f54d85b25958330717c713 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c7a8bf15c48423ea9ff14c46645a33b) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.032460 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ada5178a90b497aa086286bd1d15601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.033059 1559 tablet_replica.cc:330] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:57.033311 1559 raft_consensus.cc:2229] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.033787 1559 raft_consensus.cc:2258] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.034438 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ba98a311f91844ad8d58795d841eb2f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.035233 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba98a311f91844ad8d58795d841eb2f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.036880 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_aa240acd8d584ffbaf06939b83935899"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.037348 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa240acd8d584ffbaf06939b83935899 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.037712 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f6cfd9f4c0424d86df223b0eaab4f7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:57.038918 1562 ts_tablet_manager.cc:1918] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.039196 1562 log.cc:1196] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/b5e7a34dce584f2fa7732ee9fc402740
I20260927 15:05:57.039654 1562 ts_tablet_manager.cc:1939] T b5e7a34dce584f2fa7732ee9fc402740 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:57.039660 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cad30ab7948d46e684534f9f30dc59d0" } new_table_name: "default.Table_515ca01252504bd092991cc33a48fca0" modify_external_catalogs: true
I20260927 15:05:57.041334 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet b5e7a34dce584f2fa7732ee9fc402740 (table default.Table_1168b8b224f14d868316d417ab56fef1 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
I20260927 15:05:57.042858 1552 tablet_bootstrap.cc:492] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:57.043071 1552 ts_tablet_manager.cc:1397] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
W20260927 15:05:57.043929 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet da8215167ad74dbfb2cc1c8d50a76ed5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da8215167ad74dbfb2cc1c8d50a76ed5 already in progress: creating tablet
I20260927 15:05:57.044018 1552 raft_consensus.cc:348] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:57.044214 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 43552776a19a4e75aa2d6f3d983e3432 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43552776a19a4e75aa2d6f3d983e3432 already in progress: creating tablet
I20260927 15:05:57.044337 1552 raft_consensus.cc:374] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.044432 1552 raft_consensus.cc:729] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:05:57.044574 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 3e4e18e695f54d85b25958330717c713 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e4e18e695f54d85b25958330717c713 already in progress: creating tablet
I20260927 15:05:57.044714 1552 consensus_queue.cc:260] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.047264 1552 ts_tablet_manager.cc:1428] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:05:57.047639 1552 tablet_bootstrap.cc:492] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:57.051031 1552 tablet_bootstrap.cc:654] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.051213 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b8a3913769d4b7bb8dbb76cea120fc4" } new_table_name: "default.Table_e7ef4602b573455ba998b9742647c917" modify_external_catalogs: true
I20260927 15:05:57.053791 1418 tablet_service.cc:1467] Processing CreateTablet for tablet e188f28304604cf2a96a606811900ca5 (DEFAULT_TABLE table=default.Table_16724ccc8d1c4311a5e47f148a6148d3 [id=88ccf418a4e24b07830f6fdabe341176]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.054244 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 668320fafe5145e7ac72d15959c608af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.053607 1559 ts_tablet_manager.cc:1905] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.054569 1560 tablet_replica.cc:330] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:57.054751 1560 raft_consensus.cc:2229] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.054956 1560 raft_consensus.cc:2258] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.055610 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e4e18e695f54d85b25958330717c713 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c7a8bf15c48423ea9ff14c46645a33b) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.055699 1560 ts_tablet_manager.cc:1905] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.056233 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_72969dc9609e4a23943147a5104ed1f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.056789 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72969dc9609e4a23943147a5104ed1f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.057830 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_63d3ae8aa61f4fcd80a58e28f2104a21" } modify_external_catalogs: true
I20260927 15:05:57.058001 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_63d3ae8aa61f4fcd80a58e28f2104a21" } modify_external_catalogs: true
I20260927 15:05:57.059496 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f6cfd9f4c0424d86df223b0eaab4f7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:57.059863 1305 raft_consensus.cc:2454] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:05:57.063691 1552 tablet_bootstrap.cc:492] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:57.063833 1552 ts_tablet_manager.cc:1397] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.004s
I20260927 15:05:57.064109 1560 ts_tablet_manager.cc:1918] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.064232 1560 log.cc:1196] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/668320fafe5145e7ac72d15959c608af
I20260927 15:05:57.064411 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e188f28304604cf2a96a606811900ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.064648 1552 raft_consensus.cc:348] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.064854 1552 raft_consensus.cc:374] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.064935 1552 raft_consensus.cc:729] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.031843 1561 raft_consensus.cc:729] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.065137 1552 consensus_queue.cc:260] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.065485 1561 consensus_queue.cc:260] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.065682 1552 ts_tablet_manager.cc:1428] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:05:57.065963 1552 tablet_bootstrap.cc:492] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:57.066820 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2481967ffd2f4c30bfb57bdf8d5940e0" } modify_external_catalogs: true
I20260927 15:05:57.067015 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2481967ffd2f4c30bfb57bdf8d5940e0" } modify_external_catalogs: true
I20260927 15:05:57.067760 1561 ts_tablet_manager.cc:1428] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.037s user 0.000s sys 0.003s
I20260927 15:05:57.068799 1561 tablet_bootstrap.cc:492] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:57.069062 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d560270327c14e809f06e2cb7e0ecc11" } new_table_name: "default.Table_452367b3f3384a36aefc6823e7ab7ec2" modify_external_catalogs: true
I20260927 15:05:57.069190 1552 tablet_bootstrap.cc:654] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.069350 1166 raft_consensus.cc:2454] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
W20260927 15:05:57.073021 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 714b110a24ca4f3bb8126034dc3e6407 has no consensus state
W20260927 15:05:57.073547 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89bd5b459caa42e7a9153d9273ad52c4 has no consensus state
I20260927 15:05:57.074600 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_92c6318423b147e6984c2c78960a5476" } modify_external_catalogs: true
I20260927 15:05:57.074791 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_92c6318423b147e6984c2c78960a5476" } modify_external_catalogs: true
I20260927 15:05:57.075676 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_72969dc9609e4a23943147a5104ed1f6" } modify_external_catalogs: true
I20260927 15:05:57.075837 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_72969dc9609e4a23943147a5104ed1f6" } modify_external_catalogs: true
I20260927 15:05:57.079432 1561 tablet_bootstrap.cc:654] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.079008 1376 leader_election.cc:302] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:57.080098 1563 raft_consensus.cc:2781] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:57.080268 1563 raft_consensus.cc:482] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:57.080394 1563 raft_consensus.cc:3037] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:05:57.082450 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac3b1d765caf40a1a7593cdb19defcab consensus state has no leader
I20260927 15:05:57.084455 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 43552776a19a4e75aa2d6f3d983e3432 with delete_type TABLET_DATA_DELETED (replaced by tablet 34822e9f900f4d04b59b810d59e6aa49) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.093786 1556 tablet_bootstrap.cc:492] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.093938 1556 ts_tablet_manager.cc:1397] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.125s user 0.018s sys 0.043s
I20260927 15:05:57.095149 1556 raft_consensus.cc:348] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.095346 1556 raft_consensus.cc:374] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.095423 1556 raft_consensus.cc:729] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.095620 1556 consensus_queue.cc:260] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.101873 1563 raft_consensus.cc:504] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.104107 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f6cfd9f4c0424d86df223b0eaab4f7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:05:57.104393 1305 raft_consensus.cc:3037] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:57.107049 1556 ts_tablet_manager.cc:1428] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.013s user 0.005s sys 0.005s
I20260927 15:05:57.107265 1563 leader_election.cc:288] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:57.107568 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f6cfd9f4c0424d86df223b0eaab4f7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:05:57.107807 1166 raft_consensus.cc:3037] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:57.108402 1561 tablet_bootstrap.cc:492] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.108654 1561 ts_tablet_manager.cc:1397] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.040s user 0.011s sys 0.019s
I20260927 15:05:57.109491 1561 raft_consensus.cc:348] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.109822 1561 raft_consensus.cc:374] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.109951 1561 raft_consensus.cc:729] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.110255 1561 consensus_queue.cc:260] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.111868 1166 raft_consensus.cc:2454] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:05:57.113385 1305 raft_consensus.cc:2454] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:05:57.108522 1556 tablet_bootstrap.cc:492] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.112298 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 570a0ee2154d4aca9dbaa2f5057def9d with delete_type TABLET_DATA_DELETED (replaced by tablet 0781c9c8b4ad498bb27573939b7d06b2) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.113915 1376 leader_election.cc:302] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:57.118300 1592 raft_consensus.cc:2781] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:57.120168 1556 tablet_bootstrap.cc:654] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.126675 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 with delete_type TABLET_DATA_DELETED (replaced by tablet d6925d0369524e7eb1ac3c20ad699ded) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.113184 1561 ts_tablet_manager.cc:1428] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:05:57.129377 1559 ts_tablet_manager.cc:1918] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.129518 1559 log.cc:1196] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/1ada5178a90b497aa086286bd1d15601
I20260927 15:05:57.129931 1559 ts_tablet_manager.cc:1939] T 1ada5178a90b497aa086286bd1d15601 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:57.130225 1561 tablet_bootstrap.cc:492] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:57.134795 1560 ts_tablet_manager.cc:1939] T 668320fafe5145e7ac72d15959c608af P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:57.135630 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 89bd5b459caa42e7a9153d9273ad52c4 (DEFAULT_TABLE table=default.Table_515ca01252504bd092991cc33a48fca0 [id=4686792aaf36414380f3f894a5635874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.135891 1560 tablet_replica.cc:330] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:57.135982 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 714b110a24ca4f3bb8126034dc3e6407 (DEFAULT_TABLE table=default.Table_e7ef4602b573455ba998b9742647c917 [id=433e2c99fb354775ab79febbd9bd8be5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.136132 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89bd5b459caa42e7a9153d9273ad52c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.136143 1560 raft_consensus.cc:2229] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.136291 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 714b110a24ca4f3bb8126034dc3e6407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.136278 1560 raft_consensus.cc:2258] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.137101 1560 ts_tablet_manager.cc:1905] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.137153 1559 tablet_replica.cc:330] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:57.137320 1559 raft_consensus.cc:2229] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.137471 1559 raft_consensus.cc:2258] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.138736 1559 ts_tablet_manager.cc:1905] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.139124 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 30cf4db249154adda9406d5b07430a80 (DEFAULT_TABLE table=default.Table_40a2a7eaf0264954bccee55880a74fa6 [id=1b6050475cc24e249f2c525e95dda59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.139459 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30cf4db249154adda9406d5b07430a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.143096 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7a8bf15c48423ea9ff14c46645a33b (DEFAULT_TABLE table=default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.143430 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c7a8bf15c48423ea9ff14c46645a33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.147082 1140 tablet_service.cc:1467] Processing CreateTablet for tablet ce3b706ed2734db782efdb47cf3fda95 (DEFAULT_TABLE table=default.Table_fa494510445b4a31894f0d2313650f59 [id=8ca2c45597294e2aa3a002911c86fd1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.147507 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce3b706ed2734db782efdb47cf3fda95. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.150261 1219 tablet.cc:2369] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:05:57.150657 1561 tablet_bootstrap.cc:654] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.151860 1559 ts_tablet_manager.cc:1918] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.152040 1559 log.cc:1196] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/570a0ee2154d4aca9dbaa2f5057def9d
I20260927 15:05:57.152421 1559 ts_tablet_manager.cc:1939] T 570a0ee2154d4aca9dbaa2f5057def9d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:57.153530 914 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 0b9cf18b20a94dafa6b3843e26f784d5
I20260927 15:05:57.151368 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 1c49c70e003f47d6a325669376e5e3ca (DEFAULT_TABLE table=default.Table_2481967ffd2f4c30bfb57bdf8d5940e0 [id=ed09d325f0bd478fa0ed6172c15299ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.154176 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c49c70e003f47d6a325669376e5e3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.155850 1552 tablet_bootstrap.cc:492] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:57.156059 1552 ts_tablet_manager.cc:1397] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.090s user 0.020s sys 0.028s
I20260927 15:05:57.157083 1552 raft_consensus.cc:348] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.157407 1552 raft_consensus.cc:374] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.157531 1552 raft_consensus.cc:729] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.151746 1141 tablet_service.cc:1467] Processing CreateTablet for tablet e0db1654ced542938487126a0a09ed74 (DEFAULT_TABLE table=default.Table_762e4939259748a28b16279e147a5ada [id=09ccdcb0502f47219fc4985219701f1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.158607 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0db1654ced542938487126a0a09ed74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.152094 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 31701139f10f4478af43bd153aa3a2dc (DEFAULT_TABLE table=default.Table_7f379286c2f240ce8b30aa735ecbdd18 [id=8dc10ed6a11843b09a8a9937c145ba25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.161988 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31701139f10f4478af43bd153aa3a2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.163064 1560 ts_tablet_manager.cc:1918] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.163228 1560 log.cc:1196] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/3663d8a6672c4a9ca5c05a48700c6128
I20260927 15:05:57.163662 1560 ts_tablet_manager.cc:1939] T 3663d8a6672c4a9ca5c05a48700c6128 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:57.164937 1552 consensus_queue.cc:260] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.165547 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_a1ab17cc48c44273aca48706dde174c9 [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 2 got 0
I20260927 15:05:57.168241 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_44ec3dd510cd451a84cf5b0e73fc492d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.168788 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44ec3dd510cd451a84cf5b0e73fc492d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.169791 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 1ada5178a90b497aa086286bd1d15601 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.169947 1552 ts_tablet_manager.cc:1428] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.014s user 0.001s sys 0.002s
I20260927 15:05:57.170308 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6a021cc079fa4b88a16c5cf24359ea84" } new_table_name: "default.Table_f7ff3654808747e7a0a788d21ab84691" modify_external_catalogs: true
I20260927 15:05:57.171208 1561 tablet_bootstrap.cc:492] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.171337 1561 ts_tablet_manager.cc:1397] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260927 15:05:57.171543 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bd1398c934c0418eba63a6b9c0646259"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.171998 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd1398c934c0418eba63a6b9c0646259 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.172050 1561 raft_consensus.cc:348] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.172616 1561 raft_consensus.cc:374] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.172712 1561 raft_consensus.cc:729] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.172959 1561 consensus_queue.cc:260] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.173372 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ba98a311f91844ad8d58795d841eb2f4" } modify_external_catalogs: true
I20260927 15:05:57.173542 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ba98a311f91844ad8d58795d841eb2f4" } modify_external_catalogs: true
I20260927 15:05:57.173797 1552 tablet_bootstrap.cc:492] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:57.175364 1561 ts_tablet_manager.cc:1428] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260927 15:05:57.175998 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 1ada5178a90b497aa086286bd1d15601 (table default.Table_fc5fdb39096646f1b45f6bbfa57a8133 [id=ba1ee00f53164d94be57db428fb14125]) successfully deleted
W20260927 15:05:57.176230 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3e4e18e695f54d85b25958330717c713 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e4e18e695f54d85b25958330717c713 already in progress: creating tablet
W20260927 15:05:57.176476 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 43552776a19a4e75aa2d6f3d983e3432 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43552776a19a4e75aa2d6f3d983e3432 already in progress: creating tablet
I20260927 15:05:57.176640 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 570a0ee2154d4aca9dbaa2f5057def9d (table default.Table_61e5b4b2f11846a6b353ad02a4bc4473 [id=f301a482365b4cf2b752fccd860a8d2d]) successfully deleted
I20260927 15:05:57.177726 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 89bd5b459caa42e7a9153d9273ad52c4 (DEFAULT_TABLE table=default.Table_515ca01252504bd092991cc33a48fca0 [id=4686792aaf36414380f3f894a5635874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.177852 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 89bd5b459caa42e7a9153d9273ad52c4 (DEFAULT_TABLE table=default.Table_515ca01252504bd092991cc33a48fca0 [id=4686792aaf36414380f3f894a5635874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.178005 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 30cf4db249154adda9406d5b07430a80 (DEFAULT_TABLE table=default.Table_40a2a7eaf0264954bccee55880a74fa6 [id=1b6050475cc24e249f2c525e95dda59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.178162 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89bd5b459caa42e7a9153d9273ad52c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.178246 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89bd5b459caa42e7a9153d9273ad52c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.178375 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30cf4db249154adda9406d5b07430a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.178674 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 30cf4db249154adda9406d5b07430a80 (DEFAULT_TABLE table=default.Table_40a2a7eaf0264954bccee55880a74fa6 [id=1b6050475cc24e249f2c525e95dda59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.179060 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30cf4db249154adda9406d5b07430a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.179121 1420 tablet_service.cc:1467] Processing CreateTablet for tablet ce3b706ed2734db782efdb47cf3fda95 (DEFAULT_TABLE table=default.Table_fa494510445b4a31894f0d2313650f59 [id=8ca2c45597294e2aa3a002911c86fd1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.179649 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce3b706ed2734db782efdb47cf3fda95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.179845 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7a8bf15c48423ea9ff14c46645a33b (DEFAULT_TABLE table=default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.180186 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c7a8bf15c48423ea9ff14c46645a33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.183019 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 668320fafe5145e7ac72d15959c608af (table default.Table_804c4b270985427cb69cc7381cc86cb5 [id=0b5fd26bed7748fe941da0a7d1fa1dec]) successfully deleted
I20260927 15:05:57.183166 1414 tablet_service.cc:1467] Processing CreateTablet for tablet e0db1654ced542938487126a0a09ed74 (DEFAULT_TABLE table=default.Table_762e4939259748a28b16279e147a5ada [id=09ccdcb0502f47219fc4985219701f1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.183254 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 3663d8a6672c4a9ca5c05a48700c6128 (table default.Table_1168b8b224f14d868316d417ab56fef1 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
I20260927 15:05:57.183471 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 1c49c70e003f47d6a325669376e5e3ca (DEFAULT_TABLE table=default.Table_2481967ffd2f4c30bfb57bdf8d5940e0 [id=ed09d325f0bd478fa0ed6172c15299ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.183593 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0db1654ced542938487126a0a09ed74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.183916 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c49c70e003f47d6a325669376e5e3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.183312 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 1c49c70e003f47d6a325669376e5e3ca (DEFAULT_TABLE table=default.Table_2481967ffd2f4c30bfb57bdf8d5940e0 [id=ed09d325f0bd478fa0ed6172c15299ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.184135 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 714b110a24ca4f3bb8126034dc3e6407 (DEFAULT_TABLE table=default.Table_e7ef4602b573455ba998b9742647c917 [id=433e2c99fb354775ab79febbd9bd8be5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.184226 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c49c70e003f47d6a325669376e5e3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.184433 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 714b110a24ca4f3bb8126034dc3e6407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.183681 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 31701139f10f4478af43bd153aa3a2dc (DEFAULT_TABLE table=default.Table_7f379286c2f240ce8b30aa735ecbdd18 [id=8dc10ed6a11843b09a8a9937c145ba25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.184821 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31701139f10f4478af43bd153aa3a2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.186211 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_590e6d5e78b5436fa3687cf0b70e1921"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.186694 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_590e6d5e78b5436fa3687cf0b70e1921 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.187085 1283 tablet_service.cc:1467] Processing CreateTablet for tablet ce3b706ed2734db782efdb47cf3fda95 (DEFAULT_TABLE table=default.Table_fa494510445b4a31894f0d2313650f59 [id=8ca2c45597294e2aa3a002911c86fd1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.187170 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 31701139f10f4478af43bd153aa3a2dc (DEFAULT_TABLE table=default.Table_7f379286c2f240ce8b30aa735ecbdd18 [id=8dc10ed6a11843b09a8a9937c145ba25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.187399 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce3b706ed2734db782efdb47cf3fda95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.187314 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d80d3405cea240ec87396ab494d2d04d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.187562 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31701139f10f4478af43bd153aa3a2dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.187809 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d80d3405cea240ec87396ab494d2d04d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.188771 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_a1ab17cc48c44273aca48706dde174c9 [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 2 got 0
I20260927 15:05:57.190722 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7a8bf15c48423ea9ff14c46645a33b (DEFAULT_TABLE table=default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.191075 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c7a8bf15c48423ea9ff14c46645a33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.177755 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 714b110a24ca4f3bb8126034dc3e6407 (DEFAULT_TABLE table=default.Table_e7ef4602b573455ba998b9742647c917 [id=433e2c99fb354775ab79febbd9bd8be5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.191524 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 714b110a24ca4f3bb8126034dc3e6407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.192873 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a1ab17cc48c44273aca48706dde174c9" } new_table_name: "default.Table_4ef6d246ade74cb2a1bb687c6fd287c0" modify_external_catalogs: true
I20260927 15:05:57.193241 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 307b02ef8c224999b4b8865022b7f368 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ada5178a90b497aa086286bd1d15601) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.194669 1562 tablet_replica.cc:330] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:57.194871 1562 raft_consensus.cc:2229] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.195097 1562 raft_consensus.cc:2258] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.195187 1279 tablet_service.cc:1467] Processing CreateTablet for tablet e0db1654ced542938487126a0a09ed74 (DEFAULT_TABLE table=default.Table_762e4939259748a28b16279e147a5ada [id=09ccdcb0502f47219fc4985219701f1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.195575 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0db1654ced542938487126a0a09ed74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.195942 1562 ts_tablet_manager.cc:1905] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.199016 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ada5178a90b497aa086286bd1d15601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.202783 1552 tablet_bootstrap.cc:654] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.204679 1560 tablet_replica.cc:330] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:57.204838 1560 raft_consensus.cc:2229] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.204999 1560 raft_consensus.cc:2258] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.206737 1560 ts_tablet_manager.cc:1905] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.212512 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 538516912cf14ebfb0bfb31f706b66fc
I20260927 15:05:57.213492 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 538516912cf14ebfb0bfb31f706b66fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.213778 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1c49c70e003f47d6a325669376e5e3ca
I20260927 15:05:57.214968 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c49c70e003f47d6a325669376e5e3ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.215865 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 538516912cf14ebfb0bfb31f706b66fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.215900 910 master_service.cc:946] ReplaceTablet: received request to replace tablet baafd4f49c7543018f87f5ad81d43a6c from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.217203 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 538516912cf14ebfb0bfb31f706b66fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.217548 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c49c70e003f47d6a325669376e5e3ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.217569 1279 tablet_service.cc:1467] Processing CreateTablet for tablet e94dd938cf50495c99b5dce808ae7100 (DEFAULT_TABLE table=default.Table_63d3ae8aa61f4fcd80a58e28f2104a21 [id=ef9cdb183bd444e6baac3c583dfb631d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.218288 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e94dd938cf50495c99b5dce808ae7100
I20260927 15:05:57.218394 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e94dd938cf50495c99b5dce808ae7100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.219148 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet e94dd938cf50495c99b5dce808ae7100 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.221204 1561 tablet_bootstrap.cc:492] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:05:57.222362 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 538516912cf14ebfb0bfb31f706b66fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 538516912cf14ebfb0bfb31f706b66fc already in progress: creating tablet
W20260927 15:05:57.222621 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1c49c70e003f47d6a325669376e5e3ca because the tablet was not found. No further retry: Not found: Tablet not found: 1c49c70e003f47d6a325669376e5e3ca
I20260927 15:05:57.223417 1411 tablet_service.cc:1467] Processing CreateTablet for tablet e94dd938cf50495c99b5dce808ae7100 (DEFAULT_TABLE table=default.Table_63d3ae8aa61f4fcd80a58e28f2104a21 [id=ef9cdb183bd444e6baac3c583dfb631d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.223891 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e94dd938cf50495c99b5dce808ae7100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.226363 1592 raft_consensus.cc:686] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:05:57.226954 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet e94dd938cf50495c99b5dce808ae7100 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.226881 1592 consensus_queue.cc:237] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.233724 1560 ts_tablet_manager.cc:1918] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.233851 1560 log.cc:1196] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/1ada5178a90b497aa086286bd1d15601
I20260927 15:05:57.234190 1560 ts_tablet_manager.cc:1939] T 1ada5178a90b497aa086286bd1d15601 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:57.235160 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 1ada5178a90b497aa086286bd1d15601 (table default.Table_fc5fdb39096646f1b45f6bbfa57a8133 [id=ba1ee00f53164d94be57db428fb14125]) successfully deleted
W20260927 15:05:57.243530 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1c49c70e003f47d6a325669376e5e3ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c49c70e003f47d6a325669376e5e3ca already in progress: creating tablet
W20260927 15:05:57.244239 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 538516912cf14ebfb0bfb31f706b66fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 538516912cf14ebfb0bfb31f706b66fc already in progress: creating tablet
W20260927 15:05:57.244853 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e94dd938cf50495c99b5dce808ae7100 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e94dd938cf50495c99b5dce808ae7100 already in progress: creating tablet
W20260927 15:05:57.250802 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e94dd938cf50495c99b5dce808ae7100 because the tablet was not found. No further retry: Not found: Tablet not found: e94dd938cf50495c99b5dce808ae7100
I20260927 15:05:57.251204 1142 tablet_service.cc:1467] Processing CreateTablet for tablet e94dd938cf50495c99b5dce808ae7100 (DEFAULT_TABLE table=default.Table_63d3ae8aa61f4fcd80a58e28f2104a21 [id=ef9cdb183bd444e6baac3c583dfb631d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.251621 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e94dd938cf50495c99b5dce808ae7100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.253317 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c49c70e003f47d6a325669376e5e3ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.253336 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet e94dd938cf50495c99b5dce808ae7100 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.266443 1561 tablet_bootstrap.cc:654] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.271127 1562 ts_tablet_manager.cc:1918] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.271327 1562 log.cc:1196] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/307b02ef8c224999b4b8865022b7f368
I20260927 15:05:57.271795 1562 ts_tablet_manager.cc:1939] T 307b02ef8c224999b4b8865022b7f368 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:57.277405 1556 tablet_bootstrap.cc:492] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.277637 1556 ts_tablet_manager.cc:1397] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.169s user 0.023s sys 0.013s
I20260927 15:05:57.278410 1556 raft_consensus.cc:348] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.278796 1556 raft_consensus.cc:374] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.278949 1556 raft_consensus.cc:729] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.279304 1556 consensus_queue.cc:260] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.279680 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 307b02ef8c224999b4b8865022b7f368 (table default.Table_fc5fdb39096646f1b45f6bbfa57a8133 [id=ba1ee00f53164d94be57db428fb14125]) successfully deleted
I20260927 15:05:57.279915 1556 ts_tablet_manager.cc:1428] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:05:57.280277 1556 tablet_bootstrap.cc:492] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:05:57.281416 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 538516912cf14ebfb0bfb31f706b66fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 538516912cf14ebfb0bfb31f706b66fc already in progress: creating tablet
W20260927 15:05:57.282503 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1c49c70e003f47d6a325669376e5e3ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c49c70e003f47d6a325669376e5e3ca already in progress: creating tablet
W20260927 15:05:57.284039 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e94dd938cf50495c99b5dce808ae7100 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e94dd938cf50495c99b5dce808ae7100 already in progress: creating tablet
I20260927 15:05:57.285071 1561 tablet_bootstrap.cc:492] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.285277 1561 ts_tablet_manager.cc:1397] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.005s
I20260927 15:05:57.286069 1561 raft_consensus.cc:348] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.286360 1561 raft_consensus.cc:374] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.286477 1561 raft_consensus.cc:729] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.286753 1561 consensus_queue.cc:260] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.287361 1561 ts_tablet_manager.cc:1428] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:05:57.287690 1561 tablet_bootstrap.cc:492] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:05:57.288208 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34822e9f900f4d04b59b810d59e6aa49 has no consensus state
I20260927 15:05:57.289875 1561 tablet_bootstrap.cc:654] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.290638 1556 tablet_bootstrap.cc:654] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.292066 914 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet e075b6c3708647898c7762046be495e9
I20260927 15:05:57.292265 914 master_service.cc:946] ReplaceTablet: received request to replace tablet da8215167ad74dbfb2cc1c8d50a76ed5 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.293841 913 master_service.cc:946] ReplaceTablet: received request to replace tablet e0db1654ced542938487126a0a09ed74 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.295907 907 master_service.cc:946] ReplaceTablet: received request to replace tablet 604c05acf3864fc697758208de68da18 from {username='slave'} at 127.0.0.1:49800
W20260927 15:05:57.297010 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82f6cfd9f4c0424d86df223b0eaab4f7 consensus state has no leader
I20260927 15:05:57.304029 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dc82ae0788b94be68a26ad903bf087fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.304767 1556 tablet_bootstrap.cc:492] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.304948 1556 ts_tablet_manager.cc:1397] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260927 15:05:57.305037 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b348546f2c5f4f81927be221d3b5019f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.306115 1556 raft_consensus.cc:348] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.306327 1556 raft_consensus.cc:374] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.306413 1556 raft_consensus.cc:729] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.306375 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0a79a692b8e3421fbbf6fd4feedf0efa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.306656 1556 consensus_queue.cc:260] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.307206 1556 ts_tablet_manager.cc:1428] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:05:57.307464 1556 tablet_bootstrap.cc:492] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.307541 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_61e5b4b2f11846a6b353ad02a4bc4473" } new_table_name: "default.Table_7dea1c0fd30f48aeaa1dcd32925c05d0" modify_external_catalogs: true
I20260927 15:05:57.308897 1556 tablet_bootstrap.cc:654] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.309523 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5e28b5f6c5ec4348b3709ee9a861a2b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.311157 1561 tablet_bootstrap.cc:492] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.311295 1561 ts_tablet_manager.cc:1397] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.003s
I20260927 15:05:57.311453 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0ddd6f86b89744419bea8584de27933c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.312107 1561 raft_consensus.cc:348] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.312412 1561 raft_consensus.cc:374] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.312523 1561 raft_consensus.cc:729] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:05:57.312503 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a79a692b8e3421fbbf6fd4feedf0efa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.312777 1561 consensus_queue.cc:260] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.313640 1561 ts_tablet_manager.cc:1428] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:05:57.314007 1561 tablet_bootstrap.cc:492] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:05:57.314741 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b348546f2c5f4f81927be221d3b5019f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.316466 1561 tablet_bootstrap.cc:654] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:05:57.316880 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e28b5f6c5ec4348b3709ee9a861a2b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.318174 1556 tablet_bootstrap.cc:492] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.318316 1556 ts_tablet_manager.cc:1397] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20260927 15:05:57.319113 1556 raft_consensus.cc:348] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.319382 1556 raft_consensus.cc:374] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.319480 1556 raft_consensus.cc:729] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.319732 1556 consensus_queue.cc:260] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.320334 1556 ts_tablet_manager.cc:1428] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:05:57.320665 1556 tablet_bootstrap.cc:492] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.320654 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d10d83c1c2754cc2b108f2adc4e208cb" } new_table_name: "default.Table_f775f6645d8543308d977cc3519302b7" modify_external_catalogs: true
I20260927 15:05:57.322381 1556 tablet_bootstrap.cc:654] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:05:57.323449 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ddd6f86b89744419bea8584de27933c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.325250 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ada5178a90b497aa086286bd1d15601 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:05:57.325829 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc82ae0788b94be68a26ad903bf087fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.332792 1556 tablet_bootstrap.cc:492] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.332940 1556 ts_tablet_manager.cc:1397] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260927 15:05:57.333058 1562 tablet_replica.cc:330] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:57.333285 1562 raft_consensus.cc:2229] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.333506 1562 raft_consensus.cc:2258] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.333860 1556 raft_consensus.cc:348] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.334076 1556 raft_consensus.cc:374] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.334174 1556 raft_consensus.cc:729] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.334597 1562 ts_tablet_manager.cc:1905] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.337131 1556 consensus_queue.cc:260] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.337689 1556 ts_tablet_manager.cc:1428] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:05:57.337931 1556 tablet_bootstrap.cc:492] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.342357 1556 tablet_bootstrap.cc:654] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.344698 1561 tablet_bootstrap.cc:492] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.344949 1561 ts_tablet_manager.cc:1397] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.001s
W20260927 15:05:57.345651 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0781c9c8b4ad498bb27573939b7d06b2 consensus state has no leader
I20260927 15:05:57.347622 1561 raft_consensus.cc:348] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.347970 1561 raft_consensus.cc:374] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.348124 1561 raft_consensus.cc:729] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.348429 1561 consensus_queue.cc:260] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.350162 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1281d82fca13492ca9d09e032408682d" } new_table_name: "default.Table_527ff90f92e14e9cb2bb7053c760f6ba" modify_external_catalogs: true
I20260927 15:05:57.351218 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_607ad366580d4bd58b8879b581554873"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.351732 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_607ad366580d4bd58b8879b581554873 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.351966 1556 tablet_bootstrap.cc:492] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.352090 1556 ts_tablet_manager.cc:1397] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20260927 15:05:57.352686 1556 raft_consensus.cc:348] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.352892 1556 raft_consensus.cc:374] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.352955 1556 raft_consensus.cc:729] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.353159 1556 consensus_queue.cc:260] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.353232 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 570a0ee2154d4aca9dbaa2f5057def9d with delete_type TABLET_DATA_DELETED (replaced by tablet 0781c9c8b4ad498bb27573939b7d06b2) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.353531 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 3663d8a6672c4a9ca5c05a48700c6128 with delete_type TABLET_DATA_DELETED (replaced by tablet d6925d0369524e7eb1ac3c20ad699ded) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.353701 1561 ts_tablet_manager.cc:1428] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260927 15:05:57.353826 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a30cef3b4c2436c8c222f35b244fd06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.354045 1561 tablet_bootstrap.cc:492] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:57.355875 1561 tablet_bootstrap.cc:654] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.356273 1556 ts_tablet_manager.cc:1428] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:05:57.356549 1556 tablet_bootstrap.cc:492] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.357506 1562 ts_tablet_manager.cc:1918] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.357640 1562 log.cc:1196] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/1ada5178a90b497aa086286bd1d15601
I20260927 15:05:57.358026 1562 ts_tablet_manager.cc:1939] T 1ada5178a90b497aa086286bd1d15601 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:57.358469 1556 tablet_bootstrap.cc:654] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.362071 1592 raft_consensus.cc:482] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:57.362268 1592 raft_consensus.cc:504] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.363142 1592 leader_election.cc:288] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:57.363626 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538516912cf14ebfb0bfb31f706b66fc" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:57.363976 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538516912cf14ebfb0bfb31f706b66fc" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:57.364341 1562 tablet_replica.cc:330] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:05:57.364423 1374 leader_election.cc:341] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:57.364517 1562 raft_consensus.cc:2229] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.364681 1562 raft_consensus.cc:2258] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:05:57.364650 1376 leader_election.cc:341] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:57.364799 1376 leader_election.cc:302] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:05:57.364926 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 1ada5178a90b497aa086286bd1d15601 (table default.Table_fc5fdb39096646f1b45f6bbfa57a8133 [id=ba1ee00f53164d94be57db428fb14125]) successfully deleted
I20260927 15:05:57.365615 1592 raft_consensus.cc:2726] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:05:57.365736 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67ad68a0adad407a92b2335f43e67227 consensus state has no leader
I20260927 15:05:57.365833 1562 ts_tablet_manager.cc:1905] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.368126 906 catalog_manager.cc:5495] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:05:57.369032 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_4ef6d246ade74cb2a1bb687c6fd287c0 [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 3 got 0
I20260927 15:05:57.369334 1556 tablet_bootstrap.cc:492] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.369470 1556 ts_tablet_manager.cc:1397] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260927 15:05:57.370337 1556 raft_consensus.cc:348] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.370548 1556 raft_consensus.cc:374] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.370652 1556 raft_consensus.cc:729] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.370965 1556 consensus_queue.cc:260] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.371529 1556 ts_tablet_manager.cc:1428] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:05:57.371800 1556 tablet_bootstrap.cc:492] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.373943 1556 tablet_bootstrap.cc:654] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:05:57.375311 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61339e532e6c431babb15422a08f7aa6 consensus state has no leader
I20260927 15:05:57.376755 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_16724ccc8d1c4311a5e47f148a6148d3" } modify_external_catalogs: true
I20260927 15:05:57.376951 1556 tablet_bootstrap.cc:492] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.376962 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_16724ccc8d1c4311a5e47f148a6148d3" } modify_external_catalogs: true
I20260927 15:05:57.377108 1556 ts_tablet_manager.cc:1397] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260927 15:05:57.377800 1556 raft_consensus.cc:348] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.378135 1561 tablet_bootstrap.cc:492] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.378305 1561 ts_tablet_manager.cc:1397] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.003s
I20260927 15:05:57.378019 1556 raft_consensus.cc:374] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.378604 1556 raft_consensus.cc:729] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.378908 1556 consensus_queue.cc:260] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.379388 1561 raft_consensus.cc:348] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.379657 1561 raft_consensus.cc:374] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.379806 1561 raft_consensus.cc:729] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.379894 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 7a42ae7589c24b1bbd833ab8838521ae (DEFAULT_TABLE table=default.Table_590e6d5e78b5436fa3687cf0b70e1921 [id=f8681c26dbe446b19c269790f5078b22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.380278 1556 ts_tablet_manager.cc:1428] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:05:57.380282 1561 consensus_queue.cc:260] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.380415 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a42ae7589c24b1bbd833ab8838521ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.380563 1556 tablet_bootstrap.cc:492] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.382118 1556 tablet_bootstrap.cc:654] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.382944 1561 ts_tablet_manager.cc:1428] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:05:57.385254 1556 tablet_bootstrap.cc:492] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.385354 1561 tablet_bootstrap.cc:492] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:57.385375 1556 ts_tablet_manager.cc:1397] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260927 15:05:57.386081 1556 raft_consensus.cc:348] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.386264 1556 raft_consensus.cc:374] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.386343 1556 raft_consensus.cc:729] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.386602 1556 consensus_queue.cc:260] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.387200 1556 ts_tablet_manager.cc:1428] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:05:57.387488 1556 tablet_bootstrap.cc:492] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.387506 1561 tablet_bootstrap.cc:654] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.391845 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 538516912cf14ebfb0bfb31f706b66fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.383011 1562 ts_tablet_manager.cc:1918] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.394394 1562 log.cc:1196] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/570a0ee2154d4aca9dbaa2f5057def9d
I20260927 15:05:57.394788 1562 ts_tablet_manager.cc:1939] T 570a0ee2154d4aca9dbaa2f5057def9d P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:57.394784 914 master_service.cc:946] ReplaceTablet: received request to replace tablet e0db1654ced542938487126a0a09ed74 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.395249 1556 tablet_bootstrap.cc:654] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:05:57.395232 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 34822e9f900f4d04b59b810d59e6aa49 (table default.Table_f7ff3654808747e7a0a788d21ab84691 [id=5c4f0f47acd14538b67f8c8d579b0696], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 34822e9f900f4d04b59b810d59e6aa49 consensus state has no leader
I20260927 15:05:57.397387 1562 tablet_replica.cc:330] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:57.397662 1562 raft_consensus.cc:2229] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.397837 1562 raft_consensus.cc:2258] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.397845 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 7a42ae7589c24b1bbd833ab8838521ae (DEFAULT_TABLE table=default.Table_590e6d5e78b5436fa3687cf0b70e1921 [id=f8681c26dbe446b19c269790f5078b22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.397950 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 570a0ee2154d4aca9dbaa2f5057def9d (table default.Table_7dea1c0fd30f48aeaa1dcd32925c05d0 [id=f301a482365b4cf2b752fccd860a8d2d]) successfully deleted
I20260927 15:05:57.398280 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a42ae7589c24b1bbd833ab8838521ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.401816 1556 tablet_bootstrap.cc:492] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.401983 1556 ts_tablet_manager.cc:1397] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.007s
I20260927 15:05:57.402232 1561 tablet_bootstrap.cc:492] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.402376 1561 ts_tablet_manager.cc:1397] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260927 15:05:57.402709 1556 raft_consensus.cc:348] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.402992 1556 raft_consensus.cc:374] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.403077 1556 raft_consensus.cc:729] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.403151 1561 raft_consensus.cc:348] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.403366 1561 raft_consensus.cc:374] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.403469 1561 raft_consensus.cc:729] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.403366 1556 consensus_queue.cc:260] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.403715 1561 consensus_queue.cc:260] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.404986 1556 ts_tablet_manager.cc:1428] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:05:57.405284 1556 tablet_bootstrap.cc:492] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.405328 1561 ts_tablet_manager.cc:1428] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:05:57.405606 1561 tablet_bootstrap.cc:492] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:57.406795 1556 tablet_bootstrap.cc:654] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.406811 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_e6b64fb416dd492caadccd2e9d65a802 [id=b1106aee6c804da4a603364cee1c1116]). Expected version 2 got 0
I20260927 15:05:57.407245 1562 ts_tablet_manager.cc:1905] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.410405 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_e6b64fb416dd492caadccd2e9d65a802 [id=b1106aee6c804da4a603364cee1c1116]). Expected version 2 got 0
I20260927 15:05:57.413221 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 7a42ae7589c24b1bbd833ab8838521ae (DEFAULT_TABLE table=default.Table_590e6d5e78b5436fa3687cf0b70e1921 [id=f8681c26dbe446b19c269790f5078b22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.413689 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a42ae7589c24b1bbd833ab8838521ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.414510 1138 tablet_service.cc:1467] Processing CreateTablet for tablet bbcffb8cedd74b18871988201f9db2e5 (DEFAULT_TABLE table=default.Table_bd1398c934c0418eba63a6b9c0646259 [id=83855eb214b1496297178563cb7eb2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.414608 1556 tablet_bootstrap.cc:492] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.414740 1556 ts_tablet_manager.cc:1397] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20260927 15:05:57.414963 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbcffb8cedd74b18871988201f9db2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.415131 1561 tablet_bootstrap.cc:654] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.415522 1556 raft_consensus.cc:348] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.415729 1556 raft_consensus.cc:374] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.415825 1556 raft_consensus.cc:729] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.416050 1556 consensus_queue.cc:260] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.416569 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_762e4939259748a28b16279e147a5ada" } modify_external_catalogs: true
I20260927 15:05:57.416700 1556 ts_tablet_manager.cc:1428] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:05:57.416769 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_762e4939259748a28b16279e147a5ada" } modify_external_catalogs: true
I20260927 15:05:57.416930 1556 tablet_bootstrap.cc:492] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.417900 1417 tablet_service.cc:1467] Processing CreateTablet for tablet bb90faccda0145a7acd153fcd51b4c43 (DEFAULT_TABLE table=default.Table_44ec3dd510cd451a84cf5b0e73fc492d [id=0c63f8578de5475582ff54870c14d14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.418370 1142 tablet_service.cc:1467] Processing CreateTablet for tablet bb90faccda0145a7acd153fcd51b4c43 (DEFAULT_TABLE table=default.Table_44ec3dd510cd451a84cf5b0e73fc492d [id=0c63f8578de5475582ff54870c14d14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.418748 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb90faccda0145a7acd153fcd51b4c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.418700 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_46da6881be584d4982a6cdafe3fb1c31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.419309 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46da6881be584d4982a6cdafe3fb1c31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.419293 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 46ee85688df04e92accdedb6625406c1 (DEFAULT_TABLE table=default.Table_aa240acd8d584ffbaf06939b83935899 [id=31cb67e2dcb54a029ecdc3457b6139c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.421454 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 148c77a0e88b40f690ca96f091b78d9a (DEFAULT_TABLE table=default.Table_d80d3405cea240ec87396ab494d2d04d [id=c4ddc66927a94fd2abc8e44012cf69f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.421499 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_44ec3dd510cd451a84cf5b0e73fc492d" } modify_external_catalogs: true
I20260927 15:05:57.421690 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_44ec3dd510cd451a84cf5b0e73fc492d" } modify_external_catalogs: true
I20260927 15:05:57.422119 1419 tablet_service.cc:1467] Processing CreateTablet for tablet bbcffb8cedd74b18871988201f9db2e5 (DEFAULT_TABLE table=default.Table_bd1398c934c0418eba63a6b9c0646259 [id=83855eb214b1496297178563cb7eb2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.422006 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 46ee85688df04e92accdedb6625406c1 (DEFAULT_TABLE table=default.Table_aa240acd8d584ffbaf06939b83935899 [id=31cb67e2dcb54a029ecdc3457b6139c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.422926 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 148c77a0e88b40f690ca96f091b78d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.423199 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ee85688df04e92accdedb6625406c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.427007 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbcffb8cedd74b18871988201f9db2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.427433 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 148c77a0e88b40f690ca96f091b78d9a (DEFAULT_TABLE table=default.Table_d80d3405cea240ec87396ab494d2d04d [id=c4ddc66927a94fd2abc8e44012cf69f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.427644 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 34822e9f900f4d04b59b810d59e6aa49 (DEFAULT_TABLE table=default.Table_f7ff3654808747e7a0a788d21ab84691 [id=5c4f0f47acd14538b67f8c8d579b0696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.430922 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ee85688df04e92accdedb6625406c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.432339 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb90faccda0145a7acd153fcd51b4c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.432286 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_67c327241b1843eb973938ae7ac1d0b7" } modify_external_catalogs: true
I20260927 15:05:57.432461 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_67c327241b1843eb973938ae7ac1d0b7" } modify_external_catalogs: true
I20260927 15:05:57.432716 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34822e9f900f4d04b59b810d59e6aa49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.432974 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 148c77a0e88b40f690ca96f091b78d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.439262 1562 ts_tablet_manager.cc:1918] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.440382 1562 log.cc:1196] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/3663d8a6672c4a9ca5c05a48700c6128
I20260927 15:05:57.440562 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e0db1654ced542938487126a0a09ed74
I20260927 15:05:57.440521 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 34822e9f900f4d04b59b810d59e6aa49 (DEFAULT_TABLE table=default.Table_f7ff3654808747e7a0a788d21ab84691 [id=5c4f0f47acd14538b67f8c8d579b0696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.440762 1562 ts_tablet_manager.cc:1939] T 3663d8a6672c4a9ca5c05a48700c6128 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:57.441038 913 catalog_manager.cc:6565] ReplaceTablet: tablet e0db1654ced542938487126a0a09ed74 deleted and replaced by tablet 141710f64f9142058530f95df2eb9ee2
I20260927 15:05:57.441829 1562 tablet_replica.cc:330] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:57.441991 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34822e9f900f4d04b59b810d59e6aa49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.442066 1562 raft_consensus.cc:2229] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.442606 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet baafd4f49c7543018f87f5ad81d43a6c
I20260927 15:05:57.442730 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet e0db1654ced542938487126a0a09ed74 with delete_type TABLET_DATA_DELETED (replaced by tablet 141710f64f9142058530f95df2eb9ee2) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.443060 910 catalog_manager.cc:6565] ReplaceTablet: tablet baafd4f49c7543018f87f5ad81d43a6c deleted and replaced by tablet 2a2da04964ce40328c9749755c6f2fac
W20260927 15:05:57.444104 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e0db1654ced542938487126a0a09ed74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e0db1654ced542938487126a0a09ed74 already in progress: creating tablet
I20260927 15:05:57.445207 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 3663d8a6672c4a9ca5c05a48700c6128 (table default.Table_1168b8b224f14d868316d417ab56fef1 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
I20260927 15:05:57.445775 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e188f28304604cf2a96a606811900ca5
W20260927 15:05:57.449904 804 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu pid 812: Timed out: CheckLeaks RPC to 127.0.201.62:41167 timed out after 1.000s (SENT)
I20260927 15:05:57.450199 804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu with pid 812
I20260927 15:05:57.452684 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet e188f28304604cf2a96a606811900ca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.452852 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet baafd4f49c7543018f87f5ad81d43a6c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a2da04964ce40328c9749755c6f2fac) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.453189 1559 tablet_replica.cc:330] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:57.453404 1559 raft_consensus.cc:2229] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.453593 1559 raft_consensus.cc:2258] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.454135 1559 ts_tablet_manager.cc:1905] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.454322 1556 tablet_bootstrap.cc:654] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.446771 1562 raft_consensus.cc:2258] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:05:57.455148 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e188f28304604cf2a96a606811900ca5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e188f28304604cf2a96a606811900ca5 already in progress: creating tablet
I20260927 15:05:57.447245 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet baafd4f49c7543018f87f5ad81d43a6c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a2da04964ce40328c9749755c6f2fac) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.447741 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet e188f28304604cf2a96a606811900ca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.456360 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet e0db1654ced542938487126a0a09ed74 with delete_type TABLET_DATA_DELETED (replaced by tablet 141710f64f9142058530f95df2eb9ee2) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.458016 1562 ts_tablet_manager.cc:1905] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.458129 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bb90faccda0145a7acd153fcd51b4c43
I20260927 15:05:57.464030 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet bb90faccda0145a7acd153fcd51b4c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.449617 1566 raft_consensus.cc:482] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:57.465870 1562 ts_tablet_manager.cc:1918] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.466007 1562 log.cc:1196] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/3a30cef3b4c2436c8c222f35b244fd06
I20260927 15:05:57.464951 1566 raft_consensus.cc:504] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.466385 1562 ts_tablet_manager.cc:1939] T 3a30cef3b4c2436c8c222f35b244fd06 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:57.467319 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 3a30cef3b4c2436c8c222f35b244fd06 (table default.Table_817637f69c9a40eda1a54ec015d7cb32 [id=7f0fdeabadf2411196e949e581b7337c]) successfully deleted
I20260927 15:05:57.467602 1562 tablet_replica.cc:330] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:57.467787 1562 raft_consensus.cc:2229] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.467926 1562 raft_consensus.cc:2258] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.469638 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 46ee85688df04e92accdedb6625406c1 (DEFAULT_TABLE table=default.Table_aa240acd8d584ffbaf06939b83935899 [id=31cb67e2dcb54a029ecdc3457b6139c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.470691 911 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 141710f64f9142058530f95df2eb9ee2
I20260927 15:05:57.470237 1279 tablet_service.cc:1467] Processing CreateTablet for tablet bb90faccda0145a7acd153fcd51b4c43 (DEFAULT_TABLE table=default.Table_44ec3dd510cd451a84cf5b0e73fc492d [id=0c63f8578de5475582ff54870c14d14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.471176 908 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 2a2da04964ce40328c9749755c6f2fac
I20260927 15:05:57.471877 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet e188f28304604cf2a96a606811900ca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.472425 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 34822e9f900f4d04b59b810d59e6aa49 (DEFAULT_TABLE table=default.Table_f7ff3654808747e7a0a788d21ab84691 [id=5c4f0f47acd14538b67f8c8d579b0696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.472826 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet e0db1654ced542938487126a0a09ed74 with delete_type TABLET_DATA_DELETED (replaced by tablet 141710f64f9142058530f95df2eb9ee2) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.476890 1566 leader_election.cc:288] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:57.481142 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ee85688df04e92accdedb6625406c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.482900 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 148c77a0e88b40f690ca96f091b78d9a (DEFAULT_TABLE table=default.Table_d80d3405cea240ec87396ab494d2d04d [id=c4ddc66927a94fd2abc8e44012cf69f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.483278 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 148c77a0e88b40f690ca96f091b78d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.483968 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 61339e532e6c431babb15422a08f7aa6 (table default.Table_527ff90f92e14e9cb2bb7053c760f6ba [id=48ac6a07f3ca402aa8396ac2a1874134]). Expected version 2 got 0
I20260927 15:05:57.484256 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 0781c9c8b4ad498bb27573939b7d06b2 (table default.Table_7dea1c0fd30f48aeaa1dcd32925c05d0 [id=f301a482365b4cf2b752fccd860a8d2d]). Expected version 2 got 0
I20260927 15:05:57.484421 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_e6b64fb416dd492caadccd2e9d65a802 [id=b1106aee6c804da4a603364cee1c1116]). Expected version 2 got 0
I20260927 15:05:57.484608 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet ac3b1d765caf40a1a7593cdb19defcab (table default.Table_452367b3f3384a36aefc6823e7ab7ec2 [id=6368f21af56d44f09f5cf1ec2d19f2b6]). Expected version 1 got 0
I20260927 15:05:57.486512 1559 ts_tablet_manager.cc:1918] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.486642 1559 log.cc:1196] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/baafd4f49c7543018f87f5ad81d43a6c
I20260927 15:05:57.486922 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet bb90faccda0145a7acd153fcd51b4c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.487095 1559 ts_tablet_manager.cc:1939] T baafd4f49c7543018f87f5ad81d43a6c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:57.487162 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet baafd4f49c7543018f87f5ad81d43a6c with delete_type TABLET_DATA_DELETED (replaced by tablet 2a2da04964ce40328c9749755c6f2fac) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.487818 1560 tablet_replica.cc:330] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:57.488039 1560 raft_consensus.cc:2229] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.488240 1560 raft_consensus.cc:2258] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.488266 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 12623e6767aa4bd4934058f7314a966e (DEFAULT_TABLE table=default.Table_0a79a692b8e3421fbbf6fd4feedf0efa [id=7016faef9bb8460288ace088e5995265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.488751 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12623e6767aa4bd4934058f7314a966e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.488860 1560 ts_tablet_manager.cc:1905] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.488583 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet bb90faccda0145a7acd153fcd51b4c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.493216 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb90faccda0145a7acd153fcd51b4c43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.494680 1561 tablet_bootstrap.cc:492] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.494812 1561 ts_tablet_manager.cc:1397] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.089s user 0.010s sys 0.008s
I20260927 15:05:57.495718 1561 raft_consensus.cc:348] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.496037 1561 raft_consensus.cc:374] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.496129 1561 raft_consensus.cc:729] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.496366 1561 consensus_queue.cc:260] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.498515 1561 ts_tablet_manager.cc:1428] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260927 15:05:57.498768 1561 tablet_bootstrap.cc:492] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:57.499805 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34822e9f900f4d04b59b810d59e6aa49. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.500032 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bb90faccda0145a7acd153fcd51b4c43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb90faccda0145a7acd153fcd51b4c43 already in progress: creating tablet
I20260927 15:05:57.500381 1561 tablet_bootstrap.cc:654] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.501891 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 (DEFAULT_TABLE table=default.Table_607ad366580d4bd58b8879b581554873 [id=22e6dc77a3c3419aa3e7034a48773f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.502302 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cf0ef42c0944b049a8ce68531ed8e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.502274 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 604c05acf3864fc697758208de68da18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.502609 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e4e18e695f54d85b25958330717c713 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c7a8bf15c48423ea9ff14c46645a33b) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.503389 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a30cef3b4c2436c8c222f35b244fd06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.503753 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 8966721a788d4e64ad5e495b5a69b74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.504154 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 43552776a19a4e75aa2d6f3d983e3432 with delete_type TABLET_DATA_DELETED (replaced by tablet 34822e9f900f4d04b59b810d59e6aa49) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.505122 1560 ts_tablet_manager.cc:1918] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.505097 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 443af328e5154bdba9b570224616d77b (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.505471 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 443af328e5154bdba9b570224616d77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.505503 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8d33202ebc4e37b598d62d66472f31 (DEFAULT_TABLE table=default.Table_dc82ae0788b94be68a26ad903bf087fb [id=26cdf96fac4b455faf5607f72aa6f2f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.505797 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8d33202ebc4e37b598d62d66472f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.507871 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 (DEFAULT_TABLE table=default.Table_607ad366580d4bd58b8879b581554873 [id=22e6dc77a3c3419aa3e7034a48773f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.508220 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cf0ef42c0944b049a8ce68531ed8e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.511268 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 538516912cf14ebfb0bfb31f706b66fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.511802 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dbc92fad9bf44fd290587f43f3cd1f81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.511950 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 8af844423fc94e2c8380db179103d3aa (DEFAULT_TABLE table=default.Table_b348546f2c5f4f81927be221d3b5019f [id=8dbd285d921c4a44926c443a601add72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.512017 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0cf38c5a77d943628b2d20226904801d" } modify_external_catalogs: true
I20260927 15:05:57.512194 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0cf38c5a77d943628b2d20226904801d" } modify_external_catalogs: true
I20260927 15:05:57.512313 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8af844423fc94e2c8380db179103d3aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.512367 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbc92fad9bf44fd290587f43f3cd1f81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.513108 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 12623e6767aa4bd4934058f7314a966e (DEFAULT_TABLE table=default.Table_0a79a692b8e3421fbbf6fd4feedf0efa [id=7016faef9bb8460288ace088e5995265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.513540 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12623e6767aa4bd4934058f7314a966e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.513456 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 8af844423fc94e2c8380db179103d3aa (DEFAULT_TABLE table=default.Table_b348546f2c5f4f81927be221d3b5019f [id=8dbd285d921c4a44926c443a601add72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.513832 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8af844423fc94e2c8380db179103d3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.515120 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_de263f6e08ac4eed8c0d53662d9a8b00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.515699 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de263f6e08ac4eed8c0d53662d9a8b00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.517052 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 443af328e5154bdba9b570224616d77b (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.517073 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.517431 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 443af328e5154bdba9b570224616d77b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.517576 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.517649 1562 ts_tablet_manager.cc:1905] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.518579 1559 tablet_replica.cc:330] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:57.518777 1559 raft_consensus.cc:2229] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.518980 1559 raft_consensus.cc:2258] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.518886 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7dea1c0fd30f48aeaa1dcd32925c05d0" } new_table_name: "default.Table_81479ddeb1b6463cab4db3d03d955a91" modify_external_catalogs: true
I20260927 15:05:57.519691 1559 ts_tablet_manager.cc:1905] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.523866 1592 raft_consensus.cc:482] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:57.524020 1592 raft_consensus.cc:504] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.524617 1592 leader_election.cc:288] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
W20260927 15:05:57.526279 1374 leader_election.cc:341] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 3a30cef3b4c2436c8c222f35b244fd06
I20260927 15:05:57.529379 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 8f15485b8825436184abe2621c71e356 (DEFAULT_TABLE table=default.Table_5e28b5f6c5ec4348b3709ee9a861a2b3 [id=c2f5f4026b514c7e978c0b30f7a359ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.532897 913 master_service.cc:946] ReplaceTablet: received request to replace tablet b122f1436fde4c5da7f0afa3a1c24c70 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.533253 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 3e4e18e695f54d85b25958330717c713 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.534788 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_515ca01252504bd092991cc33a48fca0" } new_table_name: "default.Table_4951c5b770cf4f529ec4a1112cc69f1c" modify_external_catalogs: true
I20260927 15:05:57.536158 1592 raft_consensus.cc:482] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:05:57.536350 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e188f28304604cf2a96a606811900ca5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e188f28304604cf2a96a606811900ca5 already in progress: creating tablet
I20260927 15:05:57.536305 1592 raft_consensus.cc:504] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:57.536721 901 catalog_manager.cc:4808] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bb90faccda0145a7acd153fcd51b4c43 because the tablet was not found. No further retry: Not found: Tablet not found: bb90faccda0145a7acd153fcd51b4c43
I20260927 15:05:57.536921 1592 leader_election.cc:288] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
W20260927 15:05:57.537863 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0781c9c8b4ad498bb27573939b7d06b2 consensus state has no leader
I20260927 15:05:57.538268 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8d33202ebc4e37b598d62d66472f31 (DEFAULT_TABLE table=default.Table_dc82ae0788b94be68a26ad903bf087fb [id=26cdf96fac4b455faf5607f72aa6f2f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.538652 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8d33202ebc4e37b598d62d66472f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.542413 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61339e532e6c431babb15422a08f7aa6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:57.542634 1166 raft_consensus.cc:2454] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:05:57.543087 1374 leader_election.cc:302] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:57.543323 1592 raft_consensus.cc:2781] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:57.543432 1592 raft_consensus.cc:482] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:57.543524 1592 raft_consensus.cc:3037] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:05:57.545271 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89bd5b459caa42e7a9153d9273ad52c4 consensus state has no leader
I20260927 15:05:57.545526 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 8f15485b8825436184abe2621c71e356 (DEFAULT_TABLE table=default.Table_5e28b5f6c5ec4348b3709ee9a861a2b3 [id=c2f5f4026b514c7e978c0b30f7a359ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.545992 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f15485b8825436184abe2621c71e356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.546132 1592 raft_consensus.cc:504] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.547066 1592 leader_election.cc:288] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:57.517717 1552 tablet_bootstrap.cc:492] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:57.525476 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a30cef3b4c2436c8c222f35b244fd06" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:57.547752 1560 log.cc:1196] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/baafd4f49c7543018f87f5ad81d43a6c
I20260927 15:05:57.547806 1552 ts_tablet_manager.cc:1397] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.374s user 0.064s sys 0.085s
I20260927 15:05:57.535923 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 8f15485b8825436184abe2621c71e356 (DEFAULT_TABLE table=default.Table_5e28b5f6c5ec4348b3709ee9a861a2b3 [id=c2f5f4026b514c7e978c0b30f7a359ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.548213 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f15485b8825436184abe2621c71e356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.548732 1552 raft_consensus.cc:348] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.548946 1552 raft_consensus.cc:374] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.549057 1552 raft_consensus.cc:729] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.549271 1552 consensus_queue.cc:260] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.549829 1552 ts_tablet_manager.cc:1428] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:05:57.550133 1552 tablet_bootstrap.cc:492] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:05:57.551389 1376 leader_election.cc:341] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:57.551523 1376 leader_election.cc:302] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:05:57.552708 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_738223121ff44cda97e408a6b77e0c98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.553289 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_738223121ff44cda97e408a6b77e0c98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.554970 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5e28b5f6c5ec4348b3709ee9a861a2b3" } new_table_name: "default.Table_a0201a60665941a48eabe2de029dcfa4" modify_external_catalogs: true
I20260927 15:05:57.556509 1305 raft_consensus.cc:1261] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Refusing update from remote peer fabb59e74b7d48fa9be047d7f4c4cc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:57.557885 1593 raft_consensus.cc:2726] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:57.558085 1593 consensus_queue.cc:1035] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:05:57.558436 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 61339e532e6c431babb15422a08f7aa6 (table default.Table_527ff90f92e14e9cb2bb7053c760f6ba [id=48ac6a07f3ca402aa8396ac2a1874134]). Expected version 2 got 0
I20260927 15:05:57.561800 1418 tablet_service.cc:1467] Processing CreateTablet for tablet ba7faf6e79db420db13999d74fe86062 (DEFAULT_TABLE table=default.Table_46da6881be584d4982a6cdafe3fb1c31 [id=f2c85989a55c4f62bb100381a5d68dce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.562204 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba7faf6e79db420db13999d74fe86062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.562516 1552 tablet_bootstrap.cc:654] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.563532 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4c2f5acb6ff14350bb338fbee9de848a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.563732 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bf2c59d22fa84330870ea9f394bcc27b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.563874 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_303dfd972edc4c4db55b80e20fd076c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.564065 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c2f5acb6ff14350bb338fbee9de848a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:57.564275 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf2c59d22fa84330870ea9f394bcc27b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:57.564308 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_303dfd972edc4c4db55b80e20fd076c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.535878 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 (DEFAULT_TABLE table=default.Table_607ad366580d4bd58b8879b581554873 [id=22e6dc77a3c3419aa3e7034a48773f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.536544 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 12623e6767aa4bd4934058f7314a966e (DEFAULT_TABLE table=default.Table_0a79a692b8e3421fbbf6fd4feedf0efa [id=7016faef9bb8460288ace088e5995265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.564985 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12623e6767aa4bd4934058f7314a966e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.565603 1486 heartbeater.cc:644] Failed to heartbeat to 127.0.201.62:41167 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.201.62:41167 timed out after 1.000s (SENT)
I20260927 15:05:57.565563 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1f61faf056bc40f6bda21f355e152927"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.566038 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f61faf056bc40f6bda21f355e152927 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:57.569298 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f15485b8825436184abe2621c71e356 consensus state has no leader
I20260927 15:05:57.537256 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8d33202ebc4e37b598d62d66472f31 (DEFAULT_TABLE table=default.Table_dc82ae0788b94be68a26ad903bf087fb [id=26cdf96fac4b455faf5607f72aa6f2f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.537535 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61339e532e6c431babb15422a08f7aa6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:57.538018 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 443af328e5154bdba9b570224616d77b (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.570770 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a8d33202ebc4e37b598d62d66472f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.538345 1283 tablet_service.cc:1467] Processing CreateTablet for tablet bbcffb8cedd74b18871988201f9db2e5 (DEFAULT_TABLE table=default.Table_bd1398c934c0418eba63a6b9c0646259 [id=83855eb214b1496297178563cb7eb2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.541396 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 8af844423fc94e2c8380db179103d3aa (DEFAULT_TABLE table=default.Table_b348546f2c5f4f81927be221d3b5019f [id=8dbd285d921c4a44926c443a601add72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.547248 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61339e532e6c431babb15422a08f7aa6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:05:57.572332 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbcffb8cedd74b18871988201f9db2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.573390 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8af844423fc94e2c8380db179103d3aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.575227 1376 leader_election.cc:341] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:05:57.575557 1376 leader_election.cc:341] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:57.575767 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cf0ef42c0944b049a8ce68531ed8e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.576706 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b122f1436fde4c5da7f0afa3a1c24c70
I20260927 15:05:57.579051 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 443af328e5154bdba9b570224616d77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.580724 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet b122f1436fde4c5da7f0afa3a1c24c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.581200 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b348546f2c5f4f81927be221d3b5019f" } new_table_name: "default.Table_54aa4b63a0734bcca9d77b4a4c2a31c1" modify_external_catalogs: true
I20260927 15:05:57.581171 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d776eb9f204f4fc1b328b45d9bb2cf38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.581646 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4ef6d246ade74cb2a1bb687c6fd287c0" } new_table_name: "default.Table_1e3109e311ba4ef994545bcc1e76de92" modify_external_catalogs: true
W20260927 15:05:57.581702 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d776eb9f204f4fc1b328b45d9bb2cf38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.586501 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet b122f1436fde4c5da7f0afa3a1c24c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.588135 1278 tablet_service.cc:1467] Processing CreateTablet for tablet ba7faf6e79db420db13999d74fe86062 (DEFAULT_TABLE table=default.Table_46da6881be584d4982a6cdafe3fb1c31 [id=f2c85989a55c4f62bb100381a5d68dce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.588474 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba7faf6e79db420db13999d74fe86062. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.592005 1238 leader_election.cc:341] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: baafd4f49c7543018f87f5ad81d43a6c
I20260927 15:05:57.593312 1556 tablet_bootstrap.cc:492] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:57.593598 1556 ts_tablet_manager.cc:1397] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.177s user 0.007s sys 0.014s
I20260927 15:05:57.594039 1552 tablet_bootstrap.cc:492] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:57.594204 1552 ts_tablet_manager.cc:1397] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.005s
I20260927 15:05:57.548211 1560 ts_tablet_manager.cc:1939] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:05:57.594712 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8af844423fc94e2c8380db179103d3aa consensus state has no leader
I20260927 15:05:57.595132 1552 raft_consensus.cc:348] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.595165 1556 raft_consensus.cc:348] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.595376 1552 raft_consensus.cc:374] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.595464 1552 raft_consensus.cc:729] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.595715 1552 consensus_queue.cc:260] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.596261 1552 ts_tablet_manager.cc:1428] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:05:57.596287 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 570a0ee2154d4aca9dbaa2f5057def9d with delete_type TABLET_DATA_DELETED (replaced by tablet 0781c9c8b4ad498bb27573939b7d06b2) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.595532 1556 raft_consensus.cc:374] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.598956 1556 raft_consensus.cc:729] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.600056 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f15485b8825436184abe2621c71e356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.600203 1556 consensus_queue.cc:260] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.605490 1556 ts_tablet_manager.cc:1428] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260927 15:05:57.606258 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61339e532e6c431babb15422a08f7aa6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:05:57.606468 1166 raft_consensus.cc:3037] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:57.607122 1556 tablet_bootstrap.cc:492] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:57.608707 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 0d41d55fdb504b95921f46e7aed99ac1 (DEFAULT_TABLE table=default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4 [id=1f37615c984042b9a2f7cfec93acd7ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.609086 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d41d55fdb504b95921f46e7aed99ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.610457 1556 tablet_bootstrap.cc:654] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.610651 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet b122f1436fde4c5da7f0afa3a1c24c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.611380 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 (DEFAULT_TABLE table=default.Table_dbc92fad9bf44fd290587f43f3cd1f81 [id=64ae6d29aaaf4705896336b4faa6eb13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.606173 1165 raft_consensus.cc:1261] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Refusing update from remote peer fabb59e74b7d48fa9be047d7f4c4cc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:57.612257 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.614045 1592 consensus_queue.cc:1035] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:05:57.615777 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 (DEFAULT_TABLE table=default.Table_dbc92fad9bf44fd290587f43f3cd1f81 [id=64ae6d29aaaf4705896336b4faa6eb13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.616117 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.616433 1137 tablet_service.cc:1467] Processing CreateTablet for tablet ba7faf6e79db420db13999d74fe86062 (DEFAULT_TABLE table=default.Table_46da6881be584d4982a6cdafe3fb1c31 [id=f2c85989a55c4f62bb100381a5d68dce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.622489 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 0d41d55fdb504b95921f46e7aed99ac1 (DEFAULT_TABLE table=default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4 [id=1f37615c984042b9a2f7cfec93acd7ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.622864 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d41d55fdb504b95921f46e7aed99ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.616899 1573 raft_consensus.cc:482] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:57.623458 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 0d41d55fdb504b95921f46e7aed99ac1 (DEFAULT_TABLE table=default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4 [id=1f37615c984042b9a2f7cfec93acd7ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.623912 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 (DEFAULT_TABLE table=default.Table_dbc92fad9bf44fd290587f43f3cd1f81 [id=64ae6d29aaaf4705896336b4faa6eb13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.626204 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet da8215167ad74dbfb2cc1c8d50a76ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.630004 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 7d6d1cfb1a4d4c439e970d966af841b6 (DEFAULT_TABLE table=default.Table_de263f6e08ac4eed8c0d53662d9a8b00 [id=1ff3964110d34f149e6c3c539a802ff3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.631451 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d6d1cfb1a4d4c439e970d966af841b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.646414 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 61339e532e6c431babb15422a08f7aa6 (table default.Table_527ff90f92e14e9cb2bb7053c760f6ba [id=48ac6a07f3ca402aa8396ac2a1874134]). Expected version 2 got 0
I20260927 15:05:57.647064 1573 raft_consensus.cc:504] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.625810 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 7d6d1cfb1a4d4c439e970d966af841b6 (DEFAULT_TABLE table=default.Table_de263f6e08ac4eed8c0d53662d9a8b00 [id=1ff3964110d34f149e6c3c539a802ff3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.648782 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_03bb30f056204c8fa3dc1c48f1eac472"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.649434 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03bb30f056204c8fa3dc1c48f1eac472 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.651261 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 377847d06b534883ba2b870ca3317fe0 (DEFAULT_TABLE table=default.Table_d776eb9f204f4fc1b328b45d9bb2cf38 [id=56574e770aa74f04a7bf24b7718e4960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.651930 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 377847d06b534883ba2b870ca3317fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.652724 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 377847d06b534883ba2b870ca3317fe0 (DEFAULT_TABLE table=default.Table_d776eb9f204f4fc1b328b45d9bb2cf38 [id=56574e770aa74f04a7bf24b7718e4960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.654309 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_de263f6e08ac4eed8c0d53662d9a8b00" } modify_external_catalogs: true
I20260927 15:05:57.654577 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_de263f6e08ac4eed8c0d53662d9a8b00" } modify_external_catalogs: true
W20260927 15:05:57.655076 1099 leader_election.cc:341] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: baafd4f49c7543018f87f5ad81d43a6c
I20260927 15:05:57.655082 1573 leader_election.cc:288] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:57.657056 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 377847d06b534883ba2b870ca3317fe0 (DEFAULT_TABLE table=default.Table_d776eb9f204f4fc1b328b45d9bb2cf38 [id=56574e770aa74f04a7bf24b7718e4960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.658416 1420 tablet_service.cc:1467] Processing CreateTablet for tablet a04caae16db84d8ea9050b648c1ba354 (DEFAULT_TABLE table=default.Table_1f61faf056bc40f6bda21f355e152927 [id=32293fa2bff246dba3dfe47a3fcaf310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.658785 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a04caae16db84d8ea9050b648c1ba354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.661913 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 27c3283a40f14eb4868767799cfdf7bd (DEFAULT_TABLE table=default.Table_4c2f5acb6ff14350bb338fbee9de848a [id=a9323db788294017b88166e1c7973f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.663563 1141 tablet_service.cc:1467] Processing CreateTablet for tablet a04caae16db84d8ea9050b648c1ba354 (DEFAULT_TABLE table=default.Table_1f61faf056bc40f6bda21f355e152927 [id=32293fa2bff246dba3dfe47a3fcaf310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.663730 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 4ead753ba6664829b1262712f35e64f2 (DEFAULT_TABLE table=default.Table_bf2c59d22fa84330870ea9f394bcc27b [id=5d06fdeffa7142fd8a456f64254ae011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.664096 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ead753ba6664829b1262712f35e64f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.665611 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_303dfd972edc4c4db55b80e20fd076c7" } modify_external_catalogs: true
I20260927 15:05:57.665920 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_303dfd972edc4c4db55b80e20fd076c7" } modify_external_catalogs: true
I20260927 15:05:57.671695 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 4ead753ba6664829b1262712f35e64f2 (DEFAULT_TABLE table=default.Table_bf2c59d22fa84330870ea9f394bcc27b [id=5d06fdeffa7142fd8a456f64254ae011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.672288 1134 tablet_service.cc:1467] Processing CreateTablet for tablet da1812142bb043fba7457dc61ffdb180 (DEFAULT_TABLE table=default.Table_738223121ff44cda97e408a6b77e0c98 [id=32958d4a1d2d4e048c864f783034e555]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.672542 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7d6d1cfb1a4d4c439e970d966af841b6
I20260927 15:05:57.676210 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_607ad366580d4bd58b8879b581554873" } modify_external_catalogs: true
I20260927 15:05:57.676329 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4" } modify_external_catalogs: true
I20260927 15:05:57.676456 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_607ad366580d4bd58b8879b581554873" } modify_external_catalogs: true
I20260927 15:05:57.676574 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4" } modify_external_catalogs: true
I20260927 15:05:57.679608 1276 tablet_service.cc:1467] Processing CreateTablet for tablet a04caae16db84d8ea9050b648c1ba354 (DEFAULT_TABLE table=default.Table_1f61faf056bc40f6bda21f355e152927 [id=32293fa2bff246dba3dfe47a3fcaf310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.681747 1417 tablet_service.cc:1467] Processing CreateTablet for tablet f2cce454e70640e2a67b3680676b1d93 (DEFAULT_TABLE table=default.Table_303dfd972edc4c4db55b80e20fd076c7 [id=a027a86bb6274c5d90e960eede3c398f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.682534 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2cce454e70640e2a67b3680676b1d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.683561 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f2cce454e70640e2a67b3680676b1d93
W20260927 15:05:57.684911 1351 heartbeater.cc:644] Failed to heartbeat to 127.0.201.62:41167 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.201.62:41167 timed out after 1.000s (SENT)
I20260927 15:05:57.685148 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 4ead753ba6664829b1262712f35e64f2 (DEFAULT_TABLE table=default.Table_bf2c59d22fa84330870ea9f394bcc27b [id=5d06fdeffa7142fd8a456f64254ae011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.685557 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet f2cce454e70640e2a67b3680676b1d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.685596 1284 tablet_service.cc:1467] Processing CreateTablet for tablet da1812142bb043fba7457dc61ffdb180 (DEFAULT_TABLE table=default.Table_738223121ff44cda97e408a6b77e0c98 [id=32958d4a1d2d4e048c864f783034e555]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.685935 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d6d1cfb1a4d4c439e970d966af841b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.686133 1414 tablet_service.cc:1467] Processing CreateTablet for tablet da1812142bb043fba7457dc61ffdb180 (DEFAULT_TABLE table=default.Table_738223121ff44cda97e408a6b77e0c98 [id=32958d4a1d2d4e048c864f783034e555]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.686492 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da1812142bb043fba7457dc61ffdb180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.686671 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 27c3283a40f14eb4868767799cfdf7bd (DEFAULT_TABLE table=default.Table_4c2f5acb6ff14350bb338fbee9de848a [id=a9323db788294017b88166e1c7973f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.686723 1282 tablet_service.cc:1467] Processing CreateTablet for tablet f2cce454e70640e2a67b3680676b1d93 (DEFAULT_TABLE table=default.Table_303dfd972edc4c4db55b80e20fd076c7 [id=a027a86bb6274c5d90e960eede3c398f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.688761 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet f2cce454e70640e2a67b3680676b1d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:05:57.689236 1212 heartbeater.cc:644] Failed to heartbeat to 127.0.201.62:41167 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.201.62:41167 timed out after 1.000s (SENT)
I20260927 15:05:57.690296 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6cf0ef42c0944b049a8ce68531ed8e45
I20260927 15:05:57.692462 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 27c3283a40f14eb4868767799cfdf7bd (DEFAULT_TABLE table=default.Table_4c2f5acb6ff14350bb338fbee9de848a [id=a9323db788294017b88166e1c7973f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.692888 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27c3283a40f14eb4868767799cfdf7bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.693682 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d6d1cfb1a4d4c439e970d966af841b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.694715 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet f2cce454e70640e2a67b3680676b1d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.695096 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d6d1cfb1a4d4c439e970d966af841b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.696475 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.697551 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.698163 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.696208 1133 tablet_service.cc:1467] Processing CreateTablet for tablet f2cce454e70640e2a67b3680676b1d93 (DEFAULT_TABLE table=default.Table_303dfd972edc4c4db55b80e20fd076c7 [id=a027a86bb6274c5d90e960eede3c398f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.703074 1562 ts_tablet_manager.cc:1918] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:05:57.715039 1102 leader_election.cc:341] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Not found: Tablet not found: baafd4f49c7543018f87f5ad81d43a6c
I20260927 15:05:57.716481 1623 mvcc.cc:205] Tried to move back new op lower bound from 7333976299656998912 to 7333976298406084608. Current Snapshot: MvccSnapshot[applied={T|T < 7333976299656998912}]
I20260927 15:05:57.721695 907 master_service.cc:946] ReplaceTablet: received request to replace tablet 30cf4db249154adda9406d5b07430a80 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.723708 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 714b110a24ca4f3bb8126034dc3e6407 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.726011 909 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_1e3109e311ba4ef994545bcc1e76de92 [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 4 got 0
I20260927 15:05:57.734460 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_07d37a615ac24b47bc3014690bc93569"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.735111 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07d37a615ac24b47bc3014690bc93569 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.737143 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0d41d55fdb504b95921f46e7aed99ac1
I20260927 15:05:57.738628 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d41d55fdb504b95921f46e7aed99ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.739140 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d41d55fdb504b95921f46e7aed99ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.739782 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_476502809f814797a2de6c54405d8c30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.740309 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_476502809f814797a2de6c54405d8c30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.740571 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f1b5de8ecfe842e69ba40febba9c6ee1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.741106 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1b5de8ecfe842e69ba40febba9c6ee1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.739789 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4c2f5acb6ff14350bb338fbee9de848a" } new_table_name: "default.Table_022be000410e4f27910ce026561af850" modify_external_catalogs: true
I20260927 15:05:57.742374 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 654d3210fd8c46b68880e544c39d5c88 (DEFAULT_TABLE table=default.Table_03bb30f056204c8fa3dc1c48f1eac472 [id=353280883f2c4a2d9b472e8ba529acd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.742515 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 654d3210fd8c46b68880e544c39d5c88 (DEFAULT_TABLE table=default.Table_03bb30f056204c8fa3dc1c48f1eac472 [id=353280883f2c4a2d9b472e8ba529acd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.742780 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 654d3210fd8c46b68880e544c39d5c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.743127 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 714b110a24ca4f3bb8126034dc3e6407
I20260927 15:05:57.743613 911 catalog_manager.cc:6565] ReplaceTablet: tablet 714b110a24ca4f3bb8126034dc3e6407 deleted and replaced by tablet bc971defe6d148439a6a0b8c55d9092e
I20260927 15:05:57.746958 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 714b110a24ca4f3bb8126034dc3e6407 with delete_type TABLET_DATA_DELETED (replaced by tablet bc971defe6d148439a6a0b8c55d9092e) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.747640 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 714b110a24ca4f3bb8126034dc3e6407 with delete_type TABLET_DATA_DELETED (replaced by tablet bc971defe6d148439a6a0b8c55d9092e) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.740310 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 30cf4db249154adda9406d5b07430a80
I20260927 15:05:57.748418 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet 714b110a24ca4f3bb8126034dc3e6407 with delete_type TABLET_DATA_DELETED (replaced by tablet bc971defe6d148439a6a0b8c55d9092e) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.748852 907 catalog_manager.cc:6565] ReplaceTablet: tablet 30cf4db249154adda9406d5b07430a80 deleted and replaced by tablet 0e6e3600cbf741419bc7b93eec42eb13
I20260927 15:05:57.749224 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 30cf4db249154adda9406d5b07430a80 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e6e3600cbf741419bc7b93eec42eb13) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.749436 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 30cf4db249154adda9406d5b07430a80 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e6e3600cbf741419bc7b93eec42eb13) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.758091 913 master_service.cc:946] ReplaceTablet: received request to replace tablet 148c77a0e88b40f690ca96f091b78d9a from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.759734 1561 tablet_bootstrap.cc:492] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.760031 1166 raft_consensus.cc:2454] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:05:57.760495 1374 leader_election.cc:302] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:57.760959 1593 raft_consensus.cc:2781] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:57.763247 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0a79a692b8e3421fbbf6fd4feedf0efa" } new_table_name: "default.Table_a6f0eb861ab04bcb8df0053049d90e1b" modify_external_catalogs: true
I20260927 15:05:57.763898 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d41d55fdb504b95921f46e7aed99ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.763958 1552 tablet_bootstrap.cc:492] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:05:57.765113 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 27c3283a40f14eb4868767799cfdf7bd consensus state has no leader
I20260927 15:05:57.765723 1552 tablet_bootstrap.cc:654] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.767903 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba7faf6e79db420db13999d74fe86062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.770700 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.771003 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a04caae16db84d8ea9050b648c1ba354. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.772485 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 12623e6767aa4bd4934058f7314a966e consensus state has no leader
I20260927 15:05:57.773932 1566 raft_consensus.cc:482] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:57.774132 1566 raft_consensus.cc:504] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:57.775743 1239 leader_election.cc:341] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 3a30cef3b4c2436c8c222f35b244fd06
I20260927 15:05:57.775672 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a30cef3b4c2436c8c222f35b244fd06" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:57.775947 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ead753ba6664829b1262712f35e64f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.776088 1440 raft_consensus.cc:2454] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:05:57.776683 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2cce454e70640e2a67b3680676b1d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.776746 1238 leader_election.cc:302] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: c4264874db964ff2830b7894c2b3d61c
I20260927 15:05:57.774770 1566 leader_election.cc:288] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:57.777582 1566 raft_consensus.cc:2781] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:57.777685 1566 raft_consensus.cc:482] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:57.777796 1566 raft_consensus.cc:3037] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:57.779816 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2cce454e70640e2a67b3680676b1d93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.781105 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a04caae16db84d8ea9050b648c1ba354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.781342 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ead753ba6664829b1262712f35e64f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.783121 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27c3283a40f14eb4868767799cfdf7bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.785391 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 377847d06b534883ba2b870ca3317fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.786589 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da1812142bb043fba7457dc61ffdb180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.788357 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27c3283a40f14eb4868767799cfdf7bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.790279 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 654d3210fd8c46b68880e544c39d5c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.793133 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da1812142bb043fba7457dc61ffdb180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.799010 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d6d1cfb1a4d4c439e970d966af841b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.799901 1566 raft_consensus.cc:504] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:57.801360 1239 leader_election.cc:341] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 3a30cef3b4c2436c8c222f35b244fd06
I20260927 15:05:57.806071 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b492b891412a427fa40ae10dddbefee5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.806232 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_aa240acd8d584ffbaf06939b83935899" } new_table_name: "default.Table_6cc665540fb24e17b9284fc911758626" modify_external_catalogs: true
W20260927 15:05:57.806706 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b492b891412a427fa40ae10dddbefee5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.807694 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4ae68d29ddc646a5b8ff7714ff60b1e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.808197 1552 tablet_bootstrap.cc:492] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
W20260927 15:05:57.808202 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ae68d29ddc646a5b8ff7714ff60b1e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.808333 1552 ts_tablet_manager.cc:1397] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.003s
I20260927 15:05:57.809077 1552 raft_consensus.cc:348] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.809327 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 377847d06b534883ba2b870ca3317fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.811447 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f0d39392c0384f6fb29e437921f8098b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.811967 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0d39392c0384f6fb29e437921f8098b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.814615 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a30cef3b4c2436c8c222f35b244fd06" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:05:57.814904 1440 raft_consensus.cc:3037] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:57.815574 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baafd4f49c7543018f87f5ad81d43a6c" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:57.815850 1164 raft_consensus.cc:2454] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:05:57.816109 1102 leader_election.cc:302] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:05:57.816444 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 101415us
I20260927 15:05:57.816771 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d41d55fdb504b95921f46e7aed99ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.816953 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 654d3210fd8c46b68880e544c39d5c88 (DEFAULT_TABLE table=default.Table_03bb30f056204c8fa3dc1c48f1eac472 [id=353280883f2c4a2d9b472e8ba529acd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.817416 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 654d3210fd8c46b68880e544c39d5c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.818311 1440 raft_consensus.cc:2454] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:05:57.818773 1238 leader_election.cc:302] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: c4264874db964ff2830b7894c2b3d61c
I20260927 15:05:57.819123 1632 raft_consensus.cc:2781] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:57.819736 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d31a5509d4d44df18a49c4c6db67ca9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.820355 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d31a5509d4d44df18a49c4c6db67ca9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.822762 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet 30cf4db249154adda9406d5b07430a80 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e6e3600cbf741419bc7b93eec42eb13) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.822969 1561 ts_tablet_manager.cc:1397] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.261s user 0.019s sys 0.057s
I20260927 15:05:57.823740 1561 raft_consensus.cc:348] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.823978 1561 raft_consensus.cc:374] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.824059 1561 raft_consensus.cc:729] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.824213 1566 leader_election.cc:288] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:57.824173 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e0637f13993b42ccb6ccf6fd2ac388f3" } modify_external_catalogs: true
I20260927 15:05:57.824272 1561 consensus_queue.cc:260] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.824364 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e0637f13993b42ccb6ccf6fd2ac388f3" } modify_external_catalogs: true
I20260927 15:05:57.824803 1561 ts_tablet_manager.cc:1428] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:05:57.824882 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_af607bdf84604e1d89e4b679360ed558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:57.825314 1573 raft_consensus.cc:2726] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:05:57.825397 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af607bdf84604e1d89e4b679360ed558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.826210 1239 leader_election.cc:302] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:05:57.826467 1239 raft_consensus.cc:2670] T baafd4f49c7543018f87f5ad81d43a6c P 4769a710b72a4b49b816725a5921e86e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 15:05:57.828003 1562 log.cc:1196] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/538516912cf14ebfb0bfb31f706b66fc
I20260927 15:05:57.829442 1562 ts_tablet_manager.cc:1939] T 538516912cf14ebfb0bfb31f706b66fc P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:05:57.833117 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46ee85688df04e92accdedb6625406c1 consensus state has no leader
I20260927 15:05:57.835500 1562 tablet_replica.cc:330] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:57.838310 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_190c56d51dc446aa8a208d631e35f3d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.838847 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_190c56d51dc446aa8a208d631e35f3d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.839182 1562 raft_consensus.cc:2229] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.839581 1562 raft_consensus.cc:2258] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.842010 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1168b8b224f14d868316d417ab56fef1" } new_table_name: "default.Table_8b26fb5fec1348f7a8d901c9ce63006b" modify_external_catalogs: true
I20260927 15:05:57.844777 1562 ts_tablet_manager.cc:1905] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.845504 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1e3109e311ba4ef994545bcc1e76de92" } new_table_name: "default.Table_92b373f81f26454ca3c8a82dfe807cfb" modify_external_catalogs: true
I20260927 15:05:57.845729 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 538516912cf14ebfb0bfb31f706b66fc (table default.Table_92c6318423b147e6984c2c78960a5476 [id=ea5cc262555840bbb18aba64e7cce780]) successfully deleted
I20260927 15:05:57.852547 1560 tablet_replica.cc:330] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
W20260927 15:05:57.852722 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b122f1436fde4c5da7f0afa3a1c24c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b122f1436fde4c5da7f0afa3a1c24c70 already in progress: creating tablet
I20260927 15:05:57.854081 1573 raft_consensus.cc:482] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:57.854225 1573 raft_consensus.cc:504] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.854864 1573 leader_election.cc:288] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:05:57.855687 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6925d0369524e7eb1ac3c20ad699ded consensus state has no leader
I20260927 15:05:57.855866 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a7989e2b91044dab1d3e327958a051a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:57.856120 1440 raft_consensus.cc:2454] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:05:57.856611 1099 leader_election.cc:302] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:57.856916 1573 raft_consensus.cc:2781] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:57.857040 1573 raft_consensus.cc:482] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:57.857139 1573 raft_consensus.cc:3037] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:57.860296 1573 raft_consensus.cc:504] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.862175 1573 leader_election.cc:288] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:57.862480 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a7989e2b91044dab1d3e327958a051a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:05:57.862735 1440 raft_consensus.cc:3037] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:57.866426 1440 raft_consensus.cc:2454] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:05:57.866976 1099 leader_election.cc:302] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:57.867369 1573 raft_consensus.cc:2781] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:57.867539 1573 raft_consensus.cc:686] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:05:57.868026 1573 consensus_queue.cc:237] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.871908 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 443af328e5154bdba9b570224616d77b from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.872121 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6f254b1d0eb949238df41c88797697e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.872874 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f254b1d0eb949238df41c88797697e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.876343 910 master_service.cc:946] ReplaceTablet: received request to replace tablet d6925d0369524e7eb1ac3c20ad699ded from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:57.877075 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a0201a60665941a48eabe2de029dcfa4" } modify_external_catalogs: true
I20260927 15:05:57.877314 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a0201a60665941a48eabe2de029dcfa4" } modify_external_catalogs: true
I20260927 15:05:57.877727 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_92b373f81f26454ca3c8a82dfe807cfb [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 5 got 0
I20260927 15:05:57.879227 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a30cef3b4c2436c8c222f35b244fd06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.880075 1560 raft_consensus.cc:2229] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:57.853053 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 7d6d1cfb1a4d4c439e970d966af841b6 (DEFAULT_TABLE table=default.Table_de263f6e08ac4eed8c0d53662d9a8b00 [id=1ff3964110d34f149e6c3c539a802ff3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.880784 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d6d1cfb1a4d4c439e970d966af841b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.882296 1561 tablet_bootstrap.cc:492] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:57.855988 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a7989e2b91044dab1d3e327958a051a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:57.861510 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a7989e2b91044dab1d3e327958a051a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:05:57.884298 1561 tablet_bootstrap.cc:654] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:05:57.885768 1102 leader_election.cc:341] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:05:57.886155 1102 leader_election.cc:341] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:57.809300 1552 raft_consensus.cc:374] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.887048 1552 raft_consensus.cc:729] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.887439 1552 consensus_queue.cc:260] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.888118 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_46da6881be584d4982a6cdafe3fb1c31" } modify_external_catalogs: true
I20260927 15:05:57.888370 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_46da6881be584d4982a6cdafe3fb1c31" } modify_external_catalogs: true
I20260927 15:05:57.888453 1552 ts_tablet_manager.cc:1428] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.080s user 0.001s sys 0.001s
I20260927 15:05:57.882987 1560 raft_consensus.cc:2258] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:57.891989 1560 ts_tablet_manager.cc:1905] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:57.898051 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_527ff90f92e14e9cb2bb7053c760f6ba" } modify_external_catalogs: true
I20260927 15:05:57.898276 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_527ff90f92e14e9cb2bb7053c760f6ba" } modify_external_catalogs: true
I20260927 15:05:57.899055 1561 tablet_bootstrap.cc:492] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.899303 1561 ts_tablet_manager.cc:1397] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.004s
I20260927 15:05:57.900367 1561 raft_consensus.cc:348] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.900933 1561 raft_consensus.cc:374] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.901098 1561 raft_consensus.cc:729] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.901480 1561 consensus_queue.cc:260] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.914497 1628 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:05:57.915956 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 148c77a0e88b40f690ca96f091b78d9a
I20260927 15:05:57.916507 913 catalog_manager.cc:6565] ReplaceTablet: tablet 148c77a0e88b40f690ca96f091b78d9a deleted and replaced by tablet f88b401dc12e451c80abe1b509e2b532
I20260927 15:05:57.916678 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 148c77a0e88b40f690ca96f091b78d9a with delete_type TABLET_DATA_DELETED (replaced by tablet f88b401dc12e451c80abe1b509e2b532) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.918144 1552 tablet_bootstrap.cc:492] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:57.920979 1134 tablet_service.cc:1467] Processing CreateTablet for tablet bc971defe6d148439a6a0b8c55d9092e (DEFAULT_TABLE table=default.Table_e7ef4602b573455ba998b9742647c917 [id=433e2c99fb354775ab79febbd9bd8be5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.921195 1276 tablet_service.cc:1467] Processing CreateTablet for tablet bc971defe6d148439a6a0b8c55d9092e (DEFAULT_TABLE table=default.Table_e7ef4602b573455ba998b9742647c917 [id=433e2c99fb354775ab79febbd9bd8be5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.921753 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc971defe6d148439a6a0b8c55d9092e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.921941 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc971defe6d148439a6a0b8c55d9092e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.923820 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 61339e532e6c431babb15422a08f7aa6
I20260927 15:05:57.924440 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 61339e532e6c431babb15422a08f7aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.928205 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 443af328e5154bdba9b570224616d77b
I20260927 15:05:57.928591 911 catalog_manager.cc:6565] ReplaceTablet: tablet 443af328e5154bdba9b570224616d77b deleted and replaced by tablet 3d454d65afa94aac9b34c253adfa4b0c
I20260927 15:05:57.929473 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 443af328e5154bdba9b570224616d77b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d454d65afa94aac9b34c253adfa4b0c) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.931689 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 443af328e5154bdba9b570224616d77b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d454d65afa94aac9b34c253adfa4b0c) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.931989 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 61339e532e6c431babb15422a08f7aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.932016 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6c7a8bf15c48423ea9ff14c46645a33b
I20260927 15:05:57.932641 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a8bf15c48423ea9ff14c46645a33b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.933341 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a8bf15c48423ea9ff14c46645a33b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.936067 1560 ts_tablet_manager.cc:1918] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.937322 1562 ts_tablet_manager.cc:1918] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.938019 1562 log.cc:1196] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/baafd4f49c7543018f87f5ad81d43a6c
I20260927 15:05:57.939553 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8f15485b8825436184abe2621c71e356
I20260927 15:05:57.940335 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_590e6d5e78b5436fa3687cf0b70e1921" } modify_external_catalogs: true
I20260927 15:05:57.940537 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_590e6d5e78b5436fa3687cf0b70e1921" } modify_external_catalogs: true
I20260927 15:05:57.918115 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 148c77a0e88b40f690ca96f091b78d9a with delete_type TABLET_DATA_DELETED (replaced by tablet f88b401dc12e451c80abe1b509e2b532) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.941258 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 0e6e3600cbf741419bc7b93eec42eb13 (DEFAULT_TABLE table=default.Table_40a2a7eaf0264954bccee55880a74fa6 [id=1b6050475cc24e249f2c525e95dda59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.925133 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 61339e532e6c431babb15422a08f7aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.931512 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 443af328e5154bdba9b570224616d77b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d454d65afa94aac9b34c253adfa4b0c) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.932435 1634 raft_consensus.cc:482] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:05:57.932909 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 75595.7us
I20260927 15:05:57.941836 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e6e3600cbf741419bc7b93eec42eb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.941669 1634 raft_consensus.cc:504] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.942796 1592 raft_consensus.cc:482] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:57.942967 1592 raft_consensus.cc:504] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.943101 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43552776a19a4e75aa2d6f3d983e3432" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:57.943264 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f15485b8825436184abe2621c71e356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.943599 1415 tablet_service.cc:1467] Processing CreateTablet for tablet bc971defe6d148439a6a0b8c55d9092e (DEFAULT_TABLE table=default.Table_e7ef4602b573455ba998b9742647c917 [id=433e2c99fb354775ab79febbd9bd8be5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.943672 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 0e6e3600cbf741419bc7b93eec42eb13 (DEFAULT_TABLE table=default.Table_40a2a7eaf0264954bccee55880a74fa6 [id=1b6050475cc24e249f2c525e95dda59a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:05:57.943774 1374 leader_election.cc:341] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:57.944010 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc971defe6d148439a6a0b8c55d9092e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.944370 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0781c9c8b4ad498bb27573939b7d06b2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:57.944782 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e6e3600cbf741419bc7b93eec42eb13. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:57.944887 1374 leader_election.cc:341] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:57.943588 1592 leader_election.cc:288] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:57.952560 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ba7faf6e79db420db13999d74fe86062
I20260927 15:05:57.953269 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 9c9e4311049d47d3b2f1e117795624ef (DEFAULT_TABLE table=default.Table_07d37a615ac24b47bc3014690bc93569 [id=e70d41731a9442ea9dbe00db169e3b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.953760 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c9e4311049d47d3b2f1e117795624ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.955008 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7faf6e79db420db13999d74fe86062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.956624 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet d6925d0369524e7eb1ac3c20ad699ded
I20260927 15:05:57.957054 910 catalog_manager.cc:6565] ReplaceTablet: tablet d6925d0369524e7eb1ac3c20ad699ded deleted and replaced by tablet 765b3ee3323846c5ba598f47478fd367
I20260927 15:05:57.957145 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f15485b8825436184abe2621c71e356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.933164 1593 raft_consensus.cc:686] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:05:57.933940 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a8bf15c48423ea9ff14c46645a33b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.957753 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet d6925d0369524e7eb1ac3c20ad699ded with delete_type TABLET_DATA_DELETED (replaced by tablet 765b3ee3323846c5ba598f47478fd367) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.957906 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7a42ae7589c24b1bbd833ab8838521ae
I20260927 15:05:57.957605 1593 consensus_queue.cc:237] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.958935 1634 leader_election.cc:288] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:57.959193 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a42ae7589c24b1bbd833ab8838521ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:57.939085 1559 ts_tablet_manager.cc:1918] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:57.959560 1559 log.cc:1196] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/604c05acf3864fc697758208de68da18
I20260927 15:05:57.960237 1559 ts_tablet_manager.cc:1939] T 604c05acf3864fc697758208de68da18 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:57.965643 1561 ts_tablet_manager.cc:1428] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.064s user 0.002s sys 0.011s
I20260927 15:05:57.966025 1561 tablet_bootstrap.cc:492] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:57.968127 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_92b373f81f26454ca3c8a82dfe807cfb [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 5 got 0
I20260927 15:05:57.972808 1561 tablet_bootstrap.cc:654] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.973986 906 catalog_manager.cc:5495] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:05:57.974684 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_e6b64fb416dd492caadccd2e9d65a802 [id=b1106aee6c804da4a603364cee1c1116]). Expected version 2 got 0
I20260927 15:05:57.977171 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5e5da599fcef4b94ac03384faad9c44a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.977716 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e5da599fcef4b94ac03384faad9c44a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.978557 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a42ae7589c24b1bbd833ab8838521ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.978804 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet d6925d0369524e7eb1ac3c20ad699ded with delete_type TABLET_DATA_DELETED (replaced by tablet 765b3ee3323846c5ba598f47478fd367) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.979000 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_640f3ce022374459af8de55bfc69ef68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.979449 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_640f3ce022374459af8de55bfc69ef68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.979811 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7faf6e79db420db13999d74fe86062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.981513 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d62fe8ec9c694017bb26e4b692b51007"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:57.981940 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d62fe8ec9c694017bb26e4b692b51007 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:57.983182 1562 ts_tablet_manager.cc:1939] T baafd4f49c7543018f87f5ad81d43a6c P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:57.984300 1560 log.cc:1196] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/570a0ee2154d4aca9dbaa2f5057def9d
I20260927 15:05:57.942296 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 0e6e3600cbf741419bc7b93eec42eb13 (DEFAULT_TABLE table=default.Table_40a2a7eaf0264954bccee55880a74fa6 [id=1b6050475cc24e249f2c525e95dda59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.984673 1561 tablet_bootstrap.cc:492] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:57.984751 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e6e3600cbf741419bc7b93eec42eb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.984848 1561 ts_tablet_manager.cc:1397] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.006s
I20260927 15:05:57.985780 1561 raft_consensus.cc:348] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.986069 1561 raft_consensus.cc:374] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:57.986152 1561 raft_consensus.cc:729] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:57.986409 1561 consensus_queue.cc:260] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.989143 1561 ts_tablet_manager.cc:1428] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260927 15:05:57.942651 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 9c9e4311049d47d3b2f1e117795624ef (DEFAULT_TABLE table=default.Table_07d37a615ac24b47bc3014690bc93569 [id=e70d41731a9442ea9dbe00db169e3b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:57.989712 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c9e4311049d47d3b2f1e117795624ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:57.990815 1639 mvcc.cc:205] Tried to move back new op lower bound from 7333976299656998912 to 7333976298406084608. Current Snapshot: MvccSnapshot[applied={T|T < 7333976299656998912}]
I20260927 15:05:57.952852 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0781c9c8b4ad498bb27573939b7d06b2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:57.853523 1629 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:05:57.957473 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet d6925d0369524e7eb1ac3c20ad699ded with delete_type TABLET_DATA_DELETED (replaced by tablet 765b3ee3323846c5ba598f47478fd367) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.958587 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43552776a19a4e75aa2d6f3d983e3432" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:57.958804 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a42ae7589c24b1bbd833ab8838521ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.959220 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7faf6e79db420db13999d74fe86062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.966760 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f15485b8825436184abe2621c71e356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.967046 1632 raft_consensus.cc:686] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:05:57.995383 1632 consensus_queue.cc:237] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:57.996352 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet da8215167ad74dbfb2cc1c8d50a76ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.996618 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 604c05acf3864fc697758208de68da18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:57.996680 1561 tablet_bootstrap.cc:492] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:57.983914 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 148c77a0e88b40f690ca96f091b78d9a with delete_type TABLET_DATA_DELETED (replaced by tablet f88b401dc12e451c80abe1b509e2b532) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:57.998337 1561 tablet_bootstrap.cc:654] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:57.937052 1552 tablet_bootstrap.cc:654] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.001614 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e4e18e695f54d85b25958330717c713 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c7a8bf15c48423ea9ff14c46645a33b) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.001991 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 9c9e4311049d47d3b2f1e117795624ef (DEFAULT_TABLE table=default.Table_07d37a615ac24b47bc3014690bc93569 [id=e70d41731a9442ea9dbe00db169e3b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.002442 1643 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:05:58.003161 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c9e4311049d47d3b2f1e117795624ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:58.003161 1376 leader_election.cc:341] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.003661 1376 leader_election.cc:302] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:05:58.004055 1376 leader_election.cc:341] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.004204 1376 leader_election.cc:302] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:05:58.004577 1592 raft_consensus.cc:2726] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:58.004765 1592 raft_consensus.cc:2726] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:58.008543 1561 tablet_bootstrap.cc:492] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.008796 1561 ts_tablet_manager.cc:1397] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20260927 15:05:58.009816 1561 raft_consensus.cc:348] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.010241 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_92b373f81f26454ca3c8a82dfe807cfb [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 5 got 0
I20260927 15:05:58.010313 1561 raft_consensus.cc:374] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.010522 1561 raft_consensus.cc:729] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.010862 1561 consensus_queue.cc:260] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.011641 1561 ts_tablet_manager.cc:1428] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:05:58.012028 1561 tablet_bootstrap.cc:492] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.013227 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d31a5509d4d44df18a49c4c6db67ca9c" } new_table_name: "default.Table_d43c271e9640447699f9f1c2c7a6a1d5" modify_external_catalogs: true
I20260927 15:05:58.014663 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_07d37a615ac24b47bc3014690bc93569" } new_table_name: "default.Table_195d86242b4c4d008065aee0ea319f60" modify_external_catalogs: true
I20260927 15:05:58.015935 1561 tablet_bootstrap.cc:654] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.016319 1559 tablet_replica.cc:330] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:58.021400 1643 tablet.cc:1717] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Skipping requested alter to schema version 3, tablet already version 3
I20260927 15:05:58.022495 1629 tablet.cc:1717] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Skipping requested alter to schema version 3, tablet already version 3
I20260927 15:05:58.022970 1559 raft_consensus.cc:2229] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.023259 1559 raft_consensus.cc:2258] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.023360 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 604c05acf3864fc697758208de68da18 (table default.Table_7df3939469d744798289afe55352f822 [id=7edfbbe676dd491a81129debceebd914]) successfully deleted
I20260927 15:05:58.023681 1552 tablet_bootstrap.cc:492] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:58.023948 1552 ts_tablet_manager.cc:1397] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.002s
I20260927 15:05:58.023967 1559 ts_tablet_manager.cc:1905] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.024935 1552 raft_consensus.cc:348] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.025583 1552 raft_consensus.cc:374] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.025738 1552 raft_consensus.cc:729] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.026119 1552 consensus_queue.cc:260] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.026944 1628 tablet.cc:1717] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Skipping requested alter to schema version 3, tablet already version 3
I20260927 15:05:58.027458 1552 ts_tablet_manager.cc:1428] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:05:58.027902 1552 tablet_bootstrap.cc:492] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:58.031638 1556 tablet_bootstrap.cc:492] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:58.031786 1556 ts_tablet_manager.cc:1397] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.425s user 0.049s sys 0.056s
I20260927 15:05:58.032949 1560 ts_tablet_manager.cc:1939] T 570a0ee2154d4aca9dbaa2f5057def9d P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:05:58.033390 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c9e4311049d47d3b2f1e117795624ef consensus state has no leader
I20260927 15:05:58.033594 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 570a0ee2154d4aca9dbaa2f5057def9d (table default.Table_81479ddeb1b6463cab4db3d03d955a91 [id=f301a482365b4cf2b752fccd860a8d2d]) successfully deleted
W20260927 15:05:58.033730 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d6eed08273244d28fd15785a09059f9 has no consensus state
I20260927 15:05:58.034178 1621 mvcc.cc:205] Tried to move back new op lower bound from 7333976301686116352 to 7333976298406084608. Current Snapshot: MvccSnapshot[applied={T|T < 7333976301686116352}]
I20260927 15:05:58.035684 1629 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:05:58.037885 1643 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:05:58.038934 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0781c9c8b4ad498bb27573939b7d06b2 (table default.Table_81479ddeb1b6463cab4db3d03d955a91 [id=f301a482365b4cf2b752fccd860a8d2d]). Expected version 3 got 0
W20260927 15:05:58.039162 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e188f28304604cf2a96a606811900ca5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e188f28304604cf2a96a606811900ca5 already in progress: creating tablet
W20260927 15:05:58.040140 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet bb90faccda0145a7acd153fcd51b4c43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb90faccda0145a7acd153fcd51b4c43 already in progress: creating tablet
W20260927 15:05:58.040645 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b122f1436fde4c5da7f0afa3a1c24c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b122f1436fde4c5da7f0afa3a1c24c70 already in progress: creating tablet
W20260927 15:05:58.041198 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 7d6d1cfb1a4d4c439e970d966af841b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d6d1cfb1a4d4c439e970d966af841b6 already in progress: creating tablet
I20260927 15:05:58.041810 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0781c9c8b4ad498bb27573939b7d06b2 (table default.Table_81479ddeb1b6463cab4db3d03d955a91 [id=f301a482365b4cf2b752fccd860a8d2d]). Expected version 3 got 0
I20260927 15:05:58.041916 1556 raft_consensus.cc:348] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.042165 1556 raft_consensus.cc:374] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.042099 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_92b373f81f26454ca3c8a82dfe807cfb [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 5 got 4
I20260927 15:05:58.042265 1556 raft_consensus.cc:729] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.042500 1556 consensus_queue.cc:260] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.043234 1556 ts_tablet_manager.cc:1428] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 15:05:58.044700 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.045346 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.046518 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9d9b52de81d943d3958257b93aecb176"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.047103 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d9b52de81d943d3958257b93aecb176 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:58.054492 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f2cce454e70640e2a67b3680676b1d93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2cce454e70640e2a67b3680676b1d93 already in progress: creating tablet
W20260927 15:05:58.054726 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7d6d1cfb1a4d4c439e970d966af841b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d6d1cfb1a4d4c439e970d966af841b6 already in progress: creating tablet
W20260927 15:05:58.055018 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6cf0ef42c0944b049a8ce68531ed8e45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf0ef42c0944b049a8ce68531ed8e45 already in progress: creating tablet
I20260927 15:05:58.056967 1628 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260927 15:05:58.057371 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet f2cce454e70640e2a67b3680676b1d93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2cce454e70640e2a67b3680676b1d93 already in progress: creating tablet
W20260927 15:05:58.058493 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0d41d55fdb504b95921f46e7aed99ac1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d41d55fdb504b95921f46e7aed99ac1 already in progress: creating tablet
W20260927 15:05:58.058787 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6cf0ef42c0944b049a8ce68531ed8e45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf0ef42c0944b049a8ce68531ed8e45 already in progress: creating tablet
W20260927 15:05:58.058764 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 714b110a24ca4f3bb8126034dc3e6407 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 714b110a24ca4f3bb8126034dc3e6407 already in progress: creating tablet
W20260927 15:05:58.059345 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 30cf4db249154adda9406d5b07430a80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30cf4db249154adda9406d5b07430a80 already in progress: creating tablet
I20260927 15:05:58.059499 1556 tablet_bootstrap.cc:492] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:58.060442 1560 tablet_replica.cc:330] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:58.061053 1560 raft_consensus.cc:2229] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:05:58.061798 1560 pending_rounds.cc:62] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:05:58.062304 1562 tablet_replica.cc:330] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:58.062496 1560 pending_rounds.cc:68] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976301553688576 op_type: NO_OP noop_request { }
I20260927 15:05:58.062917 1562 raft_consensus.cc:2229] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.063115 1560 raft_consensus.cc:2866] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:05:58.063361 1562 raft_consensus.cc:2258] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.063548 1560 raft_consensus.cc:2258] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.064152 1562 ts_tablet_manager.cc:1905] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.061383 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b093eeae2295436bb418ac8610a19dd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.065990 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b093eeae2295436bb418ac8610a19dd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.066030 1560 ts_tablet_manager.cc:1905] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.062008 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f0d39392c0384f6fb29e437921f8098b" } new_table_name: "default.Table_46238c103f2247faa5ba7f68d8b744c4" modify_external_catalogs: true
I20260927 15:05:58.067305 1552 tablet_bootstrap.cc:654] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.062470 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bbb9f9f890a54220b1065de77e571c1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.068120 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbb9f9f890a54220b1065de77e571c1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.063001 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f1c5c1132cab4343b25f94cd31941336"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.069267 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1c5c1132cab4343b25f94cd31941336 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.064049 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_92b373f81f26454ca3c8a82dfe807cfb [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 5 got 4
I20260927 15:05:58.071655 906 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_e6b64fb416dd492caadccd2e9d65a802 [id=b1106aee6c804da4a603364cee1c1116]). Expected version 2 got 0
I20260927 15:05:58.071902 906 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_92b373f81f26454ca3c8a82dfe807cfb [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 5 got 4
I20260927 15:05:58.073366 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 538516912cf14ebfb0bfb31f706b66fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.078166 1562 ts_tablet_manager.cc:1918] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:05:58.079560 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 714b110a24ca4f3bb8126034dc3e6407 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 714b110a24ca4f3bb8126034dc3e6407 already in progress: creating tablet
W20260927 15:05:58.079809 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0d41d55fdb504b95921f46e7aed99ac1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d41d55fdb504b95921f46e7aed99ac1 already in progress: creating tablet
W20260927 15:05:58.080030 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 30cf4db249154adda9406d5b07430a80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30cf4db249154adda9406d5b07430a80 already in progress: creating tablet
I20260927 15:05:58.082540 1556 tablet_bootstrap.cc:654] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:05:58.080241 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 148c77a0e88b40f690ca96f091b78d9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 148c77a0e88b40f690ca96f091b78d9a already in progress: creating tablet
I20260927 15:05:58.085125 906 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_92b373f81f26454ca3c8a82dfe807cfb [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 5 got 4
I20260927 15:05:58.085827 1559 ts_tablet_manager.cc:1918] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.086064 1559 log.cc:1196] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3e4e18e695f54d85b25958330717c713
I20260927 15:05:58.086231 908 master_service.cc:946] ReplaceTablet: received request to replace tablet 6c7a8bf15c48423ea9ff14c46645a33b from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.086905 1559 ts_tablet_manager.cc:1939] T 3e4e18e695f54d85b25958330717c713 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:58.087370 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5b210f1beda84fd1945f9d3245063038"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.087877 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b210f1beda84fd1945f9d3245063038 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.088258 1559 tablet_replica.cc:330] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:58.088201 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_92b373f81f26454ca3c8a82dfe807cfb [id=861d1dea54204625a6d1ad99fb8f6873]). Expected version 5 got 4
I20260927 15:05:58.088475 1559 raft_consensus.cc:2229] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.088631 1559 raft_consensus.cc:2258] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.089195 1559 ts_tablet_manager.cc:1905] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.089823 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_452367b3f3384a36aefc6823e7ab7ec2" } new_table_name: "default.Table_06fd18ae207043788a5ea0e048ae2ecd" modify_external_catalogs: true
I20260927 15:05:58.089929 908 master_service.cc:946] ReplaceTablet: received request to replace tablet 538516912cf14ebfb0bfb31f706b66fc from {username='slave'} at 127.0.0.1:49800
W20260927 15:05:58.090654 1238 connection.cc:535] client connection to 127.0.201.62:41167 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 15:05:58.091375 1373 connection.cc:535] client connection to 127.0.201.62:41167 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 15:05:58.089849 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_03bb30f056204c8fa3dc1c48f1eac472" } new_table_name: "default.Table_2b3e81787f35442691853bd186de1a8a" modify_external_catalogs: true
W20260927 15:05:58.091949 898 connection.cc:535] client connection to 127.0.201.62:41167 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 15:05:58.098376 1560 ts_tablet_manager.cc:1918] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:05:58.102854 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_86b086d55b34411782656982b6de6a74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.103468 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86b086d55b34411782656982b6de6a74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:58.091245 1099 connection.cc:535] client connection to 127.0.201.62:41167 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 15:05:58.107957 1134 tablet_service.cc:1467] Processing CreateTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 (DEFAULT_TABLE table=default.Table_af607bdf84604e1d89e4b679360ed558 [id=5928f9637b7c4e569baf987137d28383]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.108477 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1d7a98ffc4745ac8eeb93012b55d417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.111730 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 08f28c023473434ba73b1142a041be97 (DEFAULT_TABLE table=default.Table_4ae68d29ddc646a5b8ff7714ff60b1e1 [id=67762455acad44448ba24d18c2863816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.113547 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08f28c023473434ba73b1142a041be97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.114925 1561 tablet_bootstrap.cc:492] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.115091 1561 ts_tablet_manager.cc:1397] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.103s user 0.030s sys 0.040s
I20260927 15:05:58.115401 1593 raft_consensus.cc:482] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.115584 1593 raft_consensus.cc:504] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.115895 1561 raft_consensus.cc:348] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.116122 1561 raft_consensus.cc:374] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.116204 1561 raft_consensus.cc:729] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.116288 1593 leader_election.cc:288] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:58.116425 1561 consensus_queue.cc:260] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.116995 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6925d0369524e7eb1ac3c20ad699ded" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:58.117556 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 6d6eed08273244d28fd15785a09059f9 (DEFAULT_TABLE table=default.Table_d43c271e9640447699f9f1c2c7a6a1d5 [id=aa16f23914de4c7db1e460bb1c743a4d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:05:58.118039 1374 leader_election.cc:341] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.118335 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6eed08273244d28fd15785a09059f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.118364 1561 ts_tablet_manager.cc:1428] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:05:58.118673 1561 tablet_bootstrap.cc:492] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.120577 1561 tablet_bootstrap.cc:654] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.122769 1418 tablet_service.cc:1467] Processing CreateTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 (DEFAULT_TABLE table=default.Table_af607bdf84604e1d89e4b679360ed558 [id=5928f9637b7c4e569baf987137d28383]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.123188 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1d7a98ffc4745ac8eeb93012b55d417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.124071 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 08f28c023473434ba73b1142a041be97 (DEFAULT_TABLE table=default.Table_4ae68d29ddc646a5b8ff7714ff60b1e1 [id=67762455acad44448ba24d18c2863816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.124399 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08f28c023473434ba73b1142a041be97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.125540 1415 tablet_service.cc:1467] Processing CreateTablet for tablet ab08d04c11dd44299ee5f9a911d581c3 (DEFAULT_TABLE table=default.Table_f1b5de8ecfe842e69ba40febba9c6ee1 [id=7f171341d8ee4ed68a7d8a4fc3e7ecb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.125850 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab08d04c11dd44299ee5f9a911d581c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.127151 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 6d6eed08273244d28fd15785a09059f9 (DEFAULT_TABLE table=default.Table_d43c271e9640447699f9f1c2c7a6a1d5 [id=aa16f23914de4c7db1e460bb1c743a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.127511 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6eed08273244d28fd15785a09059f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:58.131692 898 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 -> Peer dbf522d70373412b87815d33c0f1f745 (127.0.201.62:41167): Couldn't send request to peer dbf522d70373412b87815d33c0f1f745. Status: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260927 15:05:58.132028 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_54aa4b63a0734bcca9d77b4a4c2a31c1" } modify_external_catalogs: true
I20260927 15:05:58.132239 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_54aa4b63a0734bcca9d77b4a4c2a31c1" } modify_external_catalogs: true
W20260927 15:05:58.133559 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30244d596d4d4090af7656027b48f22e consensus state has no leader
I20260927 15:05:58.137801 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 43552776a19a4e75aa2d6f3d983e3432 with delete_type TABLET_DATA_DELETED (replaced by tablet 34822e9f900f4d04b59b810d59e6aa49) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.138178 1133 tablet_service.cc:1467] Processing CreateTablet for tablet ab08d04c11dd44299ee5f9a911d581c3 (DEFAULT_TABLE table=default.Table_f1b5de8ecfe842e69ba40febba9c6ee1 [id=7f171341d8ee4ed68a7d8a4fc3e7ecb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.138638 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab08d04c11dd44299ee5f9a911d581c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.146696 1562 log.cc:1196] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/61339e532e6c431babb15422a08f7aa6
I20260927 15:05:58.147786 1562 ts_tablet_manager.cc:1939] T 61339e532e6c431babb15422a08f7aa6 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:05:58.099813 1619 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:05:58.091687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.201.62:41167 (local address 127.0.201.2:56433)
0927 15:05:58.091940 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0927 15:05:58.091960 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0927 15:05:58.092070 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0927 15:05:58.098880 (+ 6810us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":125}
I20260927 15:05:58.107225 1274 tablet_service.cc:1467] Processing CreateTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 (DEFAULT_TABLE table=default.Table_af607bdf84604e1d89e4b679360ed558 [id=5928f9637b7c4e569baf987137d28383]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.107791 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 08f28c023473434ba73b1142a041be97 (DEFAULT_TABLE table=default.Table_4ae68d29ddc646a5b8ff7714ff60b1e1 [id=67762455acad44448ba24d18c2863816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.152444 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1d7a98ffc4745ac8eeb93012b55d417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.152676 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08f28c023473434ba73b1142a041be97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.110533 1277 tablet_service.cc:1467] Processing CreateTablet for tablet ab08d04c11dd44299ee5f9a911d581c3 (DEFAULT_TABLE table=default.Table_f1b5de8ecfe842e69ba40febba9c6ee1 [id=7f171341d8ee4ed68a7d8a4fc3e7ecb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.112427 1305 raft_consensus.cc:3037] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.115111 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 6d6eed08273244d28fd15785a09059f9 (DEFAULT_TABLE table=default.Table_d43c271e9640447699f9f1c2c7a6a1d5 [id=aa16f23914de4c7db1e460bb1c743a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.152997 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab08d04c11dd44299ee5f9a911d581c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.153223 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6eed08273244d28fd15785a09059f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.115406 1552 tablet_bootstrap.cc:492] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:58.116001 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 67cf4dae943e4092b2c490ad770e4a94 (DEFAULT_TABLE table=default.Table_6f254b1d0eb949238df41c88797697e5 [id=9ac1472258a24d01892257dd9c9874a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.155131 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67cf4dae943e4092b2c490ad770e4a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.157379 1305 raft_consensus.cc:1261] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Refusing update from remote peer c4264874db964ff2830b7894c2b3d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:58.116695 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6925d0369524e7eb1ac3c20ad699ded" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:58.158380 1552 ts_tablet_manager.cc:1397] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.131s user 0.003s sys 0.006s
I20260927 15:05:58.159271 1552 raft_consensus.cc:348] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.159515 1552 raft_consensus.cc:374] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.159618 1552 raft_consensus.cc:729] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.159842 1552 consensus_queue.cc:260] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.160444 1552 ts_tablet_manager.cc:1428] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:05:58.160715 1552 tablet_bootstrap.cc:492] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:58.167001 908 master_service.cc:946] ReplaceTablet: received request to replace tablet 3e4e18e695f54d85b25958330717c713 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.169890 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 765b3ee3323846c5ba598f47478fd367 (DEFAULT_TABLE table=default.Table_8b26fb5fec1348f7a8d901c9ce63006b [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.170379 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 765b3ee3323846c5ba598f47478fd367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.172254 1552 tablet_bootstrap.cc:654] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.176004 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 30244d596d4d4090af7656027b48f22e (DEFAULT_TABLE table=default.Table_46238c103f2247faa5ba7f68d8b744c4 [id=5577906b11a841d58884c42d471a4427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.176509 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30244d596d4d4090af7656027b48f22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.177919 1552 tablet_bootstrap.cc:492] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:58.178086 1552 ts_tablet_manager.cc:1397] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.001s
I20260927 15:05:58.178884 1552 raft_consensus.cc:348] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.179144 1552 raft_consensus.cc:374] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.179221 1552 raft_consensus.cc:729] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.179908 1552 consensus_queue.cc:260] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.180208 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 3d454d65afa94aac9b34c253adfa4b0c (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.180580 1552 ts_tablet_manager.cc:1428] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:05:58.180620 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d454d65afa94aac9b34c253adfa4b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.181319 1552 tablet_bootstrap.cc:492] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:58.183400 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 0df4a23269244191bf1dcd69cb34d371 (DEFAULT_TABLE table=default.Table_190c56d51dc446aa8a208d631e35f3d2 [id=d80cbbb5881e42f0b5651563d6f60bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.184160 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9d9b52de81d943d3958257b93aecb176" } modify_external_catalogs: true
I20260927 15:05:58.184370 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9d9b52de81d943d3958257b93aecb176" } modify_external_catalogs: true
I20260927 15:05:58.185766 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_46238c103f2247faa5ba7f68d8b744c4" } modify_external_catalogs: true
I20260927 15:05:58.185963 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_46238c103f2247faa5ba7f68d8b744c4" } modify_external_catalogs: true
I20260927 15:05:58.187234 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f1b5de8ecfe842e69ba40febba9c6ee1" } modify_external_catalogs: true
I20260927 15:05:58.187405 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f1b5de8ecfe842e69ba40febba9c6ee1" } modify_external_catalogs: true
I20260927 15:05:58.187373 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 765b3ee3323846c5ba598f47478fd367 (DEFAULT_TABLE table=default.Table_8b26fb5fec1348f7a8d901c9ce63006b [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.185788 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bf2c59d22fa84330870ea9f394bcc27b" } modify_external_catalogs: true
I20260927 15:05:58.189039 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 765b3ee3323846c5ba598f47478fd367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.189033 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bf2c59d22fa84330870ea9f394bcc27b" } modify_external_catalogs: true
I20260927 15:05:58.189112 1561 tablet_bootstrap.cc:492] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.189288 1561 ts_tablet_manager.cc:1397] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.005s
I20260927 15:05:58.189792 908 master_service.cc:946] ReplaceTablet: received request to replace tablet bb90faccda0145a7acd153fcd51b4c43 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.190219 908 master_service.cc:946] ReplaceTablet: received request to replace tablet 8f15485b8825436184abe2621c71e356 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.190865 1573 consensus_queue.cc:1035] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260927 15:05:58.191648 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1f23f91bce4df480dd9991659f2e81 (DEFAULT_TABLE table=default.Table_476502809f814797a2de6c54405d8c30 [id=fb946e044fa149ebb52128ea5c3577a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.192373 1138 tablet_service.cc:1467] Processing CreateTablet for tablet f88b401dc12e451c80abe1b509e2b532 (DEFAULT_TABLE table=default.Table_d80d3405cea240ec87396ab494d2d04d [id=c4ddc66927a94fd2abc8e44012cf69f7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:05:58.193609 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 654d3210fd8c46b68880e544c39d5c88 consensus state has no leader
I20260927 15:05:58.193795 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df4a23269244191bf1dcd69cb34d371. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:58.194695 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac3b1d765caf40a1a7593cdb19defcab consensus state has no leader
I20260927 15:05:58.196600 1131 tablet_service.cc:1467] Processing CreateTablet for tablet ba14b7531bb647248572be10d2b43cf2 (DEFAULT_TABLE table=default.Table_b492b891412a427fa40ae10dddbefee5 [id=43c20c5b532545b5b66ad52dc5af5fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.197007 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 61339e532e6c431babb15422a08f7aa6 (table default.Table_527ff90f92e14e9cb2bb7053c760f6ba [id=48ac6a07f3ca402aa8396ac2a1874134]) successfully deleted
I20260927 15:05:58.198026 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8af844423fc94e2c8380db179103d3aa
I20260927 15:05:58.198868 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 30244d596d4d4090af7656027b48f22e (DEFAULT_TABLE table=default.Table_46238c103f2247faa5ba7f68d8b744c4 [id=5577906b11a841d58884c42d471a4427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.200201 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 67cf4dae943e4092b2c490ad770e4a94 (DEFAULT_TABLE table=default.Table_6f254b1d0eb949238df41c88797697e5 [id=9ac1472258a24d01892257dd9c9874a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.202579 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 67cf4dae943e4092b2c490ad770e4a94 (DEFAULT_TABLE table=default.Table_6f254b1d0eb949238df41c88797697e5 [id=9ac1472258a24d01892257dd9c9874a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.202611 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 0df4a23269244191bf1dcd69cb34d371 (DEFAULT_TABLE table=default.Table_190c56d51dc446aa8a208d631e35f3d2 [id=d80cbbb5881e42f0b5651563d6f60bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.202895 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1f23f91bce4df480dd9991659f2e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.204227 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 604c05acf3864fc697758208de68da18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.204353 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67cf4dae943e4092b2c490ad770e4a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.205026 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1f23f91bce4df480dd9991659f2e81 (DEFAULT_TABLE table=default.Table_476502809f814797a2de6c54405d8c30 [id=fb946e044fa149ebb52128ea5c3577a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.205090 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af844423fc94e2c8380db179103d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.205366 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1f23f91bce4df480dd9991659f2e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.205714 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e4e18e695f54d85b25958330717c713 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c7a8bf15c48423ea9ff14c46645a33b) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.205966 1280 tablet_service.cc:1467] Processing CreateTablet for tablet ba14b7531bb647248572be10d2b43cf2 (DEFAULT_TABLE table=default.Table_b492b891412a427fa40ae10dddbefee5 [id=43c20c5b532545b5b66ad52dc5af5fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.206085 1278 tablet_service.cc:1467] Processing CreateTablet for tablet f88b401dc12e451c80abe1b509e2b532 (DEFAULT_TABLE table=default.Table_d80d3405cea240ec87396ab494d2d04d [id=c4ddc66927a94fd2abc8e44012cf69f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.207377 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88b401dc12e451c80abe1b509e2b532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.202817 1561 raft_consensus.cc:348] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.212262 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 0df4a23269244191bf1dcd69cb34d371 (DEFAULT_TABLE table=default.Table_190c56d51dc446aa8a208d631e35f3d2 [id=d80cbbb5881e42f0b5651563d6f60bb5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:05:58.202437 1376 leader_election.cc:341] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.213039 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 765b3ee3323846c5ba598f47478fd367 (DEFAULT_TABLE table=default.Table_8b26fb5fec1348f7a8d901c9ce63006b [id=91249093cae2422b8ec06c14cf5fdae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.211714 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 3d454d65afa94aac9b34c253adfa4b0c (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.214133 1413 tablet_service.cc:1467] Processing CreateTablet for tablet ba14b7531bb647248572be10d2b43cf2 (DEFAULT_TABLE table=default.Table_b492b891412a427fa40ae10dddbefee5 [id=43c20c5b532545b5b66ad52dc5af5fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.217118 1593 raft_consensus.cc:482] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.217255 1593 raft_consensus.cc:504] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.218351 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df4a23269244191bf1dcd69cb34d371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.218622 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af844423fc94e2c8380db179103d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.220680 1561 raft_consensus.cc:374] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.220538 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 30244d596d4d4090af7656027b48f22e (DEFAULT_TABLE table=default.Table_46238c103f2247faa5ba7f68d8b744c4 [id=5577906b11a841d58884c42d471a4427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.223014 1376 leader_election.cc:302] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:05:58.223336 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 63881.3us
I20260927 15:05:58.223687 1634 raft_consensus.cc:2726] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:58.224278 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3b1d765caf40a1a7593cdb19defcab" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:58.229018 1440 raft_consensus.cc:1261] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Refusing update from remote peer c4264874db964ff2830b7894c2b3d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:58.230178 1561 raft_consensus.cc:729] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.230460 1561 consensus_queue.cc:260] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.232164 1593 leader_election.cc:288] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:58.232545 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d454d65afa94aac9b34c253adfa4b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.235126 1552 tablet_bootstrap.cc:654] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.235843 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba14b7531bb647248572be10d2b43cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.234465 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3b1d765caf40a1a7593cdb19defcab" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:58.238138 1560 log.cc:1196] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/3a30cef3b4c2436c8c222f35b244fd06
I20260927 15:05:58.238902 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df4a23269244191bf1dcd69cb34d371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.239281 1560 ts_tablet_manager.cc:1939] T 3a30cef3b4c2436c8c222f35b244fd06 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:58.239275 1573 consensus_queue.cc:1035] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260927 15:05:58.239846 1165 raft_consensus.cc:2454] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:05:58.240305 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba14b7531bb647248572be10d2b43cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.240285 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 3a30cef3b4c2436c8c222f35b244fd06 (table default.Table_817637f69c9a40eda1a54ec015d7cb32 [id=7f0fdeabadf2411196e949e581b7337c]) successfully deleted
I20260927 15:05:58.241495 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67cf4dae943e4092b2c490ad770e4a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.243762 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af844423fc94e2c8380db179103d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.244658 1561 ts_tablet_manager.cc:1428] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260927 15:05:58.248843 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30244d596d4d4090af7656027b48f22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.250896 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88b401dc12e451c80abe1b509e2b532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.245218 1410 tablet_service.cc:1467] Processing CreateTablet for tablet f88b401dc12e451c80abe1b509e2b532 (DEFAULT_TABLE table=default.Table_d80d3405cea240ec87396ab494d2d04d [id=c4ddc66927a94fd2abc8e44012cf69f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.251030 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1f23f91bce4df480dd9991659f2e81 (DEFAULT_TABLE table=default.Table_476502809f814797a2de6c54405d8c30 [id=fb946e044fa149ebb52128ea5c3577a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.252077 1561 tablet_bootstrap.cc:492] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.253392 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 765b3ee3323846c5ba598f47478fd367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.251590 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 3d454d65afa94aac9b34c253adfa4b0c (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.256006 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1f23f91bce4df480dd9991659f2e81. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:58.253034 1376 leader_election.cc:341] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.257961 1632 raft_consensus.cc:482] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.258163 1632 raft_consensus.cc:504] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.258876 1632 leader_election.cc:288] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.259223 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d454d65afa94aac9b34c253adfa4b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.261118 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88b401dc12e451c80abe1b509e2b532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.262797 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba14b7531bb647248572be10d2b43cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.263633 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30244d596d4d4090af7656027b48f22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.266785 1374 leader_election.cc:302] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:58.267366 1593 raft_consensus.cc:2781] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:58.268205 1593 raft_consensus.cc:482] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:58.268360 1593 raft_consensus.cc:3037] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:05:58.270314 1238 leader_election.cc:341] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3e4e18e695f54d85b25958330717c713
I20260927 15:05:58.276948 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet ac3b1d765caf40a1a7593cdb19defcab (table default.Table_06fd18ae207043788a5ea0e048ae2ecd [id=6368f21af56d44f09f5cf1ec2d19f2b6]). Expected version 2 got 0
I20260927 15:05:58.277930 907 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f882de313cd54d44b6fed912b73ebd2d
I20260927 15:05:58.278348 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 30244d596d4d4090af7656027b48f22e
I20260927 15:05:58.279094 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ab08d04c11dd44299ee5f9a911d581c3
I20260927 15:05:58.279347 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 30244d596d4d4090af7656027b48f22e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.280211 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet ab08d04c11dd44299ee5f9a911d581c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.281803 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet ab08d04c11dd44299ee5f9a911d581c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.281804 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 30244d596d4d4090af7656027b48f22e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.286484 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e4e18e695f54d85b25958330717c713" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:58.286791 1165 raft_consensus.cc:2454] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:05:58.288941 911 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet ac3b1d765caf40a1a7593cdb19defcab (table default.Table_06fd18ae207043788a5ea0e048ae2ecd [id=6368f21af56d44f09f5cf1ec2d19f2b6]). Expected version 2 got 0
I20260927 15:05:58.291515 1239 leader_election.cc:302] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:05:58.292066 1632 raft_consensus.cc:2781] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:58.292173 1632 raft_consensus.cc:482] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:58.292292 1632 raft_consensus.cc:3037] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.300244 1561 tablet_bootstrap.cc:654] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.309755 1632 raft_consensus.cc:504] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.311468 1632 leader_election.cc:288] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.312145 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e4e18e695f54d85b25958330717c713" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:05:58.313186 1165 raft_consensus.cc:3037] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.313913 1573 raft_consensus.cc:482] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.315097 1573 raft_consensus.cc:504] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.315907 1573 leader_election.cc:288] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.316886 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0781c9c8b4ad498bb27573939b7d06b2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:58.317795 1238 leader_election.cc:341] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3e4e18e695f54d85b25958330717c713
W20260927 15:05:58.318953 1102 leader_election.cc:341] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.322175 1165 raft_consensus.cc:2454] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:05:58.322081 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0781c9c8b4ad498bb27573939b7d06b2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:58.322806 1239 leader_election.cc:302] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:05:58.323740 1632 raft_consensus.cc:2781] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:58.325264 1632 raft_consensus.cc:686] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:05:58.325668 1632 consensus_queue.cc:237] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.322391 1439 raft_consensus.cc:2454] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:05:58.327546 1099 leader_election.cc:302] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:58.328675 1573 raft_consensus.cc:2781] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:58.328817 1573 raft_consensus.cc:482] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:58.329221 1573 raft_consensus.cc:3037] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.329164 1593 raft_consensus.cc:504] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.333073 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3b1d765caf40a1a7593cdb19defcab" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:05:58.333771 1376 leader_election.cc:341] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.334357 1573 raft_consensus.cc:504] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.335619 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0781c9c8b4ad498bb27573939b7d06b2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:05:58.336282 1102 leader_election.cc:341] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.342896 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0781c9c8b4ad498bb27573939b7d06b2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:05:58.343142 1439 raft_consensus.cc:3037] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.343376 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3b1d765caf40a1a7593cdb19defcab" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:05:58.345364 1165 raft_consensus.cc:3037] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.348627 1593 leader_election.cc:288] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:58.352134 1573 leader_election.cc:288] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.367504 1439 raft_consensus.cc:2454] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:05:58.368136 1099 leader_election.cc:302] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:58.372809 1573 raft_consensus.cc:2781] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:58.374033 1573 raft_consensus.cc:686] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:05:58.374465 1573 consensus_queue.cc:237] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.375882 1562 tablet_replica.cc:330] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:58.378643 1562 raft_consensus.cc:2229] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.380138 1593 raft_consensus.cc:482] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.380347 1593 raft_consensus.cc:504] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.381503 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8966721a788d4e64ad5e495b5a69b74d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:05:58.382226 1374 leader_election.cc:341] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.383174 1593 leader_election.cc:288] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:58.383369 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8966721a788d4e64ad5e495b5a69b74d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:58.384397 1165 raft_consensus.cc:2454] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:05:58.384673 1562 raft_consensus.cc:2258] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.387696 1562 ts_tablet_manager.cc:1905] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.389158 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet ab08d04c11dd44299ee5f9a911d581c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.389895 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8000e7f7337f4588a7668f6d97c754cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.389789 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.390559 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8000e7f7337f4588a7668f6d97c754cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:58.390633 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.391124 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e914cd108b0a44bd881d027973fb0ec8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.391680 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e914cd108b0a44bd881d027973fb0ec8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.392321 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5d69d67ea0984bd994da0935b6ccc3c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.392812 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d69d67ea0984bd994da0935b6ccc3c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.393467 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 4ead753ba6664829b1262712f35e64f2
I20260927 15:05:58.394763 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead753ba6664829b1262712f35e64f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.397656 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8b630852db2d4e56a631bd41ba399fa2" } new_table_name: "default.Table_b1351f5b43b34a4981ab32258c31a00e" modify_external_catalogs: true
I20260927 15:05:58.399029 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6a3d9845b82d4862bdd5a2d19801544c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.399111 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_640f3ce022374459af8de55bfc69ef68" } new_table_name: "default.Table_b592f94f43ea4ffe8068db6aed19c5ef" modify_external_catalogs: true
W20260927 15:05:58.399147 1376 leader_election.cc:341] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.399276 1376 leader_election.cc:302] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:05:58.399530 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a3d9845b82d4862bdd5a2d19801544c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.399782 1374 leader_election.cc:302] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:58.400308 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bbe3afdc10dd47498be6f21a36311b58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.400695 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbe3afdc10dd47498be6f21a36311b58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.401794 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e8c7a324f17444a486965a420aced20a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.402256 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8c7a324f17444a486965a420aced20a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.403343 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d43c271e9640447699f9f1c2c7a6a1d5" } new_table_name: "default.Table_11a3612c1fb14de08bae64fc5180a805" modify_external_catalogs: true
I20260927 15:05:58.403764 1634 raft_consensus.cc:2726] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:58.408084 1562 ts_tablet_manager.cc:1918] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.413431 1562 log.cc:1196] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/da8215167ad74dbfb2cc1c8d50a76ed5
I20260927 15:05:58.414162 1562 ts_tablet_manager.cc:1939] T da8215167ad74dbfb2cc1c8d50a76ed5 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:58.415897 1561 tablet_bootstrap.cc:492] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.417168 1593 raft_consensus.cc:2781] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:58.417218 1561 ts_tablet_manager.cc:1397] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.172s user 0.008s sys 0.000s
I20260927 15:05:58.418057 1561 raft_consensus.cc:348] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.418761 1561 raft_consensus.cc:374] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.418885 1561 raft_consensus.cc:729] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.419191 1561 consensus_queue.cc:260] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.419767 1562 tablet_replica.cc:330] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:58.420595 1633 raft_consensus.cc:482] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.420804 1633 raft_consensus.cc:504] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.421188 1562 raft_consensus.cc:2229] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.421352 1562 raft_consensus.cc:2258] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.421633 1633 leader_election.cc:288] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.421921 1562 ts_tablet_manager.cc:1905] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:05:58.423345 1239 leader_election.cc:341] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 538516912cf14ebfb0bfb31f706b66fc
I20260927 15:05:58.419894 1561 ts_tablet_manager.cc:1428] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260927 15:05:58.424288 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 443af328e5154bdba9b570224616d77b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 443af328e5154bdba9b570224616d77b already in progress: creating tablet
W20260927 15:05:58.425180 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 61339e532e6c431babb15422a08f7aa6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61339e532e6c431babb15422a08f7aa6 already in progress: creating tablet
I20260927 15:05:58.427410 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 30244d596d4d4090af7656027b48f22e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.428253 1561 tablet_bootstrap.cc:492] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:05:58.429100 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6c7a8bf15c48423ea9ff14c46645a33b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c7a8bf15c48423ea9ff14c46645a33b already in progress: creating tablet
W20260927 15:05:58.429876 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet d6925d0369524e7eb1ac3c20ad699ded because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6925d0369524e7eb1ac3c20ad699ded already in progress: creating tablet
W20260927 15:05:58.430675 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7a42ae7589c24b1bbd833ab8838521ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a42ae7589c24b1bbd833ab8838521ae already in progress: creating tablet
W20260927 15:05:58.431862 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ba7faf6e79db420db13999d74fe86062 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba7faf6e79db420db13999d74fe86062 already in progress: creating tablet
I20260927 15:05:58.432569 1593 raft_consensus.cc:686] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:05:58.432953 1593 consensus_queue.cc:237] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:58.436444 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6d6eed08273244d28fd15785a09059f9 (table default.Table_d43c271e9640447699f9f1c2c7a6a1d5 [id=aa16f23914de4c7db1e460bb1c743a4d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6d6eed08273244d28fd15785a09059f9 consensus state has no leader
I20260927 15:05:58.437358 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead753ba6664829b1262712f35e64f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.437763 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538516912cf14ebfb0bfb31f706b66fc" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:58.439234 1559 ts_tablet_manager.cc:1918] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.440197 1562 ts_tablet_manager.cc:1918] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.440472 1439 raft_consensus.cc:2454] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:05:58.441016 1238 leader_election.cc:302] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: c4264874db964ff2830b7894c2b3d61c
I20260927 15:05:58.441442 1633 raft_consensus.cc:2781] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:58.441574 1633 raft_consensus.cc:482] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:58.441665 1633 raft_consensus.cc:3037] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.443498 1562 log.cc:1196] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/604c05acf3864fc697758208de68da18
I20260927 15:05:58.445179 1633 raft_consensus.cc:504] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.447009 1633 leader_election.cc:288] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:05:58.448432 1239 leader_election.cc:341] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 538516912cf14ebfb0bfb31f706b66fc
I20260927 15:05:58.448812 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538516912cf14ebfb0bfb31f706b66fc" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:05:58.451362 1556 tablet_bootstrap.cc:492] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:58.451737 1562 ts_tablet_manager.cc:1939] T 604c05acf3864fc697758208de68da18 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:58.452939 1562 tablet_replica.cc:330] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:58.453197 1562 raft_consensus.cc:2229] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.453420 1562 raft_consensus.cc:2258] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.453986 1562 ts_tablet_manager.cc:1905] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.456264 1629 tablet.cc:1717] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Skipping requested alter to schema version 4, tablet already version 4
I20260927 15:05:58.456487 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3c3f771ede53431eac4f72641bf34c64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.456957 1561 tablet_bootstrap.cc:654] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:05:58.457121 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c3f771ede53431eac4f72641bf34c64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.463828 1643 tablet.cc:1717] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Skipping requested alter to schema version 4, tablet already version 4
I20260927 15:05:58.468235 1628 tablet.cc:1717] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Skipping requested alter to schema version 4, tablet already version 4
I20260927 15:05:58.468276 1562 ts_tablet_manager.cc:1918] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.468415 1562 log.cc:1196] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/3e4e18e695f54d85b25958330717c713
I20260927 15:05:58.472034 1439 raft_consensus.cc:3037] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.472074 1556 ts_tablet_manager.cc:1397] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.408s user 0.062s sys 0.119s
I20260927 15:05:58.472215 1638 raft_consensus.cc:482] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.472432 1638 raft_consensus.cc:504] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.473260 1638 leader_election.cc:288] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:58.473227 1556 raft_consensus.cc:348] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.473532 1556 raft_consensus.cc:374] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.473610 1556 raft_consensus.cc:729] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.473937 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da8215167ad74dbfb2cc1c8d50a76ed5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:58.473896 1556 consensus_queue.cc:260] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:58.474449 1374 leader_election.cc:341] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: da8215167ad74dbfb2cc1c8d50a76ed5
W20260927 15:05:58.474929 1376 leader_election.cc:341] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.475082 1376 leader_election.cc:302] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:05:58.475310 1638 raft_consensus.cc:2726] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:05:58.475487 1651 negotiation.cc:337] Failed RPC negotiation. Trace:
0927 15:05:58.092453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.201.62:41167 (local address 127.0.201.3:48065)
0927 15:05:58.249400 (+156947us) negotiation.cc:107] Waiting for socket to connect
0927 15:05:58.439205 (+189805us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":70267,"thread_start_us":65314,"threads_started":1}
I20260927 15:05:58.475967 1629 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 15:05:58.476428 1556 ts_tablet_manager.cc:1428] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:05:58.478200 1556 tablet_bootstrap.cc:492] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:05:58.478613 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 443af328e5154bdba9b570224616d77b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 443af328e5154bdba9b570224616d77b already in progress: creating tablet
I20260927 15:05:58.478917 1559 log.cc:1196] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3a30cef3b4c2436c8c222f35b244fd06
W20260927 15:05:58.479161 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6c7a8bf15c48423ea9ff14c46645a33b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c7a8bf15c48423ea9ff14c46645a33b already in progress: creating tablet
W20260927 15:05:58.479458 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8f15485b8825436184abe2621c71e356 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f15485b8825436184abe2621c71e356 already in progress: creating tablet
W20260927 15:05:58.479655 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 7a42ae7589c24b1bbd833ab8838521ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a42ae7589c24b1bbd833ab8838521ae already in progress: creating tablet
W20260927 15:05:58.479863 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet d6925d0369524e7eb1ac3c20ad699ded because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6925d0369524e7eb1ac3c20ad699ded already in progress: creating tablet
W20260927 15:05:58.480067 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ba7faf6e79db420db13999d74fe86062 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba7faf6e79db420db13999d74fe86062 already in progress: creating tablet
I20260927 15:05:58.480476 1643 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20260927 15:05:58.481046 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8f15485b8825436184abe2621c71e356 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f15485b8825436184abe2621c71e356 already in progress: creating tablet
I20260927 15:05:58.489028 1562 ts_tablet_manager.cc:1939] T 3e4e18e695f54d85b25958330717c713 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:58.491178 1562 tablet_replica.cc:330] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:05:58.491452 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d31bf920f0d41478863959d49400731 consensus state has no leader
I20260927 15:05:58.491641 1562 raft_consensus.cc:2229] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.491801 1562 raft_consensus.cc:2258] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:05:58.491937 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a260c9d3b8fb4316864e6f986559bef1 has no consensus state
I20260927 15:05:58.494150 1562 ts_tablet_manager.cc:1905] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.494357 1561 tablet_bootstrap.cc:492] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.495318 1561 ts_tablet_manager.cc:1397] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.003s
I20260927 15:05:58.495162 907 catalog_manager.cc:5495] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:05:58.495791 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0781c9c8b4ad498bb27573939b7d06b2 (table default.Table_81479ddeb1b6463cab4db3d03d955a91 [id=f301a482365b4cf2b752fccd860a8d2d]). Expected version 3 got 0
I20260927 15:05:58.496299 1561 raft_consensus.cc:348] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.496563 1561 raft_consensus.cc:374] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.496706 1561 raft_consensus.cc:729] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.497118 1561 consensus_queue.cc:260] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.501933 1561 ts_tablet_manager.cc:1428] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:05:58.504134 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 63289edbdd734dd5a817df42d83e422e (DEFAULT_TABLE table=default.Table_b093eeae2295436bb418ac8610a19dd0 [id=9680ba832c914d98b077951ac46dc2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.504526 1276 tablet_service.cc:1467] Processing CreateTablet for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 (DEFAULT_TABLE table=default.Table_bbb9f9f890a54220b1065de77e571c1e [id=da0dd555186044f2ac3825b4fbeb645a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.504874 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9a7ed6e23e1479a86e2abcf6aa5b317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.505698 1561 tablet_bootstrap.cc:492] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.506403 1560 tablet_replica.cc:330] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:58.507642 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 63289edbdd734dd5a817df42d83e422e (DEFAULT_TABLE table=default.Table_b093eeae2295436bb418ac8610a19dd0 [id=9680ba832c914d98b077951ac46dc2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.508584 1556 tablet_bootstrap.cc:654] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.509923 1561 tablet_bootstrap.cc:654] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.510552 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet da8215167ad74dbfb2cc1c8d50a76ed5 (table default.Table_bfeb38d1ec214c8989fc01c677d5daef [id=9ed827c5b3234624bc1c68aec0d7fc73]) successfully deleted
I20260927 15:05:58.510758 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 604c05acf3864fc697758208de68da18 (table default.Table_7df3939469d744798289afe55352f822 [id=7edfbbe676dd491a81129debceebd914]) successfully deleted
I20260927 15:05:58.510962 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 3e4e18e695f54d85b25958330717c713 (table default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]) successfully deleted
I20260927 15:05:58.511212 1573 raft_consensus.cc:482] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.511365 1573 raft_consensus.cc:504] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.511559 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead753ba6664829b1262712f35e64f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.512023 1573 leader_election.cc:288] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.512624 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63289edbdd734dd5a817df42d83e422e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.512931 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6925d0369524e7eb1ac3c20ad699ded" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:58.506728 1562 ts_tablet_manager.cc:1918] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:05:58.513525 1102 leader_election.cc:341] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.513590 1562 log.cc:1196] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/43552776a19a4e75aa2d6f3d983e3432
I20260927 15:05:58.514079 1282 tablet_service.cc:1467] Processing CreateTablet for tablet cad4605da5e045e7969da2d6f56a7e70 (DEFAULT_TABLE table=default.Table_d62fe8ec9c694017bb26e4b692b51007 [id=672533238895472b9bfb06706e4b41bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.514595 1562 ts_tablet_manager.cc:1939] T 43552776a19a4e75aa2d6f3d983e3432 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:05:58.515341 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 148c77a0e88b40f690ca96f091b78d9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 148c77a0e88b40f690ca96f091b78d9a already in progress: creating tablet
I20260927 15:05:58.514796 1279 tablet_service.cc:1467] Processing CreateTablet for tablet a260c9d3b8fb4316864e6f986559bef1 (DEFAULT_TABLE table=default.Table_b592f94f43ea4ffe8068db6aed19c5ef [id=61c39607ad5b482c80883c0e60f0da9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.516125 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 109f9088371e4f008b2b5f993f2b4c3b (DEFAULT_TABLE table=default.Table_5e5da599fcef4b94ac03384faad9c44a [id=807446b6eab74770aa64683a5cf590a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.524318 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 63289edbdd734dd5a817df42d83e422e (DEFAULT_TABLE table=default.Table_b093eeae2295436bb418ac8610a19dd0 [id=9680ba832c914d98b077951ac46dc2b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.524752 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63289edbdd734dd5a817df42d83e422e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:58.526080 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d6eed08273244d28fd15785a09059f9 consensus state has no leader
I20260927 15:05:58.528396 1420 tablet_service.cc:1467] Processing CreateTablet for tablet a46e15ea145b4eae8f94b664067b4f92 (DEFAULT_TABLE table=default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20 [id=3fea2c5530204bb9ada53551032065b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.528870 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 (DEFAULT_TABLE table=default.Table_f1c5c1132cab4343b25f94cd31941336 [id=36810bbe6edd4d769f3f5da76c71e6e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.529309 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cad4605da5e045e7969da2d6f56a7e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.532167 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 (DEFAULT_TABLE table=default.Table_f1c5c1132cab4343b25f94cd31941336 [id=36810bbe6edd4d769f3f5da76c71e6e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.532706 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07b63e63f7cd4075bcf10a463ce16e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.533739 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07b63e63f7cd4075bcf10a463ce16e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.535274 1136 tablet_service.cc:1467] Processing CreateTablet for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 (DEFAULT_TABLE table=default.Table_bbb9f9f890a54220b1065de77e571c1e [id=da0dd555186044f2ac3825b4fbeb645a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.535823 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9a7ed6e23e1479a86e2abcf6aa5b317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.536921 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 43552776a19a4e75aa2d6f3d983e3432 (table default.Table_f7ff3654808747e7a0a788d21ab84691 [id=5c4f0f47acd14538b67f8c8d579b0696]) successfully deleted
W20260927 15:05:58.537164 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8af844423fc94e2c8380db179103d3aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8af844423fc94e2c8380db179103d3aa already in progress: creating tablet
W20260927 15:05:58.537384 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ab08d04c11dd44299ee5f9a911d581c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab08d04c11dd44299ee5f9a911d581c3 already in progress: creating tablet
W20260927 15:05:58.537587 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 30244d596d4d4090af7656027b48f22e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30244d596d4d4090af7656027b48f22e already in progress: creating tablet
I20260927 15:05:58.537655 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a260c9d3b8fb4316864e6f986559bef1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:58.537777 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 4ead753ba6664829b1262712f35e64f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ead753ba6664829b1262712f35e64f2 already in progress: creating tablet
I20260927 15:05:58.539223 1131 tablet_service.cc:1467] Processing CreateTablet for tablet a46e15ea145b4eae8f94b664067b4f92 (DEFAULT_TABLE table=default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20 [id=3fea2c5530204bb9ada53551032065b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.539708 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a46e15ea145b4eae8f94b664067b4f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.541364 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 109f9088371e4f008b2b5f993f2b4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.543146 1143 tablet_service.cc:1467] Processing CreateTablet for tablet a260c9d3b8fb4316864e6f986559bef1 (DEFAULT_TABLE table=default.Table_b592f94f43ea4ffe8068db6aed19c5ef [id=61c39607ad5b482c80883c0e60f0da9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.543700 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a260c9d3b8fb4316864e6f986559bef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.546617 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 109f9088371e4f008b2b5f993f2b4c3b (DEFAULT_TABLE table=default.Table_5e5da599fcef4b94ac03384faad9c44a [id=807446b6eab74770aa64683a5cf590a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.547173 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 109f9088371e4f008b2b5f993f2b4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.553270 1145 tablet_service.cc:1467] Processing CreateTablet for tablet cad4605da5e045e7969da2d6f56a7e70 (DEFAULT_TABLE table=default.Table_d62fe8ec9c694017bb26e4b692b51007 [id=672533238895472b9bfb06706e4b41bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.553771 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cad4605da5e045e7969da2d6f56a7e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.563632 1560 raft_consensus.cc:2229] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.563900 1560 raft_consensus.cc:2258] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.528321 1628 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 15:05:58.564483 1419 tablet_service.cc:1467] Processing CreateTablet for tablet a260c9d3b8fb4316864e6f986559bef1 (DEFAULT_TABLE table=default.Table_b592f94f43ea4ffe8068db6aed19c5ef [id=61c39607ad5b482c80883c0e60f0da9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.566077 1559 ts_tablet_manager.cc:1939] T 3a30cef3b4c2436c8c222f35b244fd06 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:58.567029 1560 ts_tablet_manager.cc:1905] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.568864 1280 tablet_service.cc:1467] Processing CreateTablet for tablet a46e15ea145b4eae8f94b664067b4f92 (DEFAULT_TABLE table=default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20 [id=3fea2c5530204bb9ada53551032065b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.572305 1439 raft_consensus.cc:2454] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:05:58.580165 1643 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:05:58.587064 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 1c49c70e003f47d6a325669376e5e3ca from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.597386 1629 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:05:58.601284 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a46e15ea145b4eae8f94b664067b4f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.604225 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_34408a3d87a447d499fbdf349cea9f34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.604861 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34408a3d87a447d499fbdf349cea9f34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.606209 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4ae68d29ddc646a5b8ff7714ff60b1e1" } new_table_name: "default.Table_667c238b190b4cc0a521a2a1e2250402" modify_external_catalogs: true
I20260927 15:05:58.607601 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e7ef4602b573455ba998b9742647c917" } new_table_name: "default.Table_83c5d552eb044e369bac27b9e1aac15c" modify_external_catalogs: true
I20260927 15:05:58.607827 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5d69d67ea0984bd994da0935b6ccc3c8" } modify_external_catalogs: true
I20260927 15:05:58.608079 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5d69d67ea0984bd994da0935b6ccc3c8" } modify_external_catalogs: true
I20260927 15:05:58.609391 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bbb9f9f890a54220b1065de77e571c1e" } modify_external_catalogs: true
I20260927 15:05:58.609573 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bbb9f9f890a54220b1065de77e571c1e" } modify_external_catalogs: true
I20260927 15:05:58.609843 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_195d86242b4c4d008065aee0ea319f60" } modify_external_catalogs: true
I20260927 15:05:58.610042 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_195d86242b4c4d008065aee0ea319f60" } modify_external_catalogs: true
I20260927 15:05:58.610702 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81479ddeb1b6463cab4db3d03d955a91" } modify_external_catalogs: true
I20260927 15:05:58.610953 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81479ddeb1b6463cab4db3d03d955a91" } modify_external_catalogs: true
I20260927 15:05:58.610837 1539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:05:58.611268 1539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: This master's current role is: LEADER
I20260927 15:05:58.611214 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9e37ca2b041a439aa503560c17e5b391"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.611729 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e37ca2b041a439aa503560c17e5b391 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.613350 912 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_e6b64fb416dd492caadccd2e9d65a802 [id=b1106aee6c804da4a603364cee1c1116]). Expected version 2 got 0
I20260927 15:05:58.615052 1416 tablet_service.cc:1467] Processing CreateTablet for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 (DEFAULT_TABLE table=default.Table_bbb9f9f890a54220b1065de77e571c1e [id=da0dd555186044f2ac3825b4fbeb645a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.615151 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 (DEFAULT_TABLE table=default.Table_f1c5c1132cab4343b25f94cd31941336 [id=36810bbe6edd4d769f3f5da76c71e6e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.615564 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63289edbdd734dd5a817df42d83e422e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.615909 1412 tablet_service.cc:1467] Processing CreateTablet for tablet cad4605da5e045e7969da2d6f56a7e70 (DEFAULT_TABLE table=default.Table_d62fe8ec9c694017bb26e4b692b51007 [id=672533238895472b9bfb06706e4b41bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.616261 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cad4605da5e045e7969da2d6f56a7e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.618501 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a260c9d3b8fb4316864e6f986559bef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.618891 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 109f9088371e4f008b2b5f993f2b4c3b (DEFAULT_TABLE table=default.Table_5e5da599fcef4b94ac03384faad9c44a [id=807446b6eab74770aa64683a5cf590a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.619302 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 109f9088371e4f008b2b5f993f2b4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.619550 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a46e15ea145b4eae8f94b664067b4f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.619887 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07b63e63f7cd4075bcf10a463ce16e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.621244 1561 tablet_bootstrap.cc:492] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.622330 1561 ts_tablet_manager.cc:1397] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.116s user 0.004s sys 0.001s
I20260927 15:05:58.623724 1561 raft_consensus.cc:348] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.627355 1561 raft_consensus.cc:374] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.628845 1561 raft_consensus.cc:729] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.629555 1561 consensus_queue.cc:260] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.631983 1561 ts_tablet_manager.cc:1428] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260927 15:05:58.632669 1561 tablet_bootstrap.cc:492] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.634896 1561 tablet_bootstrap.cc:654] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.638456 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 74) took 1135 ms. Trace:
I20260927 15:05:58.638603 1559 rpcz_store.cc:276] 0927 15:05:57.502903 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.502944 (+ 41us) service_pool.cc:227] Handling call
0927 15:05:58.088202 (+585258us) ts_tablet_manager.cc:1145] Deleting tablet 3a30cef3b4c2436c8c222f35b244fd06
0927 15:05:58.088212 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:58.102242 (+ 14030us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:58.432473 (+330231us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:58.638386 (+205913us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":584701}
I20260927 15:05:58.639101 1559 tablet_replica.cc:330] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:58.639285 1559 raft_consensus.cc:2229] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.639477 1559 raft_consensus.cc:2258] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.639990 1559 ts_tablet_manager.cc:1905] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.645013 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6925d0369524e7eb1ac3c20ad699ded" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:58.645329 1439 raft_consensus.cc:2454] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:05:58.646782 1099 leader_election.cc:302] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:58.647010 1559 ts_tablet_manager.cc:1918] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.647127 1559 log.cc:1196] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/8966721a788d4e64ad5e495b5a69b74d
I20260927 15:05:58.647114 1573 raft_consensus.cc:2781] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:58.647230 1573 raft_consensus.cc:482] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:58.647337 1573 raft_consensus.cc:3037] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.647505 1559 ts_tablet_manager.cc:1939] T 8966721a788d4e64ad5e495b5a69b74d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:58.648192 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 75) took 1144 ms. Trace:
I20260927 15:05:58.648296 1559 rpcz_store.cc:276] 0927 15:05:57.503667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.503704 (+ 37us) service_pool.cc:227] Handling call
0927 15:05:58.639026 (+1135322us) ts_tablet_manager.cc:1145] Deleting tablet 8966721a788d4e64ad5e495b5a69b74d
0927 15:05:58.639033 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:58.644021 (+ 4988us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:58.646912 (+ 2891us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:58.648158 (+ 1246us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1135179}
I20260927 15:05:58.648643 1559 tablet_replica.cc:330] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:58.648828 1559 raft_consensus.cc:2229] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.648981 1559 raft_consensus.cc:2258] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.649514 1559 ts_tablet_manager.cc:1905] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.650060 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9a7ed6e23e1479a86e2abcf6aa5b317. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.650187 1573 raft_consensus.cc:504] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.650811 1573 leader_election.cc:288] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.651557 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6925d0369524e7eb1ac3c20ad699ded" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:05:58.651708 1556 tablet_bootstrap.cc:492] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:58.651852 1556 ts_tablet_manager.cc:1397] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.175s user 0.004s sys 0.005s
I20260927 15:05:58.651820 1439 raft_consensus.cc:3037] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.652768 1556 raft_consensus.cc:348] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.653002 1556 raft_consensus.cc:374] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.653129 1556 raft_consensus.cc:729] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.653357 1556 consensus_queue.cc:260] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.653973 1556 ts_tablet_manager.cc:1428] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:05:58.654256 1556 tablet_bootstrap.cc:492] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:58.655777 1439 raft_consensus.cc:2454] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:05:58.657445 1556 tablet_bootstrap.cc:654] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.657680 1099 leader_election.cc:302] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:58.658167 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 3a30cef3b4c2436c8c222f35b244fd06 (table default.Table_817637f69c9a40eda1a54ec015d7cb32 [id=7f0fdeabadf2411196e949e581b7337c]) successfully deleted
I20260927 15:05:58.658252 1573 raft_consensus.cc:2781] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:58.658447 1573 raft_consensus.cc:686] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:05:58.658735 1573 consensus_queue.cc:237] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.661876 1238 leader_election.cc:302] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: c4264874db964ff2830b7894c2b3d61c
W20260927 15:05:58.663514 1238 raft_consensus.cc:2670] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 15:05:58.668887 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 8966721a788d4e64ad5e495b5a69b74d (table default.Table_9112f8699da541b58056a9f60137658e [id=d2fe03ba4bf141ef982f5a6b86fae022]) successfully deleted
I20260927 15:05:58.671187 1552 tablet_bootstrap.cc:492] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:58.668674 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6925d0369524e7eb1ac3c20ad699ded" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:05:58.672849 1102 leader_election.cc:341] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.679543 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 67cf4dae943e4092b2c490ad770e4a94 from {username='slave'} at 127.0.0.1:49800
W20260927 15:05:58.684198 898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection refused (error 111) [suppressed 5 similar messages]
I20260927 15:05:58.685097 1561 tablet_bootstrap.cc:492] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.685353 1561 ts_tablet_manager.cc:1397] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.005s
I20260927 15:05:58.686280 1561 raft_consensus.cc:348] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.686864 1561 raft_consensus.cc:374] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.687027 1561 raft_consensus.cc:729] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.687328 1561 consensus_queue.cc:260] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.688115 1561 ts_tablet_manager.cc:1428] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:05:58.688457 1561 tablet_bootstrap.cc:492] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.690663 1561 tablet_bootstrap.cc:654] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.698616 1439 raft_consensus.cc:1261] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Refusing update from remote peer c4264874db964ff2830b7894c2b3d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:58.699400 1637 consensus_queue.cc:1035] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:05:58.703609 1552 ts_tablet_manager.cc:1397] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.491s user 0.041s sys 0.072s
I20260927 15:05:58.704965 1561 tablet_bootstrap.cc:492] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.705243 1561 ts_tablet_manager.cc:1397] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.007s
I20260927 15:05:58.706313 1561 raft_consensus.cc:348] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.706736 1561 raft_consensus.cc:374] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.706933 1561 raft_consensus.cc:729] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:05:58.707129 1102 consensus_peers.cc:487] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:05:58.707301 1561 consensus_queue.cc:260] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.711848 909 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 44ce7bf40adb4155895c85006593be4b
I20260927 15:05:58.712127 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 4ead753ba6664829b1262712f35e64f2 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.712604 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 6d6eed08273244d28fd15785a09059f9 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.715508 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 67cf4dae943e4092b2c490ad770e4a94
I20260927 15:05:58.716029 912 catalog_manager.cc:6565] ReplaceTablet: tablet 67cf4dae943e4092b2c490ad770e4a94 deleted and replaced by tablet b6f6bdef4ddb4f9c9c0d1f933768cd14
I20260927 15:05:58.716231 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d1f23f91bce4df480dd9991659f2e81 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.716286 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 67cf4dae943e4092b2c490ad770e4a94 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f6bdef4ddb4f9c9c0d1f933768cd14) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.716476 1643 tablet.cc:1722] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:05:58.717082 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 67cf4dae943e4092b2c490ad770e4a94 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f6bdef4ddb4f9c9c0d1f933768cd14) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.717518 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e9a7ed6e23e1479a86e2abcf6aa5b317
W20260927 15:05:58.718223 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc971defe6d148439a6a0b8c55d9092e consensus state has no leader
W20260927 15:05:58.718659 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08f28c023473434ba73b1142a041be97 consensus state has no leader
I20260927 15:05:58.718679 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.721084 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 67cf4dae943e4092b2c490ad770e4a94 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f6bdef4ddb4f9c9c0d1f933768cd14) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.721331 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.721482 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9c9e4311049d47d3b2f1e117795624ef
I20260927 15:05:58.722273 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c9e4311049d47d3b2f1e117795624ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:05:58.724025 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 67cf4dae943e4092b2c490ad770e4a94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67cf4dae943e4092b2c490ad770e4a94 already in progress: creating tablet
I20260927 15:05:58.724226 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c9e4311049d47d3b2f1e117795624ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:05:58.724285 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9a7ed6e23e1479a86e2abcf6aa5b317 already in progress: creating tablet
I20260927 15:05:58.724794 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_29e94bb122d84391b9632159a1adedfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.725378 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29e94bb122d84391b9632159a1adedfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.726678 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fdbd726355df419fae94cbf8fce53375"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.727250 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdbd726355df419fae94cbf8fce53375 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.728389 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8000e7f7337f4588a7668f6d97c754cd" } modify_external_catalogs: true
I20260927 15:05:58.728613 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8000e7f7337f4588a7668f6d97c754cd" } modify_external_catalogs: true
W20260927 15:05:58.728950 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9c9e4311049d47d3b2f1e117795624ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c9e4311049d47d3b2f1e117795624ef already in progress: creating tablet
I20260927 15:05:58.729193 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7258841dfdbd45b0a5745d0a4cbd5551"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.729431 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c8a2e4d5fa1e4d1fb3cb671e627f77be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.729720 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7258841dfdbd45b0a5745d0a4cbd5551 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:58.729853 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8a2e4d5fa1e4d1fb3cb671e627f77be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.730742 1556 tablet_bootstrap.cc:492] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:58.731238 1556 ts_tablet_manager.cc:1397] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.077s user 0.004s sys 0.000s
I20260927 15:05:58.731873 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_e6b64fb416dd492caadccd2e9d65a802 [id=b1106aee6c804da4a603364cee1c1116] alter complete (version 2)
I20260927 15:05:58.732234 1561 ts_tablet_manager.cc:1428] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260927 15:05:58.732676 1561 tablet_bootstrap.cc:492] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.732875 1556 raft_consensus.cc:348] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.733170 1556 raft_consensus.cc:374] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.733389 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.734308 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c9e4311049d47d3b2f1e117795624ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.734651 1561 tablet_bootstrap.cc:654] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.734684 1556 raft_consensus.cc:729] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.735121 1556 consensus_queue.cc:260] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.735956 1628 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:05:58.736743 1552 raft_consensus.cc:348] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.737041 1552 raft_consensus.cc:374] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.737289 1552 raft_consensus.cc:729] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.737648 1552 consensus_queue.cc:260] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.739262 1552 ts_tablet_manager.cc:1428] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260927 15:05:58.739579 1552 tablet_bootstrap.cc:492] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:58.739993 1637 raft_consensus.cc:482] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.740160 1637 raft_consensus.cc:504] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.740797 1637 leader_election.cc:288] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.741976 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ad68a0adad407a92b2335f43e67227" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:58.742527 1102 leader_election.cc:341] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.743202 1556 ts_tablet_manager.cc:1428] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260927 15:05:58.744362 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ad68a0adad407a92b2335f43e67227" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:58.744594 1561 tablet_bootstrap.cc:492] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.744652 1440 raft_consensus.cc:2454] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:05:58.744884 1561 ts_tablet_manager.cc:1397] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260927 15:05:58.745065 1556 tablet_bootstrap.cc:492] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:58.745102 1099 leader_election.cc:302] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:58.745631 1637 raft_consensus.cc:2781] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:58.745734 1637 raft_consensus.cc:482] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:58.745844 1637 raft_consensus.cc:3037] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.745924 1561 raft_consensus.cc:348] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.746150 1561 raft_consensus.cc:374] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.746245 1561 raft_consensus.cc:729] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.746519 1561 consensus_queue.cc:260] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.747324 1561 ts_tablet_manager.cc:1428] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:05:58.747629 1561 tablet_bootstrap.cc:492] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.748021 1556 tablet_bootstrap.cc:654] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.749384 1561 tablet_bootstrap.cc:654] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.751273 1637 raft_consensus.cc:504] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.752025 1628 tablet.cc:1722] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:05:58.754848 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ad68a0adad407a92b2335f43e67227" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:05:58.755468 1102 leader_election.cc:341] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.751667 1561 tablet_bootstrap.cc:492] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.756488 1561 ts_tablet_manager.cc:1397] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.003s
I20260927 15:05:58.756829 1637 leader_election.cc:288] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.757306 1561 raft_consensus.cc:348] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.757579 1561 raft_consensus.cc:374] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.757682 1561 raft_consensus.cc:729] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.757920 1561 consensus_queue.cc:260] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.758363 1561 ts_tablet_manager.cc:1428] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:05:58.758687 1561 tablet_bootstrap.cc:492] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.760566 1561 tablet_bootstrap.cc:654] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.762116 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ad68a0adad407a92b2335f43e67227" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:05:58.762341 1439 raft_consensus.cc:3037] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.762370 1556 tablet_bootstrap.cc:492] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:58.762522 1556 ts_tablet_manager.cc:1397] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.001s
I20260927 15:05:58.763358 1556 raft_consensus.cc:348] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.763572 1556 raft_consensus.cc:374] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.763670 1556 raft_consensus.cc:729] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.763867 1556 consensus_queue.cc:260] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.764587 1556 ts_tablet_manager.cc:1428] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:05:58.764837 1556 tablet_bootstrap.cc:492] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:58.765369 1439 raft_consensus.cc:2454] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:05:58.766511 1552 tablet_bootstrap.cc:654] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.766521 1099 leader_election.cc:302] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:58.766716 1556 tablet_bootstrap.cc:654] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.767056 1637 raft_consensus.cc:2781] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:58.768340 1637 raft_consensus.cc:686] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:05:58.768779 1637 consensus_queue.cc:237] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.774022 1560 ts_tablet_manager.cc:1918] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.774962 1561 tablet_bootstrap.cc:492] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.775113 1561 ts_tablet_manager.cc:1397] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.001s
I20260927 15:05:58.775914 1593 raft_consensus.cc:482] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.776062 1559 ts_tablet_manager.cc:1918] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.776057 1561 raft_consensus.cc:348] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.776242 1559 log.cc:1196] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/43552776a19a4e75aa2d6f3d983e3432
I20260927 15:05:58.776070 1593 raft_consensus.cc:504] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.776307 1561 raft_consensus.cc:374] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.776418 1561 raft_consensus.cc:729] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.776870 1593 leader_election.cc:288] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:58.777235 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d31bf920f0d41478863959d49400731" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:58.777146 1561 consensus_queue.cc:260] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.777455 1165 raft_consensus.cc:2454] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:05:58.777907 1374 leader_election.cc:302] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:58.779129 1593 raft_consensus.cc:2781] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:58.779242 1593 raft_consensus.cc:482] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:58.779322 1593 raft_consensus.cc:3037] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.779920 1561 ts_tablet_manager.cc:1428] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260927 15:05:58.781282 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7d1f23f91bce4df480dd9991659f2e81
I20260927 15:05:58.781430 1561 tablet_bootstrap.cc:492] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.781652 912 catalog_manager.cc:6565] ReplaceTablet: tablet 7d1f23f91bce4df480dd9991659f2e81 deleted and replaced by tablet cd901034653b47dbba7912d5338bc3bb
I20260927 15:05:58.781901 1593 raft_consensus.cc:504] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.782225 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6d6eed08273244d28fd15785a09059f9
I20260927 15:05:58.782651 909 catalog_manager.cc:6565] ReplaceTablet: tablet 6d6eed08273244d28fd15785a09059f9 deleted and replaced by tablet 54a07831078b48a59807f7da4a42bcec
I20260927 15:05:58.783192 1561 tablet_bootstrap.cc:654] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.783969 1593 leader_election.cc:288] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:58.784610 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d1f23f91bce4df480dd9991659f2e81 with delete_type TABLET_DATA_DELETED (replaced by tablet cd901034653b47dbba7912d5338bc3bb) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.777459 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d31bf920f0d41478863959d49400731" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:58.782949 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d31bf920f0d41478863959d49400731" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:05:58.784900 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6eed08273244d28fd15785a09059f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a07831078b48a59807f7da4a42bcec) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.783638 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6eed08273244d28fd15785a09059f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a07831078b48a59807f7da4a42bcec) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:58.785405 1376 leader_election.cc:341] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:05:58.785710 1376 leader_election.cc:341] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.782738 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_e6b64fb416dd492caadccd2e9d65a802 [id=b1106aee6c804da4a603364cee1c1116]). Expected version 2 got 0
I20260927 15:05:58.786366 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_65acf9b7f2074b44aacf9bee5790329d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.786741 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6eed08273244d28fd15785a09059f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a07831078b48a59807f7da4a42bcec) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.784272 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d1f23f91bce4df480dd9991659f2e81 with delete_type TABLET_DATA_DELETED (replaced by tablet cd901034653b47dbba7912d5338bc3bb) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.786803 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_06fd18ae207043788a5ea0e048ae2ecd" } new_table_name: "default.Table_a8794ae976fe4fd48b9015808f70e330" modify_external_catalogs: true
W20260927 15:05:58.786957 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65acf9b7f2074b44aacf9bee5790329d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.787052 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d1f23f91bce4df480dd9991659f2e81 with delete_type TABLET_DATA_DELETED (replaced by tablet cd901034653b47dbba7912d5338bc3bb) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.787262 1560 log.cc:1196] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/538516912cf14ebfb0bfb31f706b66fc
I20260927 15:05:58.787664 1560 ts_tablet_manager.cc:1939] T 538516912cf14ebfb0bfb31f706b66fc P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:58.782971 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_92b373f81f26454ca3c8a82dfe807cfb [id=861d1dea54204625a6d1ad99fb8f6873] alter complete (version 5)
I20260927 15:05:58.790333 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 538516912cf14ebfb0bfb31f706b66fc (table default.Table_92c6318423b147e6984c2c78960a5476 [id=ea5cc262555840bbb18aba64e7cce780]) successfully deleted
I20260927 15:05:58.791711 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d31bf920f0d41478863959d49400731" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:05:58.791961 1165 raft_consensus.cc:3037] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.792229 1560 tablet_replica.cc:330] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:58.792815 1573 raft_consensus.cc:482] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.792999 1573 raft_consensus.cc:504] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.793668 1573 leader_election.cc:288] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.794441 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b122f1436fde4c5da7f0afa3a1c24c70" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:58.795003 1102 leader_election.cc:341] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:58.795712 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b122f1436fde4c5da7f0afa3a1c24c70" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:58.796018 1439 raft_consensus.cc:2454] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:05:58.796139 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 7d1f23f91bce4df480dd9991659f2e81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d1f23f91bce4df480dd9991659f2e81 already in progress: creating tablet
W20260927 15:05:58.796415 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6d6eed08273244d28fd15785a09059f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d6eed08273244d28fd15785a09059f9 already in progress: creating tablet
I20260927 15:05:58.796662 1099 leader_election.cc:302] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:58.797076 1573 raft_consensus.cc:2781] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:58.783025 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4951c5b770cf4f529ec4a1112cc69f1c" } new_table_name: "default.Table_1b15320c32a54a9ab7a584a195d7aca8" modify_external_catalogs: true
I20260927 15:05:58.797184 1573 raft_consensus.cc:482] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:58.797215 1560 raft_consensus.cc:2229] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.797292 1573 raft_consensus.cc:3037] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.797431 1560 raft_consensus.cc:2258] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.797943 1560 ts_tablet_manager.cc:1905] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.783736 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e914cd108b0a44bd881d027973fb0ec8" } new_table_name: "default.Table_449ec2814883431caf85b7bf2d9b381c" modify_external_catalogs: true
I20260927 15:05:58.784482 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7d935f8994074713a4a90f02ff7f0111"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.784936 914 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 8daedd5b1fec46029d20a32840234bc9
I20260927 15:05:58.799867 1573 raft_consensus.cc:504] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:58.800139 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac3b1d765caf40a1a7593cdb19defcab consensus state has no leader
I20260927 15:05:58.785571 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a1cebe864d4d45c6bb51a54581236606"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.801065 804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
/tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.62:41167
--webserver_interface=127.0.201.62
--webserver_port=41209
--builtin_ntp_servers=127.0.201.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260927 15:05:58.806099 1556 tablet_bootstrap.cc:492] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:58.806948 1165 raft_consensus.cc:2454] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:05:58.807456 1374 leader_election.cc:302] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:58.807750 1593 raft_consensus.cc:2781] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:58.807888 1593 raft_consensus.cc:686] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:05:58.808132 1593 consensus_queue.cc:237] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.808557 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b122f1436fde4c5da7f0afa3a1c24c70" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:05:58.809139 1102 leader_election.cc:341] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:05:58.809496 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1cebe864d4d45c6bb51a54581236606 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.810315 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b122f1436fde4c5da7f0afa3a1c24c70" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:05:58.810545 1439 raft_consensus.cc:3037] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:05:58.810662 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d935f8994074713a4a90f02ff7f0111 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.811035 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 61339e532e6c431babb15422a08f7aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.811959 1573 leader_election.cc:288] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:58.812558 1552 tablet_bootstrap.cc:492] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:58.813426 1552 ts_tablet_manager.cc:1397] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.000s
I20260927 15:05:58.814024 1439 raft_consensus.cc:2454] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:05:58.814435 1552 raft_consensus.cc:348] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.814582 1099 leader_election.cc:302] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:05:58.814630 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89bd5b459caa42e7a9153d9273ad52c4 consensus state has no leader
I20260927 15:05:58.806409 1556 ts_tablet_manager.cc:1397] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.002s
I20260927 15:05:58.814998 1573 raft_consensus.cc:2781] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
W20260927 15:05:58.816732 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fde632b187eb4180b343d7bddc7f0943 has no consensus state
I20260927 15:05:58.818222 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fa178c2ce0e14306911368823822afc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.818938 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa178c2ce0e14306911368823822afc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.825121 1573 raft_consensus.cc:686] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:05:58.825385 1573 consensus_queue.cc:237] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.826958 906 master_service.cc:946] ReplaceTablet: received request to replace tablet 604c05acf3864fc697758208de68da18 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.827438 1552 raft_consensus.cc:374] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.827535 1552 raft_consensus.cc:729] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.828230 1552 consensus_queue.cc:260] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.828630 1559 ts_tablet_manager.cc:1939] T 43552776a19a4e75aa2d6f3d983e3432 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:58.831653 1552 ts_tablet_manager.cc:1428] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260927 15:05:58.832927 1142 tablet_service.cc:1467] Processing CreateTablet for tablet fde632b187eb4180b343d7bddc7f0943 (DEFAULT_TABLE table=default.Table_449ec2814883431caf85b7bf2d9b381c [id=bb4c8603779d4998bbf639ff0f8b2ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.833498 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fde632b187eb4180b343d7bddc7f0943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.833480 1274 tablet_service.cc:1467] Processing CreateTablet for tablet ad5af5df58824fe88d607a93216bd228 (DEFAULT_TABLE table=default.Table_86b086d55b34411782656982b6de6a74 [id=63f859bf91e142e3a4b9600a580b6b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.833870 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad5af5df58824fe88d607a93216bd228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.835955 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 988ae3a67a4b436583cb475fbcf07b8f (DEFAULT_TABLE table=default.Table_5b210f1beda84fd1945f9d3245063038 [id=19258732f721448fadcdb38690160dd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.836021 1143 tablet_service.cc:1467] Processing CreateTablet for tablet ad5af5df58824fe88d607a93216bd228 (DEFAULT_TABLE table=default.Table_86b086d55b34411782656982b6de6a74 [id=63f859bf91e142e3a4b9600a580b6b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.836385 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad5af5df58824fe88d607a93216bd228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.836467 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 3a231aff1a39485db36979208d871ab3 (DEFAULT_TABLE table=default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f [id=403185df10bf4ed980e2a8ce8427a93f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.836817 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a231aff1a39485db36979208d871ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.839159 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 988ae3a67a4b436583cb475fbcf07b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.839665 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 988ae3a67a4b436583cb475fbcf07b8f (DEFAULT_TABLE table=default.Table_5b210f1beda84fd1945f9d3245063038 [id=19258732f721448fadcdb38690160dd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.839753 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 3a231aff1a39485db36979208d871ab3 (DEFAULT_TABLE table=default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f [id=403185df10bf4ed980e2a8ce8427a93f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.840034 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 988ae3a67a4b436583cb475fbcf07b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.840231 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a231aff1a39485db36979208d871ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.842694 1280 tablet_service.cc:1467] Processing CreateTablet for tablet fde632b187eb4180b343d7bddc7f0943 (DEFAULT_TABLE table=default.Table_449ec2814883431caf85b7bf2d9b381c [id=bb4c8603779d4998bbf639ff0f8b2ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.843078 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fde632b187eb4180b343d7bddc7f0943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.854046 1552 tablet_bootstrap.cc:492] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:58.840229 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 3a231aff1a39485db36979208d871ab3 (DEFAULT_TABLE table=default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f [id=403185df10bf4ed980e2a8ce8427a93f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.855463 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a231aff1a39485db36979208d871ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.857208 1552 tablet_bootstrap.cc:654] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.840644 1419 tablet_service.cc:1467] Processing CreateTablet for tablet ad5af5df58824fe88d607a93216bd228 (DEFAULT_TABLE table=default.Table_86b086d55b34411782656982b6de6a74 [id=63f859bf91e142e3a4b9600a580b6b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.859424 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad5af5df58824fe88d607a93216bd228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.852738 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 988ae3a67a4b436583cb475fbcf07b8f (DEFAULT_TABLE table=default.Table_5b210f1beda84fd1945f9d3245063038 [id=19258732f721448fadcdb38690160dd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.865337 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 988ae3a67a4b436583cb475fbcf07b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.867642 1561 tablet_bootstrap.cc:492] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.867874 1561 ts_tablet_manager.cc:1397] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.086s user 0.007s sys 0.004s
I20260927 15:05:58.868700 1561 raft_consensus.cc:348] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.869107 1561 raft_consensus.cc:374] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.869242 1561 raft_consensus.cc:729] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.869561 1561 consensus_queue.cc:260] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.870276 1561 ts_tablet_manager.cc:1428] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:05:58.876157 1552 tablet_bootstrap.cc:492] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:58.876394 1552 ts_tablet_manager.cc:1397] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260927 15:05:58.876137 1560 ts_tablet_manager.cc:1918] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.877503 1560 log.cc:1196] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/604c05acf3864fc697758208de68da18
I20260927 15:05:58.877363 1552 raft_consensus.cc:348] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.877688 1552 raft_consensus.cc:374] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.877782 1561 tablet_bootstrap.cc:492] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.877800 1552 raft_consensus.cc:729] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.877795 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2f2bd859db5046c0afc8811df26a404f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.878088 1552 consensus_queue.cc:260] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:58.878417 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f2bd859db5046c0afc8811df26a404f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.878785 1552 ts_tablet_manager.cc:1428] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:05:58.879343 1560 ts_tablet_manager.cc:1939] T 604c05acf3864fc697758208de68da18 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:58.879745 1561 tablet_bootstrap.cc:654] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.853794 1420 tablet_service.cc:1467] Processing CreateTablet for tablet fde632b187eb4180b343d7bddc7f0943 (DEFAULT_TABLE table=default.Table_449ec2814883431caf85b7bf2d9b381c [id=bb4c8603779d4998bbf639ff0f8b2ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.837085 1556 raft_consensus.cc:348] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.880059 1556 raft_consensus.cc:374] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.880117 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fde632b187eb4180b343d7bddc7f0943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.880157 1556 raft_consensus.cc:729] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.880398 1556 consensus_queue.cc:260] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.880908 1556 ts_tablet_manager.cc:1428] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.066s user 0.001s sys 0.001s
I20260927 15:05:58.881345 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 604c05acf3864fc697758208de68da18 (table default.Table_7df3939469d744798289afe55352f822 [id=7edfbbe676dd491a81129debceebd914]) successfully deleted
I20260927 15:05:58.881771 1556 tablet_bootstrap.cc:492] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:58.883451 1556 tablet_bootstrap.cc:654] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.883701 1560 tablet_replica.cc:330] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:58.883992 1560 raft_consensus.cc:2229] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:05:58.884267 1560 pending_rounds.cc:62] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:05:58.884402 1560 pending_rounds.cc:68] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976302905565184 op_type: NO_OP noop_request { }
W20260927 15:05:58.884513 1374 consensus_peers.cc:487] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Couldn't send request to peer c4264874db964ff2830b7894c2b3d61c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61339e532e6c431babb15422a08f7aa6. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:05:58.884651 1560 raft_consensus.cc:2866] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:05:58.884819 1560 raft_consensus.cc:2258] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:05:58.885129 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8af844423fc94e2c8380db179103d3aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8af844423fc94e2c8380db179103d3aa already in progress: creating tablet
I20260927 15:05:58.886375 1560 ts_tablet_manager.cc:1905] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.829974 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 76) took 1325 ms. Trace:
I20260927 15:05:58.888945 1559 rpcz_store.cc:276] 0927 15:05:57.504036 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.504074 (+ 38us) service_pool.cc:227] Handling call
0927 15:05:58.648577 (+1144503us) ts_tablet_manager.cc:1145] Deleting tablet 43552776a19a4e75aa2d6f3d983e3432
0927 15:05:58.648586 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:58.729467 (+ 80881us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:58.775940 (+ 46473us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:58.829904 (+ 53964us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1144262}
I20260927 15:05:58.889433 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 43552776a19a4e75aa2d6f3d983e3432 (table default.Table_f7ff3654808747e7a0a788d21ab84691 [id=5c4f0f47acd14538b67f8c8d579b0696]) successfully deleted
I20260927 15:05:58.890257 1559 tablet_replica.cc:330] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:58.891386 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 7d31bf920f0d41478863959d49400731 (table default.Table_b1351f5b43b34a4981ab32258c31a00e [id=b28d0e08cf944e17a720641dab1f23f5]). Expected version 1 got 0
I20260927 15:05:58.891670 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 67ad68a0adad407a92b2335f43e67227 (table default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]). Expected version 1 got 0
I20260927 15:05:58.891896 914 catalog_manager.cc:5495] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:05:58.892217 1561 tablet_bootstrap.cc:492] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.892356 1561 ts_tablet_manager.cc:1397] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.006s
I20260927 15:05:58.892388 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet ac3b1d765caf40a1a7593cdb19defcab (table default.Table_a8794ae976fe4fd48b9015808f70e330 [id=6368f21af56d44f09f5cf1ec2d19f2b6]). Expected version 3 got 0
I20260927 15:05:58.893362 1561 raft_consensus.cc:348] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.893601 1561 raft_consensus.cc:374] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.893726 1561 raft_consensus.cc:729] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.894291 1552 tablet_bootstrap.cc:492] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:58.894037 1561 consensus_queue.cc:260] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.895517 1559 raft_consensus.cc:2229] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.896179 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 6e9d03457dac43038b4e6fb120ff572c (DEFAULT_TABLE table=default.Table_fa178c2ce0e14306911368823822afc2 [id=55e2284e62fa45629d02de072260473c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.896541 1559 raft_consensus.cc:2258] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.896579 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e9d03457dac43038b4e6fb120ff572c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.897020 1552 tablet_bootstrap.cc:654] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.897629 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 6e9d03457dac43038b4e6fb120ff572c (DEFAULT_TABLE table=default.Table_fa178c2ce0e14306911368823822afc2 [id=55e2284e62fa45629d02de072260473c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.898113 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e9d03457dac43038b4e6fb120ff572c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.898636 1561 ts_tablet_manager.cc:1428] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:05:58.902668 1561 tablet_bootstrap.cc:492] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.903724 1552 tablet_bootstrap.cc:492] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:58.902653 1556 tablet_bootstrap.cc:492] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:58.904009 1556 ts_tablet_manager.cc:1397] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.002s
I20260927 15:05:58.904516 1561 tablet_bootstrap.cc:654] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.904529 1559 ts_tablet_manager.cc:1905] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.905333 1556 raft_consensus.cc:348] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.905552 1556 raft_consensus.cc:374] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.905658 1556 raft_consensus.cc:729] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.905900 1556 consensus_queue.cc:260] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.906955 1561 tablet_bootstrap.cc:492] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.907121 1561 ts_tablet_manager.cc:1397] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260927 15:05:58.907742 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0781c9c8b4ad498bb27573939b7d06b2
I20260927 15:05:58.907883 1561 raft_consensus.cc:348] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.908161 1561 raft_consensus.cc:374] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.908249 1561 raft_consensus.cc:729] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.908475 1561 consensus_queue.cc:260] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.909230 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 0781c9c8b4ad498bb27573939b7d06b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.911182 1562 tablet_replica.cc:330] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:58.911433 1562 raft_consensus.cc:2229] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:05:58.912081 1562 raft_consensus.cc:2258] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.913940 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 42baac8b7d47433e826eb3bc1980acaa (DEFAULT_TABLE table=default.Table_65acf9b7f2074b44aacf9bee5790329d [id=d3243f5a530645288cdf6befd30c31e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.914347 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42baac8b7d47433e826eb3bc1980acaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.915712 1562 ts_tablet_manager.cc:1905] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.916854 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 7d31bf920f0d41478863959d49400731 (table default.Table_b1351f5b43b34a4981ab32258c31a00e [id=b28d0e08cf944e17a720641dab1f23f5]). Expected version 1 got 0
I20260927 15:05:58.919116 907 catalog_manager.cc:5495] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:05:58.919564 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 67ad68a0adad407a92b2335f43e67227 (table default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]). Expected version 1 got 0
I20260927 15:05:58.919770 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874]). Expected version 3 got 0
I20260927 15:05:58.920215 1279 tablet_service.cc:1467] Processing CreateTablet for tablet e066308fcdfc49ed926cd81963c5f1a7 (DEFAULT_TABLE table=default.Table_7258841dfdbd45b0a5745d0a4cbd5551 [id=6ed04e9f13a242f581a5c92cca97a25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.921579 1136 tablet_service.cc:1467] Processing CreateTablet for tablet e066308fcdfc49ed926cd81963c5f1a7 (DEFAULT_TABLE table=default.Table_7258841dfdbd45b0a5745d0a4cbd5551 [id=6ed04e9f13a242f581a5c92cca97a25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.921964 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e066308fcdfc49ed926cd81963c5f1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.922183 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 0781c9c8b4ad498bb27573939b7d06b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.922363 1552 ts_tablet_manager.cc:1397] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260927 15:05:58.923297 1552 raft_consensus.cc:348] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.923563 1552 raft_consensus.cc:374] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.923642 1552 raft_consensus.cc:729] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.923924 1552 consensus_queue.cc:260] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.924352 1562 ts_tablet_manager.cc:1918] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:05:58.924461 1552 ts_tablet_manager.cc:1428] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:05:58.924485 1562 log.cc:1196] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/0781c9c8b4ad498bb27573939b7d06b2
I20260927 15:05:58.924791 1552 tablet_bootstrap.cc:492] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:58.924955 1562 ts_tablet_manager.cc:1939] T 0781c9c8b4ad498bb27573939b7d06b2 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:58.926082 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 0781c9c8b4ad498bb27573939b7d06b2 (table default.Table_81479ddeb1b6463cab4db3d03d955a91 [id=f301a482365b4cf2b752fccd860a8d2d]) successfully deleted
I20260927 15:05:58.926620 1561 ts_tablet_manager.cc:1428] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260927 15:05:58.928190 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_738223121ff44cda97e408a6b77e0c98" } modify_external_catalogs: true
I20260927 15:05:58.928393 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_738223121ff44cda97e408a6b77e0c98" } modify_external_catalogs: true
I20260927 15:05:58.928550 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fa494510445b4a31894f0d2313650f59" } new_table_name: "default.Table_9074f56e5d72442694c1b683a1911c62" modify_external_catalogs: true
I20260927 15:05:58.930135 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fd5116f32d66492291f3209ac235edf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.930286 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20" } modify_external_catalogs: true
I20260927 15:05:58.930469 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20" } modify_external_catalogs: true
I20260927 15:05:58.930761 1561 tablet_bootstrap.cc:492] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:05:58.930763 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd5116f32d66492291f3209ac235edf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.931942 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_29e94bb122d84391b9632159a1adedfc" } new_table_name: "default.Table_a1a1af250bd547f592b309be7c518a2a" modify_external_catalogs: true
I20260927 15:05:58.932061 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 42baac8b7d47433e826eb3bc1980acaa (DEFAULT_TABLE table=default.Table_65acf9b7f2074b44aacf9bee5790329d [id=d3243f5a530645288cdf6befd30c31e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.932596 1561 tablet_bootstrap.cc:654] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.933076 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e066308fcdfc49ed926cd81963c5f1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.934293 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42baac8b7d47433e826eb3bc1980acaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.934551 1561 tablet_bootstrap.cc:492] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.934685 1561 ts_tablet_manager.cc:1397] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260927 15:05:58.935493 1561 raft_consensus.cc:348] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.935734 1561 raft_consensus.cc:374] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.935819 1561 raft_consensus.cc:729] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.936088 1561 consensus_queue.cc:260] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.940563 1561 ts_tablet_manager.cc:1428] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260927 15:05:58.942015 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2b3e81787f35442691853bd186de1a8a" } modify_external_catalogs: true
I20260927 15:05:58.942221 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2b3e81787f35442691853bd186de1a8a" } modify_external_catalogs: true
I20260927 15:05:58.943940 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 45b610025b1a4b68bdc34f870654f9d1 (DEFAULT_TABLE table=default.Table_fdbd726355df419fae94cbf8fce53375 [id=f6284e29d38143b38fc421ab5c09538c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.944164 1560 ts_tablet_manager.cc:1918] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:05:58.944365 1560 log.cc:1196] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/3e4e18e695f54d85b25958330717c713
I20260927 15:05:58.944470 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45b610025b1a4b68bdc34f870654f9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.944808 1561 tablet_bootstrap.cc:492] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.944937 1560 ts_tablet_manager.cc:1939] T 3e4e18e695f54d85b25958330717c713 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:58.946708 1561 tablet_bootstrap.cc:654] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.948971 1560 tablet_replica.cc:330] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:58.954257 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet e188f28304604cf2a96a606811900ca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.954711 1561 tablet_bootstrap.cc:492] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.954944 1561 ts_tablet_manager.cc:1397] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.005s
I20260927 15:05:58.955327 1560 raft_consensus.cc:2229] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.955757 1561 raft_consensus.cc:348] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.956012 1561 raft_consensus.cc:374] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.956099 1561 raft_consensus.cc:729] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.956255 1560 raft_consensus.cc:2258] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.956368 1561 consensus_queue.cc:260] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.956534 1593 raft_consensus.cc:482] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:58.958679 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 3e4e18e695f54d85b25958330717c713 (table default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]) successfully deleted
I20260927 15:05:58.958419 912 catalog_manager.cc:5495] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
W20260927 15:05:58.958972 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ab08d04c11dd44299ee5f9a911d581c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab08d04c11dd44299ee5f9a911d581c3 already in progress: creating tablet
I20260927 15:05:58.959110 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 7d31bf920f0d41478863959d49400731 (table default.Table_b1351f5b43b34a4981ab32258c31a00e [id=b28d0e08cf944e17a720641dab1f23f5]). Expected version 1 got 0
W20260927 15:05:58.959208 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 30244d596d4d4090af7656027b48f22e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30244d596d4d4090af7656027b48f22e already in progress: creating tablet
W20260927 15:05:58.959458 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 4ead753ba6664829b1262712f35e64f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ead753ba6664829b1262712f35e64f2 already in progress: creating tablet
W20260927 15:05:58.959667 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 67cf4dae943e4092b2c490ad770e4a94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67cf4dae943e4092b2c490ad770e4a94 already in progress: creating tablet
W20260927 15:05:58.959862 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9a7ed6e23e1479a86e2abcf6aa5b317 already in progress: creating tablet
W20260927 15:05:58.960050 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9c9e4311049d47d3b2f1e117795624ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c9e4311049d47d3b2f1e117795624ef already in progress: creating tablet
W20260927 15:05:58.960223 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6d6eed08273244d28fd15785a09059f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d6eed08273244d28fd15785a09059f9 already in progress: creating tablet
W20260927 15:05:58.960453 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7d1f23f91bce4df480dd9991659f2e81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d1f23f91bce4df480dd9991659f2e81 already in progress: creating tablet
I20260927 15:05:58.960623 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 6e9d03457dac43038b4e6fb120ff572c (DEFAULT_TABLE table=default.Table_fa178c2ce0e14306911368823822afc2 [id=55e2284e62fa45629d02de072260473c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.960742 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 46ee85688df04e92accdedb6625406c1 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:58.960891 1561 ts_tablet_manager.cc:1428] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 15:05:58.961277 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 0781c9c8b4ad498bb27573939b7d06b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.962713 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 45b610025b1a4b68bdc34f870654f9d1 (DEFAULT_TABLE table=default.Table_fdbd726355df419fae94cbf8fce53375 [id=f6284e29d38143b38fc421ab5c09538c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.963672 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet da1812142bb043fba7457dc61ffdb180
W20260927 15:05:58.964583 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce3b706ed2734db782efdb47cf3fda95 consensus state has no leader
I20260927 15:05:58.964860 1561 tablet_bootstrap.cc:492] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:58.965193 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a46e15ea145b4eae8f94b664067b4f92
I20260927 15:05:58.965366 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet da1812142bb043fba7457dc61ffdb180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.965289 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet da1812142bb043fba7457dc61ffdb180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.965898 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 42baac8b7d47433e826eb3bc1980acaa (DEFAULT_TABLE table=default.Table_65acf9b7f2074b44aacf9bee5790329d [id=d3243f5a530645288cdf6befd30c31e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.965749 1165 raft_consensus.cc:1261] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Refusing update from remote peer fabb59e74b7d48fa9be047d7f4c4cc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:58.966267 1410 tablet_service.cc:1467] Processing CreateTablet for tablet e066308fcdfc49ed926cd81963c5f1a7 (DEFAULT_TABLE table=default.Table_7258841dfdbd45b0a5745d0a4cbd5551 [id=6ed04e9f13a242f581a5c92cca97a25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.967114 1634 consensus_queue.cc:1035] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:05:58.967831 1593 raft_consensus.cc:504] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.967990 1556 ts_tablet_manager.cc:1428] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260927 15:05:58.968276 1561 tablet_bootstrap.cc:654] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:58.968556 1593 leader_election.cc:288] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:58.969753 1556 tablet_bootstrap.cc:492] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:05:58.972082 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet da1812142bb043fba7457dc61ffdb180 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da1812142bb043fba7457dc61ffdb180 already in progress: creating tablet
W20260927 15:05:58.972381 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0702d9501ac047938d02ef2521dbf0d5 consensus state has no leader
I20260927 15:05:58.973380 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet a46e15ea145b4eae8f94b664067b4f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.973697 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 8966721a788d4e64ad5e495b5a69b74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.973930 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet b122f1436fde4c5da7f0afa3a1c24c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.973969 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c49c70e003f47d6a325669376e5e3ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.974023 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet d6925d0369524e7eb1ac3c20ad699ded with delete_type TABLET_DATA_DELETED (replaced by tablet 765b3ee3323846c5ba598f47478fd367) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.974174 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet e188f28304604cf2a96a606811900ca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.974270 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 0781c9c8b4ad498bb27573939b7d06b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.974488 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet e0db1654ced542938487126a0a09ed74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.974712 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet a46e15ea145b4eae8f94b664067b4f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:58.975589 1562 tablet_replica.cc:330] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:58.975821 1562 raft_consensus.cc:2229] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:58.975997 1562 raft_consensus.cc:2258] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.976387 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 654d3210fd8c46b68880e544c39d5c88
I20260927 15:05:58.976507 1562 ts_tablet_manager.cc:1905] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:58.977430 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 654d3210fd8c46b68880e544c39d5c88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:05:58.978199 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet a46e15ea145b4eae8f94b664067b4f92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a46e15ea145b4eae8f94b664067b4f92 already in progress: creating tablet
I20260927 15:05:58.978348 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 654d3210fd8c46b68880e544c39d5c88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.979046 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 46ee85688df04e92accdedb6625406c1
I20260927 15:05:58.979090 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e9d03457dac43038b4e6fb120ff572c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.979449 910 catalog_manager.cc:6565] ReplaceTablet: tablet 46ee85688df04e92accdedb6625406c1 deleted and replaced by tablet c49913b1763c4a7b9413a801aff93b30
I20260927 15:05:58.979740 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e066308fcdfc49ed926cd81963c5f1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.973381 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e188f28304604cf2a96a606811900ca5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:05:58.980137 1164 raft_consensus.cc:2454] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:05:58.973928 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 30cf4db249154adda9406d5b07430a80 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e6e3600cbf741419bc7b93eec42eb13) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.980975 1374 leader_election.cc:302] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:58.981379 1593 raft_consensus.cc:2781] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:58.981504 1593 raft_consensus.cc:482] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:58.981609 1593 raft_consensus.cc:3037] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.982990 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42baac8b7d47433e826eb3bc1980acaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:58.984833 1593 raft_consensus.cc:504] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.986150 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e188f28304604cf2a96a606811900ca5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:05:58.986387 1164 raft_consensus.cc:3037] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:58.986742 1562 ts_tablet_manager.cc:1918] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:58.988060 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 43552776a19a4e75aa2d6f3d983e3432 with delete_type TABLET_DATA_DELETED (replaced by tablet 34822e9f900f4d04b59b810d59e6aa49) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:58.988235 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 45b610025b1a4b68bdc34f870654f9d1 (DEFAULT_TABLE table=default.Table_fdbd726355df419fae94cbf8fce53375 [id=f6284e29d38143b38fc421ab5c09538c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:58.989868 1562 log.cc:1196] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/8966721a788d4e64ad5e495b5a69b74d
I20260927 15:05:58.990300 1164 raft_consensus.cc:2454] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:05:58.990301 1562 ts_tablet_manager.cc:1939] T 8966721a788d4e64ad5e495b5a69b74d P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:58.990942 1374 leader_election.cc:302] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:58.991261 1634 raft_consensus.cc:2781] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:58.991410 1634 raft_consensus.cc:686] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:05:58.991674 1634 consensus_queue.cc:237] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.993958 1562 tablet_replica.cc:330] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:58.994988 1562 raft_consensus.cc:2229] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:05:58.995463 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 8966721a788d4e64ad5e495b5a69b74d (table default.Table_9112f8699da541b58056a9f60137658e [id=d2fe03ba4bf141ef982f5a6b86fae022]) successfully deleted
I20260927 15:05:58.994711 1561 tablet_bootstrap.cc:492] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:58.995780 1561 ts_tablet_manager.cc:1397] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.000s
I20260927 15:05:58.996001 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ee85688df04e92accdedb6625406c1 with delete_type TABLET_DATA_DELETED (replaced by tablet c49913b1763c4a7b9413a801aff93b30) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:58.996763 1561 raft_consensus.cc:348] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:58.997044 1561 raft_consensus.cc:374] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:58.997152 1561 raft_consensus.cc:729] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:58.997109 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e301f5a5aea64583a20cf58c548d0934"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:58.997363 1561 consensus_queue.cc:260] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:58.997627 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e301f5a5aea64583a20cf58c548d0934 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:58.997702 1562 pending_rounds.cc:62] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:05:58.997808 1562 pending_rounds.cc:68] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976304951689216 op_type: NO_OP noop_request { }
I20260927 15:05:58.998070 1562 raft_consensus.cc:2866] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:05:58.998178 1562 raft_consensus.cc:2258] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:58.997056 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c296e3348ec248c4ad40c6b03350903e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:58.999140 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c296e3348ec248c4ad40c6b03350903e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.002039 1556 tablet_bootstrap.cc:654] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.001878 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_38d34759b5a944c988b275b39d67673b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.002410 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38d34759b5a944c988b275b39d67673b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.003597 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45b610025b1a4b68bdc34f870654f9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.005379 1593 leader_election.cc:288] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:05:59.006439 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet ac3b1d765caf40a1a7593cdb19defcab (table default.Table_a8794ae976fe4fd48b9015808f70e330 [id=6368f21af56d44f09f5cf1ec2d19f2b6]). Expected version 3 got 0
I20260927 15:05:59.006685 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874]). Expected version 3 got 0
I20260927 15:05:59.009326 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 714b110a24ca4f3bb8126034dc3e6407 with delete_type TABLET_DATA_DELETED (replaced by tablet bc971defe6d148439a6a0b8c55d9092e) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.009626 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_86b086d55b34411782656982b6de6a74" } modify_external_catalogs: true
I20260927 15:05:59.009713 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a8bf15c48423ea9ff14c46645a33b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.009845 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_86b086d55b34411782656982b6de6a74" } modify_external_catalogs: true
I20260927 15:05:59.010157 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_40a2a7eaf0264954bccee55880a74fa6" } new_table_name: "default.Table_eab3b8f9831948c8a78c4484d3911e0c" modify_external_catalogs: true
I20260927 15:05:59.009845 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5d328fa614e143f8a058dd36eaf11755"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.010805 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d328fa614e143f8a058dd36eaf11755 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.012445 1628 tablet.cc:1722] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:05:59.015776 1637 raft_consensus.cc:482] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.015960 1637 raft_consensus.cc:504] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.016624 1637 leader_election.cc:288] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.017997 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31701139f10f4478af43bd153aa3a2dc" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:59.018231 1439 raft_consensus.cc:2454] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:05:59.018790 1561 ts_tablet_manager.cc:1428] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260927 15:05:59.019160 1099 leader_election.cc:302] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:59.019299 1562 ts_tablet_manager.cc:1905] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.019572 1637 raft_consensus.cc:2781] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:59.019696 1637 raft_consensus.cc:482] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:59.019799 1637 raft_consensus.cc:3037] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:59.020527 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c49c70e003f47d6a325669376e5e3ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.021157 1561 tablet_bootstrap.cc:492] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:59.022792 1637 raft_consensus.cc:504] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.025465 1637 leader_election.cc:288] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.025528 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_667c238b190b4cc0a521a2a1e2250402" } new_table_name: "default.Table_d5fcfba46cd94c3a98d626e476a85b71" modify_external_catalogs: true
I20260927 15:05:59.026018 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31701139f10f4478af43bd153aa3a2dc" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:05:59.026118 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_34408a3d87a447d499fbdf349cea9f34" } new_table_name: "default.Table_ef61af61dda541eda62bb76d07aaa50a" modify_external_catalogs: true
I20260927 15:05:59.026232 1439 raft_consensus.cc:3037] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:59.026811 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a6f756a6136d48a78b4fb2488323f3fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.027380 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6f756a6136d48a78b4fb2488323f3fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.027817 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_55b153455b5b46ed916f0a47ccc6b0ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.028342 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55b153455b5b46ed916f0a47ccc6b0ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.029033 1439 raft_consensus.cc:2454] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:05:59.029641 1099 leader_election.cc:302] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:59.030068 1637 raft_consensus.cc:2781] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:59.030745 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a97f9c79720e40e48b56f0dd4c7441cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.031230 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a97f9c79720e40e48b56f0dd4c7441cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.032259 1637 raft_consensus.cc:686] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:05:59.032665 1637 consensus_queue.cc:237] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.034065 1561 tablet_bootstrap.cc:654] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.034123 1562 ts_tablet_manager.cc:1918] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:05:59.035526 1562 log.cc:1196] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/b122f1436fde4c5da7f0afa3a1c24c70
I20260927 15:05:59.036163 1562 ts_tablet_manager.cc:1939] T b122f1436fde4c5da7f0afa3a1c24c70 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:59.036764 1643 tablet.cc:1722] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:05:59.038143 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet b122f1436fde4c5da7f0afa3a1c24c70 (table default.Table_0cf38c5a77d943628b2d20226904801d [id=df10d723c97d47dd82747afd6899372d]) successfully deleted
I20260927 15:05:59.039003 1562 tablet_replica.cc:330] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:59.038904 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c6de440f06ab4616970f89ee3b92b90a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:59.039526 1562 raft_consensus.cc:2229] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:05:59.039762 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6de440f06ab4616970f89ee3b92b90a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.039789 1562 pending_rounds.cc:62] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:05:59.039857 1562 pending_rounds.cc:68] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976304269152256 op_type: NO_OP noop_request { }
I20260927 15:05:59.040017 1562 raft_consensus.cc:2866] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:05:59.040124 1562 raft_consensus.cc:2258] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.029903 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ee85688df04e92accdedb6625406c1 with delete_type TABLET_DATA_DELETED (replaced by tablet c49913b1763c4a7b9413a801aff93b30) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.041940 1562 ts_tablet_manager.cc:1905] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.056249 1562 ts_tablet_manager.cc:1918] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:05:59.057010 1562 log.cc:1196] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/d6925d0369524e7eb1ac3c20ad699ded
I20260927 15:05:59.057809 1562 ts_tablet_manager.cc:1939] T d6925d0369524e7eb1ac3c20ad699ded P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:59.059489 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet d6925d0369524e7eb1ac3c20ad699ded (table default.Table_8b26fb5fec1348f7a8d901c9ce63006b [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
I20260927 15:05:59.060731 1562 tablet_replica.cc:330] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:59.061209 1562 raft_consensus.cc:2229] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.061710 1562 raft_consensus.cc:2258] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.063457 1562 ts_tablet_manager.cc:1905] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.067842 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45b610025b1a4b68bdc34f870654f9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.069900 1560 ts_tablet_manager.cc:1905] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.072315 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet da1812142bb043fba7457dc61ffdb180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.070505 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 0702d9501ac047938d02ef2521dbf0d5 (DEFAULT_TABLE table=default.Table_29e94bb122d84391b9632159a1adedfc [id=1fceed220c0041ecbcb20d2ee5c0dadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.075585 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0702d9501ac047938d02ef2521dbf0d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.079536 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31701139f10f4478af43bd153aa3a2dc" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:59.080116 1102 leader_election.cc:341] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.081003 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet da8215167ad74dbfb2cc1c8d50a76ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.082139 1632 raft_consensus.cc:482] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.082304 1632 raft_consensus.cc:504] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.072974 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 654d3210fd8c46b68880e544c39d5c88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.083902 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet a46e15ea145b4eae8f94b664067b4f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.085810 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31701139f10f4478af43bd153aa3a2dc" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:05:59.087590 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ee85688df04e92accdedb6625406c1 with delete_type TABLET_DATA_DELETED (replaced by tablet c49913b1763c4a7b9413a801aff93b30) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.091975 1632 leader_election.cc:288] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.092127 1632 raft_consensus.cc:482] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.092290 1632 raft_consensus.cc:504] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.092795 1632 leader_election.cc:288] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:05:59.093788 1239 leader_election.cc:341] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 43552776a19a4e75aa2d6f3d983e3432
W20260927 15:05:59.095638 1102 leader_election.cc:341] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.096798 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e188f28304604cf2a96a606811900ca5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:59.098203 1376 consensus_peers.cc:487] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:05:59.098424 1376 leader_election.cc:341] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.098610 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 0702d9501ac047938d02ef2521dbf0d5 (DEFAULT_TABLE table=default.Table_a1a1af250bd547f592b309be7c518a2a [id=1fceed220c0041ecbcb20d2ee5c0dadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.099080 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0702d9501ac047938d02ef2521dbf0d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.099200 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 0702d9501ac047938d02ef2521dbf0d5 (DEFAULT_TABLE table=default.Table_a1a1af250bd547f592b309be7c518a2a [id=1fceed220c0041ecbcb20d2ee5c0dadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.099725 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0702d9501ac047938d02ef2521dbf0d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.106711 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ad5af5df58824fe88d607a93216bd228
I20260927 15:05:59.106879 1165 raft_consensus.cc:1261] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Refusing update from remote peer fabb59e74b7d48fa9be047d7f4c4cc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260927 15:05:59.107220 1376 consensus_peers.cc:487] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:05:59.107617 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f20e18689ad245c5872112d6f987abb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:59.106515 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e188f28304604cf2a96a606811900ca5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:05:59.107833 1239 leader_election.cc:341] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 0781c9c8b4ad498bb27573939b7d06b2
W20260927 15:05:59.108273 1376 leader_election.cc:341] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:05:59.108321 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f20e18689ad245c5872112d6f987abb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.110141 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5af5df58824fe88d607a93216bd228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.111004 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5af5df58824fe88d607a93216bd228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.111235 1552 tablet_bootstrap.cc:654] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.113165 1593 consensus_queue.cc:1035] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:05:59.117506 1376 consensus_peers.cc:487] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:05:59.119498 1637 raft_consensus.cc:482] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.119652 1637 raft_consensus.cc:504] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.120326 1637 leader_election.cc:288] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.120680 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 65c313ab6848428d8237557392669f6f (DEFAULT_TABLE table=default.Table_34408a3d87a447d499fbdf349cea9f34 [id=f66d759455bb472e9ec7816c859d2811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.121129 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65c313ab6848428d8237557392669f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.121289 1637 raft_consensus.cc:482] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.121424 1637 raft_consensus.cc:504] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.121960 1637 leader_election.cc:288] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.123358 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30cf4db249154adda9406d5b07430a80" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:05:59.124219 1099 leader_election.cc:341] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.125505 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c49c70e003f47d6a325669376e5e3ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:59.126842 1102 leader_election.cc:341] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.119982 1143 tablet_service.cc:1467] Processing CreateTablet for tablet f585bcdadbcc4032aa484481cdf94b72 (DEFAULT_TABLE table=default.Table_9e37ca2b041a439aa503560c17e5b391 [id=79aefc953f4e419f87376e3ffb2e7a1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.127914 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 65c313ab6848428d8237557392669f6f (DEFAULT_TABLE table=default.Table_34408a3d87a447d499fbdf349cea9f34 [id=f66d759455bb472e9ec7816c859d2811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.128271 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f585bcdadbcc4032aa484481cdf94b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.128859 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65c313ab6848428d8237557392669f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.129027 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c49c70e003f47d6a325669376e5e3ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:59.129659 1439 raft_consensus.cc:2454] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:05:59.130105 1099 leader_election.cc:302] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:05:59.131000 1637 raft_consensus.cc:2781] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:05:59.131129 1637 raft_consensus.cc:482] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:05:59.131249 1637 raft_consensus.cc:3037] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:59.134153 1637 raft_consensus.cc:504] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.142972 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c49c70e003f47d6a325669376e5e3ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:05:59.143435 1439 raft_consensus.cc:3037] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:05:59.143584 1637 leader_election.cc:288] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.144640 951 master_runner.cc:186] Error getting master registration for 127.0.201.62:41167: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection refused (error 111),
I20260927 15:05:59.144804 951 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:05:59.146773 1439 raft_consensus.cc:2454] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:05:59.147397 1099 leader_election.cc:302] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:05:59.147816 1637 raft_consensus.cc:2781] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:05:59.147986 1637 raft_consensus.cc:686] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:05:59.148874 1637 consensus_queue.cc:237] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.126966 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30cf4db249154adda9406d5b07430a80" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:59.152833 1102 leader_election.cc:341] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.152977 1102 leader_election.cc:302] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:05:59.153323 1573 raft_consensus.cc:2726] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:59.154358 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c49c70e003f47d6a325669376e5e3ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:05:59.155157 1560 ts_tablet_manager.cc:1918] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:05:59.155586 1102 leader_election.cc:341] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.155905 1560 log.cc:1196] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/61339e532e6c431babb15422a08f7aa6
I20260927 15:05:59.158223 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 2afab8bf87bc45c899bcd5dfdad48d26 (DEFAULT_TABLE table=default.Table_bbe3afdc10dd47498be6f21a36311b58 [id=15103ee5ddc04d809af8930de02a7d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.158672 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2afab8bf87bc45c899bcd5dfdad48d26. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:59.161041 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e6e3600cbf741419bc7b93eec42eb13 consensus state has no leader
I20260927 15:05:59.161401 907 master_service.cc:946] ReplaceTablet: received request to replace tablet a46e15ea145b4eae8f94b664067b4f92 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.161734 909 master_service.cc:946] ReplaceTablet: received request to replace tablet a46e15ea145b4eae8f94b664067b4f92 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.162066 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f1c5c1132cab4343b25f94cd31941336" } modify_external_catalogs: true
I20260927 15:05:59.162214 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d1f23f91bce4df480dd9991659f2e81 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.162249 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f1c5c1132cab4343b25f94cd31941336" } modify_external_catalogs: true
W20260927 15:05:59.162921 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08f28c023473434ba73b1142a041be97 consensus state has no leader
I20260927 15:05:59.164464 912 catalog_manager.cc:5495] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:05:59.170018 913 master_service.cc:946] ReplaceTablet: received request to replace tablet 43552776a19a4e75aa2d6f3d983e3432 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.172367 1560 ts_tablet_manager.cc:1939] T 61339e532e6c431babb15422a08f7aa6 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:59.173195 1560 tablet_replica.cc:330] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:59.173363 1560 raft_consensus.cc:2229] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.173527 1560 raft_consensus.cc:2258] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.174388 1560 ts_tablet_manager.cc:1905] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.176262 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_38d34759b5a944c988b275b39d67673b" } modify_external_catalogs: true
I20260927 15:05:59.176471 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_38d34759b5a944c988b275b39d67673b" } modify_external_catalogs: true
I20260927 15:05:59.177644 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b210f1beda84fd1945f9d3245063038" } new_table_name: "default.Table_d20ecfc838184a7ebbcaae59355b53e1" modify_external_catalogs: true
I20260927 15:05:59.180959 1131 tablet_service.cc:1467] Processing CreateTablet for tablet ebb4e007cefa4f18bdaa461b43c5c810 (DEFAULT_TABLE table=default.Table_e8c7a324f17444a486965a420aced20a [id=49e5a0fcbe0d48aa993446d112ed5d2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.181352 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebb4e007cefa4f18bdaa461b43c5c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.182664 1643 tablet.cc:1722] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:05:59.182792 1142 tablet_service.cc:1467] Processing CreateTablet for tablet cd901034653b47dbba7912d5338bc3bb (DEFAULT_TABLE table=default.Table_476502809f814797a2de6c54405d8c30 [id=fb946e044fa149ebb52128ea5c3577a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.183180 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd901034653b47dbba7912d5338bc3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.184741 1560 ts_tablet_manager.cc:1918] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.184864 1560 log.cc:1196] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/0781c9c8b4ad498bb27573939b7d06b2
I20260927 15:05:59.185228 1560 ts_tablet_manager.cc:1939] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:59.185817 1560 tablet_replica.cc:330] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:59.186041 1560 raft_consensus.cc:2229] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.186195 1560 raft_consensus.cc:2258] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:05:59.187286 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65c313ab6848428d8237557392669f6f consensus state has no leader
I20260927 15:05:59.189422 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 61339e532e6c431babb15422a08f7aa6 (table default.Table_527ff90f92e14e9cb2bb7053c760f6ba [id=48ac6a07f3ca402aa8396ac2a1874134]) successfully deleted
I20260927 15:05:59.189642 1552 tablet_bootstrap.cc:492] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:59.189738 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 0781c9c8b4ad498bb27573939b7d06b2 (table default.Table_81479ddeb1b6463cab4db3d03d955a91 [id=f301a482365b4cf2b752fccd860a8d2d]) successfully deleted
I20260927 15:05:59.189787 1552 ts_tablet_manager.cc:1397] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.265s user 0.003s sys 0.001s
I20260927 15:05:59.190670 1552 raft_consensus.cc:348] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.190966 1552 raft_consensus.cc:374] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.191075 1552 raft_consensus.cc:729] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.191318 1552 consensus_queue.cc:260] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.191998 1552 ts_tablet_manager.cc:1428] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 15:05:59.193361 1552 tablet_bootstrap.cc:492] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:59.194324 1278 tablet_service.cc:1467] Processing CreateTablet for tablet f585bcdadbcc4032aa484481cdf94b72 (DEFAULT_TABLE table=default.Table_9e37ca2b041a439aa503560c17e5b391 [id=79aefc953f4e419f87376e3ffb2e7a1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.194737 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f585bcdadbcc4032aa484481cdf94b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.196189 1552 tablet_bootstrap.cc:654] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.198217 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fa178c2ce0e14306911368823822afc2" } modify_external_catalogs: true
I20260927 15:05:59.198426 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fa178c2ce0e14306911368823822afc2" } modify_external_catalogs: true
I20260927 15:05:59.203583 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 9598ac8a916f4bf5b1cf9995a8149c70 (DEFAULT_TABLE table=default.Table_3c3f771ede53431eac4f72641bf34c64 [id=11eb50b78bd74a098a861d227a4e2662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.203723 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 454e637ec622424e81a8770c16bbc941 (DEFAULT_TABLE table=default.Table_6a3d9845b82d4862bdd5a2d19801544c [id=a1de063eacb94c21b5009200a7517a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.204115 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454e637ec622424e81a8770c16bbc941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.204185 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5af5df58824fe88d607a93216bd228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.204537 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 65c313ab6848428d8237557392669f6f (DEFAULT_TABLE table=default.Table_34408a3d87a447d499fbdf349cea9f34 [id=f66d759455bb472e9ec7816c859d2811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.204906 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65c313ab6848428d8237557392669f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.205585 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9598ac8a916f4bf5b1cf9995a8149c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.205920 1143 tablet_service.cc:1467] Processing CreateTablet for tablet fe7816e099094d13887650fc223097c7 (DEFAULT_TABLE table=default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.207100 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 2afab8bf87bc45c899bcd5dfdad48d26 (DEFAULT_TABLE table=default.Table_bbe3afdc10dd47498be6f21a36311b58 [id=15103ee5ddc04d809af8930de02a7d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.207474 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2afab8bf87bc45c899bcd5dfdad48d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.208909 1131 tablet_service.cc:1467] Processing CreateTablet for tablet b375902081c54cdb84fdb075eec6baf7 (DEFAULT_TABLE table=default.Table_7d935f8994074713a4a90f02ff7f0111 [id=8be5c577dcb3490d883bede28c6b73ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.210958 1274 tablet_service.cc:1467] Processing CreateTablet for tablet ebb4e007cefa4f18bdaa461b43c5c810 (DEFAULT_TABLE table=default.Table_e8c7a324f17444a486965a420aced20a [id=49e5a0fcbe0d48aa993446d112ed5d2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.211267 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebb4e007cefa4f18bdaa461b43c5c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.217259 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 454e637ec622424e81a8770c16bbc941 (DEFAULT_TABLE table=default.Table_6a3d9845b82d4862bdd5a2d19801544c [id=a1de063eacb94c21b5009200a7517a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.217618 1282 tablet_service.cc:1467] Processing CreateTablet for tablet cd901034653b47dbba7912d5338bc3bb (DEFAULT_TABLE table=default.Table_476502809f814797a2de6c54405d8c30 [id=fb946e044fa149ebb52128ea5c3577a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.218014 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd901034653b47dbba7912d5338bc3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.218086 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 9598ac8a916f4bf5b1cf9995a8149c70 (DEFAULT_TABLE table=default.Table_3c3f771ede53431eac4f72641bf34c64 [id=11eb50b78bd74a098a861d227a4e2662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.218391 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9598ac8a916f4bf5b1cf9995a8149c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.221247 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 54a07831078b48a59807f7da4a42bcec (DEFAULT_TABLE table=default.Table_11a3612c1fb14de08bae64fc5180a805 [id=aa16f23914de4c7db1e460bb1c743a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.222605 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 16884c7343be436aa312ec0af40f5e33 (DEFAULT_TABLE table=default.Table_c8a2e4d5fa1e4d1fb3cb671e627f77be [id=2ef45e71ca384afdac391f024dc68388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.223410 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe7816e099094d13887650fc223097c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.220858 1141 tablet_service.cc:1467] Processing CreateTablet for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14 (DEFAULT_TABLE table=default.Table_6f254b1d0eb949238df41c88797697e5 [id=9ac1472258a24d01892257dd9c9874a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.226548 1560 ts_tablet_manager.cc:1905] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.229539 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b375902081c54cdb84fdb075eec6baf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.230937 1280 tablet_service.cc:1467] Processing CreateTablet for tablet b375902081c54cdb84fdb075eec6baf7 (DEFAULT_TABLE table=default.Table_7d935f8994074713a4a90f02ff7f0111 [id=8be5c577dcb3490d883bede28c6b73ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.231967 1279 tablet_service.cc:1467] Processing CreateTablet for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14 (DEFAULT_TABLE table=default.Table_6f254b1d0eb949238df41c88797697e5 [id=9ac1472258a24d01892257dd9c9874a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.233735 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 54a07831078b48a59807f7da4a42bcec (DEFAULT_TABLE table=default.Table_11a3612c1fb14de08bae64fc5180a805 [id=aa16f23914de4c7db1e460bb1c743a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.234917 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54a07831078b48a59807f7da4a42bcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.235077 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 16884c7343be436aa312ec0af40f5e33 (DEFAULT_TABLE table=default.Table_c8a2e4d5fa1e4d1fb3cb671e627f77be [id=2ef45e71ca384afdac391f024dc68388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.238866 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.242646 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 07b63e63f7cd4075bcf10a463ce16e05
I20260927 15:05:59.242740 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f7ff3654808747e7a0a788d21ab84691" } new_table_name: "default.Table_875cbc00c31e4798bf3ed5bf3135b0a7" modify_external_catalogs: true
I20260927 15:05:59.243397 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0f6a6192da2f4f05af0cad71e5b85ef2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.243956 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f6a6192da2f4f05af0cad71e5b85ef2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.244455 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6c73f3b0a3b74d2bb569ea7c30fe0f50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:59.244892 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16884c7343be436aa312ec0af40f5e33. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:59.244993 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c73f3b0a3b74d2bb569ea7c30fe0f50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.246258 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a6f0eb861ab04bcb8df0053049d90e1b" } modify_external_catalogs: true
I20260927 15:05:59.246487 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a6f0eb861ab04bcb8df0053049d90e1b" } modify_external_catalogs: true
I20260927 15:05:59.248268 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4239cd3219fb4e32827288ef7222bf2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.248802 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4239cd3219fb4e32827288ef7222bf2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.249888 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.251178 913 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet bb933c734a3341ac91ac1ca5abcd64fe
W20260927 15:05:59.252115 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 988ae3a67a4b436583cb475fbcf07b8f consensus state has no leader
I20260927 15:05:59.255009 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454e637ec622424e81a8770c16bbc941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.255842 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b375902081c54cdb84fdb075eec6baf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.256433 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.260953 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54a07831078b48a59807f7da4a42bcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.262364 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.263042 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 8966721a788d4e64ad5e495b5a69b74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:56 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:59.268630 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34822e9f900f4d04b59b810d59e6aa49 consensus state has no leader
I20260927 15:05:59.270917 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6e9d03457dac43038b4e6fb120ff572c
I20260927 15:05:59.217614 1278 tablet_service.cc:1467] Processing CreateTablet for tablet fe7816e099094d13887650fc223097c7 (DEFAULT_TABLE table=default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.272365 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7b64507732114eac85d1c532ba939432"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.273095 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b64507732114eac85d1c532ba939432 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.274350 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe7816e099094d13887650fc223097c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.277099 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16884c7343be436aa312ec0af40f5e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.281095 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e9d03457dac43038b4e6fb120ff572c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.283810 1560 ts_tablet_manager.cc:1918] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.283969 1560 log.cc:1196] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/43552776a19a4e75aa2d6f3d983e3432
I20260927 15:05:59.284333 1560 ts_tablet_manager.cc:1939] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:59.284926 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 43552776a19a4e75aa2d6f3d983e3432 (table default.Table_875cbc00c31e4798bf3ed5bf3135b0a7 [id=5c4f0f47acd14538b67f8c8d579b0696]) successfully deleted
I20260927 15:05:59.289115 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e9d03457dac43038b4e6fb120ff572c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:05:59.290191 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet da1812142bb043fba7457dc61ffdb180 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da1812142bb043fba7457dc61ffdb180 already in progress: creating tablet
I20260927 15:05:59.291054 1560 tablet_replica.cc:330] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:59.293295 1560 raft_consensus.cc:2229] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.293812 1560 raft_consensus.cc:2258] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.295037 1560 ts_tablet_manager.cc:1905] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.295282 1561 tablet_bootstrap.cc:492] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:59.295500 1561 ts_tablet_manager.cc:1397] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.274s user 0.036s sys 0.046s
I20260927 15:05:59.296406 1561 raft_consensus.cc:348] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.296703 1561 raft_consensus.cc:374] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.296794 1561 raft_consensus.cc:729] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.297075 1561 consensus_queue.cc:260] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.297672 1561 ts_tablet_manager.cc:1428] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:05:59.298789 1561 tablet_bootstrap.cc:492] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:59.299588 1420 tablet_service.cc:1467] Processing CreateTablet for tablet f585bcdadbcc4032aa484481cdf94b72 (DEFAULT_TABLE table=default.Table_9e37ca2b041a439aa503560c17e5b391 [id=79aefc953f4e419f87376e3ffb2e7a1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.300236 1628 tablet.cc:1722] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:05:59.301482 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d31bf920f0d41478863959d49400731 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.307760 1562 ts_tablet_manager.cc:1918] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.307857 1559 ts_tablet_manager.cc:1918] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.307993 1559 log.cc:1196] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/538516912cf14ebfb0bfb31f706b66fc
I20260927 15:05:59.308223 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f585bcdadbcc4032aa484481cdf94b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.308377 1559 ts_tablet_manager.cc:1939] T 538516912cf14ebfb0bfb31f706b66fc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:59.309213 1562 log.cc:1196] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/e188f28304604cf2a96a606811900ca5
I20260927 15:05:59.309202 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 79) took 1798 ms. Trace:
I20260927 15:05:59.309340 1559 rpcz_store.cc:276] 0927 15:05:57.511141 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.511190 (+ 49us) service_pool.cc:227] Handling call
0927 15:05:58.890168 (+1378978us) ts_tablet_manager.cc:1145] Deleting tablet 538516912cf14ebfb0bfb31f706b66fc
0927 15:05:58.890179 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:59.086673 (+196494us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:59.090815 (+ 4142us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:59.309154 (+218339us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1378770}
I20260927 15:05:59.309546 1562 ts_tablet_manager.cc:1939] T e188f28304604cf2a96a606811900ca5 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:59.309724 1559 tablet_replica.cc:330] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:59.309937 1559 raft_consensus.cc:2229] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.310101 1559 raft_consensus.cc:2258] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.310511 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet e188f28304604cf2a96a606811900ca5 (table default.Table_16724ccc8d1c4311a5e47f148a6148d3 [id=88ccf418a4e24b07830f6fdabe341176]) successfully deleted
I20260927 15:05:59.310649 1559 ts_tablet_manager.cc:1905] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.309104 1561 tablet_bootstrap.cc:654] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.312503 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6c73f3b0a3b74d2bb569ea7c30fe0f50" } modify_external_catalogs: true
I20260927 15:05:59.312702 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6c73f3b0a3b74d2bb569ea7c30fe0f50" } modify_external_catalogs: true
I20260927 15:05:59.313112 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 538516912cf14ebfb0bfb31f706b66fc (table default.Table_92c6318423b147e6984c2c78960a5476 [id=ea5cc262555840bbb18aba64e7cce780]) successfully deleted
W20260927 15:05:59.313328 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0781c9c8b4ad498bb27573939b7d06b2 because the tablet was not found. No further retry: Not found: Tablet not found: 0781c9c8b4ad498bb27573939b7d06b2
I20260927 15:05:59.313617 1562 tablet_replica.cc:330] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:59.313829 1562 raft_consensus.cc:2229] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.313998 1562 raft_consensus.cc:2258] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.314275 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 2afab8bf87bc45c899bcd5dfdad48d26 (DEFAULT_TABLE table=default.Table_bbe3afdc10dd47498be6f21a36311b58 [id=15103ee5ddc04d809af8930de02a7d24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.317701 1414 tablet_service.cc:1467] Processing CreateTablet for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14 (DEFAULT_TABLE table=default.Table_6f254b1d0eb949238df41c88797697e5 [id=9ac1472258a24d01892257dd9c9874a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.319540 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 454e637ec622424e81a8770c16bbc941 (DEFAULT_TABLE table=default.Table_6a3d9845b82d4862bdd5a2d19801544c [id=a1de063eacb94c21b5009200a7517a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.319829 1562 ts_tablet_manager.cc:1905] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:05:59.322031 1238 leader_election.cc:341] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 43552776a19a4e75aa2d6f3d983e3432
I20260927 15:05:59.322175 1238 leader_election.cc:302] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:05:59.322325 1238 raft_consensus.cc:2670] T 43552776a19a4e75aa2d6f3d983e3432 P 4769a710b72a4b49b816725a5921e86e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 15:05:59.324340 1413 tablet_service.cc:1467] Processing CreateTablet for tablet ebb4e007cefa4f18bdaa461b43c5c810 (DEFAULT_TABLE table=default.Table_e8c7a324f17444a486965a420aced20a [id=49e5a0fcbe0d48aa993446d112ed5d2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.323551 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e9d03457dac43038b4e6fb120ff572c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.325311 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 54a07831078b48a59807f7da4a42bcec (DEFAULT_TABLE table=default.Table_11a3612c1fb14de08bae64fc5180a805 [id=aa16f23914de4c7db1e460bb1c743a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.325569 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_a8794ae976fe4fd48b9015808f70e330 [id=6368f21af56d44f09f5cf1ec2d19f2b6] alter complete (version 3)
I20260927 15:05:59.326318 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 9598ac8a916f4bf5b1cf9995a8149c70 (DEFAULT_TABLE table=default.Table_3c3f771ede53431eac4f72641bf34c64 [id=11eb50b78bd74a098a861d227a4e2662]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.327448 1418 tablet_service.cc:1467] Processing CreateTablet for tablet fe7816e099094d13887650fc223097c7 (DEFAULT_TABLE table=default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.327819 1417 tablet_service.cc:1467] Processing CreateTablet for tablet b375902081c54cdb84fdb075eec6baf7 (DEFAULT_TABLE table=default.Table_7d935f8994074713a4a90f02ff7f0111 [id=8be5c577dcb3490d883bede28c6b73ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.328217 1561 tablet_bootstrap.cc:492] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:59.328378 1561 ts_tablet_manager.cc:1397] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260927 15:05:59.329310 1561 raft_consensus.cc:348] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.329533 1561 raft_consensus.cc:374] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.329612 1561 raft_consensus.cc:729] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.329977 1561 consensus_queue.cc:260] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.331790 1561 ts_tablet_manager.cc:1428] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260927 15:05:59.332067 1561 tablet_bootstrap.cc:492] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:59.333153 1637 raft_consensus.cc:482] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.333304 1637 raft_consensus.cc:504] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.333886 1637 leader_election.cc:288] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.334237 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb0ab983a444d26b903a0cec64f15f0 (DEFAULT_TABLE table=default.Table_fd5116f32d66492291f3209ac235edf0 [id=8e5ae781d15d48f7924076fea8d3d292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.334684 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb0ab983a444d26b903a0cec64f15f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.334686 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb0ab983a444d26b903a0cec64f15f0 (DEFAULT_TABLE table=default.Table_fd5116f32d66492291f3209ac235edf0 [id=8e5ae781d15d48f7924076fea8d3d292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.335302 1274 tablet_service.cc:1467] Processing CreateTablet for tablet c49913b1763c4a7b9413a801aff93b30 (DEFAULT_TABLE table=default.Table_6cc665540fb24e17b9284fc911758626 [id=31cb67e2dcb54a029ecdc3457b6139c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.335484 1135 tablet_service.cc:1467] Processing CreateTablet for tablet c49913b1763c4a7b9413a801aff93b30 (DEFAULT_TABLE table=default.Table_6cc665540fb24e17b9284fc911758626 [id=31cb67e2dcb54a029ecdc3457b6139c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.335567 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb0ab983a444d26b903a0cec64f15f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.335652 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c49913b1763c4a7b9413a801aff93b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.335839 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c49913b1763c4a7b9413a801aff93b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.336102 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 48e7eac8753f425d90302360d228ee54 (DEFAULT_TABLE table=default.Table_c296e3348ec248c4ad40c6b03350903e [id=56f6b3596fe64d17a0b2fcf2c187eb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.336447 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48e7eac8753f425d90302360d228ee54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.337646 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 48e7eac8753f425d90302360d228ee54 (DEFAULT_TABLE table=default.Table_c296e3348ec248c4ad40c6b03350903e [id=56f6b3596fe64d17a0b2fcf2c187eb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.338095 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48e7eac8753f425d90302360d228ee54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.338973 1143 tablet_service.cc:1467] Processing CreateTablet for tablet dd2687f65780481c86a9942960ce7be1 (DEFAULT_TABLE table=default.Table_5d328fa614e143f8a058dd36eaf11755 [id=a56919bbdc0146839e84fcc1224c6b8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.338984 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c7a8bf15c48423ea9ff14c46645a33b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:59.339314 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd2687f65780481c86a9942960ce7be1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:59.339576 1102 leader_election.cc:341] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.340350 1131 tablet_service.cc:1467] Processing CreateTablet for tablet dc6f179aab784ae4822356e63332532f (DEFAULT_TABLE table=default.Table_2f2bd859db5046c0afc8811df26a404f [id=359e0f2f64c54790a1fbb004164bf090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.340478 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2afab8bf87bc45c899bcd5dfdad48d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.340680 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6f179aab784ae4822356e63332532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.343116 1411 tablet_service.cc:1467] Processing CreateTablet for tablet cd901034653b47dbba7912d5338bc3bb (DEFAULT_TABLE table=default.Table_476502809f814797a2de6c54405d8c30 [id=fb946e044fa149ebb52128ea5c3577a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.343303 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 1b045b82515540e8813f9250726479e5 (DEFAULT_TABLE table=default.Table_e301f5a5aea64583a20cf58c548d0934 [id=0268289149d14fd5abd1abecf14a43bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.343489 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd901034653b47dbba7912d5338bc3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.343643 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b045b82515540e8813f9250726479e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.347519 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0781c9c8b4ad498bb27573939b7d06b2" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:59.348256 1277 tablet_service.cc:1467] Processing CreateTablet for tablet dd2687f65780481c86a9942960ce7be1 (DEFAULT_TABLE table=default.Table_5d328fa614e143f8a058dd36eaf11755 [id=a56919bbdc0146839e84fcc1224c6b8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.348610 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd2687f65780481c86a9942960ce7be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.349082 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.349803 1556 tablet_bootstrap.cc:492] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:59.349551 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 16884c7343be436aa312ec0af40f5e33 (DEFAULT_TABLE table=default.Table_c8a2e4d5fa1e4d1fb3cb671e627f77be [id=2ef45e71ca384afdac391f024dc68388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.350288 1556 ts_tablet_manager.cc:1397] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.381s user 0.018s sys 0.032s
I20260927 15:05:59.351526 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54a07831078b48a59807f7da4a42bcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.352851 1560 ts_tablet_manager.cc:1918] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.352988 1560 log.cc:1196] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/da8215167ad74dbfb2cc1c8d50a76ed5
I20260927 15:05:59.353341 1560 ts_tablet_manager.cc:1939] T da8215167ad74dbfb2cc1c8d50a76ed5 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:59.354898 1560 tablet_replica.cc:330] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:59.354934 1637 raft_consensus.cc:482] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.355062 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b375902081c54cdb84fdb075eec6baf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.355093 1560 raft_consensus.cc:2229] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.355077 1637 raft_consensus.cc:504] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.355237 1560 raft_consensus.cc:2258] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.355687 1637 leader_election.cc:288] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.357167 1552 tablet_bootstrap.cc:492] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:59.357300 1552 ts_tablet_manager.cc:1397] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.164s user 0.003s sys 0.002s
I20260927 15:05:59.357995 1552 raft_consensus.cc:348] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.358229 1552 raft_consensus.cc:374] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.358292 1552 raft_consensus.cc:729] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.358652 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe7816e099094d13887650fc223097c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.359045 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9598ac8a916f4bf5b1cf9995a8149c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.359623 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebb4e007cefa4f18bdaa461b43c5c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.359598 1552 consensus_queue.cc:260] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.360193 1552 ts_tablet_manager.cc:1428] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:05:59.360488 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a42ae7589c24b1bbd833ab8838521ae" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:05:59.361169 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16884c7343be436aa312ec0af40f5e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.362036 1552 tablet_bootstrap.cc:492] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:59.363155 1560 ts_tablet_manager.cc:1905] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:05:59.364224 1102 leader_election.cc:341] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.364471 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 454e637ec622424e81a8770c16bbc941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.365118 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c8a2e4d5fa1e4d1fb3cb671e627f77be" } new_table_name: "default.Table_dae70d70a5d140fa9783607566b21619" modify_external_catalogs: true
I20260927 15:05:59.365485 913 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet ac3b1d765caf40a1a7593cdb19defcab (table default.Table_a8794ae976fe4fd48b9015808f70e330 [id=6368f21af56d44f09f5cf1ec2d19f2b6]). Expected version 3 got 0
I20260927 15:05:59.365625 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.366153 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7f379286c2f240ce8b30aa735ecbdd18" } new_table_name: "default.Table_95966f78353048d286558ae2da5bfee5" modify_external_catalogs: true
I20260927 15:05:59.366526 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_52dfae347a16444d9d03a84c7a88721d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.367036 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52dfae347a16444d9d03a84c7a88721d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.371282 1560 ts_tablet_manager.cc:1918] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.372025 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c7a8bf15c48423ea9ff14c46645a33b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:59.372447 1556 raft_consensus.cc:348] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.375138 880 master_runner.cc:186] Error getting master registration for 127.0.201.62:41167: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection refused (error 111),
I20260927 15:05:59.375329 880 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:05:59.375883 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet da8215167ad74dbfb2cc1c8d50a76ed5 (table default.Table_bfeb38d1ec214c8989fc01c677d5daef [id=9ed827c5b3234624bc1c68aec0d7fc73]) successfully deleted
W20260927 15:05:59.376156 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 654d3210fd8c46b68880e544c39d5c88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 654d3210fd8c46b68880e544c39d5c88 already in progress: creating tablet
W20260927 15:05:59.376474 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a46e15ea145b4eae8f94b664067b4f92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a46e15ea145b4eae8f94b664067b4f92 already in progress: creating tablet
W20260927 15:05:59.376717 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 46ee85688df04e92accdedb6625406c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46ee85688df04e92accdedb6625406c1 already in progress: creating tablet
W20260927 15:05:59.376916 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ad5af5df58824fe88d607a93216bd228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad5af5df58824fe88d607a93216bd228 already in progress: creating tablet
W20260927 15:05:59.377151 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 07b63e63f7cd4075bcf10a463ce16e05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07b63e63f7cd4075bcf10a463ce16e05 already in progress: creating tablet
I20260927 15:05:59.377610 1556 raft_consensus.cc:374] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.377730 1556 raft_consensus.cc:729] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.380060 1556 consensus_queue.cc:260] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.380424 1560 log.cc:1196] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/8966721a788d4e64ad5e495b5a69b74d
I20260927 15:05:59.383682 1238 leader_election.cc:302] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:05:59.383941 1238 raft_consensus.cc:2670] T 0781c9c8b4ad498bb27573939b7d06b2 P 4769a710b72a4b49b816725a5921e86e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 15:05:59.385684 1561 tablet_bootstrap.cc:654] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:05:59.385952 1099 leader_election.cc:341] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.386092 1099 leader_election.cc:302] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:05:59.386441 1573 raft_consensus.cc:2726] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:59.389021 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_022be000410e4f27910ce026561af850" } new_table_name: "default.Table_331e24eda68d4fcab4e75f6cc79a555e" modify_external_catalogs: true
I20260927 15:05:59.390287 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7d31bf920f0d41478863959d49400731
I20260927 15:05:59.390715 912 catalog_manager.cc:6565] ReplaceTablet: tablet 7d31bf920f0d41478863959d49400731 deleted and replaced by tablet 01b7e017ead242849585679873a69b43
I20260927 15:05:59.394157 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d31bf920f0d41478863959d49400731 with delete_type TABLET_DATA_DELETED (replaced by tablet 01b7e017ead242849585679873a69b43) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.394695 1560 ts_tablet_manager.cc:1939] T 8966721a788d4e64ad5e495b5a69b74d P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:59.395937 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 8966721a788d4e64ad5e495b5a69b74d (table default.Table_9112f8699da541b58056a9f60137658e [id=d2fe03ba4bf141ef982f5a6b86fae022]) successfully deleted
W20260927 15:05:59.396304 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6e9d03457dac43038b4e6fb120ff572c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e9d03457dac43038b4e6fb120ff572c already in progress: creating tablet
I20260927 15:05:59.397393 1562 ts_tablet_manager.cc:1918] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.398188 1562 log.cc:1196] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/e0db1654ced542938487126a0a09ed74
I20260927 15:05:59.398746 1562 ts_tablet_manager.cc:1939] T e0db1654ced542938487126a0a09ed74 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:59.399075 1412 tablet_service.cc:1467] Processing CreateTablet for tablet dd2687f65780481c86a9942960ce7be1 (DEFAULT_TABLE table=default.Table_5d328fa614e143f8a058dd36eaf11755 [id=a56919bbdc0146839e84fcc1224c6b8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.399459 1556 ts_tablet_manager.cc:1428] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.045s user 0.003s sys 0.000s
I20260927 15:05:59.399744 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet e0db1654ced542938487126a0a09ed74 (table default.Table_762e4939259748a28b16279e147a5ada [id=09ccdcb0502f47219fc4985219701f1b]) successfully deleted
I20260927 15:05:59.396468 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 1b045b82515540e8813f9250726479e5 (DEFAULT_TABLE table=default.Table_e301f5a5aea64583a20cf58c548d0934 [id=0268289149d14fd5abd1abecf14a43bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.403331 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 48e7eac8753f425d90302360d228ee54 (DEFAULT_TABLE table=default.Table_c296e3348ec248c4ad40c6b03350903e [id=56f6b3596fe64d17a0b2fcf2c187eb02]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:05:59.406275 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 654d3210fd8c46b68880e544c39d5c88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 654d3210fd8c46b68880e544c39d5c88 already in progress: creating tablet
I20260927 15:05:59.406596 1562 tablet_replica.cc:330] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:59.405823 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 9cb0ab983a444d26b903a0cec64f15f0 (DEFAULT_TABLE table=default.Table_fd5116f32d66492291f3209ac235edf0 [id=8e5ae781d15d48f7924076fea8d3d292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.406796 1562 raft_consensus.cc:2229] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.406996 1562 raft_consensus.cc:2258] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.407099 1556 tablet_bootstrap.cc:492] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:59.407611 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd2687f65780481c86a9942960ce7be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.400671 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a42ae7589c24b1bbd833ab8838521ae" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:59.408259 1562 ts_tablet_manager.cc:1905] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:05:59.409430 1099 leader_election.cc:341] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.409610 1099 leader_election.cc:302] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:05:59.409951 1637 raft_consensus.cc:2726] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:59.410753 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d31bf920f0d41478863959d49400731 with delete_type TABLET_DATA_DELETED (replaced by tablet 01b7e017ead242849585679873a69b43) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:59.411788 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7d31bf920f0d41478863959d49400731 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d31bf920f0d41478863959d49400731 already in progress: creating tablet
I20260927 15:05:59.412926 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d31bf920f0d41478863959d49400731 with delete_type TABLET_DATA_DELETED (replaced by tablet 01b7e017ead242849585679873a69b43) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.407891 1406 tablet_service.cc:1467] Processing CreateTablet for tablet c49913b1763c4a7b9413a801aff93b30 (DEFAULT_TABLE table=default.Table_6cc665540fb24e17b9284fc911758626 [id=31cb67e2dcb54a029ecdc3457b6139c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.413544 1552 tablet_bootstrap.cc:654] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.415438 1637 raft_consensus.cc:482] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.415599 1637 raft_consensus.cc:504] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.416240 1637 leader_election.cc:288] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.418984 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48e7eac8753f425d90302360d228ee54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.420855 912 master_service.cc:946] ReplaceTablet: received request to replace tablet e188f28304604cf2a96a606811900ca5 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.421156 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bd5b459caa42e7a9153d9273ad52c4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:59.423391 1102 leader_election.cc:341] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.427930 905 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 89074ec2ff144a7298af78ab977d97f2
I20260927 15:05:59.428198 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_b1351f5b43b34a4981ab32258c31a00e [id=b28d0e08cf944e17a720641dab1f23f5] alter complete (version 1)
I20260927 15:05:59.428702 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 12623e6767aa4bd4934058f7314a966e
I20260927 15:05:59.429394 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_df8af8dcea36480da1b3715c8d69646f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.429934 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df8af8dcea36480da1b3715c8d69646f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.427531 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 1b045b82515540e8813f9250726479e5 (DEFAULT_TABLE table=default.Table_e301f5a5aea64583a20cf58c548d0934 [id=0268289149d14fd5abd1abecf14a43bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.431082 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 12623e6767aa4bd4934058f7314a966e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:59.431140 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16884c7343be436aa312ec0af40f5e33 consensus state has no leader
I20260927 15:05:59.430109 1276 tablet_service.cc:1467] Processing CreateTablet for tablet dc6f179aab784ae4822356e63332532f (DEFAULT_TABLE table=default.Table_2f2bd859db5046c0afc8811df26a404f [id=359e0f2f64c54790a1fbb004164bf090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.432900 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 12623e6767aa4bd4934058f7314a966e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.436321 908 master_service.cc:946] ReplaceTablet: received request to replace tablet d6925d0369524e7eb1ac3c20ad699ded from {username='slave'} at 127.0.0.1:49800
W20260927 15:05:59.436774 1102 consensus_peers.cc:487] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:05:59.439399 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b045b82515540e8813f9250726479e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.440320 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet e94dd938cf50495c99b5dce808ae7100 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.440958 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a42ae7589c24b1bbd833ab8838521ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.441910 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6f179aab784ae4822356e63332532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.441793 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_940e7b3b563049e2bb3768e18c0affc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.442389 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_940e7b3b563049e2bb3768e18c0affc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.443782 1573 raft_consensus.cc:482] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.443923 1573 raft_consensus.cc:504] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.444187 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8472d420763f4fd59e6814326d75b8d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.444407 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 12623e6767aa4bd4934058f7314a966e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12623e6767aa4bd4934058f7314a966e already in progress: creating tablet
I20260927 15:05:59.444556 1573 leader_election.cc:288] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:05:59.444705 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8472d420763f4fd59e6814326d75b8d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.445586 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e94dd938cf50495c99b5dce808ae7100" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:59.446126 1102 leader_election.cc:341] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.447552 908 master_service.cc:946] ReplaceTablet: received request to replace tablet cd901034653b47dbba7912d5338bc3bb from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.448905 1561 tablet_bootstrap.cc:492] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:59.449091 1561 ts_tablet_manager.cc:1397] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.117s user 0.003s sys 0.003s
I20260927 15:05:59.449534 909 master_service.cc:946] ReplaceTablet: received request to replace tablet bc971defe6d148439a6a0b8c55d9092e from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.449836 1561 raft_consensus.cc:348] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.450101 1561 raft_consensus.cc:374] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.450172 1561 raft_consensus.cc:729] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.450387 1561 consensus_queue.cc:260] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:05:59.451299 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 27c3283a40f14eb4868767799cfdf7bd consensus state has no leader
W20260927 15:05:59.458177 899 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 988ae3a67a4b436583cb475fbcf07b8f (table default.Table_d20ecfc838184a7ebbcaae59355b53e1 [id=19258732f721448fadcdb38690160dd4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 988ae3a67a4b436583cb475fbcf07b8f consensus state has no leader
I20260927 15:05:59.459158 1561 ts_tablet_manager.cc:1428] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260927 15:05:59.459052 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_00334dfc32284d7fbda19999dd7ad94f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:59.459256 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7accf34bdde24d1e9ddbc63f5b205640"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:59.459475 1561 tablet_bootstrap.cc:492] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:59.459053 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_af607bdf84604e1d89e4b679360ed558" } modify_external_catalogs: true
I20260927 15:05:59.459885 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_af607bdf84604e1d89e4b679360ed558" } modify_external_catalogs: true
I20260927 15:05:59.460399 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9074f56e5d72442694c1b683a1911c62" } modify_external_catalogs: true
I20260927 15:05:59.460551 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9074f56e5d72442694c1b683a1911c62" } modify_external_catalogs: true
I20260927 15:05:59.461401 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8b26fb5fec1348f7a8d901c9ce63006b" } new_table_name: "default.Table_abdaaacde40f42b095135b70046aa5a5" modify_external_catalogs: true
I20260927 15:05:59.412825 1403 tablet_service.cc:1467] Processing CreateTablet for tablet dc6f179aab784ae4822356e63332532f (DEFAULT_TABLE table=default.Table_2f2bd859db5046c0afc8811df26a404f [id=359e0f2f64c54790a1fbb004164bf090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.466441 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b045b82515540e8813f9250726479e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:59.469002 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 765b3ee3323846c5ba598f47478fd367 consensus state has no leader
W20260927 15:05:59.469475 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00334dfc32284d7fbda19999dd7ad94f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:05:59.469496 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7accf34bdde24d1e9ddbc63f5b205640 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.469624 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bd5b459caa42e7a9153d9273ad52c4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:05:59.473884 1099 leader_election.cc:341] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.474033 1099 leader_election.cc:302] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:05:59.474069 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 12623e6767aa4bd4934058f7314a966e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.474998 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a8794ae976fe4fd48b9015808f70e330" } modify_external_catalogs: true
I20260927 15:05:59.475193 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a8794ae976fe4fd48b9015808f70e330" } modify_external_catalogs: true
I20260927 15:05:59.476962 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c49913b1763c4a7b9413a801aff93b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.477165 1573 raft_consensus.cc:2726] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:59.474787 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_92b373f81f26454ca3c8a82dfe807cfb" } new_table_name: "default.Table_177f5eb468964182a1cb169bf4816efc" modify_external_catalogs: true
I20260927 15:05:59.478571 1561 tablet_bootstrap.cc:654] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.485992 1440 raft_consensus.cc:1261] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Refusing update from remote peer c4264874db964ff2830b7894c2b3d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:59.486729 1573 consensus_queue.cc:1035] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:05:59.487972 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6f179aab784ae4822356e63332532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.488085 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_15947e024eaa42709496e8851bd7c768"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.488627 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15947e024eaa42709496e8851bd7c768 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.489260 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cb0ab983a444d26b903a0cec64f15f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.494900 1562 ts_tablet_manager.cc:1918] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.495630 1562 log.cc:1196] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/30cf4db249154adda9406d5b07430a80
I20260927 15:05:59.496662 1562 ts_tablet_manager.cc:1939] T 30cf4db249154adda9406d5b07430a80 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:59.500917 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ac3b1d765caf40a1a7593cdb19defcab
I20260927 15:05:59.501720 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet ac3b1d765caf40a1a7593cdb19defcab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.502216 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet ac3b1d765caf40a1a7593cdb19defcab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.502506 1560 tablet_replica.cc:330] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:59.502784 1560 raft_consensus.cc:2229] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.503006 1560 raft_consensus.cc:2258] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.503502 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 30cf4db249154adda9406d5b07430a80 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]) successfully deleted
I20260927 15:05:59.503971 1560 ts_tablet_manager.cc:1905] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:05:59.505119 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 46ee85688df04e92accdedb6625406c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46ee85688df04e92accdedb6625406c1 already in progress: creating tablet
I20260927 15:05:59.505642 1562 tablet_replica.cc:330] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:59.507314 1562 raft_consensus.cc:2229] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.507826 1562 raft_consensus.cc:2258] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.508627 1562 ts_tablet_manager.cc:1905] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.511072 1561 tablet_bootstrap.cc:492] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:59.511256 1561 ts_tablet_manager.cc:1397] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.002s
I20260927 15:05:59.512878 1560 ts_tablet_manager.cc:1918] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.512923 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet ac3b1d765caf40a1a7593cdb19defcab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.513140 1560 log.cc:1196] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/ac3b1d765caf40a1a7593cdb19defcab
I20260927 15:05:59.513125 1561 raft_consensus.cc:348] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.513460 1561 raft_consensus.cc:374] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.513664 1561 raft_consensus.cc:729] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.513684 1560 ts_tablet_manager.cc:1939] T ac3b1d765caf40a1a7593cdb19defcab P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:59.514019 1561 consensus_queue.cc:260] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.514948 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet ac3b1d765caf40a1a7593cdb19defcab (table default.Table_a8794ae976fe4fd48b9015808f70e330 [id=6368f21af56d44f09f5cf1ec2d19f2b6]) successfully deleted
I20260927 15:05:59.519625 1561 ts_tablet_manager.cc:1428] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 15:05:59.523348 1561 tablet_bootstrap.cc:492] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:59.526523 1285 tablet_service.cc:1467] Processing CreateTablet for tablet c41cd38355e64590b43b2e1271c43e91 (DEFAULT_TABLE table=default.Table_4239cd3219fb4e32827288ef7222bf2f [id=d49a20ec0aac4d799662a64a906d62f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.527009 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c41cd38355e64590b43b2e1271c43e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.528481 1556 tablet_bootstrap.cc:654] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.507962 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e94dd938cf50495c99b5dce808ae7100" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:59.530871 1561 tablet_bootstrap.cc:654] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.532476 1131 tablet_service.cc:1467] Processing CreateTablet for tablet c41cd38355e64590b43b2e1271c43e91 (DEFAULT_TABLE table=default.Table_4239cd3219fb4e32827288ef7222bf2f [id=d49a20ec0aac4d799662a64a906d62f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.532990 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c41cd38355e64590b43b2e1271c43e91. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:59.533804 1099 leader_election.cc:341] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.533931 1099 leader_election.cc:302] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:05:59.534330 1573 raft_consensus.cc:2726] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:59.545889 1559 ts_tablet_manager.cc:1918] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.547472 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8f5fefa8a52c4f66b05c89b0c5017c38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.548094 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f5fefa8a52c4f66b05c89b0c5017c38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.548822 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_305a912a4d114bd5a0d5e527d05ca887"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:59.549973 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4e746f160fe7481ea3947c59c33ed5ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.550454 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e746f160fe7481ea3947c59c33ed5ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.550976 1561 tablet_bootstrap.cc:492] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:59.551155 1561 ts_tablet_manager.cc:1397] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.003s
I20260927 15:05:59.551234 1559 log.cc:1196] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/b122f1436fde4c5da7f0afa3a1c24c70
W20260927 15:05:59.549319 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_305a912a4d114bd5a0d5e527d05ca887 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.551986 1561 raft_consensus.cc:348] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.552264 1561 raft_consensus.cc:374] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.552388 1561 raft_consensus.cc:729] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.552716 1561 consensus_queue.cc:260] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.556748 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet bb90faccda0145a7acd153fcd51b4c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.557523 1561 ts_tablet_manager.cc:1428] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 15:05:59.557622 913 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 34822e9f900f4d04b59b810d59e6aa49 (table default.Table_875cbc00c31e4798bf3ed5bf3135b0a7 [id=5c4f0f47acd14538b67f8c8d579b0696]). Expected version 2 got 0
I20260927 15:05:59.560796 1561 tablet_bootstrap.cc:492] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:59.561980 1559 ts_tablet_manager.cc:1939] T b122f1436fde4c5da7f0afa3a1c24c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:59.562315 1562 ts_tablet_manager.cc:1918] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.563045 1562 log.cc:1196] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/714b110a24ca4f3bb8126034dc3e6407
I20260927 15:05:59.563470 1562 ts_tablet_manager.cc:1939] T 714b110a24ca4f3bb8126034dc3e6407 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:59.565723 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 714b110a24ca4f3bb8126034dc3e6407 (table default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]) successfully deleted
I20260927 15:05:59.566478 1561 tablet_bootstrap.cc:654] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.566576 910 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 34822e9f900f4d04b59b810d59e6aa49 (table default.Table_875cbc00c31e4798bf3ed5bf3135b0a7 [id=5c4f0f47acd14538b67f8c8d579b0696]). Expected version 2 got 0
I20260927 15:05:59.566954 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 82) took 1987 ms. Trace:
I20260927 15:05:59.567076 1559 rpcz_store.cc:276] 0927 15:05:57.579154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.580621 (+ 1467us) service_pool.cc:227] Handling call
0927 15:05:59.309650 (+1729029us) ts_tablet_manager.cc:1145] Deleting tablet b122f1436fde4c5da7f0afa3a1c24c70
0927 15:05:59.309664 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:59.504940 (+195276us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:59.545762 (+ 40822us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:59.566566 (+ 20804us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1728792}
I20260927 15:05:59.567553 1562 tablet_replica.cc:330] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:59.567833 1562 raft_consensus.cc:2229] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.568228 1559 tablet_replica.cc:330] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:05:59.568405 1559 raft_consensus.cc:2229] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.568452 1562 raft_consensus.cc:2258] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.569540 1562 ts_tablet_manager.cc:1905] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.573686 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 31701139f10f4478af43bd153aa3a2dc (table default.Table_95966f78353048d286558ae2da5bfee5 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 1 got 0
I20260927 15:05:59.577530 1559 raft_consensus.cc:2258] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.577811 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet b122f1436fde4c5da7f0afa3a1c24c70 (table default.Table_0cf38c5a77d943628b2d20226904801d [id=df10d723c97d47dd82747afd6899372d]) successfully deleted
I20260927 15:05:59.578168 1559 ts_tablet_manager.cc:1905] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.580404 1628 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260927 15:05:59.580729 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bc971defe6d148439a6a0b8c55d9092e
I20260927 15:05:59.581199 909 catalog_manager.cc:6565] ReplaceTablet: tablet bc971defe6d148439a6a0b8c55d9092e deleted and replaced by tablet 8fc1fc04814147d8843aa734fd1794da
I20260927 15:05:59.581255 1643 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260927 15:05:59.582187 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet e0db1654ced542938487126a0a09ed74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.582429 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet bc971defe6d148439a6a0b8c55d9092e with delete_type TABLET_DATA_DELETED (replaced by tablet 8fc1fc04814147d8843aa734fd1794da) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.582433 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet bc971defe6d148439a6a0b8c55d9092e with delete_type TABLET_DATA_DELETED (replaced by tablet 8fc1fc04814147d8843aa734fd1794da) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.583003 1403 tablet_service.cc:1467] Processing CreateTablet for tablet c41cd38355e64590b43b2e1271c43e91 (DEFAULT_TABLE table=default.Table_4239cd3219fb4e32827288ef7222bf2f [id=d49a20ec0aac4d799662a64a906d62f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.583463 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c41cd38355e64590b43b2e1271c43e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.585006 1556 tablet_bootstrap.cc:492] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:59.589207 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet bc971defe6d148439a6a0b8c55d9092e with delete_type TABLET_DATA_DELETED (replaced by tablet 8fc1fc04814147d8843aa734fd1794da) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.591337 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cd901034653b47dbba7912d5338bc3bb
I20260927 15:05:59.592038 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet cd901034653b47dbba7912d5338bc3bb with delete_type TABLET_DATA_DELETED (replaced by tablet 0d4ca19b492c4df1b31c78f1629c50b5) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.592222 908 catalog_manager.cc:6565] ReplaceTablet: tablet cd901034653b47dbba7912d5338bc3bb deleted and replaced by tablet 0d4ca19b492c4df1b31c78f1629c50b5
I20260927 15:05:59.592629 1556 ts_tablet_manager.cc:1397] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.186s user 0.002s sys 0.009s
I20260927 15:05:59.593009 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet cd901034653b47dbba7912d5338bc3bb with delete_type TABLET_DATA_DELETED (replaced by tablet 0d4ca19b492c4df1b31c78f1629c50b5) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.593704 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet cd901034653b47dbba7912d5338bc3bb with delete_type TABLET_DATA_DELETED (replaced by tablet 0d4ca19b492c4df1b31c78f1629c50b5) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.593568 1556 raft_consensus.cc:348] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.595156 1556 raft_consensus.cc:374] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.595263 1556 raft_consensus.cc:729] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.597481 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd55e22d8254ea8b1dab989517148ca (DEFAULT_TABLE table=default.Table_0f6a6192da2f4f05af0cad71e5b85ef2 [id=e104421aa3634f9b9868449439d50362]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.598879 1556 consensus_queue.cc:260] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.600950 1556 ts_tablet_manager.cc:1428] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 15:05:59.603260 1133 tablet_service.cc:1467] Processing CreateTablet for tablet a90039faff27436db7b50fa4c4643d3b (DEFAULT_TABLE table=default.Table_a97f9c79720e40e48b56f0dd4c7441cc [id=e15024fd65bf43fcadd4253d7f2e991c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.603782 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a90039faff27436db7b50fa4c4643d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.606076 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 0aec677006ab4407bd7ae4c0078d6b7f (DEFAULT_TABLE table=default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.606491 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0aec677006ab4407bd7ae4c0078d6b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.607683 1140 tablet_service.cc:1467] Processing CreateTablet for tablet aa192d5cbece4127ace65e564bb1a12a (DEFAULT_TABLE table=default.Table_c6de440f06ab4616970f89ee3b92b90a [id=f96697b67a7f4eb9b111b258c5fc514a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.608039 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa192d5cbece4127ace65e564bb1a12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.611081 1143 tablet_service.cc:1467] Processing CreateTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd (DEFAULT_TABLE table=default.Table_a6f756a6136d48a78b4fb2488323f3fd [id=ed34d1e88ae54c6086ae3a7cbfdf7861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.611400 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c65bc09865bc4a0283eaa4af9f860bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.601809 1276 tablet_service.cc:1467] Processing CreateTablet for tablet a90039faff27436db7b50fa4c4643d3b (DEFAULT_TABLE table=default.Table_a97f9c79720e40e48b56f0dd4c7441cc [id=e15024fd65bf43fcadd4253d7f2e991c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.603868 1278 tablet_service.cc:1467] Processing CreateTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd (DEFAULT_TABLE table=default.Table_a6f756a6136d48a78b4fb2488323f3fd [id=ed34d1e88ae54c6086ae3a7cbfdf7861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.605430 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 0aec677006ab4407bd7ae4c0078d6b7f (DEFAULT_TABLE table=default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.612711 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd55e22d8254ea8b1dab989517148ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.606961 1277 tablet_service.cc:1467] Processing CreateTablet for tablet aa192d5cbece4127ace65e564bb1a12a (DEFAULT_TABLE table=default.Table_c6de440f06ab4616970f89ee3b92b90a [id=f96697b67a7f4eb9b111b258c5fc514a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.613013 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa192d5cbece4127ace65e564bb1a12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.614930 1573 raft_consensus.cc:482] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.615058 1573 raft_consensus.cc:504] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.615698 1573 leader_election.cc:288] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.608462 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 70cc2e16bd6c40bf99ed4436f17d7096 (DEFAULT_TABLE table=default.Table_f20e18689ad245c5872112d6f987abb1 [id=2f01e95ae3994ed8aaf98bc5743e267d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.616870 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70cc2e16bd6c40bf99ed4436f17d7096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.622728 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0aec677006ab4407bd7ae4c0078d6b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.622936 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd55e22d8254ea8b1dab989517148ca (DEFAULT_TABLE table=default.Table_0f6a6192da2f4f05af0cad71e5b85ef2 [id=e104421aa3634f9b9868449439d50362]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.623413 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcffb8cedd74b18871988201f9db2e5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:05:59.624047 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bc971defe6d148439a6a0b8c55d9092e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc971defe6d148439a6a0b8c55d9092e already in progress: creating tablet
I20260927 15:05:59.624051 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcffb8cedd74b18871988201f9db2e5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:59.624698 1102 leader_election.cc:341] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:05:59.624825 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet cd901034653b47dbba7912d5338bc3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd901034653b47dbba7912d5338bc3bb already in progress: creating tablet
W20260927 15:05:59.625150 1099 leader_election.cc:341] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.625252 1099 leader_election.cc:302] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:05:59.625591 1573 raft_consensus.cc:2726] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:59.626225 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 70cc2e16bd6c40bf99ed4436f17d7096 (DEFAULT_TABLE table=default.Table_f20e18689ad245c5872112d6f987abb1 [id=2f01e95ae3994ed8aaf98bc5743e267d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.626565 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70cc2e16bd6c40bf99ed4436f17d7096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.627265 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c65bc09865bc4a0283eaa4af9f860bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.629253 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd55e22d8254ea8b1dab989517148ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.630431 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0f6a6192da2f4f05af0cad71e5b85ef2" } modify_external_catalogs: true
I20260927 15:05:59.630636 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0f6a6192da2f4f05af0cad71e5b85ef2" } modify_external_catalogs: true
I20260927 15:05:59.632529 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b093eeae2295436bb418ac8610a19dd0" } modify_external_catalogs: true
I20260927 15:05:59.632730 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b093eeae2295436bb418ac8610a19dd0" } modify_external_catalogs: true
I20260927 15:05:59.632984 1406 tablet_service.cc:1467] Processing CreateTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd (DEFAULT_TABLE table=default.Table_a6f756a6136d48a78b4fb2488323f3fd [id=ed34d1e88ae54c6086ae3a7cbfdf7861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.633154 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a90039faff27436db7b50fa4c4643d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.633384 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c65bc09865bc4a0283eaa4af9f860bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.632154 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_95966f78353048d286558ae2da5bfee5" } new_table_name: "default.Table_d8e4a9d0dbcb49878bf7891e8e712915" modify_external_catalogs: true
I20260927 15:05:59.635967 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 0aec677006ab4407bd7ae4c0078d6b7f (DEFAULT_TABLE table=default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.636472 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0aec677006ab4407bd7ae4c0078d6b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.640793 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 70cc2e16bd6c40bf99ed4436f17d7096 (DEFAULT_TABLE table=default.Table_f20e18689ad245c5872112d6f987abb1 [id=2f01e95ae3994ed8aaf98bc5743e267d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.641146 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70cc2e16bd6c40bf99ed4436f17d7096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.642940 1556 tablet_bootstrap.cc:492] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:59.644914 1419 tablet_service.cc:1467] Processing CreateTablet for tablet aa192d5cbece4127ace65e564bb1a12a (DEFAULT_TABLE table=default.Table_c6de440f06ab4616970f89ee3b92b90a [id=f96697b67a7f4eb9b111b258c5fc514a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.644915 1556 tablet_bootstrap.cc:654] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.646371 1643 tablet.cc:1722] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:05:59.659384 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 2cd55e22d8254ea8b1dab989517148ca (DEFAULT_TABLE table=default.Table_0f6a6192da2f4f05af0cad71e5b85ef2 [id=e104421aa3634f9b9868449439d50362]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.659940 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cd55e22d8254ea8b1dab989517148ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.660593 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ce3b706ed2734db782efdb47cf3fda95
I20260927 15:05:59.661274 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dcca958a30ba42a8943865116e383a22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.661820 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcca958a30ba42a8943865116e383a22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.663528 1637 raft_consensus.cc:482] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:05:59.663687 1637 raft_consensus.cc:504] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.664270 1637 leader_election.cc:288] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:05:59.665364 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet ce3b706ed2734db782efdb47cf3fda95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.665639 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce3b706ed2734db782efdb47cf3fda95" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:05:59.666307 1102 consensus_peers.cc:487] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:05:59.666383 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet ce3b706ed2734db782efdb47cf3fda95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:05:59.666515 1102 leader_election.cc:341] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.667716 1439 raft_consensus.cc:1261] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Refusing update from remote peer c4264874db964ff2830b7894c2b3d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:05:59.668147 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce3b706ed2734db782efdb47cf3fda95" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:05:59.668769 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet ce3b706ed2734db782efdb47cf3fda95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.669678 1637 consensus_queue.cc:1035] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:05:59.669831 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ce3b706ed2734db782efdb47cf3fda95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce3b706ed2734db782efdb47cf3fda95 already in progress: creating tablet
W20260927 15:05:59.670315 1099 leader_election.cc:341] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:05:59.670415 1099 leader_election.cc:302] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:05:59.670689 1628 tablet.cc:1722] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:05:59.673861 1637 raft_consensus.cc:2726] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:05:59.680285 1556 tablet_bootstrap.cc:492] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:59.680442 1556 ts_tablet_manager.cc:1397] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.001s
I20260927 15:05:59.681162 1556 raft_consensus.cc:348] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.681381 1556 raft_consensus.cc:374] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.681473 1556 raft_consensus.cc:729] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.681735 1556 consensus_queue.cc:260] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.682904 1552 tablet_bootstrap.cc:492] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:59.683041 1552 ts_tablet_manager.cc:1397] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.321s user 0.038s sys 0.058s
I20260927 15:05:59.683768 1552 raft_consensus.cc:348] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.683987 1552 raft_consensus.cc:374] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.684073 1552 raft_consensus.cc:729] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.684276 1552 consensus_queue.cc:260] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.685150 1552 ts_tablet_manager.cc:1428] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:05:59.685434 1552 tablet_bootstrap.cc:492] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:59.688284 1552 tablet_bootstrap.cc:654] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:05:59.690958 1723 log.cc:924] Time spent T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
I20260927 15:05:59.692646 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_476502809f814797a2de6c54405d8c30" } new_table_name: "default.Table_4e02ea20ad894ef6b1ea82884cfdf529" modify_external_catalogs: true
I20260927 15:05:59.693946 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet d6925d0369524e7eb1ac3c20ad699ded with delete_type TABLET_DATA_DELETED (replaced by tablet 765b3ee3323846c5ba598f47478fd367) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.694180 1560 tablet_replica.cc:330] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:59.694362 1560 raft_consensus.cc:2229] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.694545 1560 raft_consensus.cc:2258] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.694775 1556 ts_tablet_manager.cc:1428] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260927 15:05:59.694685 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b492b891412a427fa40ae10dddbefee5" } new_table_name: "default.Table_bc0cef144e2c48f6883df97308937a76" modify_external_catalogs: true
I20260927 15:05:59.695200 1556 tablet_bootstrap.cc:492] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:59.695933 1560 ts_tablet_manager.cc:1905] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.696393 906 master_service.cc:946] ReplaceTablet: received request to replace tablet 148c77a0e88b40f690ca96f091b78d9a from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.697002 906 master_service.cc:946] ReplaceTablet: received request to replace tablet fe7816e099094d13887650fc223097c7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.698099 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_177f5eb468964182a1cb169bf4816efc [id=861d1dea54204625a6d1ad99fb8f6873] alter complete (version 6)
I20260927 15:05:59.698428 909 master_service.cc:946] ReplaceTablet: received request to replace tablet fe7816e099094d13887650fc223097c7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.698561 1561 tablet_bootstrap.cc:492] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:59.698725 1561 ts_tablet_manager.cc:1397] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.138s user 0.001s sys 0.005s
I20260927 15:05:59.699486 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.699973 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.701368 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7052ab085a334588b13fab6355c981dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.701817 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7052ab085a334588b13fab6355c981dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.703043 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f1d7a98ffc4745ac8eeb93012b55d417
I20260927 15:05:59.703651 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dbc92fad9bf44fd290587f43f3cd1f81" } new_table_name: "default.Table_03f21e43b48e4663bf25f8656a9ee2b4" modify_external_catalogs: true
I20260927 15:05:59.703758 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.704254 1560 ts_tablet_manager.cc:1918] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.704422 1560 log.cc:1196] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/d6925d0369524e7eb1ac3c20ad699ded
I20260927 15:05:59.698781 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 63289edbdd734dd5a817df42d83e422e
I20260927 15:05:59.705259 1560 ts_tablet_manager.cc:1939] T d6925d0369524e7eb1ac3c20ad699ded P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:59.705168 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_04cbee496c0e43669b6c8658b48b5d8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.705595 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04cbee496c0e43669b6c8658b48b5d8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.705577 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 63289edbdd734dd5a817df42d83e422e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.706092 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2cd55e22d8254ea8b1dab989517148ca
I20260927 15:05:59.706441 1728 tablet.cc:1722] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260927 15:05:59.706691 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_36bbe5ba649840a5a2dacf9ce1cd8d75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.707121 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36bbe5ba649840a5a2dacf9ce1cd8d75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.708057 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet d6925d0369524e7eb1ac3c20ad699ded (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
I20260927 15:05:59.708381 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.708421 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 63289edbdd734dd5a817df42d83e422e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.708643 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cd55e22d8254ea8b1dab989517148ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.709190 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cd55e22d8254ea8b1dab989517148ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.709311 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 63289edbdd734dd5a817df42d83e422e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.710237 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:59.711920 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 63289edbdd734dd5a817df42d83e422e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63289edbdd734dd5a817df42d83e422e already in progress: creating tablet
W20260927 15:05:59.712697 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2cd55e22d8254ea8b1dab989517148ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cd55e22d8254ea8b1dab989517148ca already in progress: creating tablet
W20260927 15:05:59.713402 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f1d7a98ffc4745ac8eeb93012b55d417 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1d7a98ffc4745ac8eeb93012b55d417 already in progress: creating tablet
I20260927 15:05:59.713824 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa192d5cbece4127ace65e564bb1a12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.716470 1561 raft_consensus.cc:348] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.717049 1561 raft_consensus.cc:374] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.717581 1561 raft_consensus.cc:729] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.721886 1561 consensus_queue.cc:260] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.722795 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 31701139f10f4478af43bd153aa3a2dc (table default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 2 got 1
I20260927 15:05:59.723614 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_75127a34541e4a979aace6aa029d396e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.724068 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75127a34541e4a979aace6aa029d396e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.726362 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2f2bd859db5046c0afc8811df26a404f" } modify_external_catalogs: true
I20260927 15:05:59.726552 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2f2bd859db5046c0afc8811df26a404f" } modify_external_catalogs: true
I20260927 15:05:59.726850 1561 ts_tablet_manager.cc:1428] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20260927 15:05:59.727140 1561 tablet_bootstrap.cc:492] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:59.727334 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fe7816e099094d13887650fc223097c7
I20260927 15:05:59.727823 906 catalog_manager.cc:6565] ReplaceTablet: tablet fe7816e099094d13887650fc223097c7 deleted and replaced by tablet c90e5c66d8564f68b401b3e4280499a7
I20260927 15:05:59.728315 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7816e099094d13887650fc223097c7 with delete_type TABLET_DATA_DELETED (replaced by tablet c90e5c66d8564f68b401b3e4280499a7) from {username='slave'} at 127.0.0.1:54602
W20260927 15:05:59.729526 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet fe7816e099094d13887650fc223097c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe7816e099094d13887650fc223097c7 already in progress: creating tablet
I20260927 15:05:59.730178 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7816e099094d13887650fc223097c7 with delete_type TABLET_DATA_DELETED (replaced by tablet c90e5c66d8564f68b401b3e4280499a7) from {username='slave'} at 127.0.0.1:49234
W20260927 15:05:59.732388 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 consensus state has no leader
W20260927 15:05:59.733089 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba14b7531bb647248572be10d2b43cf2 consensus state has no leader
W20260927 15:05:59.734292 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d4ca19b492c4df1b31c78f1629c50b5 has no consensus state
I20260927 15:05:59.736485 1561 tablet_bootstrap.cc:654] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.737740 1552 tablet_bootstrap.cc:492] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:05:59.737978 1552 ts_tablet_manager.cc:1397] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.002s
I20260927 15:05:59.738768 1552 raft_consensus.cc:348] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.739374 1556 tablet_bootstrap.cc:654] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.747349 1552 raft_consensus.cc:374] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.747550 1552 raft_consensus.cc:729] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.747900 1552 consensus_queue.cc:260] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.749346 1552 ts_tablet_manager.cc:1428] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260927 15:05:59.749711 1552 tablet_bootstrap.cc:492] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:05:59.749694 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_166945d9ee0740f2b92a0138063f8891"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.750561 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_166945d9ee0740f2b92a0138063f8891 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.751444 1552 tablet_bootstrap.cc:654] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.752823 1628 tablet.cc:1722] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:05:59.755522 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d31bf920f0d41478863959d49400731 with delete_type TABLET_DATA_DELETED (replaced by tablet 01b7e017ead242849585679873a69b43) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.756062 1560 tablet_replica.cc:330] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:05:59.756247 1560 raft_consensus.cc:2229] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.728592 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7816e099094d13887650fc223097c7 with delete_type TABLET_DATA_DELETED (replaced by tablet c90e5c66d8564f68b401b3e4280499a7) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.730134 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cd55e22d8254ea8b1dab989517148ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.756441 1560 raft_consensus.cc:2258] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.690775 1562 ts_tablet_manager.cc:1918] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.742354 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ee85688df04e92accdedb6625406c1 with delete_type TABLET_DATA_DELETED (replaced by tablet c49913b1763c4a7b9413a801aff93b30) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.757582 1562 log.cc:1196] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/6c7a8bf15c48423ea9ff14c46645a33b
I20260927 15:05:59.751067 1643 tablet.cc:1722] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:05:59.761281 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b1351f5b43b34a4981ab32258c31a00e" } new_table_name: "default.Table_d57bcc02349c4f17b76b5a31ec74e0f2" modify_external_catalogs: true
I20260927 15:05:59.767645 1562 ts_tablet_manager.cc:1939] T 6c7a8bf15c48423ea9ff14c46645a33b P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:59.768723 1562 tablet_replica.cc:330] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:59.769004 1562 raft_consensus.cc:2229] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:05:59.769300 1562 pending_rounds.cc:62] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:05:59.769344 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 6c7a8bf15c48423ea9ff14c46645a33b (table default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]) successfully deleted
I20260927 15:05:59.769444 1562 pending_rounds.cc:68] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976306276352000 op_type: NO_OP noop_request { }
I20260927 15:05:59.769590 1562 raft_consensus.cc:2866] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:05:59.769693 1556 tablet_bootstrap.cc:492] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:59.769717 1562 raft_consensus.cc:2258] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.769944 1556 ts_tablet_manager.cc:1397] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.001s
I20260927 15:05:59.770439 1560 ts_tablet_manager.cc:1905] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.771198 1556 raft_consensus.cc:348] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.771435 1556 raft_consensus.cc:374] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.771524 1556 raft_consensus.cc:729] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.771757 1556 consensus_queue.cc:260] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.772718 1556 ts_tablet_manager.cc:1428] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:05:59.773018 1556 tablet_bootstrap.cc:492] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:05:59.776803 1556 tablet_bootstrap.cc:654] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.777064 1561 tablet_bootstrap.cc:492] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:59.777222 1561 ts_tablet_manager.cc:1397] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.003s
I20260927 15:05:59.778015 1560 ts_tablet_manager.cc:1918] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.778107 1561 raft_consensus.cc:348] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.778337 1561 raft_consensus.cc:374] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.778357 1560 log.cc:1196] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/7d31bf920f0d41478863959d49400731
I20260927 15:05:59.778417 1561 raft_consensus.cc:729] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.778880 1560 ts_tablet_manager.cc:1939] T 7d31bf920f0d41478863959d49400731 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:05:59.778708 1561 consensus_queue.cc:260] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.781311 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 7d31bf920f0d41478863959d49400731 (table default.Table_b1351f5b43b34a4981ab32258c31a00e [id=b28d0e08cf944e17a720641dab1f23f5]) successfully deleted
I20260927 15:05:59.781476 914 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25] alter complete (version 2)
W20260927 15:05:59.782266 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01b7e017ead242849585679873a69b43 has no consensus state
I20260927 15:05:59.778705 1562 ts_tablet_manager.cc:1905] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.787407 1559 ts_tablet_manager.cc:1918] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:05:59.787611 1559 log.cc:1196] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/da8215167ad74dbfb2cc1c8d50a76ed5
I20260927 15:05:59.789304 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet dc6f179aab784ae4822356e63332532f
I20260927 15:05:59.790045 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6f179aab784ae4822356e63332532f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.791184 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6f179aab784ae4822356e63332532f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.791715 1403 tablet_service.cc:1467] Processing CreateTablet for tablet a90039faff27436db7b50fa4c4643d3b (DEFAULT_TABLE table=default.Table_a97f9c79720e40e48b56f0dd4c7441cc [id=e15024fd65bf43fcadd4253d7f2e991c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.792126 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a90039faff27436db7b50fa4c4643d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.795699 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 373b6e6c03614b78a8343c84095bd347 (DEFAULT_TABLE table=default.Table_7accf34bdde24d1e9ddbc63f5b205640 [id=2bbf143085ef4c7e8d039b230baffa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.796128 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 373b6e6c03614b78a8343c84095bd347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.802955 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 148c77a0e88b40f690ca96f091b78d9a with delete_type TABLET_DATA_DELETED (replaced by tablet f88b401dc12e451c80abe1b509e2b532) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.803478 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 16884c7343be436aa312ec0af40f5e33 from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.807952 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 373b6e6c03614b78a8343c84095bd347 (DEFAULT_TABLE table=default.Table_7accf34bdde24d1e9ddbc63f5b205640 [id=2bbf143085ef4c7e8d039b230baffa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.808401 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 373b6e6c03614b78a8343c84095bd347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.812148 1561 ts_tablet_manager.cc:1428] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:05:59.815397 1562 ts_tablet_manager.cc:1918] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:05:59.815559 1562 log.cc:1196] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/1c49c70e003f47d6a325669376e5e3ca
I20260927 15:05:59.815622 1561 tablet_bootstrap.cc:492] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:59.815992 1562 ts_tablet_manager.cc:1939] T 1c49c70e003f47d6a325669376e5e3ca P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:59.817462 1561 tablet_bootstrap.cc:654] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.817624 1562 tablet_replica.cc:330] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:59.817937 1562 raft_consensus.cc:2229] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.818221 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 1c49c70e003f47d6a325669376e5e3ca (table default.Table_2481967ffd2f4c30bfb57bdf8d5940e0 [id=ed09d325f0bd478fa0ed6172c15299ec]) successfully deleted
I20260927 15:05:59.818267 1562 raft_consensus.cc:2258] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:05:59.818854 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ad5af5df58824fe88d607a93216bd228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad5af5df58824fe88d607a93216bd228 already in progress: creating tablet
W20260927 15:05:59.819166 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 07b63e63f7cd4075bcf10a463ce16e05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07b63e63f7cd4075bcf10a463ce16e05 already in progress: creating tablet
W20260927 15:05:59.819386 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6e9d03457dac43038b4e6fb120ff572c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e9d03457dac43038b4e6fb120ff572c already in progress: creating tablet
I20260927 15:05:59.819823 905 master_service.cc:946] ReplaceTablet: received request to replace tablet 12623e6767aa4bd4934058f7314a966e from {username='slave'} at 127.0.0.1:49800
I20260927 15:05:59.820211 1562 ts_tablet_manager.cc:1905] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.823179 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 16884c7343be436aa312ec0af40f5e33
I20260927 15:05:59.823920 912 catalog_manager.cc:6565] ReplaceTablet: tablet 16884c7343be436aa312ec0af40f5e33 deleted and replaced by tablet 6cc8bd2079f84da39e13113e6699bf5e
I20260927 15:05:59.824210 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 16884c7343be436aa312ec0af40f5e33 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cc8bd2079f84da39e13113e6699bf5e) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.825356 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 16884c7343be436aa312ec0af40f5e33 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cc8bd2079f84da39e13113e6699bf5e) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.829229 1562 ts_tablet_manager.cc:1918] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:05:59.829499 1562 log.cc:1196] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/7d31bf920f0d41478863959d49400731
I20260927 15:05:59.829921 1562 ts_tablet_manager.cc:1939] T 7d31bf920f0d41478863959d49400731 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:05:59.831058 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 7d31bf920f0d41478863959d49400731 (table default.Table_d57bcc02349c4f17b76b5a31ec74e0f2 [id=b28d0e08cf944e17a720641dab1f23f5]) successfully deleted
I20260927 15:05:59.833316 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 75537edf83a040cba4da502c726bf456 (DEFAULT_TABLE table=default.Table_8472d420763f4fd59e6814326d75b8d7 [id=2637a7b31e84469c82b01a83a6edc97d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.833832 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75537edf83a040cba4da502c726bf456. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:59.843319 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet dc6f179aab784ae4822356e63332532f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc6f179aab784ae4822356e63332532f already in progress: creating tablet
W20260927 15:05:59.844105 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 16884c7343be436aa312ec0af40f5e33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16884c7343be436aa312ec0af40f5e33 already in progress: creating tablet
I20260927 15:05:59.845535 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 4658de7351e9423b83f393f7f7045eed (DEFAULT_TABLE table=default.Table_df8af8dcea36480da1b3715c8d69646f [id=4e520f2c8e9348b0905f6b71bd98d6a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.845932 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4658de7351e9423b83f393f7f7045eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.854571 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 75537edf83a040cba4da502c726bf456 (DEFAULT_TABLE table=default.Table_8472d420763f4fd59e6814326d75b8d7 [id=2637a7b31e84469c82b01a83a6edc97d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.855331 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75537edf83a040cba4da502c726bf456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.861898 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 4658de7351e9423b83f393f7f7045eed (DEFAULT_TABLE table=default.Table_df8af8dcea36480da1b3715c8d69646f [id=4e520f2c8e9348b0905f6b71bd98d6a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.862315 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4658de7351e9423b83f393f7f7045eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.862550 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 5c0d51b50b414721a255fdde2fe1732f (DEFAULT_TABLE table=default.Table_52dfae347a16444d9d03a84c7a88721d [id=60be603d0c3844e8925f32c3553e8d56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.863001 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c0d51b50b414721a255fdde2fe1732f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.867420 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_03f21e43b48e4663bf25f8656a9ee2b4" } modify_external_catalogs: true
I20260927 15:05:59.867640 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_03f21e43b48e4663bf25f8656a9ee2b4" } modify_external_catalogs: true
I20260927 15:05:59.870189 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 5c0d51b50b414721a255fdde2fe1732f (DEFAULT_TABLE table=default.Table_52dfae347a16444d9d03a84c7a88721d [id=60be603d0c3844e8925f32c3553e8d56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.870642 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c0d51b50b414721a255fdde2fe1732f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.871610 1276 tablet_service.cc:1467] Processing CreateTablet for tablet c264c532db8249e5abe1dbef8ee8ffa0 (DEFAULT_TABLE table=default.Table_15947e024eaa42709496e8851bd7c768 [id=63fa9c7455a147acac68561c09363d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.871277 1135 tablet_service.cc:1467] Processing CreateTablet for tablet c264c532db8249e5abe1dbef8ee8ffa0 (DEFAULT_TABLE table=default.Table_15947e024eaa42709496e8851bd7c768 [id=63fa9c7455a147acac68561c09363d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.872136 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c264c532db8249e5abe1dbef8ee8ffa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.871928 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4ca19b492c4df1b31c78f1629c50b5 (DEFAULT_TABLE table=default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.872680 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c264c532db8249e5abe1dbef8ee8ffa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.875229 1559 ts_tablet_manager.cc:1939] T da8215167ad74dbfb2cc1c8d50a76ed5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:05:59.875240 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4ca19b492c4df1b31c78f1629c50b5 (DEFAULT_TABLE table=default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.876588 1562 tablet_replica.cc:330] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:05:59.876816 1562 raft_consensus.cc:2229] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:05:59.877017 1562 raft_consensus.cc:2258] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:05:59.877578 1562 ts_tablet_manager.cc:1905] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:05:59.879352 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d4ca19b492c4df1b31c78f1629c50b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.880259 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5
I20260927 15:05:59.882668 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d4ca19b492c4df1b31c78f1629c50b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:05:59.883701 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 12623e6767aa4bd4934058f7314a966e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12623e6767aa4bd4934058f7314a966e already in progress: creating tablet
I20260927 15:05:59.885110 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.889192 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 87) took 2259 ms. Trace:
I20260927 15:05:59.889176 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 01b7e017ead242849585679873a69b43 (DEFAULT_TABLE table=default.Table_d57bcc02349c4f17b76b5a31ec74e0f2 [id=b28d0e08cf944e17a720641dab1f23f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.889861 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b7e017ead242849585679873a69b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.891024 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:05:59.891412 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 01b7e017ead242849585679873a69b43 (DEFAULT_TABLE table=default.Table_d57bcc02349c4f17b76b5a31ec74e0f2 [id=b28d0e08cf944e17a720641dab1f23f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.891873 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b7e017ead242849585679873a69b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.892300 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 75537edf83a040cba4da502c726bf456 (DEFAULT_TABLE table=default.Table_8472d420763f4fd59e6814326d75b8d7 [id=2637a7b31e84469c82b01a83a6edc97d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.892730 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 6c73e813bb594a5e871718b73fe61fc9 (DEFAULT_TABLE table=default.Table_00334dfc32284d7fbda19999dd7ad94f [id=a5be5daa955846b58970402702de73f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.892910 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 5c0d51b50b414721a255fdde2fe1732f (DEFAULT_TABLE table=default.Table_52dfae347a16444d9d03a84c7a88721d [id=60be603d0c3844e8925f32c3553e8d56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.893298 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 8fc1fc04814147d8843aa734fd1794da (DEFAULT_TABLE table=default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.893390 1416 tablet_service.cc:1467] Processing CreateTablet for tablet c264c532db8249e5abe1dbef8ee8ffa0 (DEFAULT_TABLE table=default.Table_15947e024eaa42709496e8851bd7c768 [id=63fa9c7455a147acac68561c09363d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.893692 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fc1fc04814147d8843aa734fd1794da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.894094 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 6c73e813bb594a5e871718b73fe61fc9 (DEFAULT_TABLE table=default.Table_00334dfc32284d7fbda19999dd7ad94f [id=a5be5daa955846b58970402702de73f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.895506 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 8fc1fc04814147d8843aa734fd1794da (DEFAULT_TABLE table=default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.896375 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c73e813bb594a5e871718b73fe61fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.896523 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 6c73e813bb594a5e871718b73fe61fc9 (DEFAULT_TABLE table=default.Table_00334dfc32284d7fbda19999dd7ad94f [id=a5be5daa955846b58970402702de73f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.897266 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c73e813bb594a5e871718b73fe61fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.899819 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fc1fc04814147d8843aa734fd1794da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.904131 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f473e7d31ecc4adfbda7d8a1df28ec33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:05:59.904780 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f473e7d31ecc4adfbda7d8a1df28ec33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.907998 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1a0416550bbc4a05bc617171ed8c1504"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:59.908600 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5e5da599fcef4b94ac03384faad9c44a" } modify_external_catalogs: true
I20260927 15:05:59.909210 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_00334dfc32284d7fbda19999dd7ad94f" } modify_external_catalogs: true
I20260927 15:05:59.909034 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c6d23c73ae904261ac5ed42420c0eaab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:59.909382 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_00334dfc32284d7fbda19999dd7ad94f" } modify_external_catalogs: true
W20260927 15:05:59.910547 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a0416550bbc4a05bc617171ed8c1504 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:05:59.912813 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6f179aab784ae4822356e63332532f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.913340 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75537edf83a040cba4da502c726bf456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.913715 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 373b6e6c03614b78a8343c84095bd347 (DEFAULT_TABLE table=default.Table_7accf34bdde24d1e9ddbc63f5b205640 [id=2bbf143085ef4c7e8d039b230baffa63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.914081 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 16884c7343be436aa312ec0af40f5e33 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cc8bd2079f84da39e13113e6699bf5e) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.914247 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 4658de7351e9423b83f393f7f7045eed (DEFAULT_TABLE table=default.Table_df8af8dcea36480da1b3715c8d69646f [id=4e520f2c8e9348b0905f6b71bd98d6a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.914520 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4ca19b492c4df1b31c78f1629c50b5 (DEFAULT_TABLE table=default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.914795 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:05:59.914997 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 8fc1fc04814147d8843aa734fd1794da (DEFAULT_TABLE table=default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:05:59.915863 1559 rpcz_store.cc:276] 0927 15:05:57.625918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.626045 (+ 127us) service_pool.cc:227] Handling call
0927 15:05:59.567343 (+1941298us) ts_tablet_manager.cc:1145] Deleting tablet da8215167ad74dbfb2cc1c8d50a76ed5
0927 15:05:59.567355 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:59.591425 (+ 24070us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:59.787270 (+195845us) tablet_metadata.cc:641] Metadata flushed
0927 15:05:59.885267 (+ 97997us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1940848}
I20260927 15:05:59.917927 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c0d51b50b414721a255fdde2fe1732f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.918161 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c264c532db8249e5abe1dbef8ee8ffa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.921257 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fc1fc04814147d8843aa734fd1794da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.926949 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d4ca19b492c4df1b31c78f1629c50b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.931313 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 373b6e6c03614b78a8343c84095bd347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.935138 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4658de7351e9423b83f393f7f7045eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.938709 1561 tablet_bootstrap.cc:492] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:05:59.938918 1561 ts_tablet_manager.cc:1397] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.123s user 0.005s sys 0.007s
I20260927 15:05:59.939695 1561 raft_consensus.cc:348] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.939932 1561 raft_consensus.cc:374] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:05:59.940006 1561 raft_consensus.cc:729] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:05:59.941913 1561 consensus_queue.cc:260] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:05:59.942975 1561 ts_tablet_manager.cc:1428] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:05:59.944103 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c73e813bb594a5e871718b73fe61fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:05:59.947466 1561 tablet_bootstrap.cc:492] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:05:59.949939 1561 tablet_bootstrap.cc:654] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:05:59.954749 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e6b64fb416dd492caadccd2e9d65a802" } new_table_name: "default.Table_e23e5a0596754267a9314c66227c595f" modify_external_catalogs: true
I20260927 15:05:59.965041 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5e5da599fcef4b94ac03384faad9c44a" } modify_external_catalogs: true
I20260927 15:05:59.970801 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cfdacdd524ba40369d8d01a7eb20da74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:05:59.972069 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet da8215167ad74dbfb2cc1c8d50a76ed5 (table default.Table_bfeb38d1ec214c8989fc01c677d5daef [id=9ed827c5b3234624bc1c68aec0d7fc73]) successfully deleted
I20260927 15:05:59.975991 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 95) took 2281 ms. Trace:
I20260927 15:05:59.976532 1559 rpcz_store.cc:276] 0927 15:05:57.688471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.688665 (+ 194us) service_pool.cc:227] Handling call
0927 15:05:59.968209 (+2279544us) ts_tablet_manager.cc:1145] Deleting tablet f2cce454e70640e2a67b3680676b1d93
0927 15:05:59.968219 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:59.969444 (+ 1225us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2279260}
I20260927 15:05:59.977305 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 94) took 2295 ms. Trace:
I20260927 15:05:59.977784 1559 rpcz_store.cc:276] 0927 15:05:57.682357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.694929 (+ 12572us) service_pool.cc:227] Handling call
0927 15:05:59.977175 (+2282246us) ts_tablet_manager.cc:1145] Deleting tablet 7d6d1cfb1a4d4c439e970d966af841b6
0927 15:05:59.977188 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:59.977277 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2281859}
I20260927 15:05:59.978300 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 96) took 2280 ms. Trace:
I20260927 15:05:59.978780 1559 rpcz_store.cc:276] 0927 15:05:57.697410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.697462 (+ 52us) service_pool.cc:227] Handling call
0927 15:05:59.978186 (+2280724us) ts_tablet_manager.cc:1145] Deleting tablet 6cf0ef42c0944b049a8ce68531ed8e45
0927 15:05:59.978194 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:59.978273 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2280475}
I20260927 15:05:59.979364 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 97) took 2241 ms. Trace:
I20260927 15:05:59.982636 1643 tablet.cc:1722] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:05:59.986863 1628 tablet.cc:1722] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:05:59.979907 1559 rpcz_store.cc:276] 0927 15:05:57.737907 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.738542 (+ 635us) service_pool.cc:227] Handling call
0927 15:05:59.979202 (+2240660us) ts_tablet_manager.cc:1145] Deleting tablet 0d41d55fdb504b95921f46e7aed99ac1
0927 15:05:59.979212 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:59.979323 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2240419}
I20260927 15:05:59.988191 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 99) took 2240 ms. Trace:
I20260927 15:05:59.988396 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 12623e6767aa4bd4934058f7314a966e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:05:59.997959 1556 tablet_bootstrap.cc:492] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:05:59.998304 1559 rpcz_store.cc:276] 0927 15:05:57.747246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.747569 (+ 323us) service_pool.cc:227] Handling call
0927 15:05:59.987996 (+2240427us) ts_tablet_manager.cc:1145] Deleting tablet 714b110a24ca4f3bb8126034dc3e6407
0927 15:05:59.988010 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:05:59.988140 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2240215}
I20260927 15:06:00.000346 1556 ts_tablet_manager.cc:1397] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.225s user 0.039s sys 0.096s
I20260927 15:06:00.001837 1556 raft_consensus.cc:348] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.002190 1556 raft_consensus.cc:374] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.002285 1556 raft_consensus.cc:729] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.002573 1559 tablet_replica.cc:330] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.004393 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2597f21341574a599cce741248f402e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:00.005084 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2597f21341574a599cce741248f402e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:00.005435 1556 consensus_queue.cc:260] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.006287 1562 ts_tablet_manager.cc:1918] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.006419 1562 log.cc:1196] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/e94dd938cf50495c99b5dce808ae7100
W20260927 15:06:00.006520 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfdacdd524ba40369d8d01a7eb20da74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:00.008239 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f2cce454e70640e2a67b3680676b1d93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2cce454e70640e2a67b3680676b1d93 already in progress: creating tablet
I20260927 15:06:00.008287 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c62bcaf11f0645449faf533a55f5d15f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:00.009116 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7d6d1cfb1a4d4c439e970d966af841b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d6d1cfb1a4d4c439e970d966af841b6 already in progress: creating tablet
W20260927 15:06:00.009445 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6cf0ef42c0944b049a8ce68531ed8e45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf0ef42c0944b049a8ce68531ed8e45 already in progress: creating tablet
W20260927 15:06:00.009541 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c62bcaf11f0645449faf533a55f5d15f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:00.009708 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0d41d55fdb504b95921f46e7aed99ac1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d41d55fdb504b95921f46e7aed99ac1 already in progress: creating tablet
W20260927 15:06:00.009999 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 714b110a24ca4f3bb8126034dc3e6407 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 714b110a24ca4f3bb8126034dc3e6407 already in progress: creating tablet
I20260927 15:06:00.010696 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3d65f616a187485eaa9298155971a648"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:00.011315 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d65f616a187485eaa9298155971a648 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:00.011433 1556 ts_tablet_manager.cc:1428] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 15:06:00.011837 1556 tablet_bootstrap.cc:492] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.014020 1556 tablet_bootstrap.cc:654] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.014554 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_04cbee496c0e43669b6c8658b48b5d8a" } modify_external_catalogs: true
I20260927 15:06:00.014794 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_04cbee496c0e43669b6c8658b48b5d8a" } modify_external_catalogs: true
I20260927 15:06:00.013296 1561 tablet_bootstrap.cc:492] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.017525 1561 ts_tablet_manager.cc:1397] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.070s user 0.011s sys 0.014s
I20260927 15:06:00.018313 1561 raft_consensus.cc:348] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.018636 1561 raft_consensus.cc:374] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.018751 1561 raft_consensus.cc:729] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.019081 1561 consensus_queue.cc:260] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.022727 1561 ts_tablet_manager.cc:1428] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:00.006819 1562 ts_tablet_manager.cc:1939] T e94dd938cf50495c99b5dce808ae7100 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:00.023775 1562 tablet_replica.cc:330] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:00.014194 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 434e9390f1fd4a3ebb65924c37b85bd4 (DEFAULT_TABLE table=default.Table_7b64507732114eac85d1c532ba939432 [id=fe47ea48cef44035b7d9df3be08eabb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.024493 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 434e9390f1fd4a3ebb65924c37b85bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.024986 1561 tablet_bootstrap.cc:492] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:00.026966 1374 consensus_peers.cc:487] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Couldn't send request to peer c4264874db964ff2830b7894c2b3d61c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d31bf920f0d41478863959d49400731. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:00.029116 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet e94dd938cf50495c99b5dce808ae7100 (table default.Table_63d3ae8aa61f4fcd80a58e28f2104a21 [id=ef9cdb183bd444e6baac3c583dfb631d]) successfully deleted
I20260927 15:06:00.029207 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 434e9390f1fd4a3ebb65924c37b85bd4 (DEFAULT_TABLE table=default.Table_7b64507732114eac85d1c532ba939432 [id=fe47ea48cef44035b7d9df3be08eabb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.029415 1562 raft_consensus.cc:2229] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.029623 1562 raft_consensus.cc:2258] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.029623 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 434e9390f1fd4a3ebb65924c37b85bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.029954 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 424b66c69254487f932894516d570204 (DEFAULT_TABLE table=default.Table_940e7b3b563049e2bb3768e18c0affc9 [id=45ff9a80d85b49fc8f74596b7f1dd1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.030175 1562 ts_tablet_manager.cc:1905] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.017184 1559 raft_consensus.cc:2229] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.019368 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 424b66c69254487f932894516d570204 (DEFAULT_TABLE table=default.Table_940e7b3b563049e2bb3768e18c0affc9 [id=45ff9a80d85b49fc8f74596b7f1dd1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.032672 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424b66c69254487f932894516d570204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.033972 1561 tablet_bootstrap.cc:654] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.034178 909 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874]). Expected version 3 got 0
I20260927 15:06:00.034441 909 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 67ad68a0adad407a92b2335f43e67227 (table default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]). Expected version 1 got 0
I20260927 15:06:00.034659 909 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 31701139f10f4478af43bd153aa3a2dc (table default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 2 got 1
I20260927 15:06:00.035254 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6c73e813bb594a5e871718b73fe61fc9
I20260927 15:06:00.038733 1562 ts_tablet_manager.cc:1918] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.038887 1562 log.cc:1196] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/7a42ae7589c24b1bbd833ab8838521ae
I20260927 15:06:00.039244 1562 ts_tablet_manager.cc:1939] T 7a42ae7589c24b1bbd833ab8838521ae P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:00.039449 1559 raft_consensus.cc:2258] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.040079 1562 tablet_replica.cc:330] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:00.040266 1562 raft_consensus.cc:2229] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.040419 1559 ts_tablet_manager.cc:1905] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.040901 1562 raft_consensus.cc:2258] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.042585 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dae70d70a5d140fa9783607566b21619" } new_table_name: "default.Table_148b139f16504ddb8e47c777c207685a" modify_external_catalogs: true
I20260927 15:06:00.019788 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 01b7e017ead242849585679873a69b43 (DEFAULT_TABLE table=default.Table_d57bcc02349c4f17b76b5a31ec74e0f2 [id=b28d0e08cf944e17a720641dab1f23f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.044466 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b7e017ead242849585679873a69b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.045140 1562 ts_tablet_manager.cc:1905] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.045465 1634 raft_consensus.cc:482] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.045656 1634 raft_consensus.cc:504] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.046479 1634 leader_election.cc:288] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
W20260927 15:06:00.047562 1374 leader_election.cc:341] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: e0db1654ced542938487126a0a09ed74
I20260927 15:06:00.057361 1556 tablet_bootstrap.cc:492] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.057443 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 7a42ae7589c24b1bbd833ab8838521ae (table default.Table_590e6d5e78b5436fa3687cf0b70e1921 [id=f8681c26dbe446b19c269790f5078b22]) successfully deleted
I20260927 15:06:00.057709 1556 ts_tablet_manager.cc:1397] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.003s
I20260927 15:06:00.058665 1556 raft_consensus.cc:348] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.059041 1556 raft_consensus.cc:374] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.059422 1556 raft_consensus.cc:729] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.059770 1556 consensus_queue.cc:260] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.056034 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c73e813bb594a5e871718b73fe61fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:00.058128 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424b66c69254487f932894516d570204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.062279 1556 ts_tablet_manager.cc:1428] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:00.062691 1556 tablet_bootstrap.cc:492] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:00.065160 1374 consensus_peers.cc:487] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Couldn't send request to peer c4264874db964ff2830b7894c2b3d61c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e188f28304604cf2a96a606811900ca5. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:00.065848 1556 tablet_bootstrap.cc:654] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.069576 1559 ts_tablet_manager.cc:1918] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.069821 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_18591fe82c804016b1f5794d997374d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:00.070603 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18591fe82c804016b1f5794d997374d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:00.071372 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 109f9088371e4f008b2b5f993f2b4c3b
I20260927 15:06:00.071949 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7d935f8994074713a4a90f02ff7f0111" } new_table_name: "default.Table_661afffa3463498f9b3ef33b46bda8e5" modify_external_catalogs: true
I20260927 15:06:00.078068 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 109f9088371e4f008b2b5f993f2b4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:00.078958 1559 log.cc:1196] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/30cf4db249154adda9406d5b07430a80
I20260927 15:06:00.080323 1559 ts_tablet_manager.cc:1939] T 30cf4db249154adda9406d5b07430a80 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.081071 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 100) took 2331 ms. Trace:
I20260927 15:06:00.081184 1559 rpcz_store.cc:276] 0927 15:05:57.749305 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.749353 (+ 48us) service_pool.cc:227] Handling call
0927 15:05:59.998969 (+2249616us) ts_tablet_manager.cc:1145] Deleting tablet 30cf4db249154adda9406d5b07430a80
0927 15:05:59.998984 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.055935 (+ 56951us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.069447 (+ 13512us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.081018 (+ 11571us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2249410}
I20260927 15:06:00.083707 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 103) took 2165 ms. Trace:
I20260927 15:06:00.083890 1556 tablet_bootstrap.cc:492] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.084102 1556 ts_tablet_manager.cc:1397] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260927 15:06:00.084061 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 30cf4db249154adda9406d5b07430a80 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]) successfully deleted
I20260927 15:06:00.085024 1556 raft_consensus.cc:348] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.085323 1556 raft_consensus.cc:374] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.085436 1556 raft_consensus.cc:729] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.085530 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 109f9088371e4f008b2b5f993f2b4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:00.085713 1556 consensus_queue.cc:260] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.086452 1556 ts_tablet_manager.cc:1428] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:00.087167 1556 tablet_bootstrap.cc:492] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.088095 1562 ts_tablet_manager.cc:1918] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:00.089303 1556 tablet_bootstrap.cc:654] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.091252 1562 log.cc:1196] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/ac3b1d765caf40a1a7593cdb19defcab
I20260927 15:06:00.044417 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c73e813bb594a5e871718b73fe61fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:00.083837 1559 rpcz_store.cc:276] 0927 15:05:57.917932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.918024 (+ 92us) service_pool.cc:227] Handling call
0927 15:06:00.083540 (+2165516us) ts_tablet_manager.cc:1145] Deleting tablet 148c77a0e88b40f690ca96f091b78d9a
0927 15:06:00.083550 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.083646 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2142108}
W20260927 15:06:00.095945 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6d23c73ae904261ac5ed42420c0eaab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:00.096731 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 148c77a0e88b40f690ca96f091b78d9a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 148c77a0e88b40f690ca96f091b78d9a already in progress: creating tablet
I20260927 15:06:00.097316 1559 tablet_replica.cc:330] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.098125 1559 raft_consensus.cc:2229] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:00.101824 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ef61af61dda541eda62bb76d07aaa50a" } new_table_name: "default.Table_188cad16a13a4aabb2ce4cd74b0c41a6" modify_external_catalogs: true
W20260927 15:06:00.105224 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 already in progress: creating tablet
I20260927 15:06:00.108690 1562 ts_tablet_manager.cc:1939] T ac3b1d765caf40a1a7593cdb19defcab P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:00.110440 905 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet fcca240ab9084b298b080d86eff4a652
I20260927 15:06:00.111050 1562 tablet_replica.cc:330] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:00.111169 906 master_service.cc:946] ReplaceTablet: received request to replace tablet b375902081c54cdb84fdb075eec6baf7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:00.111418 1562 raft_consensus.cc:2229] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.114187 1562 raft_consensus.cc:2258] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.115016 907 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02] alter complete (version 1)
I20260927 15:06:00.116140 1562 ts_tablet_manager.cc:1905] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.116575 1556 tablet_bootstrap.cc:492] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.116729 1556 ts_tablet_manager.cc:1397] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.003s
I20260927 15:06:00.117807 1561 tablet_bootstrap.cc:492] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.117659 1556 raft_consensus.cc:348] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.117935 1556 raft_consensus.cc:374] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.118045 1556 raft_consensus.cc:729] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.118157 1561 ts_tablet_manager.cc:1397] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.094s user 0.006s sys 0.013s
I20260927 15:06:00.118299 1556 consensus_queue.cc:260] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.118981 1561 raft_consensus.cc:348] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.119387 1556 ts_tablet_manager.cc:1428] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:00.119508 1561 raft_consensus.cc:374] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.119683 1556 tablet_bootstrap.cc:492] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.119657 1561 raft_consensus.cc:729] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.120020 1561 consensus_queue.cc:260] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.121555 1559 pending_rounds.cc:62] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:00.121901 1559 pending_rounds.cc:68] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976301398654976 op_type: NO_OP noop_request { }
I20260927 15:06:00.122115 1559 raft_consensus.cc:2866] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:00.122233 1559 raft_consensus.cc:2258] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.122246 1643 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:00.122802 1559 ts_tablet_manager.cc:1905] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.125540 1556 tablet_bootstrap.cc:654] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.129535 1628 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:00.129815 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 424b66c69254487f932894516d570204 (DEFAULT_TABLE table=default.Table_940e7b3b563049e2bb3768e18c0affc9 [id=45ff9a80d85b49fc8f74596b7f1dd1ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.130087 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0db1654ced542938487126a0a09ed74" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:00.130604 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 434e9390f1fd4a3ebb65924c37b85bd4 (DEFAULT_TABLE table=default.Table_7b64507732114eac85d1c532ba939432 [id=fe47ea48cef44035b7d9df3be08eabb1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:00.131453 1376 leader_election.cc:341] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.131659 1376 leader_election.cc:302] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.132278 1634 raft_consensus.cc:2726] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.132606 1552 tablet_bootstrap.cc:492] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.132789 1552 ts_tablet_manager.cc:1397] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.383s user 0.005s sys 0.007s
I20260927 15:06:00.134232 1552 raft_consensus.cc:348] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.134507 1552 raft_consensus.cc:374] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.134640 1552 raft_consensus.cc:729] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.134938 1552 consensus_queue.cc:260] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.135643 1552 ts_tablet_manager.cc:1428] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:00.139261 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 109f9088371e4f008b2b5f993f2b4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:00.139520 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c73e813bb594a5e871718b73fe61fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:00.142561 1561 ts_tablet_manager.cc:1428] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260927 15:06:00.144390 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424b66c69254487f932894516d570204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.146661 1561 tablet_bootstrap.cc:492] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:00.151392 1552 tablet_bootstrap.cc:492] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:00.155290 1561 tablet_bootstrap.cc:654] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:00.156031 1374 consensus_peers.cc:487] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Couldn't send request to peer c4264874db964ff2830b7894c2b3d61c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac3b1d765caf40a1a7593cdb19defcab. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:00.155045 1552 tablet_bootstrap.cc:654] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.165349 1728 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260927 15:06:00.165481 1376 consensus_peers.cc:487] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:00.167011 1561 tablet_bootstrap.cc:492] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.167250 1561 ts_tablet_manager.cc:1397] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260927 15:06:00.168104 1561 raft_consensus.cc:348] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.168413 1561 raft_consensus.cc:374] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.168524 1561 raft_consensus.cc:729] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.168838 1561 consensus_queue.cc:260] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.173103 1556 tablet_bootstrap.cc:492] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.173323 1556 ts_tablet_manager.cc:1397] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.054s user 0.000s sys 0.005s
I20260927 15:06:00.174182 1556 raft_consensus.cc:348] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.174477 1556 raft_consensus.cc:374] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.174587 1556 raft_consensus.cc:729] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.174865 1556 consensus_queue.cc:260] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.175504 1556 ts_tablet_manager.cc:1428] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:00.175820 1556 tablet_bootstrap.cc:492] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.176781 1561 ts_tablet_manager.cc:1428] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 15:06:00.177847 1556 tablet_bootstrap.cc:654] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.180239 1561 tablet_bootstrap.cc:492] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:00.178647 1559 ts_tablet_manager.cc:1918] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:00.182955 1559 log.cc:1196] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/61339e532e6c431babb15422a08f7aa6
I20260927 15:06:00.183198 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 434e9390f1fd4a3ebb65924c37b85bd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.183323 1562 ts_tablet_manager.cc:1918] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.183368 1559 ts_tablet_manager.cc:1939] T 61339e532e6c431babb15422a08f7aa6 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.183465 1562 log.cc:1196] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/bb90faccda0145a7acd153fcd51b4c43
I20260927 15:06:00.183771 1562 ts_tablet_manager.cc:1939] T bb90faccda0145a7acd153fcd51b4c43 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:00.184206 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 104) took 2259 ms. Trace:
I20260927 15:06:00.184303 1559 rpcz_store.cc:276] 0927 15:05:57.924978 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.925034 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:00.097202 (+2172168us) ts_tablet_manager.cc:1145] Deleting tablet 61339e532e6c431babb15422a08f7aa6
0927 15:06:00.097220 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.157392 (+ 60172us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.178542 (+ 21150us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.184151 (+ 5609us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2155695}
I20260927 15:06:00.184729 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 61339e532e6c431babb15422a08f7aa6 (table default.Table_527ff90f92e14e9cb2bb7053c760f6ba [id=48ac6a07f3ca402aa8396ac2a1874134]) successfully deleted
I20260927 15:06:00.185106 1561 tablet_bootstrap.cc:654] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.187326 1562 tablet_replica.cc:330] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:00.187522 1562 raft_consensus.cc:2229] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:00.187570 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 109f9088371e4f008b2b5f993f2b4c3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 109f9088371e4f008b2b5f993f2b4c3b already in progress: creating tablet
I20260927 15:06:00.187727 1562 raft_consensus.cc:2258] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:00.187958 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6c73e813bb594a5e871718b73fe61fc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c73e813bb594a5e871718b73fe61fc9 already in progress: creating tablet
I20260927 15:06:00.187111 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 105) took 2255 ms. Trace:
I20260927 15:06:00.188251 1562 ts_tablet_manager.cc:1905] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.188274 1559 rpcz_store.cc:276] 0927 15:05:57.931333 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.931407 (+ 74us) service_pool.cc:227] Handling call
0927 15:06:00.186934 (+2255527us) ts_tablet_manager.cc:1145] Deleting tablet 443af328e5154bdba9b570224616d77b
0927 15:06:00.186944 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.187047 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2245402}
W20260927 15:06:00.188812 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 443af328e5154bdba9b570224616d77b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 443af328e5154bdba9b570224616d77b already in progress: creating tablet
I20260927 15:06:00.189285 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 108) took 2246 ms. Trace:
I20260927 15:06:00.189416 1559 rpcz_store.cc:276] 0927 15:05:57.943100 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.943150 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:00.189090 (+2245940us) ts_tablet_manager.cc:1145] Deleting tablet 8f15485b8825436184abe2621c71e356
0927 15:06:00.189099 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.189236 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2245695}
W20260927 15:06:00.189874 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8f15485b8825436184abe2621c71e356 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f15485b8825436184abe2621c71e356 already in progress: creating tablet
I20260927 15:06:00.190276 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 110) took 2235 ms. Trace:
I20260927 15:06:00.190410 1559 rpcz_store.cc:276] 0927 15:05:57.954852 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.954905 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:00.190136 (+2235231us) ts_tablet_manager.cc:1145] Deleting tablet ba7faf6e79db420db13999d74fe86062
0927 15:06:00.190145 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.190229 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2234909}
W20260927 15:06:00.190908 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ba7faf6e79db420db13999d74fe86062 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba7faf6e79db420db13999d74fe86062 already in progress: creating tablet
I20260927 15:06:00.191471 1559 tablet_replica.cc:330] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.192750 1559 raft_consensus.cc:2229] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.193063 1556 tablet_bootstrap.cc:492] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.195014 1556 ts_tablet_manager.cc:1397] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s
I20260927 15:06:00.195837 1556 raft_consensus.cc:348] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.196139 1556 raft_consensus.cc:374] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.196264 1556 raft_consensus.cc:729] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.196502 1556 consensus_queue.cc:260] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.196831 1562 ts_tablet_manager.cc:1918] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.196959 1562 log.cc:1196] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/ce3b706ed2734db782efdb47cf3fda95
I20260927 15:06:00.194767 1559 raft_consensus.cc:2258] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.197834 1556 ts_tablet_manager.cc:1428] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:00.200913 1562 ts_tablet_manager.cc:1939] T ce3b706ed2734db782efdb47cf3fda95 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:00.201241 1556 tablet_bootstrap.cc:492] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.198525 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 30cf4db249154adda9406d5b07430a80 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e6e3600cbf741419bc7b93eec42eb13) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:00.199380 1559 ts_tablet_manager.cc:1905] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.110006 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet ac3b1d765caf40a1a7593cdb19defcab (table default.Table_a8794ae976fe4fd48b9015808f70e330 [id=6368f21af56d44f09f5cf1ec2d19f2b6]) successfully deleted
W20260927 15:06:00.202658 899 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 92691.9us
I20260927 15:06:00.202970 1556 tablet_bootstrap.cc:654] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.204453 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet bb90faccda0145a7acd153fcd51b4c43 (table default.Table_44ec3dd510cd451a84cf5b0e73fc492d [id=0c63f8578de5475582ff54870c14d14b]) successfully deleted
W20260927 15:06:00.204736 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet bc971defe6d148439a6a0b8c55d9092e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc971defe6d148439a6a0b8c55d9092e already in progress: creating tablet
I20260927 15:06:00.209406 1559 ts_tablet_manager.cc:1918] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.209525 1559 log.cc:1196] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/6c7a8bf15c48423ea9ff14c46645a33b
I20260927 15:06:00.209803 1634 raft_consensus.cc:482] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.209980 1634 raft_consensus.cc:504] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.210548 1634 leader_election.cc:288] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:00.211895 1561 tablet_bootstrap.cc:492] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.211849 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bd5b459caa42e7a9153d9273ad52c4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:00.212040 1561 ts_tablet_manager.cc:1397] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.005s
I20260927 15:06:00.212157 1165 raft_consensus.cc:2454] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:00.212750 1561 raft_consensus.cc:348] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.211621 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d824f1399fb8451dad058a93321740ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:00.212950 1561 raft_consensus.cc:374] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.212049 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_449ec2814883431caf85b7bf2d9b381c" } new_table_name: "default.Table_be15cdb2ae6a49e38da808ee4cafd27c" modify_external_catalogs: true
I20260927 15:06:00.213027 1561 raft_consensus.cc:729] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.213295 1374 leader_election.cc:302] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:00.213207 1561 consensus_queue.cc:260] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.212575 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0d6069947977462cae4376eb9ccfe2ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:00.214128 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d6069947977462cae4376eb9ccfe2ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:00.214905 1561 ts_tablet_manager.cc:1428] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:00.215171 1561 tablet_bootstrap.cc:492] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:00.215217 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d824f1399fb8451dad058a93321740ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:00.217458 1562 tablet_replica.cc:330] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:00.217738 1562 raft_consensus.cc:2229] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.217902 1562 raft_consensus.cc:2258] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:00.218868 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet cd901034653b47dbba7912d5338bc3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd901034653b47dbba7912d5338bc3bb already in progress: creating tablet
I20260927 15:06:00.219357 1561 tablet_bootstrap.cc:654] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.219738 1634 raft_consensus.cc:2781] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:00.219838 1634 raft_consensus.cc:482] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:00.219954 1634 raft_consensus.cc:3037] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.220324 1559 ts_tablet_manager.cc:1939] T 6c7a8bf15c48423ea9ff14c46645a33b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.221051 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 106) took 2287 ms. Trace:
I20260927 15:06:00.221167 1559 rpcz_store.cc:276] 0927 15:05:57.933785 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.933851 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:00.191369 (+2257518us) ts_tablet_manager.cc:1145] Deleting tablet 6c7a8bf15c48423ea9ff14c46645a33b
0927 15:06:00.191378 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.205970 (+ 14592us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.209298 (+ 3328us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.221009 (+ 11711us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2234020}
I20260927 15:06:00.221567 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 6c7a8bf15c48423ea9ff14c46645a33b (table default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]) successfully deleted
I20260927 15:06:00.222208 1562 ts_tablet_manager.cc:1905] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.223052 1559 tablet_replica.cc:330] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.223273 1559 raft_consensus.cc:2229] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.223424 1559 raft_consensus.cc:2258] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.223889 1559 ts_tablet_manager.cc:1905] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:00.224531 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6cc8bd2079f84da39e13113e6699bf5e has no consensus state
I20260927 15:06:00.222815 1634 raft_consensus.cc:504] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.229305 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bd5b459caa42e7a9153d9273ad52c4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:00.229442 911 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 67ad68a0adad407a92b2335f43e67227 (table default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]). Expected version 1 got 0
I20260927 15:06:00.229532 1165 raft_consensus.cc:3037] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.231876 1556 tablet_bootstrap.cc:492] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.232024 1556 ts_tablet_manager.cc:1397] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.004s
I20260927 15:06:00.232587 1561 tablet_bootstrap.cc:492] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.232756 1165 raft_consensus.cc:2454] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:00.232758 1561 ts_tablet_manager.cc:1397] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20260927 15:06:00.233210 911 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 67ad68a0adad407a92b2335f43e67227 (table default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]). Expected version 1 got 0
I20260927 15:06:00.233222 1374 leader_election.cc:302] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:00.233161 1556 raft_consensus.cc:348] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.233397 1556 raft_consensus.cc:374] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.233486 1556 raft_consensus.cc:729] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.233526 1561 raft_consensus.cc:348] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.233767 1561 raft_consensus.cc:374] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.233837 1561 raft_consensus.cc:729] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.233740 1556 consensus_queue.cc:260] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.234091 1561 consensus_queue.cc:260] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.235357 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bd5b459caa42e7a9153d9273ad52c4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:00.235502 1634 leader_election.cc:288] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:00.235651 1634 raft_consensus.cc:2781] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:00.235785 1634 raft_consensus.cc:686] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:00.236207 1561 ts_tablet_manager.cc:1428] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:00.236510 1561 tablet_bootstrap.cc:492] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:00.235380 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bd5b459caa42e7a9153d9273ad52c4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.236048 1376 leader_election.cc:341] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:00.238214 1376 leader_election.cc:341] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.238381 1561 tablet_bootstrap.cc:654] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.238672 1634 consensus_queue.cc:237] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.238895 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet ce3b706ed2734db782efdb47cf3fda95 (table default.Table_9074f56e5d72442694c1b683a1911c62 [id=8ca2c45597294e2aa3a002911c86fd1d]) successfully deleted
I20260927 15:06:00.240545 1552 tablet_bootstrap.cc:492] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.240825 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 714b110a24ca4f3bb8126034dc3e6407 with delete_type TABLET_DATA_DELETED (replaced by tablet bc971defe6d148439a6a0b8c55d9092e) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:00.241169 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet f1d7a98ffc4745ac8eeb93012b55d417 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1d7a98ffc4745ac8eeb93012b55d417 already in progress: creating tablet
W20260927 15:06:00.241406 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 63289edbdd734dd5a817df42d83e422e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63289edbdd734dd5a817df42d83e422e already in progress: creating tablet
W20260927 15:06:00.241668 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet fe7816e099094d13887650fc223097c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe7816e099094d13887650fc223097c7 already in progress: creating tablet
W20260927 15:06:00.241889 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 2cd55e22d8254ea8b1dab989517148ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cd55e22d8254ea8b1dab989517148ca already in progress: creating tablet
I20260927 15:06:00.242632 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet e94dd938cf50495c99b5dce808ae7100 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:00.245805 1559 ts_tablet_manager.cc:1918] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.245944 1559 log.cc:1196] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/d6925d0369524e7eb1ac3c20ad699ded
I20260927 15:06:00.246320 1559 ts_tablet_manager.cc:1939] T d6925d0369524e7eb1ac3c20ad699ded P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.246181 1552 ts_tablet_manager.cc:1397] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.095s user 0.001s sys 0.003s
I20260927 15:06:00.247094 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 111) took 2289 ms. Trace:
I20260927 15:06:00.247236 1559 rpcz_store.cc:276] 0927 15:05:57.957628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.957673 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:00.222995 (+2265322us) ts_tablet_manager.cc:1145] Deleting tablet d6925d0369524e7eb1ac3c20ad699ded
0927 15:06:00.223005 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.239745 (+ 16740us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.245708 (+ 5963us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.247018 (+ 1310us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2265133}
I20260927 15:06:00.247786 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet d6925d0369524e7eb1ac3c20ad699ded (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
W20260927 15:06:00.248000 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b375902081c54cdb84fdb075eec6baf7 consensus state has no leader
I20260927 15:06:00.243234 1562 ts_tablet_manager.cc:1918] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.248195 1562 log.cc:1196] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/46ee85688df04e92accdedb6625406c1
I20260927 15:06:00.248531 1562 ts_tablet_manager.cc:1939] T 46ee85688df04e92accdedb6625406c1 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:00.249711 1562 tablet_replica.cc:330] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:00.249909 1562 raft_consensus.cc:2229] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.250427 1562 raft_consensus.cc:2258] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.251755 1562 ts_tablet_manager.cc:1905] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.251806 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 112) took 2292 ms. Trace:
I20260927 15:06:00.251897 1559 rpcz_store.cc:276] 0927 15:05:57.959058 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:57.959124 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:00.251643 (+2292519us) ts_tablet_manager.cc:1145] Deleting tablet 7a42ae7589c24b1bbd833ab8838521ae
0927 15:06:00.251654 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.251746 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2292335}
W20260927 15:06:00.252396 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7a42ae7589c24b1bbd833ab8838521ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a42ae7589c24b1bbd833ab8838521ae already in progress: creating tablet
I20260927 15:06:00.253521 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 126) took 2032 ms. Trace:
I20260927 15:06:00.253502 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a1cebe864d4d45c6bb51a54581236606" } modify_external_catalogs: true
I20260927 15:06:00.253611 1559 rpcz_store.cc:276] 0927 15:05:58.221214 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.221285 (+ 71us) service_pool.cc:227] Handling call
0927 15:06:00.253190 (+2031905us) ts_tablet_manager.cc:1145] Deleting tablet 8af844423fc94e2c8380db179103d3aa
0927 15:06:00.253201 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.253472 (+ 271us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2009243}
I20260927 15:06:00.253814 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a1cebe864d4d45c6bb51a54581236606" } modify_external_catalogs: true
I20260927 15:06:00.253984 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4e02ea20ad894ef6b1ea82884cfdf529" } modify_external_catalogs: true
W20260927 15:06:00.254082 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8af844423fc94e2c8380db179103d3aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8af844423fc94e2c8380db179103d3aa already in progress: creating tablet
I20260927 15:06:00.254184 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4e02ea20ad894ef6b1ea82884cfdf529" } modify_external_catalogs: true
I20260927 15:06:00.254812 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 127) took 1975 ms. Trace:
I20260927 15:06:00.256146 1552 raft_consensus.cc:348] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.256575 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 46ee85688df04e92accdedb6625406c1 (table default.Table_6cc665540fb24e17b9284fc911758626 [id=31cb67e2dcb54a029ecdc3457b6139c1]) successfully deleted
W20260927 15:06:00.256817 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet dc6f179aab784ae4822356e63332532f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc6f179aab784ae4822356e63332532f already in progress: creating tablet
I20260927 15:06:00.257607 1552 raft_consensus.cc:374] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.258023 1552 raft_consensus.cc:729] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.258917 1552 consensus_queue.cc:260] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.261313 1552 ts_tablet_manager.cc:1428] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
W20260927 15:06:00.261960 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65c313ab6848428d8237557392669f6f consensus state has no leader
I20260927 15:06:00.262327 908 master_service.cc:946] ReplaceTablet: received request to replace tablet 0aec677006ab4407bd7ae4c0078d6b7f from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:00.262369 1561 tablet_bootstrap.cc:492] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.262499 1561 ts_tablet_manager.cc:1397] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.001s
I20260927 15:06:00.263104 1637 raft_consensus.cc:482] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.263190 1561 raft_consensus.cc:348] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.263417 1561 raft_consensus.cc:374] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.263293 1637 raft_consensus.cc:504] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.263516 1561 raft_consensus.cc:729] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.263816 1552 tablet_bootstrap.cc:492] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:00.263728 1561 consensus_queue.cc:260] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.264123 1637 leader_election.cc:288] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.267804 1561 ts_tablet_manager.cc:1428] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:00.268127 1561 tablet_bootstrap.cc:492] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:00.271219 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34822e9f900f4d04b59b810d59e6aa49" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.271981 1102 leader_election.cc:341] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.272107 1552 tablet_bootstrap.cc:654] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.257814 1556 ts_tablet_manager.cc:1428] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.026s user 0.004s sys 0.004s
I20260927 15:06:00.272570 1556 tablet_bootstrap.cc:492] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.272729 1562 ts_tablet_manager.cc:1918] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.272841 1562 log.cc:1196] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/148c77a0e88b40f690ca96f091b78d9a
I20260927 15:06:00.273198 1562 ts_tablet_manager.cc:1939] T 148c77a0e88b40f690ca96f091b78d9a P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:00.274300 1556 tablet_bootstrap.cc:654] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.274441 1562 tablet_replica.cc:330] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:00.274665 1562 raft_consensus.cc:2229] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.274848 1562 raft_consensus.cc:2258] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.257073 1754 raft_consensus.cc:482] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.275419 1754 raft_consensus.cc:504] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.276155 1754 leader_election.cc:288] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
W20260927 15:06:00.277119 1374 leader_election.cc:341] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 148c77a0e88b40f690ca96f091b78d9a
I20260927 15:06:00.277395 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "148c77a0e88b40f690ca96f091b78d9a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.278110 1376 leader_election.cc:341] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.278234 1376 leader_election.cc:302] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.278468 1754 raft_consensus.cc:2726] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.279127 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 148c77a0e88b40f690ca96f091b78d9a (table default.Table_d80d3405cea240ec87396ab494d2d04d [id=c4ddc66927a94fd2abc8e44012cf69f7]) successfully deleted
I20260927 15:06:00.279633 1634 raft_consensus.cc:482] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:00.279999 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 16884c7343be436aa312ec0af40f5e33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16884c7343be436aa312ec0af40f5e33 already in progress: creating tablet
W20260927 15:06:00.281183 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 already in progress: creating tablet
I20260927 15:06:00.279922 1634 raft_consensus.cc:504] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:00.283582 1374 leader_election.cc:341] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 714b110a24ca4f3bb8126034dc3e6407
I20260927 15:06:00.254944 1559 rpcz_store.cc:276] 0927 15:05:58.279188 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.279249 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:00.254684 (+1975435us) ts_tablet_manager.cc:1145] Deleting tablet 30244d596d4d4090af7656027b48f22e
0927 15:06:00.254693 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.254764 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1975170}
I20260927 15:06:00.284449 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 128) took 2004 ms. Trace:
I20260927 15:06:00.284533 1559 rpcz_store.cc:276] 0927 15:05:58.280039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.280095 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:00.284297 (+2004202us) ts_tablet_manager.cc:1145] Deleting tablet ab08d04c11dd44299ee5f9a911d581c3
0927 15:06:00.284307 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.284402 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2003922}
I20260927 15:06:00.285733 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "714b110a24ca4f3bb8126034dc3e6407" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.286211 1376 leader_election.cc:341] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.286315 1376 leader_election.cc:302] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.286670 1753 raft_consensus.cc:2726] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.286900 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 129) took 1887 ms. Trace:
I20260927 15:06:00.287009 1559 rpcz_store.cc:276] 0927 15:05:58.399715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.406164 (+ 6449us) service_pool.cc:227] Handling call
0927 15:06:00.286731 (+1880567us) ts_tablet_manager.cc:1145] Deleting tablet 4ead753ba6664829b1262712f35e64f2
0927 15:06:00.286741 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.286824 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1849123}
I20260927 15:06:00.287317 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 137) took 1570 ms. Trace:
I20260927 15:06:00.287402 1559 rpcz_store.cc:276] 0927 15:05:58.716845 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.716969 (+ 124us) service_pool.cc:227] Handling call
0927 15:06:00.287192 (+1570223us) ts_tablet_manager.cc:1145] Deleting tablet 67cf4dae943e4092b2c490ad770e4a94
0927 15:06:00.287201 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.287277 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1569963}
I20260927 15:06:00.287569 1634 leader_election.cc:288] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:00.288807 1561 tablet_bootstrap.cc:654] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.291736 1552 tablet_bootstrap.cc:492] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.291944 1552 ts_tablet_manager.cc:1397] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.001s
I20260927 15:06:00.292248 1562 ts_tablet_manager.cc:1905] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:00.292279 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 30244d596d4d4090af7656027b48f22e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30244d596d4d4090af7656027b48f22e already in progress: creating tablet
W20260927 15:06:00.292526 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ab08d04c11dd44299ee5f9a911d581c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab08d04c11dd44299ee5f9a911d581c3 already in progress: creating tablet
W20260927 15:06:00.292734 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 4ead753ba6664829b1262712f35e64f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ead753ba6664829b1262712f35e64f2 already in progress: creating tablet
W20260927 15:06:00.292979 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 67cf4dae943e4092b2c490ad770e4a94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67cf4dae943e4092b2c490ad770e4a94 already in progress: creating tablet
I20260927 15:06:00.293041 1552 raft_consensus.cc:348] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.293347 1552 raft_consensus.cc:374] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.293469 1556 tablet_bootstrap.cc:492] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.293478 1552 raft_consensus.cc:729] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.293674 1556 ts_tablet_manager.cc:1397] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.002s
I20260927 15:06:00.294090 1552 consensus_queue.cc:260] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.295070 1552 ts_tablet_manager.cc:1428] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:00.295661 1552 tablet_bootstrap.cc:492] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:00.295723 1556 raft_consensus.cc:348] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.296030 1556 raft_consensus.cc:374] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.296159 1556 raft_consensus.cc:729] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.296427 1556 consensus_queue.cc:260] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.297138 1556 ts_tablet_manager.cc:1428] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:00.297482 1556 tablet_bootstrap.cc:492] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.287690 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 138) took 1569 ms. Trace:
I20260927 15:06:00.300446 1552 tablet_bootstrap.cc:654] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.300614 1559 rpcz_store.cc:276] 0927 15:05:58.718550 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.718606 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:00.287580 (+1568974us) ts_tablet_manager.cc:1145] Deleting tablet e9a7ed6e23e1479a86e2abcf6aa5b317
0927 15:06:00.287588 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.287646 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1568768}
I20260927 15:06:00.301170 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 139) took 1579 ms. Trace:
I20260927 15:06:00.301390 1559 rpcz_store.cc:276] 0927 15:05:58.722126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.722180 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:00.301011 (+1578831us) ts_tablet_manager.cc:1145] Deleting tablet 9c9e4311049d47d3b2f1e117795624ef
0927 15:06:00.301023 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.301121 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1578195}
I20260927 15:06:00.301949 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 141) took 1515 ms. Trace:
I20260927 15:06:00.302989 1559 rpcz_store.cc:276] 0927 15:05:58.786129 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.786669 (+ 540us) service_pool.cc:227] Handling call
0927 15:06:00.301760 (+1515091us) ts_tablet_manager.cc:1145] Deleting tablet 6d6eed08273244d28fd15785a09059f9
0927 15:06:00.301773 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.301873 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1514879}
I20260927 15:06:00.303468 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 140) took 1517 ms. Trace:
I20260927 15:06:00.304829 907 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 34822e9f900f4d04b59b810d59e6aa49 (table default.Table_875cbc00c31e4798bf3ed5bf3135b0a7 [id=5c4f0f47acd14538b67f8c8d579b0696]). Expected version 2 got 0
I20260927 15:06:00.305454 1562 ts_tablet_manager.cc:1918] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.305591 1562 log.cc:1196] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/12623e6767aa4bd4934058f7314a966e
I20260927 15:06:00.305958 1562 ts_tablet_manager.cc:1939] T 12623e6767aa4bd4934058f7314a966e P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:00.308967 1561 tablet_bootstrap.cc:492] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.309122 1561 ts_tablet_manager.cc:1397] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.006s
I20260927 15:06:00.309877 1561 raft_consensus.cc:348] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.310135 1561 raft_consensus.cc:374] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.310202 1561 raft_consensus.cc:729] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.307940 1556 tablet_bootstrap.cc:654] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.310384 1559 rpcz_store.cc:276] 0927 15:05:58.786006 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.786976 (+ 970us) service_pool.cc:227] Handling call
0927 15:06:00.303302 (+1516326us) ts_tablet_manager.cc:1145] Deleting tablet 7d1f23f91bce4df480dd9991659f2e81
0927 15:06:00.303313 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.303414 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1516142}
I20260927 15:06:00.310402 1561 consensus_queue.cc:260] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.310768 1559 tablet_replica.cc:330] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.310983 1559 raft_consensus.cc:2229] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:00.311296 1559 pending_rounds.cc:62] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:00.311373 1559 pending_rounds.cc:68] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976305632665600 op_type: NO_OP noop_request { }
I20260927 15:06:00.311529 1559 raft_consensus.cc:2866] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:00.311635 1559 raft_consensus.cc:2258] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.312352 1559 ts_tablet_manager.cc:1905] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.312588 1561 ts_tablet_manager.cc:1428] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:00.312940 1561 tablet_bootstrap.cc:492] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:00.318034 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 566aa5caa012443ea63fcb7389c8b7c0 (DEFAULT_TABLE table=default.Table_166945d9ee0740f2b92a0138063f8891 [id=cad1448cfd5a4e76afe95e544d8a30b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.318373 1552 tablet_bootstrap.cc:492] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.318585 1552 ts_tablet_manager.cc:1397] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260927 15:06:00.318591 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566aa5caa012443ea63fcb7389c8b7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.319679 1552 raft_consensus.cc:348] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.320032 1552 raft_consensus.cc:374] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.320130 1552 raft_consensus.cc:729] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.320402 1552 consensus_queue.cc:260] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.320922 1552 ts_tablet_manager.cc:1428] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:00.321204 1552 tablet_bootstrap.cc:492] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:00.322063 1559 ts_tablet_manager.cc:1918] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:00.322211 1559 log.cc:1196] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/e188f28304604cf2a96a606811900ca5
I20260927 15:06:00.322750 1559 ts_tablet_manager.cc:1939] T e188f28304604cf2a96a606811900ca5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.322769 1552 tablet_bootstrap.cc:654] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.323527 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 149) took 1369 ms. Trace:
I20260927 15:06:00.323640 1559 rpcz_store.cc:276] 0927 15:05:58.953859 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.954166 (+ 307us) service_pool.cc:227] Handling call
0927 15:06:00.310664 (+1356498us) ts_tablet_manager.cc:1145] Deleting tablet e188f28304604cf2a96a606811900ca5
0927 15:06:00.310696 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.315707 (+ 5011us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.321965 (+ 6258us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.323477 (+ 1512us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1356235}
I20260927 15:06:00.324120 1561 tablet_bootstrap.cc:654] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.327123 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 9049d003d787403f80aa0c08872dd3b5 (DEFAULT_TABLE table=default.Table_75127a34541e4a979aace6aa029d396e [id=67ad7f9c36834f09a601dbf2841ebc48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.327597 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9049d003d787403f80aa0c08872dd3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.327944 1556 tablet_bootstrap.cc:492] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.328112 1556 ts_tablet_manager.cc:1397] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.000s
I20260927 15:06:00.328836 1556 raft_consensus.cc:348] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.329063 1556 raft_consensus.cc:374] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.329133 1556 raft_consensus.cc:729] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.329447 1559 tablet_replica.cc:330] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.329355 1556 consensus_queue.cc:260] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.329674 1559 raft_consensus.cc:2229] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.329891 1559 raft_consensus.cc:2258] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.330016 1556 ts_tablet_manager.cc:1428] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:00.330283 1556 tablet_bootstrap.cc:492] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.330448 1559 ts_tablet_manager.cc:1905] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.331902 1556 tablet_bootstrap.cc:654] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.336942 1559 ts_tablet_manager.cc:1918] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:00.337061 1559 log.cc:1196] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/0781c9c8b4ad498bb27573939b7d06b2
I20260927 15:06:00.337471 1559 ts_tablet_manager.cc:1939] T 0781c9c8b4ad498bb27573939b7d06b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.337647 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34822e9f900f4d04b59b810d59e6aa49" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:00.337857 1438 raft_consensus.cc:2454] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:00.338205 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 146) took 1429 ms. Trace:
I20260927 15:06:00.338337 1559 rpcz_store.cc:276] 0927 15:05:58.908858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.909444 (+ 586us) service_pool.cc:227] Handling call
0927 15:06:00.329356 (+1419912us) ts_tablet_manager.cc:1145] Deleting tablet 0781c9c8b4ad498bb27573939b7d06b2
0927 15:06:00.329368 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.333860 (+ 4492us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.336833 (+ 2973us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.338162 (+ 1329us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1367915}
I20260927 15:06:00.338449 1099 leader_election.cc:302] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.339557 1637 raft_consensus.cc:2781] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:00.339689 1637 raft_consensus.cc:482] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:00.339789 1637 raft_consensus.cc:3037] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.342296 1552 tablet_bootstrap.cc:492] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.342428 1552 ts_tablet_manager.cc:1397] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260927 15:06:00.343204 1552 raft_consensus.cc:348] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.343437 1552 raft_consensus.cc:374] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.343523 1552 raft_consensus.cc:729] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.343822 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 153) took 1378 ms. Trace:
I20260927 15:06:00.343576 1637 raft_consensus.cc:504] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.343789 1552 consensus_queue.cc:260] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.344524 1552 ts_tablet_manager.cc:1428] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:00.344735 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34822e9f900f4d04b59b810d59e6aa49" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:00.344856 1552 tablet_bootstrap.cc:492] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:00.345340 1102 leader_election.cc:341] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.345950 1637 leader_election.cc:288] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.346930 1552 tablet_bootstrap.cc:654] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.343937 1559 rpcz_store.cc:276] 0927 15:05:58.965222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.965284 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:00.343667 (+1378383us) ts_tablet_manager.cc:1145] Deleting tablet da1812142bb043fba7457dc61ffdb180
0927 15:06:00.343679 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.343782 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1378150}
I20260927 15:06:00.347676 1559 tablet_replica.cc:330] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.347946 1559 raft_consensus.cc:2229] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.348124 1559 raft_consensus.cc:2258] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.348678 1559 ts_tablet_manager.cc:1905] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.348860 1758 raft_consensus.cc:482] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.349027 1758 raft_consensus.cc:504] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.349891 1758 leader_election.cc:288] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
W20260927 15:06:00.350740 1374 leader_election.cc:341] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 46ee85688df04e92accdedb6625406c1
I20260927 15:06:00.351475 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ee85688df04e92accdedb6625406c1" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.351995 1376 leader_election.cc:341] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.352131 1376 leader_election.cc:302] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.352324 1758 raft_consensus.cc:2726] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.353236 1556 tablet_bootstrap.cc:492] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.353363 1556 ts_tablet_manager.cc:1397] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.003s
I20260927 15:06:00.354162 1556 raft_consensus.cc:348] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.354348 1556 raft_consensus.cc:374] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.354429 1556 raft_consensus.cc:729] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.354605 1556 consensus_queue.cc:260] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.355187 1556 ts_tablet_manager.cc:1428] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:00.355434 1556 tablet_bootstrap.cc:492] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.355326 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 04007cd4bd214b88a4664e23daf4b790 (DEFAULT_TABLE table=default.Table_7052ab085a334588b13fab6355c981dd [id=ff900aafe4f94663a9633fc0fbec0a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.355798 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04007cd4bd214b88a4664e23daf4b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.357123 1556 tablet_bootstrap.cc:654] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.364089 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34822e9f900f4d04b59b810d59e6aa49" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:00.364312 1438 raft_consensus.cc:3037] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.367378 1438 raft_consensus.cc:2454] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:00.370574 1278 tablet_service.cc:1467] Processing CreateTablet for tablet fb2a8e788b71451da4a18f52b643e5e2 (DEFAULT_TABLE table=default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e [id=db7af27293544752bbe914164e4e9d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.370980 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb2a8e788b71451da4a18f52b643e5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.371624 1559 ts_tablet_manager.cc:1918] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.371752 1559 log.cc:1196] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/1c49c70e003f47d6a325669376e5e3ca
I20260927 15:06:00.372089 1559 ts_tablet_manager.cc:1939] T 1c49c70e003f47d6a325669376e5e3ca P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.372835 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 155) took 1398 ms. Trace:
I20260927 15:06:00.372954 1559 rpcz_store.cc:276] 0927 15:05:58.973858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.973909 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:00.347626 (+1373717us) ts_tablet_manager.cc:1145] Deleting tablet 1c49c70e003f47d6a325669376e5e3ca
0927 15:06:00.347635 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.367322 (+ 19687us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.371533 (+ 4211us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.372787 (+ 1254us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1373531}
I20260927 15:06:00.375775 1552 tablet_bootstrap.cc:492] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.375975 1552 ts_tablet_manager.cc:1397] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.031s user 0.011s sys 0.003s
I20260927 15:06:00.376979 1552 raft_consensus.cc:348] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.377341 1552 raft_consensus.cc:374] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.377461 1552 raft_consensus.cc:729] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.377760 1552 consensus_queue.cc:260] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.378333 1099 leader_election.cc:302] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.378496 1552 ts_tablet_manager.cc:1428] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:00.378818 1637 raft_consensus.cc:2781] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:00.378911 1552 tablet_bootstrap.cc:492] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:00.379940 1637 raft_consensus.cc:686] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:00.380434 1637 consensus_queue.cc:237] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.381335 1552 tablet_bootstrap.cc:654] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.383988 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 154) took 1410 ms. Trace:
I20260927 15:06:00.384087 1559 rpcz_store.cc:276] 0927 15:05:58.973733 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.974596 (+ 863us) service_pool.cc:227] Handling call
0927 15:06:00.383797 (+1409201us) ts_tablet_manager.cc:1145] Deleting tablet a46e15ea145b4eae8f94b664067b4f92
0927 15:06:00.383809 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.383935 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408974}
I20260927 15:06:00.387205 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 156) took 1409 ms. Trace:
I20260927 15:06:00.387323 1559 rpcz_store.cc:276] 0927 15:05:58.977283 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:58.977333 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:00.387017 (+1409684us) ts_tablet_manager.cc:1145] Deleting tablet 654d3210fd8c46b68880e544c39d5c88
0927 15:06:00.387032 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.387152 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1409436}
I20260927 15:06:00.388564 1559 tablet_replica.cc:330] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.388813 1559 raft_consensus.cc:2229] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.389026 1559 raft_consensus.cc:2258] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.390615 1559 ts_tablet_manager.cc:1905] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.398983 1552 tablet_bootstrap.cc:492] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.399149 1552 ts_tablet_manager.cc:1397] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.002s
I20260927 15:06:00.399940 1552 raft_consensus.cc:348] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.400120 1559 ts_tablet_manager.cc:1918] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.400605 1552 raft_consensus.cc:374] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.400650 1559 log.cc:1196] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/46ee85688df04e92accdedb6625406c1
I20260927 15:06:00.400703 1552 raft_consensus.cc:729] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.401084 1559 ts_tablet_manager.cc:1939] T 46ee85688df04e92accdedb6625406c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.400970 1552 consensus_queue.cc:260] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.401562 1552 ts_tablet_manager.cc:1428] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:00.401809 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 157) took 1422 ms. Trace:
I20260927 15:06:00.401974 1552 tablet_bootstrap.cc:492] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:00.401935 1559 rpcz_store.cc:276] 0927 15:05:58.979744 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:59.029801 (+ 50057us) service_pool.cc:227] Handling call
0927 15:06:00.388475 (+1358674us) ts_tablet_manager.cc:1145] Deleting tablet 46ee85688df04e92accdedb6625406c1
0927 15:06:00.388487 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.397085 (+ 8598us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.400004 (+ 2919us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.401775 (+ 1771us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1348139}
I20260927 15:06:00.402364 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 160) took 1291 ms. Trace:
I20260927 15:06:00.402469 1559 rpcz_store.cc:276] 0927 15:05:59.110533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:59.110894 (+ 361us) service_pool.cc:227] Handling call
0927 15:06:00.402217 (+1291323us) ts_tablet_manager.cc:1145] Deleting tablet ad5af5df58824fe88d607a93216bd228
0927 15:06:00.402227 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.402334 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1291083}
I20260927 15:06:00.402853 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 175) took 1095 ms. Trace:
I20260927 15:06:00.402982 1559 rpcz_store.cc:276] 0927 15:05:59.306950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:59.307096 (+ 146us) service_pool.cc:227] Handling call
0927 15:06:00.402704 (+1095608us) ts_tablet_manager.cc:1145] Deleting tablet 6e9d03457dac43038b4e6fb120ff572c
0927 15:06:00.402716 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.402802 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1077615}
I20260927 15:06:00.403321 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 174) took 1096 ms. Trace:
I20260927 15:06:00.403728 1552 tablet_bootstrap.cc:654] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.403700 1559 rpcz_store.cc:276] 0927 15:05:59.306775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:59.307591 (+ 816us) service_pool.cc:227] Handling call
0927 15:06:00.403196 (+1095605us) ts_tablet_manager.cc:1145] Deleting tablet 07b63e63f7cd4075bcf10a463ce16e05
0927 15:06:00.403205 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.403282 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1053946}
I20260927 15:06:00.403993 1559 tablet_replica.cc:330] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.404186 1559 raft_consensus.cc:2229] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:00.404578 1559 raft_consensus.cc:2258] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.406207 1559 ts_tablet_manager.cc:1905] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.409791 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 0129eaa5636544e696076e439d713b1b (DEFAULT_TABLE table=default.Table_dcca958a30ba42a8943865116e383a22 [id=3d369788b9e44a0b9befbbb44303d24e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.410279 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0129eaa5636544e696076e439d713b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.415316 1559 ts_tablet_manager.cc:1918] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:00.415495 1559 log.cc:1196] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/7d31bf920f0d41478863959d49400731
I20260927 15:06:00.415979 1559 ts_tablet_manager.cc:1939] T 7d31bf920f0d41478863959d49400731 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.416934 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 184) took 1012 ms. Trace:
I20260927 15:06:00.417073 1559 rpcz_store.cc:276] 0927 15:05:59.404737 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:05:59.404778 (+ 41us) service_pool.cc:227] Handling call
0927 15:06:00.403945 (+999167us) ts_tablet_manager.cc:1145] Deleting tablet 7d31bf920f0d41478863959d49400731
0927 15:06:00.403954 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:00.411537 (+ 7583us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.415208 (+ 3671us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:00.416857 (+ 1649us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":950595}
I20260927 15:06:00.418083 1559 tablet_replica.cc:330] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.418336 1559 raft_consensus.cc:2229] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:00.418851 1559 raft_consensus.cc:2258] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.419536 1559 ts_tablet_manager.cc:1905] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.420918 1758 raft_consensus.cc:482] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.421134 1758 raft_consensus.cc:504] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.421972 1758 leader_election.cc:288] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:00.422719 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb90faccda0145a7acd153fcd51b4c43" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.424434 1376 leader_election.cc:341] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:00.424916 1374 leader_election.cc:341] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: bb90faccda0145a7acd153fcd51b4c43
I20260927 15:06:00.425047 1374 leader_election.cc:302] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.425354 1758 raft_consensus.cc:482] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.425508 1758 raft_consensus.cc:504] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.425643 1757 raft_consensus.cc:2726] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.426148 1758 leader_election.cc:288] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:00.426342 1559 ts_tablet_manager.cc:1918] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:00.426452 1559 log.cc:1196] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/ac3b1d765caf40a1a7593cdb19defcab
I20260927 15:06:00.426733 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a42ae7589c24b1bbd833ab8838521ae" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:00.426879 1559 ts_tablet_manager.cc:1939] T ac3b1d765caf40a1a7593cdb19defcab P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:00.427282 1376 leader_election.cc:341] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.428074 1559 tablet_replica.cc:330] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:00.428184 1374 leader_election.cc:341] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 7a42ae7589c24b1bbd833ab8838521ae
I20260927 15:06:00.428323 1374 leader_election.cc:302] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.428380 1559 raft_consensus.cc:2229] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.428560 1559 raft_consensus.cc:2258] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.429072 1758 raft_consensus.cc:2726] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.429196 1559 ts_tablet_manager.cc:1905] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.432447 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 566aa5caa012443ea63fcb7389c8b7c0 (DEFAULT_TABLE table=default.Table_166945d9ee0740f2b92a0138063f8891 [id=cad1448cfd5a4e76afe95e544d8a30b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.432667 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 9049d003d787403f80aa0c08872dd3b5 (DEFAULT_TABLE table=default.Table_75127a34541e4a979aace6aa029d396e [id=67ad7f9c36834f09a601dbf2841ebc48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.432950 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566aa5caa012443ea63fcb7389c8b7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.433476 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 04007cd4bd214b88a4664e23daf4b790 (DEFAULT_TABLE table=default.Table_7052ab085a334588b13fab6355c981dd [id=ff900aafe4f94663a9633fc0fbec0a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.433890 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04007cd4bd214b88a4664e23daf4b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.434290 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9049d003d787403f80aa0c08872dd3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.443761 1416 tablet_service.cc:1467] Processing CreateTablet for tablet fb2a8e788b71451da4a18f52b643e5e2 (DEFAULT_TABLE table=default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e [id=db7af27293544752bbe914164e4e9d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.444367 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb2a8e788b71451da4a18f52b643e5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.448132 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:00.448453 1562 tablet_replica.cc:330] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:00.448664 1562 raft_consensus.cc:2229] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.448861 1562 raft_consensus.cc:2258] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.449005 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 566aa5caa012443ea63fcb7389c8b7c0 (DEFAULT_TABLE table=default.Table_166945d9ee0740f2b92a0138063f8891 [id=cad1448cfd5a4e76afe95e544d8a30b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.449424 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566aa5caa012443ea63fcb7389c8b7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.449633 1562 ts_tablet_manager.cc:1905] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.453122 1706 raft_consensus.cc:482] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.453346 1706 raft_consensus.cc:504] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.454516 1706 leader_election.cc:288] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:00.456002 1239 leader_election.cc:341] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 1c49c70e003f47d6a325669376e5e3ca
I20260927 15:06:00.457666 1562 ts_tablet_manager.cc:1918] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.457793 1562 log.cc:1196] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/6cf0ef42c0944b049a8ce68531ed8e45
I20260927 15:06:00.458166 1562 ts_tablet_manager.cc:1939] T 6cf0ef42c0944b049a8ce68531ed8e45 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:06:00.460364 1238 leader_election.cc:341] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 1c49c70e003f47d6a325669376e5e3ca
I20260927 15:06:00.460564 1238 leader_election.cc:302] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:00.460889 1706 raft_consensus.cc:2726] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.464046 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 80a8563c77484a1ebbbe7dab9a652aeb (DEFAULT_TABLE table=default.Table_8f5fefa8a52c4f66b05c89b0c5017c38 [id=f76efa8048524aa9a343ed0912a15500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.464483 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80a8563c77484a1ebbbe7dab9a652aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.466307 1559 ts_tablet_manager.cc:1918] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.466459 1559 log.cc:1196] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/e0db1654ced542938487126a0a09ed74
I20260927 15:06:00.466917 1559 ts_tablet_manager.cc:1939] T e0db1654ced542938487126a0a09ed74 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.467736 1556 tablet_bootstrap.cc:492] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.467888 1556 ts_tablet_manager.cc:1397] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.112s user 0.017s sys 0.020s
I20260927 15:06:00.468763 1559 tablet_replica.cc:330] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.468639 1556 raft_consensus.cc:348] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.468919 1556 raft_consensus.cc:374] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.469008 1556 raft_consensus.cc:729] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.469048 1559 raft_consensus.cc:2229] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.469296 1559 raft_consensus.cc:2258] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.469267 1556 consensus_queue.cc:260] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.469924 1556 ts_tablet_manager.cc:1428] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:00.470095 1559 ts_tablet_manager.cc:1905] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.470230 1556 tablet_bootstrap.cc:492] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.472133 1556 tablet_bootstrap.cc:654] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.473439 1706 raft_consensus.cc:482] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.473616 1706 raft_consensus.cc:504] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.474265 1706 leader_election.cc:288] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:00.477103 1239 leader_election.cc:341] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: b122f1436fde4c5da7f0afa3a1c24c70
I20260927 15:06:00.478086 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 8790d59beb804acb8e4353f862d7f6f8 (DEFAULT_TABLE table=default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.478658 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8790d59beb804acb8e4353f862d7f6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.478914 1559 ts_tablet_manager.cc:1918] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.479064 1559 log.cc:1196] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/ce3b706ed2734db782efdb47cf3fda95
I20260927 15:06:00.479532 1559 ts_tablet_manager.cc:1939] T ce3b706ed2734db782efdb47cf3fda95 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.483098 1556 tablet_bootstrap.cc:492] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.483258 1556 ts_tablet_manager.cc:1397] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.001s
W20260927 15:06:00.484105 1238 leader_election.cc:341] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b122f1436fde4c5da7f0afa3a1c24c70
I20260927 15:06:00.484252 1559 tablet_replica.cc:330] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.484097 1556 raft_consensus.cc:348] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.484392 1556 raft_consensus.cc:374] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.484505 1556 raft_consensus.cc:729] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.484503 1238 leader_election.cc:302] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:00.484835 1706 raft_consensus.cc:2726] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.484989 1559 raft_consensus.cc:2229] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.485060 1556 consensus_queue.cc:260] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.485191 1559 raft_consensus.cc:2258] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.485637 1556 ts_tablet_manager.cc:1428] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:00.486279 1559 ts_tablet_manager.cc:1905] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.488454 1758 raft_consensus.cc:482] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.488616 1758 raft_consensus.cc:504] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.489229 1758 leader_election.cc:288] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:00.489827 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "443af328e5154bdba9b570224616d77b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.490366 1376 leader_election.cc:341] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.491134 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "443af328e5154bdba9b570224616d77b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:00.491691 1374 leader_election.cc:341] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.491822 1374 leader_election.cc:302] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.492183 1758 raft_consensus.cc:2726] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.493559 1556 tablet_bootstrap.cc:492] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.495008 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 04007cd4bd214b88a4664e23daf4b790 (DEFAULT_TABLE table=default.Table_7052ab085a334588b13fab6355c981dd [id=ff900aafe4f94663a9633fc0fbec0a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.495402 1556 tablet_bootstrap.cc:654] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.495460 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04007cd4bd214b88a4664e23daf4b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.496266 1559 ts_tablet_manager.cc:1918] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.496443 1559 log.cc:1196] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/714b110a24ca4f3bb8126034dc3e6407
I20260927 15:06:00.496878 1559 ts_tablet_manager.cc:1939] T 714b110a24ca4f3bb8126034dc3e6407 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.498003 1559 tablet_replica.cc:330] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.498236 1559 raft_consensus.cc:2229] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.498432 1559 raft_consensus.cc:2258] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.499423 1559 ts_tablet_manager.cc:1905] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.500588 1556 tablet_bootstrap.cc:492] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.500742 1556 ts_tablet_manager.cc:1397] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.003s
I20260927 15:06:00.501521 1556 raft_consensus.cc:348] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.501791 1556 raft_consensus.cc:374] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.501870 1556 raft_consensus.cc:729] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.502122 1556 consensus_queue.cc:260] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.502744 1556 ts_tablet_manager.cc:1428] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:00.503065 1556 tablet_bootstrap.cc:492] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.503852 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 9049d003d787403f80aa0c08872dd3b5 (DEFAULT_TABLE table=default.Table_75127a34541e4a979aace6aa029d396e [id=67ad7f9c36834f09a601dbf2841ebc48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.504364 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9049d003d787403f80aa0c08872dd3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.504700 1556 tablet_bootstrap.cc:654] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.507915 1559 ts_tablet_manager.cc:1918] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.508031 1559 log.cc:1196] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/e94dd938cf50495c99b5dce808ae7100
I20260927 15:06:00.508436 1559 ts_tablet_manager.cc:1939] T e94dd938cf50495c99b5dce808ae7100 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:00.510732 899 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 6cc8bd2079f84da39e13113e6699bf5e (table default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6cc8bd2079f84da39e13113e6699bf5e consensus state has no leader
I20260927 15:06:00.511260 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 12623e6767aa4bd4934058f7314a966e (table default.Table_a6f0eb861ab04bcb8df0053049d90e1b [id=7016faef9bb8460288ace088e5995265]) successfully deleted
W20260927 15:06:00.511525 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6c73e813bb594a5e871718b73fe61fc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c73e813bb594a5e871718b73fe61fc9 already in progress: creating tablet
W20260927 15:06:00.511759 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 109f9088371e4f008b2b5f993f2b4c3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 109f9088371e4f008b2b5f993f2b4c3b already in progress: creating tablet
I20260927 15:06:00.511940 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 6cf0ef42c0944b049a8ce68531ed8e45 (table default.Table_607ad366580d4bd58b8879b581554873 [id=22e6dc77a3c3419aa3e7034a48773f8f]) successfully deleted
I20260927 15:06:00.512532 1136 tablet_service.cc:1467] Processing CreateTablet for tablet fb2a8e788b71451da4a18f52b643e5e2 (DEFAULT_TABLE table=default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e [id=db7af27293544752bbe914164e4e9d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.513033 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb2a8e788b71451da4a18f52b643e5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.519483 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 8f4bd8182c9d48c7b6e6175ab98d405a (DEFAULT_TABLE table=default.Table_f473e7d31ecc4adfbda7d8a1df28ec33 [id=a8244b3e082b4423bdf4d108ee1647b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.519784 1556 tablet_bootstrap.cc:492] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.519959 1556 ts_tablet_manager.cc:1397] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20260927 15:06:00.519572 1274 tablet_service.cc:1467] Processing CreateTablet for tablet c90e5c66d8564f68b401b3e4280499a7 (DEFAULT_TABLE table=default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.520890 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c90e5c66d8564f68b401b3e4280499a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.520756 1556 raft_consensus.cc:348] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.521004 1556 raft_consensus.cc:374] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.521095 1556 raft_consensus.cc:729] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.521306 1556 consensus_queue.cc:260] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.522035 1556 ts_tablet_manager.cc:1428] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:00.522316 1556 tablet_bootstrap.cc:492] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.522516 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f4bd8182c9d48c7b6e6175ab98d405a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.523952 1556 tablet_bootstrap.cc:654] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.530457 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 0129eaa5636544e696076e439d713b1b (DEFAULT_TABLE table=default.Table_dcca958a30ba42a8943865116e383a22 [id=3d369788b9e44a0b9befbbb44303d24e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.531174 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0129eaa5636544e696076e439d713b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.543988 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 8790d59beb804acb8e4353f862d7f6f8 (DEFAULT_TABLE table=default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.544709 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8790d59beb804acb8e4353f862d7f6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.549811 1758 raft_consensus.cc:482] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.550043 1758 raft_consensus.cc:504] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.551826 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8af844423fc94e2c8380db179103d3aa" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.552671 1376 leader_election.cc:341] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.553068 1758 leader_election.cc:288] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:00.553871 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8af844423fc94e2c8380db179103d3aa" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:00.554224 1165 raft_consensus.cc:2454] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:00.554850 1374 leader_election.cc:302] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.555554 1758 raft_consensus.cc:2781] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:00.555678 1758 raft_consensus.cc:482] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:00.555843 1758 raft_consensus.cc:3037] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.560011 1758 raft_consensus.cc:504] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.561570 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8af844423fc94e2c8380db179103d3aa" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:00.562568 1376 leader_election.cc:341] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:00.562620 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.62:41167, user_credentials={real_user=slave}} blocked reactor thread for 127695us
I20260927 15:06:00.563697 1758 leader_election.cc:288] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:00.563948 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 80a8563c77484a1ebbbe7dab9a652aeb (DEFAULT_TABLE table=default.Table_8f5fefa8a52c4f66b05c89b0c5017c38 [id=f76efa8048524aa9a343ed0912a15500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.564512 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80a8563c77484a1ebbbe7dab9a652aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.567443 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8af844423fc94e2c8380db179103d3aa" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:00.567719 1165 raft_consensus.cc:3037] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.575716 1165 raft_consensus.cc:2454] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:00.576390 1374 leader_election.cc:302] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.576941 1758 raft_consensus.cc:2781] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:00.577128 1758 raft_consensus.cc:686] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:00.577448 1758 consensus_queue.cc:237] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.592016 1131 tablet_service.cc:1467] Processing CreateTablet for tablet c90e5c66d8564f68b401b3e4280499a7 (DEFAULT_TABLE table=default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.593140 1552 tablet_bootstrap.cc:492] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.593379 1552 ts_tablet_manager.cc:1397] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.191s user 0.002s sys 0.064s
I20260927 15:06:00.594412 1552 raft_consensus.cc:348] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.594753 1552 raft_consensus.cc:374] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.594794 1561 tablet_bootstrap.cc:492] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.594838 1552 raft_consensus.cc:729] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.595130 1552 consensus_queue.cc:260] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:00.596647 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9a7ed6e23e1479a86e2abcf6aa5b317 already in progress: creating tablet
I20260927 15:06:00.597455 1552 ts_tablet_manager.cc:1428] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260927 15:06:00.597442 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9c9e4311049d47d3b2f1e117795624ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c9e4311049d47d3b2f1e117795624ef already in progress: creating tablet
I20260927 15:06:00.597772 1552 tablet_bootstrap.cc:492] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:00.597697 1278 tablet_service.cc:1467] Processing CreateTablet for tablet c5cd55de34d249bc8d3adcf4690f0414 (DEFAULT_TABLE table=default.Table_4e746f160fe7481ea3947c59c33ed5ee [id=1b056b1df8b440a7a49989039998313c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.598096 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5cd55de34d249bc8d3adcf4690f0414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.600322 1552 tablet_bootstrap.cc:654] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:00.600823 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6d6eed08273244d28fd15785a09059f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d6eed08273244d28fd15785a09059f9 already in progress: creating tablet
W20260927 15:06:00.601145 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7d1f23f91bce4df480dd9991659f2e81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d1f23f91bce4df480dd9991659f2e81 already in progress: creating tablet
I20260927 15:06:00.594990 1561 ts_tablet_manager.cc:1397] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.282s user 0.053s sys 0.101s
I20260927 15:06:00.595813 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 8f4bd8182c9d48c7b6e6175ab98d405a (DEFAULT_TABLE table=default.Table_f473e7d31ecc4adfbda7d8a1df28ec33 [id=a8244b3e082b4423bdf4d108ee1647b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.603961 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet e188f28304604cf2a96a606811900ca5 (table default.Table_16724ccc8d1c4311a5e47f148a6148d3 [id=88ccf418a4e24b07830f6fdabe341176]) successfully deleted
I20260927 15:06:00.604166 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 0781c9c8b4ad498bb27573939b7d06b2 (table default.Table_81479ddeb1b6463cab4db3d03d955a91 [id=f301a482365b4cf2b752fccd860a8d2d]) successfully deleted
W20260927 15:06:00.605381 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet da1812142bb043fba7457dc61ffdb180 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da1812142bb043fba7457dc61ffdb180 already in progress: creating tablet
I20260927 15:06:00.605680 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 1c49c70e003f47d6a325669376e5e3ca (table default.Table_2481967ffd2f4c30bfb57bdf8d5940e0 [id=ed09d325f0bd478fa0ed6172c15299ec]) successfully deleted
W20260927 15:06:00.606317 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a46e15ea145b4eae8f94b664067b4f92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a46e15ea145b4eae8f94b664067b4f92 already in progress: creating tablet
W20260927 15:06:00.606525 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 654d3210fd8c46b68880e544c39d5c88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 654d3210fd8c46b68880e544c39d5c88 already in progress: creating tablet
I20260927 15:06:00.606853 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 46ee85688df04e92accdedb6625406c1 (table default.Table_6cc665540fb24e17b9284fc911758626 [id=31cb67e2dcb54a029ecdc3457b6139c1]) successfully deleted
W20260927 15:06:00.607053 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ad5af5df58824fe88d607a93216bd228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad5af5df58824fe88d607a93216bd228 already in progress: creating tablet
W20260927 15:06:00.607410 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6e9d03457dac43038b4e6fb120ff572c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e9d03457dac43038b4e6fb120ff572c already in progress: creating tablet
W20260927 15:06:00.607627 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 07b63e63f7cd4075bcf10a463ce16e05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07b63e63f7cd4075bcf10a463ce16e05 already in progress: creating tablet
I20260927 15:06:00.609570 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 6cc8bd2079f84da39e13113e6699bf5e (DEFAULT_TABLE table=default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.610102 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cc8bd2079f84da39e13113e6699bf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.610008 1561 raft_consensus.cc:348] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.610343 1561 raft_consensus.cc:374] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.610473 1561 raft_consensus.cc:729] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.610971 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 7d31bf920f0d41478863959d49400731 (table default.Table_d57bcc02349c4f17b76b5a31ec74e0f2 [id=b28d0e08cf944e17a720641dab1f23f5]) successfully deleted
W20260927 15:06:00.611219 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 12623e6767aa4bd4934058f7314a966e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12623e6767aa4bd4934058f7314a966e already in progress: creating tablet
I20260927 15:06:00.611482 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet ac3b1d765caf40a1a7593cdb19defcab (table default.Table_a8794ae976fe4fd48b9015808f70e330 [id=6368f21af56d44f09f5cf1ec2d19f2b6]) successfully deleted
I20260927 15:06:00.611982 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet e0db1654ced542938487126a0a09ed74 (table default.Table_762e4939259748a28b16279e147a5ada [id=09ccdcb0502f47219fc4985219701f1b]) successfully deleted
I20260927 15:06:00.614471 1142 tablet_service.cc:1467] Processing CreateTablet for tablet c5cd55de34d249bc8d3adcf4690f0414 (DEFAULT_TABLE table=default.Table_4e746f160fe7481ea3947c59c33ed5ee [id=1b056b1df8b440a7a49989039998313c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.618547 1552 tablet_bootstrap.cc:492] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.618618 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 6cc8bd2079f84da39e13113e6699bf5e (DEFAULT_TABLE table=default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.618743 1552 ts_tablet_manager.cc:1397] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.001s
I20260927 15:06:00.620774 1552 raft_consensus.cc:348] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.621066 1552 raft_consensus.cc:374] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.621151 1552 raft_consensus.cc:729] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.621376 1552 consensus_queue.cc:260] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.623835 1556 tablet_bootstrap.cc:492] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.624043 1556 ts_tablet_manager.cc:1397] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.102s user 0.030s sys 0.042s
I20260927 15:06:00.624722 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd31ae2ac2e4bc9897724bc9012698d (DEFAULT_TABLE table=default.Table_36bbe5ba649840a5a2dacf9ce1cd8d75 [id=7013e1594ad24b3aaae4c55b4287d3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.624788 1556 raft_consensus.cc:348] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.625187 1556 raft_consensus.cc:374] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.625274 1556 raft_consensus.cc:729] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.625344 1552 ts_tablet_manager.cc:1428] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 15:06:00.626959 1556 consensus_queue.cc:260] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.627211 1552 tablet_bootstrap.cc:492] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:00.627625 1556 ts_tablet_manager.cc:1428] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:00.627916 1556 tablet_bootstrap.cc:492] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.628127 1561 consensus_queue.cc:260] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.628822 1561 ts_tablet_manager.cc:1428] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.027s user 0.000s sys 0.002s
W20260927 15:06:00.629066 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bc971defe6d148439a6a0b8c55d9092e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc971defe6d148439a6a0b8c55d9092e already in progress: creating tablet
I20260927 15:06:00.629132 1552 tablet_bootstrap.cc:654] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:00.629287 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet cd901034653b47dbba7912d5338bc3bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd901034653b47dbba7912d5338bc3bb already in progress: creating tablet
I20260927 15:06:00.629446 1556 tablet_bootstrap.cc:654] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.629522 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet ce3b706ed2734db782efdb47cf3fda95 (table default.Table_9074f56e5d72442694c1b683a1911c62 [id=8ca2c45597294e2aa3a002911c86fd1d]) successfully deleted
W20260927 15:06:00.629727 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f1d7a98ffc4745ac8eeb93012b55d417 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1d7a98ffc4745ac8eeb93012b55d417 already in progress: creating tablet
I20260927 15:06:00.629774 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd31ae2ac2e4bc9897724bc9012698d (DEFAULT_TABLE table=default.Table_36bbe5ba649840a5a2dacf9ce1cd8d75 [id=7013e1594ad24b3aaae4c55b4287d3e9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:00.629953 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2cd55e22d8254ea8b1dab989517148ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cd55e22d8254ea8b1dab989517148ca already in progress: creating tablet
W20260927 15:06:00.630141 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 63289edbdd734dd5a817df42d83e422e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63289edbdd734dd5a817df42d83e422e already in progress: creating tablet
I20260927 15:06:00.630162 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd31ae2ac2e4bc9897724bc9012698d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:00.630411 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fe7816e099094d13887650fc223097c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe7816e099094d13887650fc223097c7 already in progress: creating tablet
W20260927 15:06:00.630596 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet dc6f179aab784ae4822356e63332532f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc6f179aab784ae4822356e63332532f already in progress: creating tablet
W20260927 15:06:00.630769 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 16884c7343be436aa312ec0af40f5e33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16884c7343be436aa312ec0af40f5e33 already in progress: creating tablet
W20260927 15:06:00.630965 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 already in progress: creating tablet
W20260927 15:06:00.631152 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 109f9088371e4f008b2b5f993f2b4c3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 109f9088371e4f008b2b5f993f2b4c3b already in progress: creating tablet
W20260927 15:06:00.631301 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6c73e813bb594a5e871718b73fe61fc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c73e813bb594a5e871718b73fe61fc9 already in progress: creating tablet
W20260927 15:06:00.631474 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 30cf4db249154adda9406d5b07430a80 because the tablet was not found. No further retry: Not found: Tablet not found: 30cf4db249154adda9406d5b07430a80
I20260927 15:06:00.631615 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 714b110a24ca4f3bb8126034dc3e6407 (table default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]) successfully deleted
I20260927 15:06:00.631781 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet e94dd938cf50495c99b5dce808ae7100 (table default.Table_63d3ae8aa61f4fcd80a58e28f2104a21 [id=ef9cdb183bd444e6baac3c583dfb631d]) successfully deleted
I20260927 15:06:00.633477 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c90e5c66d8564f68b401b3e4280499a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.646533 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5cd55de34d249bc8d3adcf4690f0414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.647042 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cc8bd2079f84da39e13113e6699bf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.647222 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f4bd8182c9d48c7b6e6175ab98d405a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.653553 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd31ae2ac2e4bc9897724bc9012698d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.657361 1758 raft_consensus.cc:482] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.657512 1758 raft_consensus.cc:504] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.658157 1758 leader_election.cc:288] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:00.658720 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 0129eaa5636544e696076e439d713b1b (DEFAULT_TABLE table=default.Table_dcca958a30ba42a8943865116e383a22 [id=3d369788b9e44a0b9befbbb44303d24e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.659227 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0129eaa5636544e696076e439d713b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.660722 1561 tablet_bootstrap.cc:492] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:00.662369 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12623e6767aa4bd4934058f7314a966e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:00.662972 1561 tablet_bootstrap.cc:654] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:00.663745 1376 leader_election.cc:341] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:00.664143 1374 leader_election.cc:341] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 12623e6767aa4bd4934058f7314a966e
I20260927 15:06:00.664260 1374 leader_election.cc:302] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.664597 1758 raft_consensus.cc:2726] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.668996 1556 tablet_bootstrap.cc:492] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.669133 1556 ts_tablet_manager.cc:1397] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.008s
I20260927 15:06:00.669951 1556 raft_consensus.cc:348] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.670177 1556 raft_consensus.cc:374] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.670706 1556 raft_consensus.cc:729] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.670991 1556 consensus_queue.cc:260] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.671697 1556 ts_tablet_manager.cc:1428] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 15:06:00.671998 1556 tablet_bootstrap.cc:492] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.673669 1556 tablet_bootstrap.cc:654] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.676690 1552 tablet_bootstrap.cc:492] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:00.676860 1552 ts_tablet_manager.cc:1397] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.018s
I20260927 15:06:00.677723 1552 raft_consensus.cc:348] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.677959 1552 raft_consensus.cc:374] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.678040 1552 raft_consensus.cc:729] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.678236 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 8790d59beb804acb8e4353f862d7f6f8 (DEFAULT_TABLE table=default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.678289 1552 consensus_queue.cc:260] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.678707 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8790d59beb804acb8e4353f862d7f6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.679785 1552 ts_tablet_manager.cc:1428] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:00.680058 1552 tablet_bootstrap.cc:492] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:00.681591 1552 tablet_bootstrap.cc:654] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.682889 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 80a8563c77484a1ebbbe7dab9a652aeb (DEFAULT_TABLE table=default.Table_8f5fefa8a52c4f66b05c89b0c5017c38 [id=f76efa8048524aa9a343ed0912a15500]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:00.684017 1688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260927 15:06:00.684499 1688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:06:00.684669 1688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260927 15:06:00.685467 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80a8563c77484a1ebbbe7dab9a652aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.686534 1556 tablet_bootstrap.cc:492] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.686677 1556 ts_tablet_manager.cc:1397] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.002s
I20260927 15:06:00.687561 1556 raft_consensus.cc:348] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.687810 1556 raft_consensus.cc:374] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.687906 1556 raft_consensus.cc:729] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.688133 1556 consensus_queue.cc:260] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.689729 1556 ts_tablet_manager.cc:1428] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:00.690023 1556 tablet_bootstrap.cc:492] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.691573 1556 tablet_bootstrap.cc:654] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.694628 1556 tablet_bootstrap.cc:492] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:00.694763 1556 ts_tablet_manager.cc:1397] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260927 15:06:00.696193 1416 tablet_service.cc:1467] Processing CreateTablet for tablet c90e5c66d8564f68b401b3e4280499a7 (DEFAULT_TABLE table=default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.696642 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c90e5c66d8564f68b401b3e4280499a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.696837 1556 raft_consensus.cc:348] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.697065 1556 raft_consensus.cc:374] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.697165 1556 raft_consensus.cc:729] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.697391 1556 consensus_queue.cc:260] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.698107 1556 ts_tablet_manager.cc:1428] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:00.698385 1556 tablet_bootstrap.cc:492] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:00.700790 1556 tablet_bootstrap.cc:654] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.706203 1706 raft_consensus.cc:482] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.706459 1706 raft_consensus.cc:504] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.707278 1706 leader_election.cc:288] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.708091 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ad68a0adad407a92b2335f43e67227" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:00.710502 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ad68a0adad407a92b2335f43e67227" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:00.711076 1238 leader_election.cc:302] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:00.711531 1706 raft_consensus.cc:2726] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.717249 1706 raft_consensus.cc:482] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.717442 1706 raft_consensus.cc:504] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.718173 1706 leader_election.cc:288] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.718989 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31701139f10f4478af43bd153aa3a2dc" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:00.723805 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 8f4bd8182c9d48c7b6e6175ab98d405a (DEFAULT_TABLE table=default.Table_f473e7d31ecc4adfbda7d8a1df28ec33 [id=a8244b3e082b4423bdf4d108ee1647b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.724444 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f4bd8182c9d48c7b6e6175ab98d405a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.724754 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd31ae2ac2e4bc9897724bc9012698d (DEFAULT_TABLE table=default.Table_36bbe5ba649840a5a2dacf9ce1cd8d75 [id=7013e1594ad24b3aaae4c55b4287d3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.725203 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd31ae2ac2e4bc9897724bc9012698d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:00.727497 1688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:06:00.727603 1688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:06:00.727664 1688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:06:00.727736 1688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260927 15:06:00.731133 1412 tablet_service.cc:1467] Processing CreateTablet for tablet c5cd55de34d249bc8d3adcf4690f0414 (DEFAULT_TABLE table=default.Table_4e746f160fe7481ea3947c59c33ed5ee [id=1b056b1df8b440a7a49989039998313c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.731518 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5cd55de34d249bc8d3adcf4690f0414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.735437 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 6cc8bd2079f84da39e13113e6699bf5e (DEFAULT_TABLE table=default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:00.735917 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cc8bd2079f84da39e13113e6699bf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:00.743856 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31701139f10f4478af43bd153aa3a2dc" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:00.744765 1238 leader_election.cc:302] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:00.745375 1706 raft_consensus.cc:2726] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:00.748780 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fde632b187eb4180b343d7bddc7f0943 consensus state has no leader
I20260927 15:06:00.749162 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 65c313ab6848428d8237557392669f6f from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:00.750078 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 31701139f10f4478af43bd153aa3a2dc from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:00.758844 1637 raft_consensus.cc:482] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.759080 1637 raft_consensus.cc:504] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.759902 1637 leader_election.cc:288] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.760819 1688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.201.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.62:41167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.201.62
--webserver_port=41209
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 27 Sep 2026 13:46:26 UTC on ccycloud.quasar-xkqhuq.root.comops.site
build id 4676080
ASAN enabled
I20260927 15:06:00.761236 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f15485b8825436184abe2621c71e356" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:00.762513 1688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260927 15:06:00.762565 1102 leader_election.cc:341] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.763528 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f15485b8825436184abe2621c71e356" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:00.763839 1438 raft_consensus.cc:2454] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:00.768613 1688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:06:00.773765 1099 leader_election.cc:302] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.774307 1725 raft_consensus.cc:482] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.774484 1725 raft_consensus.cc:504] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.775285 1725 leader_election.cc:288] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.775506 1725 raft_consensus.cc:2781] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:00.775620 1725 raft_consensus.cc:482] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:00.775735 1725 raft_consensus.cc:3037] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.779870 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d33202ebc4e37b598d62d66472f31" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.780918 1102 leader_election.cc:341] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.782325 1725 raft_consensus.cc:504] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.784678 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f15485b8825436184abe2621c71e356" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:00.785342 1102 leader_election.cc:341] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.785876 1725 leader_election.cc:288] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.786163 1637 raft_consensus.cc:482] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.786343 1637 raft_consensus.cc:504] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.787077 1637 leader_election.cc:288] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.787058 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d33202ebc4e37b598d62d66472f31" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:00.787330 1438 raft_consensus.cc:2454] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:00.788383 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d41d55fdb504b95921f46e7aed99ac1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.789080 1102 leader_election.cc:341] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.792568 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f15485b8825436184abe2621c71e356" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:00.792815 1438 raft_consensus.cc:3037] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.797468 1438 raft_consensus.cc:2454] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:00.809072 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d41d55fdb504b95921f46e7aed99ac1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:00.809564 1438 raft_consensus.cc:2454] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:00.809752 1793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:06:00.810451 1099 leader_election.cc:302] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.811023 1725 raft_consensus.cc:2781] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:00.811142 1725 raft_consensus.cc:482] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:00.811260 1725 raft_consensus.cc:3037] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.815539 1725 raft_consensus.cc:504] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.816386 1725 leader_election.cc:288] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:00.816496 1792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:06:00.817312 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d33202ebc4e37b598d62d66472f31" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:00.818087 1102 leader_election.cc:341] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.819279 1099 leader_election.cc:302] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.819621 1561 tablet_bootstrap.cc:492] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.819826 1561 ts_tablet_manager.cc:1397] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.159s user 0.034s sys 0.034s
I20260927 15:06:00.820416 1099 leader_election.cc:302] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.819881 1725 raft_consensus.cc:2781] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:00.820987 1637 raft_consensus.cc:2781] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:00.821086 1637 raft_consensus.cc:482] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:00.821153 1637 raft_consensus.cc:3037] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.822818 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a8d33202ebc4e37b598d62d66472f31" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:00.823119 1438 raft_consensus.cc:3037] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.823875 1637 raft_consensus.cc:504] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.824640 1637 leader_election.cc:288] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.825696 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d41d55fdb504b95921f46e7aed99ac1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:00.826324 1561 raft_consensus.cc:348] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:00.826450 1102 leader_election.cc:341] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.827028 1561 raft_consensus.cc:374] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.827134 1561 raft_consensus.cc:729] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.828128 1561 consensus_queue.cc:260] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.828871 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d41d55fdb504b95921f46e7aed99ac1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:00.829095 1439 raft_consensus.cc:3037] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.830320 1561 ts_tablet_manager.cc:1428] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 15:06:00.831116 1438 raft_consensus.cc:2454] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:00.831475 1099 leader_election.cc:302] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.831583 1561 tablet_bootstrap.cc:492] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:00.831875 1439 raft_consensus.cc:2454] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:00.832145 1637 raft_consensus.cc:2781] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:00.832314 1637 raft_consensus.cc:686] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
W20260927 15:06:00.834115 898 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 -> Peer dbf522d70373412b87815d33c0f1f745 (127.0.201.62:41167): Couldn't send request to peer dbf522d70373412b87815d33c0f1f745. Status: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:00.834697 1637 consensus_queue.cc:237] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.835413 1099 leader_election.cc:302] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.837648 1799 raft_consensus.cc:2781] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:00.839082 1799 raft_consensus.cc:686] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:00.839916 1799 consensus_queue.cc:237] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.842154 1561 tablet_bootstrap.cc:654] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:00.846690 1725 raft_consensus.cc:686] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:00.847051 1725 consensus_queue.cc:237] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.847185 911 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_e23e5a0596754267a9314c66227c595f [id=b1106aee6c804da4a603364cee1c1116] alter complete (version 3)
I20260927 15:06:00.847887 911 master_service.cc:946] ReplaceTablet: received request to replace tablet e9a7ed6e23e1479a86e2abcf6aa5b317 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:00.849725 1561 tablet_bootstrap.cc:492] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:00.849839 1561 ts_tablet_manager.cc:1397] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20260927 15:06:00.850499 1561 raft_consensus.cc:348] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.850678 1561 raft_consensus.cc:374] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:00.850746 1561 raft_consensus.cc:729] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:00.854060 1561 consensus_queue.cc:260] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.856705 1561 ts_tablet_manager.cc:1428] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260927 15:06:00.858920 1706 raft_consensus.cc:482] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.859037 1561 tablet_bootstrap.cc:492] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:00.859114 1706 raft_consensus.cc:504] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.859927 1706 leader_election.cc:288] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.860574 1561 tablet_bootstrap.cc:654] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:00.861760 1239 leader_election.cc:341] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: e188f28304604cf2a96a606811900ca5
I20260927 15:06:00.863587 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:00.864454 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f15485b8825436184abe2621c71e356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:00.864776 1562 tablet_replica.cc:330] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:00.865800 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d41d55fdb504b95921f46e7aed99ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:00.866671 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af844423fc94e2c8380db179103d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:00.868863 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6cf0ef42c0944b049a8ce68531ed8e45 because the tablet was not found. No further retry: Not found: Tablet not found: 6cf0ef42c0944b049a8ce68531ed8e45
I20260927 15:06:00.869238 1799 raft_consensus.cc:482] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.869540 1799 raft_consensus.cc:504] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.871012 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "443af328e5154bdba9b570224616d77b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:00.871747 1102 leader_election.cc:341] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.872282 1799 leader_election.cc:288] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.873116 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "443af328e5154bdba9b570224616d77b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:00.873358 1439 raft_consensus.cc:2454] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:00.873469 1238 leader_election.cc:341] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: e188f28304604cf2a96a606811900ca5
I20260927 15:06:00.873584 1238 leader_election.cc:302] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:00.874063 1706 raft_consensus.cc:2726] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.874878 1099 leader_election.cc:302] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.875806 1799 raft_consensus.cc:2781] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:00.875931 1799 raft_consensus.cc:482] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:00.876065 1799 raft_consensus.cc:3037] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.881639 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0aec677006ab4407bd7ae4c0078d6b7f
I20260927 15:06:00.882179 908 catalog_manager.cc:6565] ReplaceTablet: tablet 0aec677006ab4407bd7ae4c0078d6b7f deleted and replaced by tablet 66b54ee47e424aacb7f53fd95b0ce889
I20260927 15:06:00.883569 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0d4ca19b492c4df1b31c78f1629c50b5
I20260927 15:06:00.886752 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d4ca19b492c4df1b31c78f1629c50b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:00.891281 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 0aec677006ab4407bd7ae4c0078d6b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 66b54ee47e424aacb7f53fd95b0ce889) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:00.892242 1758 raft_consensus.cc:482] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.892412 1758 raft_consensus.cc:504] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.892509 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 0aec677006ab4407bd7ae4c0078d6b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 66b54ee47e424aacb7f53fd95b0ce889) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:00.893122 1758 leader_election.cc:288] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:00.893550 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d4ca19b492c4df1b31c78f1629c50b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:00.894702 1374 leader_election.cc:341] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 6cf0ef42c0944b049a8ce68531ed8e45
I20260927 15:06:00.895112 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cf0ef42c0944b049a8ce68531ed8e45" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:00.895596 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b375902081c54cdb84fdb075eec6baf7
W20260927 15:06:00.895861 1376 leader_election.cc:341] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.895982 1376 leader_election.cc:302] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.896076 906 catalog_manager.cc:6565] ReplaceTablet: tablet b375902081c54cdb84fdb075eec6baf7 deleted and replaced by tablet 0f4cff4a06db44269defca578af289d8
I20260927 15:06:00.896417 1758 raft_consensus.cc:2726] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.897660 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c90e5c66d8564f68b401b3e4280499a7
I20260927 15:06:00.899709 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet c90e5c66d8564f68b401b3e4280499a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:00.900669 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet b375902081c54cdb84fdb075eec6baf7 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f4cff4a06db44269defca578af289d8) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:00.901394 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet b375902081c54cdb84fdb075eec6baf7 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f4cff4a06db44269defca578af289d8) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:00.914330 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0d4ca19b492c4df1b31c78f1629c50b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d4ca19b492c4df1b31c78f1629c50b5 already in progress: creating tablet
I20260927 15:06:00.914660 1305 raft_consensus.cc:3037] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.914857 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet c90e5c66d8564f68b401b3e4280499a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:00.916720 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0aec677006ab4407bd7ae4c0078d6b7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0aec677006ab4407bd7ae4c0078d6b7f already in progress: creating tablet
W20260927 15:06:00.917033 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c90e5c66d8564f68b401b3e4280499a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c90e5c66d8564f68b401b3e4280499a7 already in progress: creating tablet
W20260927 15:06:00.917291 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b375902081c54cdb84fdb075eec6baf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b375902081c54cdb84fdb075eec6baf7 already in progress: creating tablet
I20260927 15:06:00.931279 1758 raft_consensus.cc:482] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.931540 1758 raft_consensus.cc:504] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.932524 1758 leader_election.cc:288] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:00.933835 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7faf6e79db420db13999d74fe86062" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:00.934434 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7faf6e79db420db13999d74fe86062" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:00.935148 1706 raft_consensus.cc:482] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.935340 1706 raft_consensus.cc:504] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:00.935477 1374 leader_election.cc:341] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:00.936002 1376 leader_election.cc:341] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.936062 1706 leader_election.cc:288] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.936137 1376 leader_election.cc:302] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:00.937183 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bd5b459caa42e7a9153d9273ad52c4" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:00.937602 1165 raft_consensus.cc:2379] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in this term.
I20260927 15:06:00.939306 1758 raft_consensus.cc:2726] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.941126 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bd5b459caa42e7a9153d9273ad52c4" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:00.942163 1238 leader_election.cc:302] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:00.942503 1706 raft_consensus.cc:3037] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.944061 1808 tablet.cc:1722] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:00.947023 1303 raft_consensus.cc:3037] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.947610 1706 raft_consensus.cc:2726] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:00.968195 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 148c77a0e88b40f690ca96f091b78d9a with delete_type TABLET_DATA_DELETED (replaced by tablet f88b401dc12e451c80abe1b509e2b532) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:00.968549 1559 tablet_replica.cc:330] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:00.968883 1559 raft_consensus.cc:2229] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:00.969089 1559 raft_consensus.cc:2258] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:00.969830 1559 ts_tablet_manager.cc:1905] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:00.970415 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 0aec677006ab4407bd7ae4c0078d6b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 66b54ee47e424aacb7f53fd95b0ce889) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:00.973009 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d4ca19b492c4df1b31c78f1629c50b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:00.974563 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet b375902081c54cdb84fdb075eec6baf7 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f4cff4a06db44269defca578af289d8) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:00.975190 1798 raft_consensus.cc:482] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:00.975420 1798 raft_consensus.cc:504] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.976346 1798 leader_election.cc:288] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.976897 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87cc6cc43a4a4ed1ac79e1902aca9fe5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:00.977085 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87cc6cc43a4a4ed1ac79e1902aca9fe5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:00.977514 1439 raft_consensus.cc:2454] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:00.977694 1102 leader_election.cc:341] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.977941 1099 leader_election.cc:302] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.978259 1798 raft_consensus.cc:2781] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:00.978366 1798 raft_consensus.cc:482] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:00.978439 1798 raft_consensus.cc:3037] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.980083 1559 ts_tablet_manager.cc:1918] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:00.980212 1559 log.cc:1196] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/148c77a0e88b40f690ca96f091b78d9a
I20260927 15:06:00.980597 1559 ts_tablet_manager.cc:1939] T 148c77a0e88b40f690ca96f091b78d9a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:00.981307 1798 raft_consensus.cc:504] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:00.983343 1798 leader_election.cc:288] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:00.983791 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87cc6cc43a4a4ed1ac79e1902aca9fe5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:00.984009 1439 raft_consensus.cc:3037] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:00.984144 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87cc6cc43a4a4ed1ac79e1902aca9fe5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:00.984753 1102 leader_election.cc:341] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:00.986752 1439 raft_consensus.cc:2454] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:00.987370 1099 leader_election.cc:302] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:00.988066 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7b64507732114eac85d1c532ba939432" } new_table_name: "default.Table_23a85033692d4048be1c35c35572a83a" modify_external_catalogs: true
I20260927 15:06:00.991834 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_148b139f16504ddb8e47c777c207685a" } modify_external_catalogs: true
I20260927 15:06:00.992038 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_148b139f16504ddb8e47c777c207685a" } modify_external_catalogs: true
I20260927 15:06:00.992750 1637 raft_consensus.cc:2781] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:00.993429 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_05efeebbfcb44fd488866bede83f6a31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:00.994149 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05efeebbfcb44fd488866bede83f6a31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:00.996482 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d30c425670fb48e8b23a840865bee28b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:00.997058 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d30c425670fb48e8b23a840865bee28b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:00.999126 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5b34cca200794f3fa6075659ba3851ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:00.999794 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b34cca200794f3fa6075659ba3851ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.003123 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3d65f616a187485eaa9298155971a648" } modify_external_catalogs: true
I20260927 15:06:01.003381 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3d65f616a187485eaa9298155971a648" } modify_external_catalogs: true
I20260927 15:06:01.008015 1706 raft_consensus.cc:482] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.009871 1706 raft_consensus.cc:504] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:01.013079 1239 leader_election.cc:341] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 6c7a8bf15c48423ea9ff14c46645a33b
W20260927 15:06:01.017769 1238 leader_election.cc:341] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6c7a8bf15c48423ea9ff14c46645a33b
I20260927 15:06:01.018076 1238 leader_election.cc:302] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:01.018728 1706 leader_election.cc:288] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.019308 1706 raft_consensus.cc:2726] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.031699 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet c90e5c66d8564f68b401b3e4280499a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.037070 1798 raft_consensus.cc:482] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.037375 1798 raft_consensus.cc:504] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.039371 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04caae16db84d8ea9050b648c1ba354" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:01.040118 1099 leader_election.cc:341] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.041218 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04caae16db84d8ea9050b648c1ba354" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:01.042294 1102 leader_election.cc:341] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.042439 1102 leader_election.cc:302] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:01.042744 1812 raft_consensus.cc:2726] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.040462 1798 leader_election.cc:288] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.046495 1799 raft_consensus.cc:504] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.046893 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 148c77a0e88b40f690ca96f091b78d9a (table default.Table_d80d3405cea240ec87396ab494d2d04d [id=c4ddc66927a94fd2abc8e44012cf69f7]) successfully deleted
W20260927 15:06:01.048738 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0aec677006ab4407bd7ae4c0078d6b7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0aec677006ab4407bd7ae4c0078d6b7f already in progress: creating tablet
I20260927 15:06:01.052139 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet bb90faccda0145a7acd153fcd51b4c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.055155 1688 server_base.cc:1034] running on GCE node
I20260927 15:06:01.058048 1559 tablet_replica.cc:330] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.058367 1559 raft_consensus.cc:2229] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.058624 1559 raft_consensus.cc:2258] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.059396 1559 ts_tablet_manager.cc:1905] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.069273 1559 ts_tablet_manager.cc:1918] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.069834 1559 log.cc:1196] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/bb90faccda0145a7acd153fcd51b4c43
I20260927 15:06:01.070358 1559 ts_tablet_manager.cc:1939] T bb90faccda0145a7acd153fcd51b4c43 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:01.054785 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0d4ca19b492c4df1b31c78f1629c50b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d4ca19b492c4df1b31c78f1629c50b5 already in progress: creating tablet
W20260927 15:06:01.072896 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b375902081c54cdb84fdb075eec6baf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b375902081c54cdb84fdb075eec6baf7 already in progress: creating tablet
W20260927 15:06:01.073352 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c90e5c66d8564f68b401b3e4280499a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c90e5c66d8564f68b401b3e4280499a7 already in progress: creating tablet
I20260927 15:06:01.073751 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet bb90faccda0145a7acd153fcd51b4c43 (table default.Table_44ec3dd510cd451a84cf5b0e73fc492d [id=0c63f8578de5475582ff54870c14d14b]) successfully deleted
I20260927 15:06:01.076263 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 31701139f10f4478af43bd153aa3a2dc
I20260927 15:06:01.076803 910 catalog_manager.cc:6565] ReplaceTablet: tablet 31701139f10f4478af43bd153aa3a2dc deleted and replaced by tablet 6b1f2143af1142eb9f3dbc777299c186
I20260927 15:06:01.077289 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_91bf12e088ba482ba6effe0407e05844"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.078085 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91bf12e088ba482ba6effe0407e05844 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.082592 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 31701139f10f4478af43bd153aa3a2dc with delete_type TABLET_DATA_DELETED (replaced by tablet 6b1f2143af1142eb9f3dbc777299c186) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.082903 1805 tablet_replica.cc:330] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:01.071630 1637 raft_consensus.cc:686] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:01.083406 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 31701139f10f4478af43bd153aa3a2dc with delete_type TABLET_DATA_DELETED (replaced by tablet 6b1f2143af1142eb9f3dbc777299c186) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.085067 1637 consensus_queue.cc:237] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.090317 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "443af328e5154bdba9b570224616d77b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:01.090356 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "443af328e5154bdba9b570224616d77b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:01.090682 1439 raft_consensus.cc:3037] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:01.091068 1102 leader_election.cc:341] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:01.091284 1362 kernel_stack_watchdog.cc:198] Thread 1556 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 262ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f26da5a6980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7f26d72c0bfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7f26d72e0fd8 kudu::ThreadPool::CreateThread() at ??:0
@ 0x7f26d72dcbeb kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7f26d72e1cef kudu::ThreadPool::Submit() at ??:0
@ 0x7f26e218606d kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7f26e21850bf kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7f26e2184ca6 kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7f26e218ca02 kudu::log::Log::Init() at ??:0
@ 0x7f26e218bdbf kudu::log::Log::Open() at ??:0
@ 0x7f26e3a1d2ee kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7f26e3a197dd kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7f26e3a17fd4 kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260927 15:06:01.099385 1439 raft_consensus.cc:2454] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:01.100113 1099 leader_election.cc:302] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:01.113061 1758 consensus_queue.cc:1035] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:01.124588 1798 raft_consensus.cc:2781] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:01.125375 1798 raft_consensus.cc:686] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:01.127593 1798 consensus_queue.cc:237] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:01.163234 1303 raft_consensus.cc:1565] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Could not prepare op 'term: 1 index: 3' and following 0 ops. Status for this op: Illegal state: STOPPING
I20260927 15:06:01.163273 1809 raft_consensus.cc:482] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.164427 1809 raft_consensus.cc:504] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.166746 1799 leader_election.cc:288] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:01.167567 1796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:06:01.169974 1688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:06:01.172349 1562 raft_consensus.cc:2229] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:01.173277 1562 pending_rounds.cc:62] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:01.173400 1562 pending_rounds.cc:68] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976313232093184 op_type: NO_OP noop_request { }
I20260927 15:06:01.173588 1562 raft_consensus.cc:2866] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:01.173770 1562 raft_consensus.cc:2258] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.179157 1688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:06:01.180543 1688 hybrid_clock.cc:648] HybridClock initialized: now 1790521561180412 us; error 93 us; skew 500 ppm
I20260927 15:06:01.181102 1688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260927 15:06:01.183821 1239 leader_election.cc:341] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: e94dd938cf50495c99b5dce808ae7100
W20260927 15:06:01.184580 1238 leader_election.cc:341] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: e94dd938cf50495c99b5dce808ae7100
I20260927 15:06:01.184782 1725 raft_consensus.cc:482] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.184899 1238 leader_election.cc:302] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:01.184957 1725 raft_consensus.cc:504] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.185302 1706 raft_consensus.cc:2726] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.185559 1799 raft_consensus.cc:482] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.185737 1725 leader_election.cc:288] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:01.185830 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.60:46799, user_credentials={real_user=slave}} blocked reactor thread for 111710us
I20260927 15:06:01.186797 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2cce454e70640e2a67b3680676b1d93" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:01.187690 1102 leader_election.cc:341] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.188350 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2cce454e70640e2a67b3680676b1d93" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:01.188918 1099 leader_election.cc:341] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.189085 1099 leader_election.cc:302] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:01.189505 1725 raft_consensus.cc:2726] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.189751 1688 webserver.cc:460] Webserver started at http://127.0.201.62:41209/ using document root <none> and password file <none>
I20260927 15:06:01.190948 1688 fs_manager.cc:359] Metadata directory not provided
I20260927 15:06:01.191138 1688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260927 15:06:01.192571 1799 raft_consensus.cc:504] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.193818 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377847d06b534883ba2b870ca3317fe0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:01.194414 1102 leader_election.cc:341] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.194391 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 31701139f10f4478af43bd153aa3a2dc with delete_type TABLET_DATA_DELETED (replaced by tablet 6b1f2143af1142eb9f3dbc777299c186) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.194742 1559 tablet_replica.cc:330] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.195187 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377847d06b534883ba2b870ca3317fe0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:01.195714 1099 leader_election.cc:341] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.195852 1099 leader_election.cc:302] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:01.195959 1805 raft_consensus.cc:2229] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.196149 1725 raft_consensus.cc:2726] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.196398 1799 leader_election.cc:288] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.197183 1805 raft_consensus.cc:2258] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.195986 1808 tablet.cc:1722] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:01.205202 1805 ts_tablet_manager.cc:1905] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.195190 1559 raft_consensus.cc:2229] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.207254 1559 raft_consensus.cc:2258] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.207950 1559 ts_tablet_manager.cc:1905] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.207988 1809 leader_election.cc:288] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.213135 1805 ts_tablet_manager.cc:1918] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:01.213279 1805 log.cc:1196] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/31701139f10f4478af43bd153aa3a2dc
I20260927 15:06:01.214335 1805 ts_tablet_manager.cc:1939] T 31701139f10f4478af43bd153aa3a2dc P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:01.215088 1552 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.078s sys 0.137s
W20260927 15:06:01.215193 1552 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.531s user 0.078s sys 0.137s
I20260927 15:06:01.215221 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 31701139f10f4478af43bd153aa3a2dc (table default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]) successfully deleted
W20260927 15:06:01.215691 1102 consensus_peers.cc:487] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31701139f10f4478af43bd153aa3a2dc. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:01.216125 1552 tablet_bootstrap.cc:492] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:01.216289 1552 ts_tablet_manager.cc:1397] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.536s user 0.079s sys 0.138s
I20260927 15:06:01.217427 1552 raft_consensus.cc:348] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.217832 1552 raft_consensus.cc:374] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.217943 1552 raft_consensus.cc:729] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.218207 1552 consensus_queue.cc:260] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.226352 1552 ts_tablet_manager.cc:1428] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260927 15:06:01.226722 1552 tablet_bootstrap.cc:492] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:01.226724 1559 ts_tablet_manager.cc:1918] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:01.229632 1552 tablet_bootstrap.cc:654] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:01.231361 1556 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.530s user 0.119s sys 0.295s
W20260927 15:06:01.231487 1556 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.530s user 0.119s sys 0.295s
W20260927 15:06:01.182377 1803 consensus_queue.cc:1159] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c4264874db964ff2830b7894c2b3d61c" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260927 15:06:01.232594 1556 tablet_bootstrap.cc:492] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:01.232754 1556 ts_tablet_manager.cc:1397] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.534s user 0.120s sys 0.295s
I20260927 15:06:01.232920 1559 log.cc:1196] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/31701139f10f4478af43bd153aa3a2dc
I20260927 15:06:01.233461 1559 ts_tablet_manager.cc:1939] T 31701139f10f4478af43bd153aa3a2dc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:01.233704 1556 raft_consensus.cc:348] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.233924 1556 raft_consensus.cc:374] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.233997 1556 raft_consensus.cc:729] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.234249 1556 consensus_queue.cc:260] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.235332 1561 tablet_bootstrap.cc:492] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:01.235507 1561 ts_tablet_manager.cc:1397] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.377s user 0.036s sys 0.057s
I20260927 15:06:01.235747 1556 ts_tablet_manager.cc:1428] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260927 15:06:01.235846 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 434e9390f1fd4a3ebb65924c37b85bd4 consensus state has no leader
I20260927 15:06:01.236042 1556 tablet_bootstrap.cc:492] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:01.236260 1561 raft_consensus.cc:348] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.236582 1561 raft_consensus.cc:374] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.236675 1561 raft_consensus.cc:729] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.236950 1561 consensus_queue.cc:260] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.237572 1556 tablet_bootstrap.cc:654] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.237596 1561 ts_tablet_manager.cc:1428] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:01.237941 1561 tablet_bootstrap.cc:492] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:01.241587 905 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49800 (request call id 333) took 1037 ms. Trace:
I20260927 15:06:01.243391 1561 tablet_bootstrap.cc:654] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.241736 905 rpcz_store.cc:276] 0927 15:06:00.204264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:00.846628 (+642364us) service_pool.cc:227] Handling call
0927 15:06:00.993314 (+146686us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00007f2c3731827d 00007f2c37318373 00007f2c3413a361 00007f2c3baad66a 00007f2c3bc35313 00007f2c32f27466 00007f2c32f27195 00007f2c2f7379be 00007f2c2f73679e 00007f2c2f73cb25 00007f2c2f73d54f
0927 15:06:00.994272 (+ 958us) catalog_manager.cc:2075] Acquired catalog manager lock
0927 15:06:00.994960 (+ 688us) catalog_manager.cc:2121] Created new table and tablet info
0927 15:06:01.241355 (+246395us) catalog_manager.cc:2181] Wrote table and tablets to system table
0927 15:06:01.241467 (+ 112us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0927 15:06:01.241549 (+ 82us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:01.008376 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:01.008505 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:01.008511 (+ 6us) write_op.cc:435] Acquired schema lock
0927 15:06:01.008515 (+ 4us) tablet.cc:660] Decoding operations
0927 15:06:01.008639 (+ 124us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:01.008651 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:01.008658 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:01.008748 (+ 90us) tablet.cc:699] Row locks acquired
0927 15:06:01.008752 (+ 4us) write_op.cc:260] PREPARE: finished
0927 15:06:01.008786 (+ 34us) write_op.cc:270] Start()
0927 15:06:01.008820 (+ 34us) write_op.cc:276] Timestamp: P: 1790521561008755 usec, L: 0
0927 15:06:01.008825 (+ 5us) op_driver.cc:331] REPLICATION: starting
0927 15:06:01.009000 (+ 175us) log.cc:842] Serialized 433 byte log entry
0927 15:06:01.237122 (+228122us) op_driver.cc:444] REPLICATION: finished
0927 15:06:01.239036 (+ 1914us) write_op.cc:301] APPLY: starting
0927 15:06:01.239050 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:01.239103 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:01.239132 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:01.239240 (+ 108us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:01.239276 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 15:06:01.239286 (+ 10us) write_op.cc:312] APPLY: finished
0927 15:06:01.239350 (+ 64us) log.cc:842] Serialized 29 byte log entry
0927 15:06:01.239396 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:01.239412 (+ 16us) write_op.cc:454] Released schema lock
0927 15:06:01.239420 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:01.239475 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:01.239480 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":336549248,"child_traces":[["op",{"apply.queue_time_us":1880,"apply.run_cpu_time_us":489,"apply.run_wall_time_us":487,"num_ops":2,"prepare.queue_time_us":927,"prepare.run_cpu_time_us":763,"prepare.run_wall_time_us":2939,"raft.queue_time_us":34,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":228281}]]}
I20260927 15:06:01.246245 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 31701139f10f4478af43bd153aa3a2dc (table default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]) successfully deleted
I20260927 15:06:01.246902 1556 tablet_bootstrap.cc:492] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:01.247033 1556 ts_tablet_manager.cc:1397] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260927 15:06:01.247877 1556 raft_consensus.cc:348] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.248123 1556 raft_consensus.cc:374] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.248210 1556 raft_consensus.cc:729] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.248476 1556 consensus_queue.cc:260] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.248651 1552 tablet_bootstrap.cc:492] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:01.249029 1552 ts_tablet_manager.cc:1397] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.001s
I20260927 15:06:01.249918 1552 raft_consensus.cc:348] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.250104 1556 ts_tablet_manager.cc:1428] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:01.250411 1556 tablet_bootstrap.cc:492] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:01.250377 1552 raft_consensus.cc:374] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.250473 1552 raft_consensus.cc:729] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.251557 1552 consensus_queue.cc:260] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.252094 1556 tablet_bootstrap.cc:654] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.252251 1552 ts_tablet_manager.cc:1428] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:01.253872 1552 tablet_bootstrap.cc:492] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:01.256546 1758 raft_consensus.cc:482] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.256718 1758 raft_consensus.cc:504] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.257345 1758 leader_election.cc:288] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:01.258337 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcffb8cedd74b18871988201f9db2e5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:01.258447 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcffb8cedd74b18871988201f9db2e5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:01.258615 1164 raft_consensus.cc:2454] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:01.259106 1374 leader_election.cc:302] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:01.259382 1758 raft_consensus.cc:2781] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:01.259476 1758 raft_consensus.cc:482] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:01.259606 1758 raft_consensus.cc:3037] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:01.262436 1758 raft_consensus.cc:504] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:01.264097 1376 leader_election.cc:341] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.264999 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcffb8cedd74b18871988201f9db2e5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:01.265457 1376 leader_election.cc:341] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.266381 1758 leader_election.cc:288] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:01.268157 1552 tablet_bootstrap.cc:654] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.271986 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bbe3afdc10dd47498be6f21a36311b58" } new_table_name: "default.Table_a04a6074db084291834a75d52898cf4b" modify_external_catalogs: true
I20260927 15:06:01.275283 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dc82ae0788b94be68a26ad903bf087fb" } modify_external_catalogs: true
I20260927 15:06:01.275506 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dc82ae0788b94be68a26ad903bf087fb" } modify_external_catalogs: true
I20260927 15:06:01.277333 1758 consensus_queue.cc:1035] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:01.277596 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0f7df44cf73c428799fa262825170d1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.278600 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f7df44cf73c428799fa262825170d1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.280539 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e54284c6f69f46a58add5dfc7c9bec4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.281224 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e54284c6f69f46a58add5dfc7c9bec4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.282589 1552 tablet_bootstrap.cc:492] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:01.282753 1552 ts_tablet_manager.cc:1397] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.002s
I20260927 15:06:01.283665 1552 raft_consensus.cc:348] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.283946 1552 raft_consensus.cc:374] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.284044 1552 raft_consensus.cc:729] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.284307 1552 consensus_queue.cc:260] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.287168 1706 raft_consensus.cc:482] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.287329 1706 raft_consensus.cc:504] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:01.290231 1239 leader_election.cc:341] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 7a42ae7589c24b1bbd833ab8838521ae
I20260927 15:06:01.290970 1706 leader_election.cc:288] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.291678 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcffb8cedd74b18871988201f9db2e5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:01.291926 1164 raft_consensus.cc:3037] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:01.295867 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a42ae7589c24b1bbd833ab8838521ae" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:01.296097 1439 raft_consensus.cc:2454] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:01.296506 1238 leader_election.cc:302] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:01.296900 1706 raft_consensus.cc:2781] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:01.297004 1706 raft_consensus.cc:482] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:01.297092 1706 raft_consensus.cc:3037] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:01.297542 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2afab8bf87bc45c899bcd5dfdad48d26 consensus state has no leader
I20260927 15:06:01.298482 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e18064a8c28446469b9ea854acda2a65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.299201 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e18064a8c28446469b9ea854acda2a65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.299944 1706 raft_consensus.cc:504] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.300247 1556 tablet_bootstrap.cc:492] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:01.300407 1556 ts_tablet_manager.cc:1397] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.004s
I20260927 15:06:01.301142 1556 raft_consensus.cc:348] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:01.301318 1239 leader_election.cc:341] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 7a42ae7589c24b1bbd833ab8838521ae
I20260927 15:06:01.301407 1556 raft_consensus.cc:374] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.301493 1556 raft_consensus.cc:729] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.302625 1164 raft_consensus.cc:2454] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:01.303620 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a42ae7589c24b1bbd833ab8838521ae" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:01.303803 1439 raft_consensus.cc:3037] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:01.303755 1556 consensus_queue.cc:260] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.304838 908 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874]). Expected version 3 got 0
I20260927 15:06:01.305859 1758 raft_consensus.cc:482] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.306013 1758 raft_consensus.cc:504] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.306260 1439 raft_consensus.cc:2454] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:01.306627 1758 leader_election.cc:288] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:01.306777 1238 leader_election.cc:302] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:01.307206 1706 leader_election.cc:288] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.307425 1809 raft_consensus.cc:2781] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:01.307602 1809 raft_consensus.cc:686] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:01.307863 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377847d06b534883ba2b870ca3317fe0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:01.307904 1809 consensus_queue.cc:237] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.308125 1164 raft_consensus.cc:2454] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:01.308187 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c49c70e003f47d6a325669376e5e3ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.308480 1805 tablet_replica.cc:330] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:01.308684 1805 raft_consensus.cc:2229] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.308820 1805 raft_consensus.cc:2258] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.309301 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377847d06b534883ba2b870ca3317fe0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:01.309342 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet b122f1436fde4c5da7f0afa3a1c24c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.309583 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet e94dd938cf50495c99b5dce808ae7100 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.309779 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet e188f28304604cf2a96a606811900ca5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:01.309809 1376 leader_election.cc:341] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.309981 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet e0db1654ced542938487126a0a09ed74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.310073 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7a8bf15c48423ea9ff14c46645a33b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.310139 1805 ts_tablet_manager.cc:1905] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.327852 1561 tablet_bootstrap.cc:492] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:01.314373 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_15947e024eaa42709496e8851bd7c768" } new_table_name: "default.Table_5a81a62189ec499e91de04c9b60d73b5" modify_external_catalogs: true
I20260927 15:06:01.359273 1688 fs_manager.cc:709] Time spent opening directory manager: real 0.031s user 0.005s sys 0.000s
I20260927 15:06:01.339877 912 catalog_manager.cc:5495] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:01.439692 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874]). Expected version 3 got 0
I20260927 15:06:01.345624 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_40a2f0de5a5944319df4d4b69013208d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.441074 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40a2f0de5a5944319df4d4b69013208d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.355489 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6cc8bd2079f84da39e13113e6699bf5e
I20260927 15:06:01.442129 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cfdacdd524ba40369d8d01a7eb20da74" } new_table_name: "default.Table_862695dd435f415a9be8f6394105e76a" modify_external_catalogs: true
I20260927 15:06:01.355763 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 65c313ab6848428d8237557392669f6f
I20260927 15:06:01.357177 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7052ab085a334588b13fab6355c981dd" } new_table_name: "default.Table_1363eb0bffb8454a9bfbc067762dad9c" modify_external_catalogs: true
I20260927 15:06:01.310201 1374 leader_election.cc:302] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:01.443591 914 catalog_manager.cc:6565] ReplaceTablet: tablet 65c313ab6848428d8237557392669f6f deleted and replaced by tablet 568ba79ea795403cba76fb6632efd7e2
I20260927 15:06:01.443727 914 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:49800 (request call id 331) took 1239 ms. Trace:
W20260927 15:06:01.443683 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 133499us
I20260927 15:06:01.444060 1374 leader_election.cc:302] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:01.361860 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ce566cc49cfe4483b942d2eaa8269acc
I20260927 15:06:01.444310 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cc8bd2079f84da39e13113e6699bf5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.443852 914 rpcz_store.cc:276] 0927 15:06:00.204039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:00.749077 (+545038us) service_pool.cc:227] Handling call
0927 15:06:00.995827 (+246750us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00007f2c3731827d 00007f2c37318373 00007f2c3413a361 00007f2c3baad66a 00007f2c3bc41527 00007f2c32f33da7 00007f2c32f33ad5 00007f2c2f7379be 00007f2c2f73679e 00007f2c2f73cb25 00007f2c2f73d54f
0927 15:06:01.443668 (+447841us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:01.315153 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:01.315319 (+ 166us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:01.315329 (+ 10us) write_op.cc:435] Acquired schema lock
0927 15:06:01.315334 (+ 5us) tablet.cc:660] Decoding operations
0927 15:06:01.315496 (+ 162us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:01.315512 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:01.315520 (+ 8us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:01.315632 (+ 112us) tablet.cc:699] Row locks acquired
0927 15:06:01.315637 (+ 5us) write_op.cc:260] PREPARE: finished
0927 15:06:01.315678 (+ 41us) write_op.cc:270] Start()
0927 15:06:01.315723 (+ 45us) write_op.cc:276] Timestamp: P: 1790521561315658 usec, L: 0
0927 15:06:01.315730 (+ 7us) op_driver.cc:331] REPLICATION: starting
0927 15:06:01.315964 (+ 234us) log.cc:842] Serialized 622 byte log entry
0927 15:06:01.349151 (+ 33187us) op_driver.cc:444] REPLICATION: finished
0927 15:06:01.350734 (+ 1583us) write_op.cc:301] APPLY: starting
0927 15:06:01.350744 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:01.350777 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:01.350806 (+ 29us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:01.350945 (+ 139us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:01.351013 (+ 68us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 15:06:01.351021 (+ 8us) write_op.cc:312] APPLY: finished
0927 15:06:01.351086 (+ 65us) log.cc:842] Serialized 29 byte log entry
0927 15:06:01.351140 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:01.351154 (+ 14us) write_op.cc:454] Released schema lock
0927 15:06:01.351160 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:01.351210 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:01.351214 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":566534400,"child_traces":[["op",{"apply.queue_time_us":1555,"apply.run_cpu_time_us":519,"apply.run_wall_time_us":520,"num_ops":2,"prepare.queue_time_us":11837,"prepare.run_cpu_time_us":940,"prepare.run_wall_time_us":1390,"raft.queue_time_us":1507,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":33406}]]}
I20260927 15:06:01.444432 1758 raft_consensus.cc:2781] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:01.310731 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 30cf4db249154adda9406d5b07430a80 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e6e3600cbf741419bc7b93eec42eb13) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.311203 1552 ts_tablet_manager.cc:1428] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260927 15:06:01.444761 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_868afe47a2504c16883e32967e707061"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:01.445114 1552 tablet_bootstrap.cc:492] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:01.445297 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_868afe47a2504c16883e32967e707061 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.445329 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c313ab6848428d8237557392669f6f with delete_type TABLET_DATA_DELETED (replaced by tablet 568ba79ea795403cba76fb6632efd7e2) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.310866 1556 ts_tablet_manager.cc:1428] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260927 15:06:01.446285 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet ce566cc49cfe4483b942d2eaa8269acc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.446595 1556 tablet_bootstrap.cc:492] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:01.332784 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 (DEFAULT_TABLE table=default.Table_c6d23c73ae904261ac5ed42420c0eaab [id=0fa527ae49b1486f955fef21e0b35e7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.446895 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet ce566cc49cfe4483b942d2eaa8269acc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.447000 1552 tablet_bootstrap.cc:654] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.447239 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 033e71f60c3e47fd9647db090d4d6cd5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:01.447571 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6cc8bd2079f84da39e13113e6699bf5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cc8bd2079f84da39e13113e6699bf5e already in progress: creating tablet
W20260927 15:06:01.447810 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 65c313ab6848428d8237557392669f6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65c313ab6848428d8237557392669f6f already in progress: creating tablet
I20260927 15:06:01.314944 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 31701139f10f4478af43bd153aa3a2dc with delete_type TABLET_DATA_DELETED (replaced by tablet 6b1f2143af1142eb9f3dbc777299c186) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.320349 1805 ts_tablet_manager.cc:1918] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.448015 1805 log.cc:1196] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/1c49c70e003f47d6a325669376e5e3ca
I20260927 15:06:01.335296 1406 tablet_service.cc:1467] Processing CreateTablet for tablet ce566cc49cfe4483b942d2eaa8269acc (DEFAULT_TABLE table=default.Table_3d65f616a187485eaa9298155971a648 [id=5c5e1b2501064bd5a6df36c4dddda94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.448366 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce566cc49cfe4483b942d2eaa8269acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.448419 1805 ts_tablet_manager.cc:1939] T 1c49c70e003f47d6a325669376e5e3ca P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:01.448877 1805 tablet_replica.cc:330] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:01.449100 1805 raft_consensus.cc:2229] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.449301 1805 raft_consensus.cc:2258] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.449816 1805 ts_tablet_manager.cc:1905] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.450162 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cc8bd2079f84da39e13113e6699bf5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.338377 1419 tablet_service.cc:1467] Processing CreateTablet for tablet fd8a53f3c95c4cb7bce21d23f79af28c (DEFAULT_TABLE table=default.Table_c62bcaf11f0645449faf533a55f5d15f [id=a51d9c4b701c4c639d904aef0ac3a2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.338744 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 4b9e88c3679d412cac7603f200cf899b (DEFAULT_TABLE table=default.Table_1a0416550bbc4a05bc617171ed8c1504 [id=286509b6ce63492cbdc1ddea9374115c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.339143 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 2c4a123886a847d08b2a94ff5e4e01ca (DEFAULT_TABLE table=default.Table_cfdacdd524ba40369d8d01a7eb20da74 [id=3415aea6aba444339a381ccdde11e18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.328033 1561 ts_tablet_manager.cc:1397] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.090s user 0.009s sys 0.021s
I20260927 15:06:01.452183 1561 raft_consensus.cc:348] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.452415 1561 raft_consensus.cc:374] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.339200 1415 tablet_service.cc:1467] Processing CreateTablet for tablet b3cc37a97bc145bdaa654bcc193fe93b (DEFAULT_TABLE table=default.Table_2597f21341574a599cce741248f402e9 [id=fad65497755c45c0b8ba4c338f3712c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.452526 1561 raft_consensus.cc:729] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.341540 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 610ff6563dc64e73b2b4d7c268468b21 (DEFAULT_TABLE table=default.Table_18591fe82c804016b1f5794d997374d5 [id=eb505f5ebaa2482182e05e9b000f35b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.365265 1827 raft_consensus.cc:482] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.452875 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd8a53f3c95c4cb7bce21d23f79af28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.452745 1561 consensus_queue.cc:260] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.452705 1827 raft_consensus.cc:504] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.453212 1561 ts_tablet_manager.cc:1428] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:01.333307 1809 raft_consensus.cc:482] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.453395 1827 leader_election.cc:288] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:01.453410 1809 raft_consensus.cc:504] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.453548 1561 tablet_bootstrap.cc:492] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:01.453600 1827 raft_consensus.cc:2781] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:01.453750 1827 raft_consensus.cc:482] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:01.453850 1827 raft_consensus.cc:3037] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:01.454093 1809 leader_election.cc:288] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.328850 1562 ts_tablet_manager.cc:1905] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.455161 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c4a123886a847d08b2a94ff5e4e01ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.456708 1827 raft_consensus.cc:504] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.457223 1827 leader_election.cc:288] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:01.449119 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c313ab6848428d8237557392669f6f with delete_type TABLET_DATA_DELETED (replaced by tablet 568ba79ea795403cba76fb6632efd7e2) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.458472 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d6d1cfb1a4d4c439e970d966af841b6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:01.340799 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 (DEFAULT_TABLE table=default.Table_c6d23c73ae904261ac5ed42420c0eaab [id=0fa527ae49b1486f955fef21e0b35e7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.458886 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377847d06b534883ba2b870ca3317fe0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:01.459045 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 610ff6563dc64e73b2b4d7c268468b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.459270 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 033e71f60c3e47fd9647db090d4d6cd5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:01.459560 1239 leader_election.cc:341] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: e0db1654ced542938487126a0a09ed74
I20260927 15:06:01.462993 1805 ts_tablet_manager.cc:1918] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.463135 1805 log.cc:1196] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/b122f1436fde4c5da7f0afa3a1c24c70
I20260927 15:06:01.463534 1805 ts_tablet_manager.cc:1939] T b122f1436fde4c5da7f0afa3a1c24c70 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:01.333125 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 (DEFAULT_TABLE table=default.Table_c6d23c73ae904261ac5ed42420c0eaab [id=0fa527ae49b1486f955fef21e0b35e7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.464023 1805 tablet_replica.cc:330] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:01.464052 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 033e71f60c3e47fd9647db090d4d6cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.464294 1805 raft_consensus.cc:2229] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.464497 1805 raft_consensus.cc:2258] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.465137 1805 ts_tablet_manager.cc:1905] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.465880 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_27a7140bf7c847d8acb10f2ac4c04bcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.466539 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27a7140bf7c847d8acb10f2ac4c04bcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.341589 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 610ff6563dc64e73b2b4d7c268468b21 (DEFAULT_TABLE table=default.Table_18591fe82c804016b1f5794d997374d5 [id=eb505f5ebaa2482182e05e9b000f35b9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:01.467135 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ce566cc49cfe4483b942d2eaa8269acc because the tablet was not found. No further retry: Not found: Tablet not found: ce566cc49cfe4483b942d2eaa8269acc
I20260927 15:06:01.467217 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 610ff6563dc64e73b2b4d7c268468b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.333530 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 610ff6563dc64e73b2b4d7c268468b21 (DEFAULT_TABLE table=default.Table_18591fe82c804016b1f5794d997374d5 [id=eb505f5ebaa2482182e05e9b000f35b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.471055 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 610ff6563dc64e73b2b4d7c268468b21. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:01.463040 1376 leader_election.cc:341] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.471133 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b9e88c3679d412cac7603f200cf899b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.471287 1852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260927 15:06:01.471712 1376 leader_election.cc:341] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.471869 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3cc37a97bc145bdaa654bcc193fe93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.336382 1131 tablet_service.cc:1467] Processing CreateTablet for tablet ce566cc49cfe4483b942d2eaa8269acc (DEFAULT_TABLE table=default.Table_3d65f616a187485eaa9298155971a648 [id=5c5e1b2501064bd5a6df36c4dddda94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.336747 1137 tablet_service.cc:1467] Processing CreateTablet for tablet fd8a53f3c95c4cb7bce21d23f79af28c (DEFAULT_TABLE table=default.Table_c62bcaf11f0645449faf533a55f5d15f [id=a51d9c4b701c4c639d904aef0ac3a2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.337064 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 4b9e88c3679d412cac7603f200cf899b (DEFAULT_TABLE table=default.Table_1a0416550bbc4a05bc617171ed8c1504 [id=286509b6ce63492cbdc1ddea9374115c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.339821 1142 tablet_service.cc:1467] Processing CreateTablet for tablet b3cc37a97bc145bdaa654bcc193fe93b (DEFAULT_TABLE table=default.Table_2597f21341574a599cce741248f402e9 [id=fad65497755c45c0b8ba4c338f3712c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.339915 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 2c4a123886a847d08b2a94ff5e4e01ca (DEFAULT_TABLE table=default.Table_cfdacdd524ba40369d8d01a7eb20da74 [id=3415aea6aba444339a381ccdde11e18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.346989 1811 consensus_queue.cc:1035] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:01.475322 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce566cc49cfe4483b942d2eaa8269acc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:01.408844 1099 consensus_peers.cc:487] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31701139f10f4478af43bd153aa3a2dc. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:01.475584 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 66770.9us
I20260927 15:06:01.342085 1277 tablet_service.cc:1467] Processing CreateTablet for tablet ce566cc49cfe4483b942d2eaa8269acc (DEFAULT_TABLE table=default.Table_3d65f616a187485eaa9298155971a648 [id=5c5e1b2501064bd5a6df36c4dddda94a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.478993 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3cc37a97bc145bdaa654bcc193fe93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.479276 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce566cc49cfe4483b942d2eaa8269acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.345146 1279 tablet_service.cc:1467] Processing CreateTablet for tablet fd8a53f3c95c4cb7bce21d23f79af28c (DEFAULT_TABLE table=default.Table_c62bcaf11f0645449faf533a55f5d15f [id=a51d9c4b701c4c639d904aef0ac3a2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.483146 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd8a53f3c95c4cb7bce21d23f79af28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.483261 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet ce566cc49cfe4483b942d2eaa8269acc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.483542 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cc8bd2079f84da39e13113e6699bf5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.351030 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 4b9e88c3679d412cac7603f200cf899b (DEFAULT_TABLE table=default.Table_1a0416550bbc4a05bc617171ed8c1504 [id=286509b6ce63492cbdc1ddea9374115c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.484345 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b9e88c3679d412cac7603f200cf899b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.485318 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 1c49c70e003f47d6a325669376e5e3ca (table default.Table_2481967ffd2f4c30bfb57bdf8d5940e0 [id=ed09d325f0bd478fa0ed6172c15299ec]) successfully deleted
I20260927 15:06:01.485646 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet b122f1436fde4c5da7f0afa3a1c24c70 (table default.Table_0cf38c5a77d943628b2d20226904801d [id=df10d723c97d47dd82747afd6899372d]) successfully deleted
I20260927 15:06:01.485649 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c313ab6848428d8237557392669f6f with delete_type TABLET_DATA_DELETED (replaced by tablet 568ba79ea795403cba76fb6632efd7e2) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.351603 1280 tablet_service.cc:1467] Processing CreateTablet for tablet b3cc37a97bc145bdaa654bcc193fe93b (DEFAULT_TABLE table=default.Table_2597f21341574a599cce741248f402e9 [id=fad65497755c45c0b8ba4c338f3712c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.486037 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3cc37a97bc145bdaa654bcc193fe93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.352052 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 2c4a123886a847d08b2a94ff5e4e01ca (DEFAULT_TABLE table=default.Table_cfdacdd524ba40369d8d01a7eb20da74 [id=3415aea6aba444339a381ccdde11e18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.487210 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c4a123886a847d08b2a94ff5e4e01ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.488099 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c4a123886a847d08b2a94ff5e4e01ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:01.489540 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c264c532db8249e5abe1dbef8ee8ffa0 consensus state has no leader
I20260927 15:06:01.491004 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b9e88c3679d412cac7603f200cf899b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.492844 905 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874]). Expected version 3 got 0
I20260927 15:06:01.494182 1561 tablet_bootstrap.cc:654] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.423106 1706 raft_consensus.cc:482] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.494976 1706 raft_consensus.cc:504] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.495667 1706 leader_election.cc:288] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.495890 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd8a53f3c95c4cb7bce21d23f79af28c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:01.496543 1239 leader_election.cc:341] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 714b110a24ca4f3bb8126034dc3e6407
I20260927 15:06:01.499696 1562 ts_tablet_manager.cc:1918] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:01.499850 1562 log.cc:1196] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/8f15485b8825436184abe2621c71e356
I20260927 15:06:01.500435 1562 ts_tablet_manager.cc:1939] T 8f15485b8825436184abe2621c71e356 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:01.501516 1562 tablet_replica.cc:330] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:01.501719 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 8f15485b8825436184abe2621c71e356 (table default.Table_a0201a60665941a48eabe2de029dcfa4 [id=c2f5f4026b514c7e978c0b30f7a359ec]) successfully deleted
I20260927 15:06:01.502996 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet ce3b706ed2734db782efdb47cf3fda95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.503254 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a42ae7589c24b1bbd833ab8838521ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.503777 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 714b110a24ca4f3bb8126034dc3e6407 with delete_type TABLET_DATA_DELETED (replaced by tablet bc971defe6d148439a6a0b8c55d9092e) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.501796 1562 raft_consensus.cc:2229] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:01.505297 1562 pending_rounds.cc:62] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:01.505523 1562 pending_rounds.cc:68] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976313205649408 op_type: NO_OP noop_request { }
I20260927 15:06:01.506412 1561 tablet_bootstrap.cc:492] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:01.506596 1561 ts_tablet_manager.cc:1397] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.000s
I20260927 15:06:01.508057 1561 raft_consensus.cc:348] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.508360 1561 raft_consensus.cc:374] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.508447 1561 raft_consensus.cc:729] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.508673 1688 fs_manager.cc:725] Time spent opening block manager: real 0.067s user 0.004s sys 0.000s
I20260927 15:06:01.508858 1561 consensus_queue.cc:260] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.508869 1688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data,/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
uuid: "dbf522d70373412b87815d33c0f1f745"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:06:01.510964 1688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:06:01.511261 1561 ts_tablet_manager.cc:1428] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:01.511586 1561 tablet_bootstrap.cc:492] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:01.512404 1562 raft_consensus.cc:2866] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:01.512626 1562 raft_consensus.cc:2258] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.516374 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2597f21341574a599cce741248f402e9" } modify_external_catalogs: true
I20260927 15:06:01.516425 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_875cbc00c31e4798bf3ed5bf3135b0a7" } modify_external_catalogs: true
I20260927 15:06:01.516641 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2597f21341574a599cce741248f402e9" } modify_external_catalogs: true
I20260927 15:06:01.516644 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_875cbc00c31e4798bf3ed5bf3135b0a7" } modify_external_catalogs: true
I20260927 15:06:01.517678 1556 tablet_bootstrap.cc:654] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.516896 1758 raft_consensus.cc:686] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
W20260927 15:06:01.524031 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c4a123886a847d08b2a94ff5e4e01ca consensus state has no leader
W20260927 15:06:01.525483 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2afab8bf87bc45c899bcd5dfdad48d26 (table default.Table_a04a6074db084291834a75d52898cf4b [id=15103ee5ddc04d809af8930de02a7d24], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2afab8bf87bc45c899bcd5dfdad48d26 consensus state has no leader
I20260927 15:06:01.525635 911 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874]). Expected version 3 got 0
I20260927 15:06:01.526424 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 0df4a23269244191bf1dcd69cb34d371 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:01.528146 1238 leader_election.cc:341] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: e0db1654ced542938487126a0a09ed74
I20260927 15:06:01.528980 1238 leader_election.cc:302] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:01.529456 1238 leader_election.cc:341] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 714b110a24ca4f3bb8126034dc3e6407
I20260927 15:06:01.529587 1238 leader_election.cc:302] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:01.529228 1758 consensus_queue.cc:237] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.529824 1809 raft_consensus.cc:2726] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:01.536108 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04007cd4bd214b88a4664e23daf4b790 consensus state has no leader
I20260927 15:06:01.536376 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d1f23f91bce4df480dd9991659f2e81 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:01.536973 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_294f26f04be64c4f8564c20e515fabb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.537544 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_294f26f04be64c4f8564c20e515fabb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.538322 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_23a85033692d4048be1c35c35572a83a" } new_table_name: "default.Table_a56d879e7b0840c5a012eb740af3d016" modify_external_catalogs: true
I20260927 15:06:01.542331 1706 raft_consensus.cc:2726] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.542574 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_702f8a99c52f4aa197c9a40e3cc7dfa4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.543152 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_702f8a99c52f4aa197c9a40e3cc7dfa4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.543779 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0f11b40830cd4696a3e43054e33ed454"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.544314 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f11b40830cd4696a3e43054e33ed454 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.558561 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b3cc37a97bc145bdaa654bcc193fe93b
I20260927 15:06:01.559127 1552 tablet_bootstrap.cc:492] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:01.559306 1552 ts_tablet_manager.cc:1397] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.114s user 0.001s sys 0.021s
I20260927 15:06:01.559333 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7c7824484c624468a8ccbd47f7ea4ca8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:01.559659 1805 ts_tablet_manager.cc:1918] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.559791 1805 log.cc:1196] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/e94dd938cf50495c99b5dce808ae7100
W20260927 15:06:01.559981 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c7824484c624468a8ccbd47f7ea4ca8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.560173 1805 ts_tablet_manager.cc:1939] T e94dd938cf50495c99b5dce808ae7100 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:01.560222 1552 raft_consensus.cc:348] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.560545 1552 raft_consensus.cc:374] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.560635 1552 raft_consensus.cc:729] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.560947 1552 consensus_queue.cc:260] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.561200 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet e94dd938cf50495c99b5dce808ae7100 (table default.Table_63d3ae8aa61f4fcd80a58e28f2104a21 [id=ef9cdb183bd444e6baac3c583dfb631d]) successfully deleted
I20260927 15:06:01.561406 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet b3cc37a97bc145bdaa654bcc193fe93b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.561684 1805 tablet_replica.cc:330] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:01.561930 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet b3cc37a97bc145bdaa654bcc193fe93b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.562211 1805 raft_consensus.cc:2229] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.563391 1552 ts_tablet_manager.cc:1428] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260927 15:06:01.564966 1552 tablet_bootstrap.cc:492] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:01.566716 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet b3cc37a97bc145bdaa654bcc193fe93b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:01.566741 1102 consensus_peers.cc:487] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:01.567755 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 434e9390f1fd4a3ebb65924c37b85bd4 consensus state has no leader
I20260927 15:06:01.563545 1805 raft_consensus.cc:2258] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.568532 1805 ts_tablet_manager.cc:1905] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.568568 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 8790d59beb804acb8e4353f862d7f6f8 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:01.569640 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 6cf0ef42c0944b049a8ce68531ed8e45 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:01.569746 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8f5fefa8a52c4f66b05c89b0c5017c38" } new_table_name: "default.Table_36ee5821ff0c4c76b28ba32d1fa76b25" modify_external_catalogs: true
I20260927 15:06:01.570261 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_755d73e8fa1340cf82c0c60ecc9fc5b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.570789 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_755d73e8fa1340cf82c0c60ecc9fc5b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.573769 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 148c77a0e88b40f690ca96f091b78d9a with delete_type TABLET_DATA_DELETED (replaced by tablet f88b401dc12e451c80abe1b509e2b532) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:01.574448 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b3cc37a97bc145bdaa654bcc193fe93b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3cc37a97bc145bdaa654bcc193fe93b already in progress: creating tablet
I20260927 15:06:01.576589 1562 ts_tablet_manager.cc:1905] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:01.579011 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 134954us
I20260927 15:06:01.579645 1706 raft_consensus.cc:482] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.579797 1706 raft_consensus.cc:504] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.579910 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d6d1cfb1a4d4c439e970d966af841b6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:01.580470 1706 leader_election.cc:288] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:01.581260 1239 leader_election.cc:341] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 30cf4db249154adda9406d5b07430a80
W20260927 15:06:01.581614 1238 leader_election.cc:341] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 30cf4db249154adda9406d5b07430a80
I20260927 15:06:01.581753 1238 leader_election.cc:302] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:01.582090 1706 raft_consensus.cc:2726] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.582588 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3450181a5d9d4059b161a9cfcc6cb882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.583823 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3450181a5d9d4059b161a9cfcc6cb882 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.583741 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.584198 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:01.586637 1374 leader_election.cc:341] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.586777 1374 leader_election.cc:302] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:01.586795 1706 raft_consensus.cc:482] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.586962 1706 raft_consensus.cc:504] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.587594 1706 leader_election.cc:288] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.588268 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377847d06b534883ba2b870ca3317fe0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:01.588481 1165 raft_consensus.cc:3037] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:01.589296 1552 tablet_bootstrap.cc:654] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:01.589618 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80a8563c77484a1ebbbe7dab9a652aeb consensus state has no leader
W20260927 15:06:01.591845 1238 leader_election.cc:341] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ce3b706ed2734db782efdb47cf3fda95
W20260927 15:06:01.592759 1239 leader_election.cc:341] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: ce3b706ed2734db782efdb47cf3fda95
I20260927 15:06:01.592864 1239 leader_election.cc:302] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:01.592994 907 catalog_manager.cc:5495] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:01.593466 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 34822e9f900f4d04b59b810d59e6aa49 (table default.Table_875cbc00c31e4798bf3ed5bf3135b0a7 [id=5c4f0f47acd14538b67f8c8d579b0696]). Expected version 2 got 0
I20260927 15:06:01.593647 1827 raft_consensus.cc:2726] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.593755 1805 ts_tablet_manager.cc:1918] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.593887 1805 log.cc:1196] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/e188f28304604cf2a96a606811900ca5
I20260927 15:06:01.594281 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3a8d33202ebc4e37b598d62d66472f31
I20260927 15:06:01.594561 1805 ts_tablet_manager.cc:1939] T e188f28304604cf2a96a606811900ca5 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:01.594739 913 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49800 (request call id 341) took 1147 ms. Trace:
I20260927 15:06:01.595131 1165 raft_consensus.cc:2454] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:01.594893 913 rpcz_store.cc:276] 0927 15:06:00.447113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.237667 (+790554us) service_pool.cc:227] Handling call
0927 15:06:01.275173 (+ 37506us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00007f2c3731827d 00007f2c37318373 00007f2c3413a361 00007f2c3baad66a 00007f2c3bc362e6 00007f2c32f29126 00007f2c32f28e55 00007f2c2f7379be 00007f2c2f73679e 00007f2c2f73cb25 00007f2c2f73d54f
0927 15:06:01.275645 (+ 472us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0927 15:06:01.275816 (+ 171us) catalog_manager.cc:2752] Modifying in-memory table state
0927 15:06:01.275892 (+ 76us) catalog_manager.cc:2761] Locking tablets
0927 15:06:01.491791 (+215899us) catalog_manager.cc:2775] Removing table and tablets from system table
0927 15:06:01.550406 (+ 58615us) catalog_manager.cc:2793] Removing table from by-name map
0927 15:06:01.550504 (+ 98us) catalog_manager.cc:2809] Committing in-memory state
0927 15:06:01.594209 (+ 43705us) catalog_manager.cc:2813] Aborting table tasks
0927 15:06:01.594702 (+ 493us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:01.544413 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:01.544512 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:01.544518 (+ 6us) write_op.cc:435] Acquired schema lock
0927 15:06:01.544522 (+ 4us) tablet.cc:660] Decoding operations
0927 15:06:01.544621 (+ 99us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:01.544631 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:01.544636 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:01.544744 (+ 108us) tablet.cc:699] Row locks acquired
0927 15:06:01.544748 (+ 4us) write_op.cc:260] PREPARE: finished
0927 15:06:01.544785 (+ 37us) write_op.cc:270] Start()
0927 15:06:01.544809 (+ 24us) write_op.cc:276] Timestamp: P: 1790521561544750 usec, L: 0
0927 15:06:01.544813 (+ 4us) op_driver.cc:331] REPLICATION: starting
0927 15:06:01.544939 (+ 126us) log.cc:842] Serialized 725 byte log entry
0927 15:06:01.549710 (+ 4771us) op_driver.cc:444] REPLICATION: finished
0927 15:06:01.549940 (+ 230us) write_op.cc:301] APPLY: starting
0927 15:06:01.549955 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:01.549990 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:01.550032 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:01.550096 (+ 64us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:01.550126 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 15:06:01.550133 (+ 7us) write_op.cc:312] APPLY: finished
0927 15:06:01.550192 (+ 59us) log.cc:842] Serialized 29 byte log entry
0927 15:06:01.550234 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:01.550248 (+ 14us) write_op.cc:454] Released schema lock
0927 15:06:01.550254 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:01.550304 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:01.550309 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":85575552,"child_traces":[["op",{"apply.queue_time_us":190,"apply.run_cpu_time_us":413,"apply.run_wall_time_us":413,"num_ops":2,"prepare.queue_time_us":51960,"prepare.run_cpu_time_us":626,"prepare.run_wall_time_us":2223,"raft.queue_time_us":35,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":4877}]]}
I20260927 15:06:01.596350 1805 tablet_replica.cc:330] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:01.596588 1805 raft_consensus.cc:2229] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.596778 1805 raft_consensus.cc:2258] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.597023 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d33202ebc4e37b598d62d66472f31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.597325 1805 ts_tablet_manager.cc:1905] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.597769 1827 consensus_queue.cc:1035] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:01.598453 1374 leader_election.cc:302] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:01.598897 1827 raft_consensus.cc:2781] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:01.599027 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d33202ebc4e37b598d62d66472f31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.599181 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d33202ebc4e37b598d62d66472f31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.599315 1559 tablet_replica.cc:330] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.599421 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet e188f28304604cf2a96a606811900ca5 (table default.Table_16724ccc8d1c4311a5e47f148a6148d3 [id=88ccf418a4e24b07830f6fdabe341176]) successfully deleted
I20260927 15:06:01.599526 1559 raft_consensus.cc:2229] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.599812 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d41d55fdb504b95921f46e7aed99ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.599993 1706 raft_consensus.cc:2726] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.600039 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.600256 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a42ae7589c24b1bbd833ab8838521ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.600898 1559 raft_consensus.cc:2258] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.601454 1559 ts_tablet_manager.cc:1905] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.603372 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 595c84453cd84c3bb5a4d444892bf5e6 (DEFAULT_TABLE table=default.Table_91bf12e088ba482ba6effe0407e05844 [id=06ca630052694f10aebe6f8b7aaa81d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.603770 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 595c84453cd84c3bb5a4d444892bf5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.608300 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 595c84453cd84c3bb5a4d444892bf5e6 (DEFAULT_TABLE table=default.Table_91bf12e088ba482ba6effe0407e05844 [id=06ca630052694f10aebe6f8b7aaa81d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.608742 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 595c84453cd84c3bb5a4d444892bf5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.613265 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7faf6e79db420db13999d74fe86062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.614631 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0df4a23269244191bf1dcd69cb34d371
I20260927 15:06:01.615031 1827 raft_consensus.cc:686] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:01.615114 911 catalog_manager.cc:6565] ReplaceTablet: tablet 0df4a23269244191bf1dcd69cb34d371 deleted and replaced by tablet 3042c17580d54082971b761433a7dca9
I20260927 15:06:01.615758 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df4a23269244191bf1dcd69cb34d371 with delete_type TABLET_DATA_DELETED (replaced by tablet 3042c17580d54082971b761433a7dca9) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.615525 1827 consensus_queue.cc:237] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.616204 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df4a23269244191bf1dcd69cb34d371 with delete_type TABLET_DATA_DELETED (replaced by tablet 3042c17580d54082971b761433a7dca9) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.617301 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 12623e6767aa4bd4934058f7314a966e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.617568 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df4a23269244191bf1dcd69cb34d371 with delete_type TABLET_DATA_DELETED (replaced by tablet 3042c17580d54082971b761433a7dca9) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.618358 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af844423fc94e2c8380db179103d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.619681 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 443af328e5154bdba9b570224616d77b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d454d65afa94aac9b34c253adfa4b0c) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.622892 1136 tablet_service.cc:1467] Processing CreateTablet for tablet cd76c49eda1c4b4ca0edf0f4d2790188 (DEFAULT_TABLE table=default.Table_05efeebbfcb44fd488866bede83f6a31 [id=697526af76a54d6597dee1ac56eca889]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.623023 1281 tablet_service.cc:1467] Processing CreateTablet for tablet a19c9cc5859f49a58a35460e504b3f84 (DEFAULT_TABLE table=default.Table_d824f1399fb8451dad058a93321740ce [id=7fc0363b53f4466f9e6320ea6750aec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.623384 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd76c49eda1c4b4ca0edf0f4d2790188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.623404 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19c9cc5859f49a58a35460e504b3f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.623603 1143 tablet_service.cc:1467] Processing CreateTablet for tablet a19c9cc5859f49a58a35460e504b3f84 (DEFAULT_TABLE table=default.Table_d824f1399fb8451dad058a93321740ce [id=7fc0363b53f4466f9e6320ea6750aec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.623973 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19c9cc5859f49a58a35460e504b3f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.625420 1808 tablet.cc:1722] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:01.633200 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 595c84453cd84c3bb5a4d444892bf5e6 (DEFAULT_TABLE table=default.Table_91bf12e088ba482ba6effe0407e05844 [id=06ca630052694f10aebe6f8b7aaa81d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.633687 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 595c84453cd84c3bb5a4d444892bf5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.634562 1276 tablet_service.cc:1467] Processing CreateTablet for tablet cd76c49eda1c4b4ca0edf0f4d2790188 (DEFAULT_TABLE table=default.Table_05efeebbfcb44fd488866bede83f6a31 [id=697526af76a54d6597dee1ac56eca889]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.635073 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd76c49eda1c4b4ca0edf0f4d2790188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.640061 1412 tablet_service.cc:1467] Processing CreateTablet for tablet cd76c49eda1c4b4ca0edf0f4d2790188 (DEFAULT_TABLE table=default.Table_05efeebbfcb44fd488866bede83f6a31 [id=697526af76a54d6597dee1ac56eca889]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.645609 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8790d59beb804acb8e4353f862d7f6f8
I20260927 15:06:01.646027 910 catalog_manager.cc:6565] ReplaceTablet: tablet 8790d59beb804acb8e4353f862d7f6f8 deleted and replaced by tablet fd5f2ab9677c4598b0b8d9a93a6a23c7
I20260927 15:06:01.647809 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 8790d59beb804acb8e4353f862d7f6f8 with delete_type TABLET_DATA_DELETED (replaced by tablet fd5f2ab9677c4598b0b8d9a93a6a23c7) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.648506 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 8790d59beb804acb8e4353f862d7f6f8 with delete_type TABLET_DATA_DELETED (replaced by tablet fd5f2ab9677c4598b0b8d9a93a6a23c7) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.650529 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd76c49eda1c4b4ca0edf0f4d2790188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.650817 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 278205071701447e8ee7457b2ee84be4 (DEFAULT_TABLE table=default.Table_0d6069947977462cae4376eb9ccfe2ad [id=550aebac3b894a95ae6482fd0b422a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.651283 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 278205071701447e8ee7457b2ee84be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.651330 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 278205071701447e8ee7457b2ee84be4 (DEFAULT_TABLE table=default.Table_0d6069947977462cae4376eb9ccfe2ad [id=550aebac3b894a95ae6482fd0b422a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.651723 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 278205071701447e8ee7457b2ee84be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.642302 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f15485b8825436184abe2621c71e356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.642799 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.644621 1403 tablet_service.cc:1467] Processing CreateTablet for tablet a19c9cc5859f49a58a35460e504b3f84 (DEFAULT_TABLE table=default.Table_d824f1399fb8451dad058a93321740ce [id=7fc0363b53f4466f9e6320ea6750aec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.655354 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19c9cc5859f49a58a35460e504b3f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.656203 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 34822e9f900f4d04b59b810d59e6aa49
I20260927 15:06:01.656338 911 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874] alter complete (version 3)
I20260927 15:06:01.648300 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 8790d59beb804acb8e4353f862d7f6f8 with delete_type TABLET_DATA_DELETED (replaced by tablet fd5f2ab9677c4598b0b8d9a93a6a23c7) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.658258 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 278205071701447e8ee7457b2ee84be4 (DEFAULT_TABLE table=default.Table_0d6069947977462cae4376eb9ccfe2ad [id=550aebac3b894a95ae6482fd0b422a8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.658746 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 278205071701447e8ee7457b2ee84be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.660320 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.660421 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f15485b8825436184abe2621c71e356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.660570 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet f2cce454e70640e2a67b3680676b1d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.661314 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 443af328e5154bdba9b570224616d77b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d454d65afa94aac9b34c253adfa4b0c) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.661559 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 34822e9f900f4d04b59b810d59e6aa49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.661823 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 34822e9f900f4d04b59b810d59e6aa49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.663259 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 34822e9f900f4d04b59b810d59e6aa49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.577971 1561 tablet_bootstrap.cc:654] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.664073 1559 ts_tablet_manager.cc:1918] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.664212 1559 log.cc:1196] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3a8d33202ebc4e37b598d62d66472f31
I20260927 15:06:01.664601 1559 ts_tablet_manager.cc:1939] T 3a8d33202ebc4e37b598d62d66472f31 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:01.665925 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 3a8d33202ebc4e37b598d62d66472f31 (table default.Table_dc82ae0788b94be68a26ad903bf087fb [id=26cdf96fac4b455faf5607f72aa6f2f5]) successfully deleted
I20260927 15:06:01.666872 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 (DEFAULT_TABLE table=default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.667392 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b1f2143af1142eb9f3dbc777299c186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.667451 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 (DEFAULT_TABLE table=default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.667660 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 66b54ee47e424aacb7f53fd95b0ce889 (DEFAULT_TABLE table=default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.667842 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b1f2143af1142eb9f3dbc777299c186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.668030 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66b54ee47e424aacb7f53fd95b0ce889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.671587 1805 ts_tablet_manager.cc:1918] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.671742 1805 log.cc:1196] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/e0db1654ced542938487126a0a09ed74
I20260927 15:06:01.672125 1805 ts_tablet_manager.cc:1939] T e0db1654ced542938487126a0a09ed74 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:01.673166 1805 tablet_replica.cc:330] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:01.673369 1805 raft_consensus.cc:2229] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.673621 1805 raft_consensus.cc:2258] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.673766 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet e0db1654ced542938487126a0a09ed74 (table default.Table_762e4939259748a28b16279e147a5ada [id=09ccdcb0502f47219fc4985219701f1b]) successfully deleted
I20260927 15:06:01.674149 1805 ts_tablet_manager.cc:1905] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.674330 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 (DEFAULT_TABLE table=default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.674721 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b1f2143af1142eb9f3dbc777299c186. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:01.683835 1376 consensus_peers.cc:487] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:01.684758 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6cc665540fb24e17b9284fc911758626" } modify_external_catalogs: true
I20260927 15:06:01.685031 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6cc665540fb24e17b9284fc911758626" } modify_external_catalogs: true
I20260927 15:06:01.691380 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 66b54ee47e424aacb7f53fd95b0ce889 (DEFAULT_TABLE table=default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.692350 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 (DEFAULT_TABLE table=default.Table_5b34cca200794f3fa6075659ba3851ec [id=450ecac4fd094088b06f5d3add7acd2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.692484 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 66b54ee47e424aacb7f53fd95b0ce889 (DEFAULT_TABLE table=default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.692910 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66b54ee47e424aacb7f53fd95b0ce889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.692888 1279 tablet_service.cc:1467] Processing CreateTablet for tablet cb859b43634c420382da5c201ce24dfc (DEFAULT_TABLE table=default.Table_d30c425670fb48e8b23a840865bee28b [id=0303fc8be5ae400a87d56696b7b75994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.694118 1414 tablet_service.cc:1467] Processing CreateTablet for tablet cb859b43634c420382da5c201ce24dfc (DEFAULT_TABLE table=default.Table_d30c425670fb48e8b23a840865bee28b [id=0303fc8be5ae400a87d56696b7b75994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.694491 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb859b43634c420382da5c201ce24dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.694499 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4cff4a06db44269defca578af289d8 (DEFAULT_TABLE table=default.Table_661afffa3463498f9b3ef33b46bda8e5 [id=8be5c577dcb3490d883bede28c6b73ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.694969 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bd1398c934c0418eba63a6b9c0646259" } modify_external_catalogs: true
I20260927 15:06:01.695202 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bd1398c934c0418eba63a6b9c0646259" } modify_external_catalogs: true
I20260927 15:06:01.696141 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4cff4a06db44269defca578af289d8 (DEFAULT_TABLE table=default.Table_661afffa3463498f9b3ef33b46bda8e5 [id=8be5c577dcb3490d883bede28c6b73ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.696471 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4cff4a06db44269defca578af289d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.699039 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4cff4a06db44269defca578af289d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.699226 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66b54ee47e424aacb7f53fd95b0ce889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.699415 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 (DEFAULT_TABLE table=default.Table_5b34cca200794f3fa6075659ba3851ec [id=450ecac4fd094088b06f5d3add7acd2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.699757 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e9b07ea3ec9457399e2b765580d06e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.703083 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e9b07ea3ec9457399e2b765580d06e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.706420 1556 tablet_bootstrap.cc:492] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:01.706575 1556 ts_tablet_manager.cc:1397] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.260s user 0.011s sys 0.002s
I20260927 15:06:01.707297 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb859b43634c420382da5c201ce24dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.707361 1556 raft_consensus.cc:348] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.707662 1556 raft_consensus.cc:374] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.707756 1556 raft_consensus.cc:729] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.707973 1556 consensus_queue.cc:260] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.708521 1556 ts_tablet_manager.cc:1428] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:01.708803 1556 tablet_bootstrap.cc:492] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:01.709776 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dcca958a30ba42a8943865116e383a22" } new_table_name: "default.Table_0393b69c63dc4c42b67201f634d5c6fa" modify_external_catalogs: true
I20260927 15:06:01.710753 1556 tablet_bootstrap.cc:654] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.714212 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c49913b1763c4a7b9413a801aff93b30
I20260927 15:06:01.716210 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet c49913b1763c4a7b9413a801aff93b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:01.721366 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0129eaa5636544e696076e439d713b1b consensus state has no leader
I20260927 15:06:01.722074 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bbcffb8cedd74b18871988201f9db2e5
I20260927 15:06:01.722196 1556 tablet_bootstrap.cc:492] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:01.722347 1556 ts_tablet_manager.cc:1397] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260927 15:06:01.723151 1556 raft_consensus.cc:348] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.723443 1556 raft_consensus.cc:374] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.723534 1556 raft_consensus.cc:729] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.725517 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0f7df44cf73c428799fa262825170d1b" } new_table_name: "default.Table_90059eaac20f42eead7d864d2e91a12e" modify_external_catalogs: true
I20260927 15:06:01.726687 1556 consensus_queue.cc:260] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.728307 1559 tablet_replica.cc:330] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.728586 1559 raft_consensus.cc:2229] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.728816 1559 raft_consensus.cc:2258] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.729106 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet bbcffb8cedd74b18871988201f9db2e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:01.729641 1556 ts_tablet_manager.cc:1428] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260927 15:06:01.731348 1556 tablet_bootstrap.cc:492] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:01.733549 1556 tablet_bootstrap.cc:654] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.733897 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet c49913b1763c4a7b9413a801aff93b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.735008 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet bbcffb8cedd74b18871988201f9db2e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:01.736778 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3efc44686be2407cbcdca61909301539 has no consensus state
I20260927 15:06:01.737883 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_05efeebbfcb44fd488866bede83f6a31" } new_table_name: "default.Table_024037ff57734bfa973dff7fd4f09896" modify_external_catalogs: true
I20260927 15:06:01.729707 1559 ts_tablet_manager.cc:1905] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.747844 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a26de115d3a9477f8b879db21ba9bf8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.748515 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a26de115d3a9477f8b879db21ba9bf8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:01.749104 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd76c49eda1c4b4ca0edf0f4d2790188 consensus state has no leader
I20260927 15:06:01.697625 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 (DEFAULT_TABLE table=default.Table_5b34cca200794f3fa6075659ba3851ec [id=450ecac4fd094088b06f5d3add7acd2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.751173 1865 tablet.cc:1722] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:01.749645 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4cff4a06db44269defca578af289d8 (DEFAULT_TABLE table=default.Table_661afffa3463498f9b3ef33b46bda8e5 [id=8be5c577dcb3490d883bede28c6b73ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.752358 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cd87785e4030410da63d85472104fc1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.752924 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd87785e4030410da63d85472104fc1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.753791 908 master_service.cc:946] ReplaceTablet: received request to replace tablet 30cf4db249154adda9406d5b07430a80 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:01.756287 1827 raft_consensus.cc:482] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.756558 1827 raft_consensus.cc:504] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.762089 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet c49913b1763c4a7b9413a801aff93b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.763772 1135 tablet_service.cc:1467] Processing CreateTablet for tablet cb859b43634c420382da5c201ce24dfc (DEFAULT_TABLE table=default.Table_d30c425670fb48e8b23a840865bee28b [id=0303fc8be5ae400a87d56696b7b75994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:01.765439 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet bbcffb8cedd74b18871988201f9db2e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.766574 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e9b07ea3ec9457399e2b765580d06e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.768308 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_be15cdb2ae6a49e38da808ee4cafd27c" } modify_external_catalogs: true
I20260927 15:06:01.770792 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_be15cdb2ae6a49e38da808ee4cafd27c" } modify_external_catalogs: true
I20260927 15:06:01.770812 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_176f42444c5047c4a033918980dbe2db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.772897 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_176f42444c5047c4a033918980dbe2db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.773249 1827 leader_election.cc:288] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:01.774904 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f4cff4a06db44269defca578af289d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.775071 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3c89cbbe4c0242f5b21b7c86fe5199e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.776749 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c89cbbe4c0242f5b21b7c86fe5199e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.785514 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead753ba6664829b1262712f35e64f2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:01.791458 1556 tablet_bootstrap.cc:492] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:01.791627 1556 ts_tablet_manager.cc:1397] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.061s user 0.008s sys 0.001s
I20260927 15:06:01.791800 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_11a3612c1fb14de08bae64fc5180a805" } new_table_name: "default.Table_c8f0a331bf1f4f7c969299f5f0c4d5a6" modify_external_catalogs: true
I20260927 15:06:01.792477 1556 raft_consensus.cc:348] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.795012 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a9cb632191944d39a0dc0da5abee6a22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:01.795571 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead753ba6664829b1262712f35e64f2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:01.795713 1556 raft_consensus.cc:374] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.795964 1556 raft_consensus.cc:729] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
W20260927 15:06:01.796173 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9cb632191944d39a0dc0da5abee6a22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:01.796339 1376 leader_election.cc:341] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.796779 1556 consensus_queue.cc:260] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.797079 1559 ts_tablet_manager.cc:1918] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.800761 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fb33d66f39634767ba162859269f434e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.801374 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb33d66f39634767ba162859269f434e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.803052 1559 log.cc:1196] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/0d41d55fdb504b95921f46e7aed99ac1
I20260927 15:06:01.804378 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3773f93fae58433d85f1b2cdbe15ed29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.804953 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3773f93fae58433d85f1b2cdbe15ed29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.805476 1559 ts_tablet_manager.cc:1939] T 0d41d55fdb504b95921f46e7aed99ac1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:01.806427 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54a07831078b48a59807f7da4a42bcec consensus state has no leader
I20260927 15:06:01.807960 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 0d41d55fdb504b95921f46e7aed99ac1 (table default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4 [id=1f37615c984042b9a2f7cfec93acd7ba]) successfully deleted
I20260927 15:06:01.809273 1559 tablet_replica.cc:330] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.809551 1559 raft_consensus.cc:2229] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.809728 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e18064a8c28446469b9ea854acda2a65" } modify_external_catalogs: true
I20260927 15:06:01.809978 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e18064a8c28446469b9ea854acda2a65" } modify_external_catalogs: true
I20260927 15:06:01.810096 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cf1a116400854111ad696b9bbc4fc97d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:01.810493 1559 raft_consensus.cc:2258] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:01.810681 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf1a116400854111ad696b9bbc4fc97d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.810585 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b94ff6d2011948078b03af17b4d95fae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.811117 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b94ff6d2011948078b03af17b4d95fae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.811923 1559 ts_tablet_manager.cc:1905] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.813024 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_40a2f0de5a5944319df4d4b69013208d" } new_table_name: "default.Table_55279d33dbe5409dbe792ef5ae239862" modify_external_catalogs: true
I20260927 15:06:01.814487 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_372c248535f74b55adc8c643989b8e57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:01.815137 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_372c248535f74b55adc8c643989b8e57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.797506 1556 ts_tablet_manager.cc:1428] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260927 15:06:01.823711 1556 tablet_bootstrap.cc:492] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:01.826673 1556 tablet_bootstrap.cc:654] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.832460 1559 ts_tablet_manager.cc:1918] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.835788 1559 log.cc:1196] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/87cc6cc43a4a4ed1ac79e1902aca9fe5
I20260927 15:06:01.837041 1559 ts_tablet_manager.cc:1939] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:01.840495 1559 tablet_replica.cc:330] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.841570 1559 raft_consensus.cc:2229] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.842170 1559 raft_consensus.cc:2258] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.843117 1559 ts_tablet_manager.cc:1905] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.843466 1164 raft_consensus.cc:2454] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:01.844357 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 (table default.Table_03f21e43b48e4663bf25f8656a9ee2b4 [id=64ae6d29aaaf4705896336b4faa6eb13]) successfully deleted
I20260927 15:06:01.843874 1374 leader_election.cc:302] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:01.845322 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb859b43634c420382da5c201ce24dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:01.845374 1827 raft_consensus.cc:2781] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:01.845460 1827 raft_consensus.cc:482] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:01.845558 1827 raft_consensus.cc:3037] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:01.846038 1099 consensus_peers.cc:487] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a8d33202ebc4e37b598d62d66472f31. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:01.848500 1827 raft_consensus.cc:504] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.849571 1827 leader_election.cc:288] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:01.849654 1561 tablet_bootstrap.cc:492] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:01.849609 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 65c313ab6848428d8237557392669f6f from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:01.849586 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead753ba6664829b1262712f35e64f2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:01.849802 1561 ts_tablet_manager.cc:1397] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.338s user 0.003s sys 0.017s
W20260927 15:06:01.850090 1376 leader_election.cc:341] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.850900 1561 raft_consensus.cc:348] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.851151 1561 raft_consensus.cc:374] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.852070 1561 raft_consensus.cc:729] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.852303 1561 consensus_queue.cc:260] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.853788 1561 ts_tablet_manager.cc:1428] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:01.854142 1561 tablet_bootstrap.cc:492] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:01.855074 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ead753ba6664829b1262712f35e64f2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:01.855481 1164 raft_consensus.cc:3037] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:01.857956 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce" } modify_external_catalogs: true
I20260927 15:06:01.858299 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce" } modify_external_catalogs: true
I20260927 15:06:01.861600 1561 tablet_bootstrap.cc:654] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.870741 1559 ts_tablet_manager.cc:1918] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.874938 1559 log.cc:1196] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/7a42ae7589c24b1bbd833ab8838521ae
I20260927 15:06:01.875409 1559 ts_tablet_manager.cc:1939] T 7a42ae7589c24b1bbd833ab8838521ae P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:01.876966 1559 tablet_replica.cc:330] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.877115 911 master_service.cc:946] ReplaceTablet: received request to replace tablet bc971defe6d148439a6a0b8c55d9092e from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:01.878090 1164 raft_consensus.cc:2454] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:01.878572 1374 leader_election.cc:302] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:01.879092 1805 ts_tablet_manager.cc:1918] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.879240 1805 log.cc:1196] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/6c7a8bf15c48423ea9ff14c46645a33b
I20260927 15:06:01.879369 1827 raft_consensus.cc:2781] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:01.879519 1827 raft_consensus.cc:686] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:01.879613 1805 ts_tablet_manager.cc:1939] T 6c7a8bf15c48423ea9ff14c46645a33b P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:01.879751 1827 consensus_queue.cc:237] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.880501 1805 tablet_replica.cc:330] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:01.881171 1805 raft_consensus.cc:2229] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.881335 1805 raft_consensus.cc:2258] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.881882 1805 ts_tablet_manager.cc:1905] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.882294 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 6c7a8bf15c48423ea9ff14c46645a33b (table default.Table_e0637f13993b42ccb6ccf6fd2ac388f3 [id=34a0775e8d7c47fda6244a1168a1a2d5]) successfully deleted
I20260927 15:06:01.887522 1559 raft_consensus.cc:2229] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.888155 1559 raft_consensus.cc:2258] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.888721 1805 ts_tablet_manager.cc:1918] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.888955 1805 log.cc:1196] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/30cf4db249154adda9406d5b07430a80
I20260927 15:06:01.888926 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 7a42ae7589c24b1bbd833ab8838521ae (table default.Table_590e6d5e78b5436fa3687cf0b70e1921 [id=f8681c26dbe446b19c269790f5078b22]) successfully deleted
I20260927 15:06:01.888988 1559 ts_tablet_manager.cc:1905] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.889407 1805 ts_tablet_manager.cc:1939] T 30cf4db249154adda9406d5b07430a80 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:01.890436 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 30cf4db249154adda9406d5b07430a80 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]) successfully deleted
I20260927 15:06:01.891376 1562 ts_tablet_manager.cc:1918] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:01.891409 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ce566cc49cfe4483b942d2eaa8269acc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce566cc49cfe4483b942d2eaa8269acc already in progress: creating tablet
I20260927 15:06:01.891594 1552 tablet_bootstrap.cc:492] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:01.891827 1552 ts_tablet_manager.cc:1397] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.327s user 0.016s sys 0.014s
W20260927 15:06:01.894785 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ef93a120f00423d91664ce4eaf03803 has no consensus state
I20260927 15:06:01.896019 1552 raft_consensus.cc:348] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.896281 1552 raft_consensus.cc:374] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.896382 1552 raft_consensus.cc:729] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.897127 1556 tablet_bootstrap.cc:492] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:01.897452 1556 ts_tablet_manager.cc:1397] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.001s
W20260927 15:06:01.898286 901 catalog_manager.cc:4808] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 31701139f10f4478af43bd153aa3a2dc because the tablet was not found. No further retry: Not found: Tablet not found: 31701139f10f4478af43bd153aa3a2dc
W20260927 15:06:01.898710 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6cc8bd2079f84da39e13113e6699bf5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cc8bd2079f84da39e13113e6699bf5e already in progress: creating tablet
W20260927 15:06:01.899199 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 65c313ab6848428d8237557392669f6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65c313ab6848428d8237557392669f6f already in progress: creating tablet
I20260927 15:06:01.899399 1805 tablet_replica.cc:330] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:01.899842 1805 raft_consensus.cc:2229] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.900156 1556 raft_consensus.cc:348] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.900714 1556 raft_consensus.cc:374] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.900866 1556 raft_consensus.cc:729] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.901415 1556 consensus_queue.cc:260] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.902202 1556 ts_tablet_manager.cc:1428] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:01.902576 1556 tablet_bootstrap.cc:492] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:01.904438 1805 raft_consensus.cc:2258] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.906134 1805 ts_tablet_manager.cc:1905] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.899220 1561 tablet_bootstrap.cc:492] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:01.904820 1552 consensus_queue.cc:260] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.906908 1561 ts_tablet_manager.cc:1397] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.002s
I20260927 15:06:01.907788 1561 raft_consensus.cc:348] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.908154 1561 raft_consensus.cc:374] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.908293 1561 raft_consensus.cc:729] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.910255 1561 consensus_queue.cc:260] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.910908 1561 ts_tablet_manager.cc:1428] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:01.912348 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ee85688df04e92accdedb6625406c1 with delete_type TABLET_DATA_DELETED (replaced by tablet c49913b1763c4a7b9413a801aff93b30) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:01.914379 1552 ts_tablet_manager.cc:1428] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260927 15:06:01.916477 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3773f93fae58433d85f1b2cdbe15ed29" } modify_external_catalogs: true
I20260927 15:06:01.916685 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3773f93fae58433d85f1b2cdbe15ed29" } modify_external_catalogs: true
I20260927 15:06:01.917131 1561 tablet_bootstrap.cc:492] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:01.919759 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 6b1f2143af1142eb9f3dbc777299c186 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:01.920624 1879 tablet.cc:1722] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260927 15:06:01.920995 1102 consensus_peers.cc:487] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:01.906682 1562 log.cc:1196] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/0d41d55fdb504b95921f46e7aed99ac1
I20260927 15:06:01.922468 1562 ts_tablet_manager.cc:1939] T 0d41d55fdb504b95921f46e7aed99ac1 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:01.923782 1561 tablet_bootstrap.cc:654] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.924548 1552 tablet_bootstrap.cc:492] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:01.925202 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e8c7a324f17444a486965a420aced20a" } new_table_name: "default.Table_304808acc5d54345ad85bb6a5dc817fb" modify_external_catalogs: true
I20260927 15:06:01.926535 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_176f42444c5047c4a033918980dbe2db" } modify_external_catalogs: true
I20260927 15:06:01.926729 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_176f42444c5047c4a033918980dbe2db" } modify_external_catalogs: true
I20260927 15:06:01.927793 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 245) took 1062 ms. Trace:
I20260927 15:06:01.927978 1562 rpcz_store.cc:276] 0927 15:06:00.865678 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:00.865735 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:01.501439 (+635704us) ts_tablet_manager.cc:1145] Deleting tablet 0d41d55fdb504b95921f46e7aed99ac1
0927 15:06:01.501451 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:01.696901 (+195450us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:01.891241 (+194340us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:01.927754 (+ 36513us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":635505}
I20260927 15:06:01.929378 1562 tablet_replica.cc:330] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:01.929447 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 0d41d55fdb504b95921f46e7aed99ac1 (table default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4 [id=1f37615c984042b9a2f7cfec93acd7ba]) successfully deleted
I20260927 15:06:01.921849 1559 ts_tablet_manager.cc:1918] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.929730 1562 raft_consensus.cc:2229] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.929771 1559 log.cc:1196] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/ba7faf6e79db420db13999d74fe86062
I20260927 15:06:01.930011 1562 raft_consensus.cc:2258] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.930194 1559 ts_tablet_manager.cc:1939] T ba7faf6e79db420db13999d74fe86062 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:01.931059 1562 ts_tablet_manager.cc:1905] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.932061 1559 tablet_replica.cc:330] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.932410 1559 raft_consensus.cc:2229] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:01.936704 1559 raft_consensus.cc:2258] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.939625 1552 tablet_bootstrap.cc:654] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.940047 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_65acf9b7f2074b44aacf9bee5790329d" } new_table_name: "default.Table_e362bbc19fce4b2a842bd907b98ede40" modify_external_catalogs: true
I20260927 15:06:01.940840 1559 ts_tablet_manager.cc:1905] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.943816 1688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:06:01.936322 1556 tablet_bootstrap.cc:654] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:01.945161 1688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:06:01.945716 1688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260927 15:06:01.946818 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet ba7faf6e79db420db13999d74fe86062 (table default.Table_46da6881be584d4982a6cdafe3fb1c31 [id=f2c85989a55c4f62bb100381a5d68dce]) successfully deleted
W20260927 15:06:01.947182 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0df4a23269244191bf1dcd69cb34d371 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0df4a23269244191bf1dcd69cb34d371 already in progress: creating tablet
W20260927 15:06:01.948144 1099 consensus_peers.cc:487] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87cc6cc43a4a4ed1ac79e1902aca9fe5. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:01.949102 911 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet cce40be004d545b19728bf53b7caee56
I20260927 15:06:01.950366 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 9cb0ab983a444d26b903a0cec64f15f0 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:01.954346 1562 ts_tablet_manager.cc:1918] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:01.956701 910 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 752799f976514e15b0ac68da632ec4bb
I20260927 15:06:01.957123 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_55279d33dbe5409dbe792ef5ae239862" } new_table_name: "default.Table_996a8c79612d4f8f81e6849eb51715b9" modify_external_catalogs: true
W20260927 15:06:01.958546 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42baac8b7d47433e826eb3bc1980acaa consensus state has no leader
W20260927 15:06:01.959980 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ebb4e007cefa4f18bdaa461b43c5c810 consensus state has no leader
I20260927 15:06:01.960891 1552 tablet_bootstrap.cc:492] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:01.961104 1552 ts_tablet_manager.cc:1397] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.000s
I20260927 15:06:01.961787 1562 log.cc:1196] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/8af844423fc94e2c8380db179103d3aa
I20260927 15:06:01.962412 1562 ts_tablet_manager.cc:1939] T 8af844423fc94e2c8380db179103d3aa P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:01.962620 1559 ts_tablet_manager.cc:1918] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:01.962780 1559 log.cc:1196] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/8af844423fc94e2c8380db179103d3aa
I20260927 15:06:01.963265 1559 ts_tablet_manager.cc:1939] T 8af844423fc94e2c8380db179103d3aa P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:01.963289 1552 raft_consensus.cc:348] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.963526 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 246) took 1097 ms. Trace:
I20260927 15:06:01.963706 1552 raft_consensus.cc:374] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.963807 1552 raft_consensus.cc:729] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.963788 1811 raft_consensus.cc:482] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:01.963979 1811 raft_consensus.cc:504] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.964133 1552 consensus_queue.cc:260] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.964787 1811 leader_election.cc:288] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:01.966789 1559 tablet_replica.cc:330] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.966979 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 8af844423fc94e2c8380db179103d3aa (table default.Table_54aa4b63a0734bcca9d77b4a4c2a31c1 [id=8dbd285d921c4a44926c443a601add72]) successfully deleted
I20260927 15:06:01.967025 1559 raft_consensus.cc:2229] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.967203 1559 raft_consensus.cc:2258] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.967365 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "654d3210fd8c46b68880e544c39d5c88" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:01.967746 1559 ts_tablet_manager.cc:1905] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:01.967932 1102 leader_election.cc:341] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.963686 1562 rpcz_store.cc:276] 0927 15:06:00.866475 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:00.866586 (+ 111us) service_pool.cc:227] Handling call
0927 15:06:01.929287 (+1062701us) ts_tablet_manager.cc:1145] Deleting tablet 8af844423fc94e2c8380db179103d3aa
0927 15:06:01.929304 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:01.949365 (+ 20061us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:01.954201 (+ 4836us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:01.963467 (+ 9266us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1062456}
I20260927 15:06:01.968892 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "654d3210fd8c46b68880e544c39d5c88" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:01.969602 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 8af844423fc94e2c8380db179103d3aa (table default.Table_54aa4b63a0734bcca9d77b4a4c2a31c1 [id=8dbd285d921c4a44926c443a601add72]) successfully deleted
W20260927 15:06:01.970048 1099 leader_election.cc:341] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:01.970225 1099 leader_election.cc:302] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:01.970799 1811 raft_consensus.cc:2726] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:01.972190 1561 tablet_bootstrap.cc:492] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:01.972429 1561 ts_tablet_manager.cc:1397] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.055s user 0.013s sys 0.011s
I20260927 15:06:01.973440 1561 raft_consensus.cc:348] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:01.973814 1561 raft_consensus.cc:374] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:01.973985 1561 raft_consensus.cc:729] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:01.973883 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dd7090ea741141e2b5c0b1a207278282"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:01.974376 1561 consensus_queue.cc:260] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:01.974478 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd7090ea741141e2b5c0b1a207278282 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:01.978514 1561 ts_tablet_manager.cc:1428] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:06:01.978947 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 247) took 1086 ms. Trace:
I20260927 15:06:01.979300 1562 rpcz_store.cc:276] 0927 15:06:00.892369 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:00.892431 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:01.978737 (+1086306us) ts_tablet_manager.cc:1145] Deleting tablet 0aec677006ab4407bd7ae4c0078d6b7f
0927 15:06:01.978750 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:01.978884 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1086096}
I20260927 15:06:01.980149 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet bb90faccda0145a7acd153fcd51b4c43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:01.980335 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ef93a120f00423d91664ce4eaf03803 has no consensus state
I20260927 15:06:01.982373 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 27c3283a40f14eb4868767799cfdf7bd (table default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85]). Expected version 2 got 0
I20260927 15:06:01.982589 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874]). Expected version 3 got 0
I20260927 15:06:01.986598 1559 ts_tablet_manager.cc:1918] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:01.986792 1559 log.cc:1196] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/12623e6767aa4bd4934058f7314a966e
I20260927 15:06:01.987275 1559 ts_tablet_manager.cc:1939] T 12623e6767aa4bd4934058f7314a966e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:01.988348 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 12623e6767aa4bd4934058f7314a966e (table default.Table_a6f0eb861ab04bcb8df0053049d90e1b [id=7016faef9bb8460288ace088e5995265]) successfully deleted
I20260927 15:06:01.991995 908 catalog_manager.cc:5495] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:01.992266 1552 ts_tablet_manager.cc:1428] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.031s user 0.000s sys 0.002s
I20260927 15:06:01.992559 908 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_1b15320c32a54a9ab7a584a195d7aca8 [id=4686792aaf36414380f3f894a5635874]). Expected version 3 got 0
I20260927 15:06:01.992789 1559 tablet_replica.cc:330] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:01.993014 1559 raft_consensus.cc:2229] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:01.993180 1559 raft_consensus.cc:2258] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:01.993839 1559 ts_tablet_manager.cc:1905] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:01.997123 1552 tablet_bootstrap.cc:492] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:01.985424 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead753ba6664829b1262712f35e64f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.985584 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af844423fc94e2c8380db179103d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.985692 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 654d3210fd8c46b68880e544c39d5c88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:01.997371 1561 tablet_bootstrap.cc:492] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:02.000908 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0aec677006ab4407bd7ae4c0078d6b7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0aec677006ab4407bd7ae4c0078d6b7f already in progress: creating tablet
I20260927 15:06:02.001252 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 248) took 1107 ms. Trace:
I20260927 15:06:02.002236 1562 rpcz_store.cc:276] 0927 15:06:00.893413 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:00.893464 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:02.001058 (+1107594us) ts_tablet_manager.cc:1145] Deleting tablet 0d4ca19b492c4df1b31c78f1629c50b5
0927 15:06:02.001074 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.001187 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1107347}
I20260927 15:06:02.004504 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 249) took 1103 ms. Trace:
W20260927 15:06:02.004499 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0d4ca19b492c4df1b31c78f1629c50b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d4ca19b492c4df1b31c78f1629c50b5 already in progress: creating tablet
I20260927 15:06:02.004638 1562 rpcz_store.cc:276] 0927 15:06:00.901223 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:00.901283 (+ 60us) service_pool.cc:227] Handling call
0927 15:06:02.004344 (+1103061us) ts_tablet_manager.cc:1145] Deleting tablet b375902081c54cdb84fdb075eec6baf7
0927 15:06:02.004356 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.004453 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1092445}
W20260927 15:06:02.005041 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b375902081c54cdb84fdb075eec6baf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b375902081c54cdb84fdb075eec6baf7 already in progress: creating tablet
I20260927 15:06:02.005167 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 250) took 1091 ms. Trace:
I20260927 15:06:02.005262 1562 rpcz_store.cc:276] 0927 15:06:00.913753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:00.914724 (+ 971us) service_pool.cc:227] Handling call
0927 15:06:02.005011 (+1090287us) ts_tablet_manager.cc:1145] Deleting tablet c90e5c66d8564f68b401b3e4280499a7
0927 15:06:02.005022 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.005123 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1089925}
W20260927 15:06:02.005628 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c90e5c66d8564f68b401b3e4280499a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c90e5c66d8564f68b401b3e4280499a7 already in progress: creating tablet
I20260927 15:06:02.005676 1562 tablet_replica.cc:330] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:02.005715 1559 ts_tablet_manager.cc:1918] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.005851 1559 log.cc:1196] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/443af328e5154bdba9b570224616d77b
I20260927 15:06:02.006156 1562 raft_consensus.cc:2229] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:02.006551 1552 tablet_bootstrap.cc:654] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.006654 1562 raft_consensus.cc:2258] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.007040 1559 ts_tablet_manager.cc:1939] T 443af328e5154bdba9b570224616d77b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:02.007302 1562 ts_tablet_manager.cc:1905] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.008622 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 214229a8283b43c4916a5db7ba120e03
I20260927 15:06:02.009428 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 214229a8283b43c4916a5db7ba120e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.009821 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 214229a8283b43c4916a5db7ba120e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.010591 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a8de6246f7904f6c80df624f3631db17
I20260927 15:06:02.011372 1559 tablet_replica.cc:330] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:02.011668 1559 raft_consensus.cc:2229] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.011828 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9cb0ab983a444d26b903a0cec64f15f0
I20260927 15:06:02.011914 1559 raft_consensus.cc:2258] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.012019 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 214229a8283b43c4916a5db7ba120e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.004073 1561 tablet_bootstrap.cc:654] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.012430 1559 ts_tablet_manager.cc:1905] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.012631 911 catalog_manager.cc:6565] ReplaceTablet: tablet 9cb0ab983a444d26b903a0cec64f15f0 deleted and replaced by tablet 9ae003f1ca76472cbaa8b577b66fe84c
I20260927 15:06:02.012710 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet a8de6246f7904f6c80df624f3631db17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.013372 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6b1f2143af1142eb9f3dbc777299c186
I20260927 15:06:02.013664 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet a8de6246f7904f6c80df624f3631db17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.013785 909 catalog_manager.cc:6565] ReplaceTablet: tablet 6b1f2143af1142eb9f3dbc777299c186 deleted and replaced by tablet 99d4707e599840b3bdc2ab13c348ea80
I20260927 15:06:02.014418 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb0ab983a444d26b903a0cec64f15f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ae003f1ca76472cbaa8b577b66fe84c) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.014647 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 with delete_type TABLET_DATA_DELETED (replaced by tablet 99d4707e599840b3bdc2ab13c348ea80) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.015306 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 with delete_type TABLET_DATA_DELETED (replaced by tablet 99d4707e599840b3bdc2ab13c348ea80) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.015585 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb0ab983a444d26b903a0cec64f15f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ae003f1ca76472cbaa8b577b66fe84c) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.016024 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 443af328e5154bdba9b570224616d77b (table default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]) successfully deleted
I20260927 15:06:02.006886 1805 ts_tablet_manager.cc:1918] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.016695 1805 log.cc:1196] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/ce3b706ed2734db782efdb47cf3fda95
I20260927 15:06:02.016695 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet a8de6246f7904f6c80df624f3631db17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.017398 1805 ts_tablet_manager.cc:1939] T ce3b706ed2734db782efdb47cf3fda95 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:02.019336 1805 tablet_replica.cc:330] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:02.019598 1805 raft_consensus.cc:2229] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:02.020166 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet ce3b706ed2734db782efdb47cf3fda95 (table default.Table_9074f56e5d72442694c1b683a1911c62 [id=8ca2c45597294e2aa3a002911c86fd1d]) successfully deleted
I20260927 15:06:02.020506 1805 pending_rounds.cc:62] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:02.020665 1805 pending_rounds.cc:68] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976315120717824 op_type: NO_OP noop_request { }
I20260927 15:06:02.020933 1805 raft_consensus.cc:2866] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:02.021714 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb0ab983a444d26b903a0cec64f15f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ae003f1ca76472cbaa8b577b66fe84c) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.022413 1805 raft_consensus.cc:2258] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.022538 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 with delete_type TABLET_DATA_DELETED (replaced by tablet 99d4707e599840b3bdc2ab13c348ea80) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.022957 911 master_service.cc:946] ReplaceTablet: received request to replace tablet ad5af5df58824fe88d607a93216bd228 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:02.023372 1562 ts_tablet_manager.cc:1918] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:02.023463 1805 ts_tablet_manager.cc:1905] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.024708 1561 tablet_bootstrap.cc:492] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:02.025434 1561 ts_tablet_manager.cc:1397] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.004s
I20260927 15:06:02.026252 1561 raft_consensus.cc:348] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.026564 1561 raft_consensus.cc:374] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.026693 1561 raft_consensus.cc:729] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.027035 1559 ts_tablet_manager.cc:1918] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.027145 1561 consensus_queue.cc:260] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.030709 1559 log.cc:1196] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/8f15485b8825436184abe2621c71e356
I20260927 15:06:02.031239 1559 ts_tablet_manager.cc:1939] T 8f15485b8825436184abe2621c71e356 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:02.031519 1561 ts_tablet_manager.cc:1428] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:06:02.032286 1561 tablet_bootstrap.cc:492] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:02.032353 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 8f15485b8825436184abe2621c71e356 (table default.Table_a0201a60665941a48eabe2de029dcfa4 [id=c2f5f4026b514c7e978c0b30f7a359ec]) successfully deleted
I20260927 15:06:02.032749 1559 tablet_replica.cc:330] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:02.032992 1559 raft_consensus.cc:2229] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.033217 1559 raft_consensus.cc:2258] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.033850 1559 ts_tablet_manager.cc:1905] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.034269 1561 tablet_bootstrap.cc:654] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.034430 1562 log.cc:1196] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/31701139f10f4478af43bd153aa3a2dc
I20260927 15:06:02.035642 1279 tablet_service.cc:1467] Processing CreateTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 (DEFAULT_TABLE table=default.Table_3450181a5d9d4059b161a9cfcc6cb882 [id=3305179f942c4133896ea7b9b1bc898b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.035827 1556 tablet_bootstrap.cc:492] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:02.035991 1556 ts_tablet_manager.cc:1397] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.133s user 0.002s sys 0.007s
I20260927 15:06:02.036108 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc20a62bbd484c4e9e25cf1c15e1dde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.036975 1556 raft_consensus.cc:348] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.037256 1556 raft_consensus.cc:374] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.037333 1556 raft_consensus.cc:729] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.037604 1556 consensus_queue.cc:260] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.038251 1556 ts_tablet_manager.cc:1428] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260927 15:06:02.040382 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fde632b187eb4180b343d7bddc7f0943
I20260927 15:06:02.041186 1415 tablet_service.cc:1467] Processing CreateTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 (DEFAULT_TABLE table=default.Table_3450181a5d9d4059b161a9cfcc6cb882 [id=3305179f942c4133896ea7b9b1bc898b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.041731 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc20a62bbd484c4e9e25cf1c15e1dde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.041736 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet fde632b187eb4180b343d7bddc7f0943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.045027 1556 tablet_bootstrap.cc:492] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:02.047003 1552 tablet_bootstrap.cc:492] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:02.047217 1552 ts_tablet_manager.cc:1397] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.003s
I20260927 15:06:02.048166 1552 raft_consensus.cc:348] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.048465 1552 raft_consensus.cc:374] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.048614 1552 raft_consensus.cc:729] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.048936 1552 consensus_queue.cc:260] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.052973 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet fde632b187eb4180b343d7bddc7f0943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.053206 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af844423fc94e2c8380db179103d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.053419 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d6d1cfb1a4d4c439e970d966af841b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.054019 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6a3d9845b82d4862bdd5a2d19801544c" } new_table_name: "default.Table_a6b84fe2576f4557af001177805017c3" modify_external_catalogs: true
I20260927 15:06:02.054343 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5d29cefe8c174dd89895f67e0784bf77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.054885 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d29cefe8c174dd89895f67e0784bf77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.055884 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f1973c1b1bb545a098000d81bf8c4223"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:02.056303 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_55df6d1d64674ec48c904460dbb96a29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.056473 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1973c1b1bb545a098000d81bf8c4223 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:02.056769 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55df6d1d64674ec48c904460dbb96a29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.059152 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_99dd24a63c524768a5e8485d5610b507"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:02.059387 1556 tablet_bootstrap.cc:654] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:02.059588 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99dd24a63c524768a5e8485d5610b507 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.059988 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b02433e9b8104b55a95ec09c1725dc4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.060433 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b02433e9b8104b55a95ec09c1725dc4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.060845 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fa7b0e87e81842e5a14ce4457fd9dafe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.061297 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa7b0e87e81842e5a14ce4457fd9dafe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.061864 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2c585ef1be384bbf993054ce07ec28d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.062263 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c585ef1be384bbf993054ce07ec28d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.073875 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8f07b64c8bf84ad088c74e987afe40bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:02.074152 1136 tablet_service.cc:1467] Processing CreateTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 (DEFAULT_TABLE table=default.Table_3450181a5d9d4059b161a9cfcc6cb882 [id=3305179f942c4133896ea7b9b1bc898b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:02.074623 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f07b64c8bf84ad088c74e987afe40bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.075500 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc20a62bbd484c4e9e25cf1c15e1dde0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.076359 1102 consensus_peers.cc:487] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:02.077294 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet fde632b187eb4180b343d7bddc7f0943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.077696 911 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 27c3283a40f14eb4868767799cfdf7bd (table default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85]). Expected version 2 got 0
I20260927 15:06:02.080009 1556 tablet_bootstrap.cc:492] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:02.080189 1866 raft_consensus.cc:482] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.080297 1556 ts_tablet_manager.cc:1397] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.001s
I20260927 15:06:02.080395 1866 raft_consensus.cc:504] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.081195 1866 leader_election.cc:288] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:02.081435 1556 raft_consensus.cc:348] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.081696 1556 raft_consensus.cc:374] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.081768 1556 raft_consensus.cc:729] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.082180 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04caae16db84d8ea9050b648c1ba354" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:02.082145 1556 consensus_queue.cc:260] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:02.082878 1376 leader_election.cc:341] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.083616 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 654d3210fd8c46b68880e544c39d5c88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.084120 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet da1812142bb043fba7457dc61ffdb180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.084074 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cd9a04e478fd4b95a2dfc85613965e31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:02.084414 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet da1812142bb043fba7457dc61ffdb180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:02.084646 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd9a04e478fd4b95a2dfc85613965e31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.084647 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7faf6e79db420db13999d74fe86062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.084812 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d6d1cfb1a4d4c439e970d966af841b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.084414 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04caae16db84d8ea9050b648c1ba354" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:02.084926 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead753ba6664829b1262712f35e64f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.086552 1279 tablet_service.cc:1467] Processing CreateTablet for tablet d4f05da432f041378c5ab808536e6b6f (DEFAULT_TABLE table=default.Table_755d73e8fa1340cf82c0c60ecc9fc5b5 [id=2386e9e051a140358b16dbe3d7add4c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.087311 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4f05da432f041378c5ab808536e6b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.087594 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet f2cce454e70640e2a67b3680676b1d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.088160 1556 ts_tablet_manager.cc:1428] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260927 15:06:02.088307 1706 raft_consensus.cc:482] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.088342 1165 raft_consensus.cc:2454] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:02.088434 1706 raft_consensus.cc:504] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.089073 1706 leader_election.cc:288] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.089425 1374 leader_election.cc:302] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:02.089363 1135 tablet_service.cc:1467] Processing CreateTablet for tablet d4f05da432f041378c5ab808536e6b6f (DEFAULT_TABLE table=default.Table_755d73e8fa1340cf82c0c60ecc9fc5b5 [id=2386e9e051a140358b16dbe3d7add4c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.090193 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34822e9f900f4d04b59b810d59e6aa49" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:02.090263 1725 raft_consensus.cc:482] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.090867 1866 raft_consensus.cc:2781] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:02.090987 1866 raft_consensus.cc:482] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:02.091073 1866 raft_consensus.cc:3037] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.092614 1415 tablet_service.cc:1467] Processing CreateTablet for tablet d4f05da432f041378c5ab808536e6b6f (DEFAULT_TABLE table=default.Table_755d73e8fa1340cf82c0c60ecc9fc5b5 [id=2386e9e051a140358b16dbe3d7add4c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.092927 1562 ts_tablet_manager.cc:1939] T 31701139f10f4478af43bd153aa3a2dc P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:02.094043 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 251) took 1010 ms. Trace:
I20260927 15:06:02.094163 1866 raft_consensus.cc:504] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.094519 1562 rpcz_store.cc:276] 0927 15:06:01.083215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.083301 (+ 86us) service_pool.cc:227] Handling call
0927 15:06:02.005604 (+922303us) ts_tablet_manager.cc:1145] Deleting tablet 31701139f10f4478af43bd153aa3a2dc
0927 15:06:02.005612 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.011083 (+ 5471us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.023248 (+ 12165us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.093996 (+ 70748us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":920928}
I20260927 15:06:02.095666 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04caae16db84d8ea9050b648c1ba354" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:02.095847 1562 tablet_replica.cc:330] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:06:02.096292 1376 leader_election.cc:341] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.096760 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 31701139f10f4478af43bd153aa3a2dc (table default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]) successfully deleted
W20260927 15:06:02.097110 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ce566cc49cfe4483b942d2eaa8269acc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce566cc49cfe4483b942d2eaa8269acc already in progress: creating tablet
W20260927 15:06:02.097359 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6cc8bd2079f84da39e13113e6699bf5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cc8bd2079f84da39e13113e6699bf5e already in progress: creating tablet
I20260927 15:06:02.097432 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34822e9f900f4d04b59b810d59e6aa49" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:02.097558 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 65c313ab6848428d8237557392669f6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65c313ab6848428d8237557392669f6f already in progress: creating tablet
W20260927 15:06:02.097811 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b3cc37a97bc145bdaa654bcc193fe93b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3cc37a97bc145bdaa654bcc193fe93b already in progress: creating tablet
I20260927 15:06:02.099087 1561 tablet_bootstrap.cc:492] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:02.099449 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4f05da432f041378c5ab808536e6b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.100348 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 9576d1a36d7547bf81faabe9c362e3cb (DEFAULT_TABLE table=default.Table_7c7824484c624468a8ccbd47f7ea4ca8 [id=9c08749b7a9241a9870e1b13ae17aece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.101630 905 master_service.cc:946] ReplaceTablet: received request to replace tablet c65bc09865bc4a0283eaa4af9f860bdd from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:02.103186 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet bc971defe6d148439a6a0b8c55d9092e with delete_type TABLET_DATA_DELETED (replaced by tablet 8fc1fc04814147d8843aa734fd1794da) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:02.103256 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 454e637ec622424e81a8770c16bbc941 consensus state has no leader
I20260927 15:06:02.102890 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 9576d1a36d7547bf81faabe9c362e3cb (DEFAULT_TABLE table=default.Table_7c7824484c624468a8ccbd47f7ea4ca8 [id=9c08749b7a9241a9870e1b13ae17aece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.103648 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c296e3348ec248c4ad40c6b03350903e" } new_table_name: "default.Table_336bf4e2b65f4a6ea300b83b198b1b4f" modify_external_catalogs: true
I20260927 15:06:02.104045 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet bc971defe6d148439a6a0b8c55d9092e with delete_type TABLET_DATA_DELETED (replaced by tablet 8fc1fc04814147d8843aa734fd1794da) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.104171 1561 ts_tablet_manager.cc:1397] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.072s user 0.008s sys 0.004s
I20260927 15:06:02.105284 1866 leader_election.cc:288] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:02.105700 1725 raft_consensus.cc:504] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.105945 1238 leader_election.cc:302] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:02.106508 1725 leader_election.cc:288] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.106736 1562 raft_consensus.cc:2229] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:02.106802 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 9576d1a36d7547bf81faabe9c362e3cb (DEFAULT_TABLE table=default.Table_7c7824484c624468a8ccbd47f7ea4ca8 [id=9c08749b7a9241a9870e1b13ae17aece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.107137 1562 pending_rounds.cc:62] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:02.107306 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9576d1a36d7547bf81faabe9c362e3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.107232 1562 pending_rounds.cc:68] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976313184374784 op_type: NO_OP noop_request { }
I20260927 15:06:02.107403 1562 raft_consensus.cc:2866] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:02.107556 1562 raft_consensus.cc:2258] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.108304 1562 ts_tablet_manager.cc:1905] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.108675 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04caae16db84d8ea9050b648c1ba354" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:02.108927 1165 raft_consensus.cc:3037] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.111126 1706 raft_consensus.cc:2726] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:02.111404 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27c3283a40f14eb4868767799cfdf7bd" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:02.111987 1102 leader_election.cc:341] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.112082 1165 raft_consensus.cc:2454] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:02.112213 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 1ef93a120f00423d91664ce4eaf03803 (DEFAULT_TABLE table=default.Table_996a8c79612d4f8f81e6849eb51715b9 [id=40aeb63abca64c3a8d12f9085fd816d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.112319 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9576d1a36d7547bf81faabe9c362e3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.113315 1374 leader_election.cc:302] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:02.113996 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 1ef93a120f00423d91664ce4eaf03803 (DEFAULT_TABLE table=default.Table_996a8c79612d4f8f81e6849eb51715b9 [id=40aeb63abca64c3a8d12f9085fd816d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.114430 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ef93a120f00423d91664ce4eaf03803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.114796 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe (DEFAULT_TABLE table=default.Table_27a7140bf7c847d8acb10f2ac4c04bcf [id=a99492ccd2464bc2b1885ade4a76db9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.114886 1561 raft_consensus.cc:348] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.115098 1561 raft_consensus.cc:374] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.115182 1561 raft_consensus.cc:729] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.115331 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe (DEFAULT_TABLE table=default.Table_27a7140bf7c847d8acb10f2ac4c04bcf [id=a99492ccd2464bc2b1885ade4a76db9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.115392 1561 consensus_queue.cc:260] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.116050 1561 ts_tablet_manager.cc:1428] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260927 15:06:02.116415 1561 tablet_bootstrap.cc:492] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:02.117602 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d6bdc1ac004d889aac36db65afbbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.119172 1561 tablet_bootstrap.cc:654] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.120472 1133 tablet_service.cc:1467] Processing CreateTablet for tablet f271c76b5f2447239d3d014fbde4e8b2 (DEFAULT_TABLE table=default.Table_e54284c6f69f46a58add5dfc7c9bec4a [id=6b5a311a2ea347fb8e51feecb8e01b7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.120872 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f271c76b5f2447239d3d014fbde4e8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.121838 1403 tablet_service.cc:1467] Processing CreateTablet for tablet f271c76b5f2447239d3d014fbde4e8b2 (DEFAULT_TABLE table=default.Table_e54284c6f69f46a58add5dfc7c9bec4a [id=6b5a311a2ea347fb8e51feecb8e01b7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.123121 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 3efc44686be2407cbcdca61909301539 (DEFAULT_TABLE table=default.Table_90059eaac20f42eead7d864d2e91a12e [id=20050d0c476441cc882540df66f162fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.123472 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3efc44686be2407cbcdca61909301539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.123629 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 3efc44686be2407cbcdca61909301539 (DEFAULT_TABLE table=default.Table_90059eaac20f42eead7d864d2e91a12e [id=20050d0c476441cc882540df66f162fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.124066 1137 tablet_service.cc:1467] Processing CreateTablet for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (DEFAULT_TABLE table=default.Table_0f11b40830cd4696a3e43054e33ed454 [id=7e847271183947df9443097f992a88b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.124894 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.133405 1406 tablet_service.cc:1467] Processing CreateTablet for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (DEFAULT_TABLE table=default.Table_0f11b40830cd4696a3e43054e33ed454 [id=7e847271183947df9443097f992a88b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.134959 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 429088342b4743c39fb1e38d235024de (DEFAULT_TABLE table=default.Table_294f26f04be64c4f8564c20e515fabb9 [id=09a85e91664d444eab58b705a3be138d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.135100 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27c3283a40f14eb4868767799cfdf7bd" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:02.135344 1438 raft_consensus.cc:2454] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:02.135512 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 429088342b4743c39fb1e38d235024de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.137786 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0e6e3600cbf741419bc7b93eec42eb13 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]). Expected version 1 got 0
I20260927 15:06:02.138477 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 429088342b4743c39fb1e38d235024de (DEFAULT_TABLE table=default.Table_294f26f04be64c4f8564c20e515fabb9 [id=09a85e91664d444eab58b705a3be138d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.140658 1099 leader_election.cc:302] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:02.140955 1725 raft_consensus.cc:2781] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:02.141064 1725 raft_consensus.cc:482] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:02.141185 1725 raft_consensus.cc:3037] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.141907 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe (DEFAULT_TABLE table=default.Table_27a7140bf7c847d8acb10f2ac4c04bcf [id=a99492ccd2464bc2b1885ade4a76db9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.142324 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 1ef93a120f00423d91664ce4eaf03803 (DEFAULT_TABLE table=default.Table_996a8c79612d4f8f81e6849eb51715b9 [id=40aeb63abca64c3a8d12f9085fd816d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.142987 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d6bdc1ac004d889aac36db65afbbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.143105 1281 tablet_service.cc:1467] Processing CreateTablet for tablet f271c76b5f2447239d3d014fbde4e8b2 (DEFAULT_TABLE table=default.Table_e54284c6f69f46a58add5dfc7c9bec4a [id=6b5a311a2ea347fb8e51feecb8e01b7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.143303 1278 tablet_service.cc:1467] Processing CreateTablet for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (DEFAULT_TABLE table=default.Table_0f11b40830cd4696a3e43054e33ed454 [id=7e847271183947df9443097f992a88b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.143477 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f271c76b5f2447239d3d014fbde4e8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.143690 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.145965 1556 tablet_bootstrap.cc:492] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:02.146982 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 429088342b4743c39fb1e38d235024de (DEFAULT_TABLE table=default.Table_294f26f04be64c4f8564c20e515fabb9 [id=09a85e91664d444eab58b705a3be138d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.147091 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 3efc44686be2407cbcdca61909301539 (DEFAULT_TABLE table=default.Table_90059eaac20f42eead7d864d2e91a12e [id=20050d0c476441cc882540df66f162fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.148128 1556 tablet_bootstrap.cc:654] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.150754 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0e6e3600cbf741419bc7b93eec42eb13 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]). Expected version 1 got 0
I20260927 15:06:02.153195 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d30c425670fb48e8b23a840865bee28b" } modify_external_catalogs: true
I20260927 15:06:02.153889 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d30c425670fb48e8b23a840865bee28b" } modify_external_catalogs: true
I20260927 15:06:02.154227 1725 raft_consensus.cc:504] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.154992 1725 leader_election.cc:288] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.155333 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3efc44686be2407cbcdca61909301539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.155596 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 429088342b4743c39fb1e38d235024de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.155768 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27c3283a40f14eb4868767799cfdf7bd" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:02.156495 1102 leader_election.cc:341] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.158957 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ef93a120f00423d91664ce4eaf03803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.159140 1562 ts_tablet_manager.cc:1918] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:02.159252 1562 log.cc:1196] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/3a8d33202ebc4e37b598d62d66472f31
I20260927 15:06:02.159307 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27c3283a40f14eb4868767799cfdf7bd" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:02.159538 1438 raft_consensus.cc:3037] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.160020 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4f05da432f041378c5ab808536e6b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.160596 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9576d1a36d7547bf81faabe9c362e3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.161113 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ef93a120f00423d91664ce4eaf03803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.161506 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d6bdc1ac004d889aac36db65afbbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.161929 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3efc44686be2407cbcdca61909301539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.162371 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.162443 1438 raft_consensus.cc:2454] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:02.162771 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f271c76b5f2447239d3d014fbde4e8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.163193 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 429088342b4743c39fb1e38d235024de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.163298 1099 leader_election.cc:302] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:02.163717 1799 raft_consensus.cc:2781] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:02.163834 1799 raft_consensus.cc:686] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:02.164096 1799 consensus_queue.cc:237] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.168740 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_372c248535f74b55adc8c643989b8e57" } new_table_name: "default.Table_060d882a43514f8abc1ee73fd897d1bf" modify_external_catalogs: true
I20260927 15:06:02.170413 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_99dd24a63c524768a5e8485d5610b507" } new_table_name: "default.Table_83597ebfdee14f58abf228d7cd16bbd3" modify_external_catalogs: true
I20260927 15:06:02.171087 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a26de115d3a9477f8b879db21ba9bf8d" } modify_external_catalogs: true
I20260927 15:06:02.171284 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a26de115d3a9477f8b879db21ba9bf8d" } modify_external_catalogs: true
I20260927 15:06:02.175436 1561 tablet_bootstrap.cc:492] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:02.175612 1561 ts_tablet_manager.cc:1397] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.059s user 0.000s sys 0.003s
I20260927 15:06:02.176820 1561 raft_consensus.cc:348] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.177062 1561 raft_consensus.cc:374] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.177125 1561 raft_consensus.cc:729] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.177425 1561 consensus_queue.cc:260] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.178095 1561 ts_tablet_manager.cc:1428] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260927 15:06:02.178399 1561 tablet_bootstrap.cc:492] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:02.180590 1561 tablet_bootstrap.cc:654] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.181752 1866 raft_consensus.cc:2781] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:02.181972 1866 raft_consensus.cc:686] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:02.182665 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_940e7b3b563049e2bb3768e18c0affc9" } new_table_name: "default.Table_af3d6c72bfa14a6d8f04be3fb4a72235" modify_external_catalogs: true
I20260927 15:06:02.182258 1866 consensus_queue.cc:237] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.193820 1552 ts_tablet_manager.cc:1428] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.145s user 0.002s sys 0.000s
W20260927 15:06:02.194868 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 078ba40ca56745b2a2b86402a1519011 has no consensus state
W20260927 15:06:02.196792 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2268d824f5324cd1b81879e2fe4fd027 has no consensus state
I20260927 15:06:02.197935 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c65bc09865bc4a0283eaa4af9f860bdd
I20260927 15:06:02.198395 905 catalog_manager.cc:6565] ReplaceTablet: tablet c65bc09865bc4a0283eaa4af9f860bdd deleted and replaced by tablet db09498a395b4570a34d32fbfc71e8ed
I20260927 15:06:02.199154 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cb859b43634c420382da5c201ce24dfc
I20260927 15:06:02.200093 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet cb859b43634c420382da5c201ce24dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:02.200542 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48e7eac8753f425d90302360d228ee54 consensus state has no leader
I20260927 15:06:02.201505 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd with delete_type TABLET_DATA_DELETED (replaced by tablet db09498a395b4570a34d32fbfc71e8ed) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.201850 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet cb859b43634c420382da5c201ce24dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.199154 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd with delete_type TABLET_DATA_DELETED (replaced by tablet db09498a395b4570a34d32fbfc71e8ed) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.199800 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet cb859b43634c420382da5c201ce24dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.203070 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_083e1ad3d401408dabc1266d11ab2734"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.203756 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_083e1ad3d401408dabc1266d11ab2734 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.205458 1552 tablet_bootstrap.cc:492] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:02.205654 908 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 981a46644db940c6b558416a3856aa32
W20260927 15:06:02.208879 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 424b66c69254487f932894516d570204 consensus state has no leader
I20260927 15:06:02.209235 1552 tablet_bootstrap.cc:654] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.210865 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1a0416550bbc4a05bc617171ed8c1504" } modify_external_catalogs: true
I20260927 15:06:02.211086 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1a0416550bbc4a05bc617171ed8c1504" } modify_external_catalogs: true
I20260927 15:06:02.214564 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd with delete_type TABLET_DATA_DELETED (replaced by tablet db09498a395b4570a34d32fbfc71e8ed) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.217331 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e362bbc19fce4b2a842bd907b98ede40" } modify_external_catalogs: true
I20260927 15:06:02.217542 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e362bbc19fce4b2a842bd907b98ede40" } modify_external_catalogs: true
I20260927 15:06:02.221869 1559 ts_tablet_manager.cc:1918] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.227859 1559 log.cc:1196] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/6cf0ef42c0944b049a8ce68531ed8e45
I20260927 15:06:02.228047 1143 tablet_service.cc:1467] Processing CreateTablet for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 (DEFAULT_TABLE table=default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.228492 1559 ts_tablet_manager.cc:1939] T 6cf0ef42c0944b049a8ce68531ed8e45 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:02.229741 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 6cf0ef42c0944b049a8ce68531ed8e45 (table default.Table_607ad366580d4bd58b8879b581554873 [id=22e6dc77a3c3419aa3e7034a48773f8f]) successfully deleted
I20260927 15:06:02.227133 1415 tablet_service.cc:1467] Processing CreateTablet for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 (DEFAULT_TABLE table=default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.230533 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.234429 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 4b9e88c3679d412cac7603f200cf899b
W20260927 15:06:02.235976 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8790d59beb804acb8e4353f862d7f6f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8790d59beb804acb8e4353f862d7f6f8 already in progress: creating tablet
I20260927 15:06:02.236546 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b9e88c3679d412cac7603f200cf899b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.236835 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.239090 1556 tablet_bootstrap.cc:492] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:02.239303 1556 ts_tablet_manager.cc:1397] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.093s user 0.001s sys 0.003s
I20260927 15:06:02.239601 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 42baac8b7d47433e826eb3bc1980acaa
I20260927 15:06:02.240320 1556 raft_consensus.cc:348] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.241024 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 42baac8b7d47433e826eb3bc1980acaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.241012 1556 raft_consensus.cc:374] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.241539 1556 raft_consensus.cc:729] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.241881 1556 consensus_queue.cc:260] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.242393 1562 ts_tablet_manager.cc:1939] T 3a8d33202ebc4e37b598d62d66472f31 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:02.242673 1559 tablet_replica.cc:330] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:02.244161 1562 tablet_replica.cc:330] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:02.244081 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 568ba79ea795403cba76fb6632efd7e2 (DEFAULT_TABLE table=default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.244551 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 568ba79ea795403cba76fb6632efd7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.246415 1827 raft_consensus.cc:482] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.246579 1827 raft_consensus.cc:504] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.247280 1827 leader_election.cc:288] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:02.247578 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 3042c17580d54082971b761433a7dca9 (DEFAULT_TABLE table=default.Table_190c56d51dc446aa8a208d631e35f3d2 [id=d80cbbb5881e42f0b5651563d6f60bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.247958 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3042c17580d54082971b761433a7dca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.252583 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc971defe6d148439a6a0b8c55d9092e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:02.253131 1165 raft_consensus.cc:2454] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:02.253743 1404 tablet_service.cc:1467] Processing CreateTablet for tablet a8de6246f7904f6c80df624f3631db17 (DEFAULT_TABLE table=default.Table_e18064a8c28446469b9ea854acda2a65 [id=f4b1254299c64997962c71b810f7cc67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.254158 1374 leader_election.cc:302] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:02.254518 1827 raft_consensus.cc:2781] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:02.254635 1827 raft_consensus.cc:482] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:02.254711 1827 raft_consensus.cc:3037] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.256032 1416 tablet_service.cc:1467] Processing CreateTablet for tablet df6d7670381b49bb927943b2ee920c84 (DEFAULT_TABLE table=default.Table_868afe47a2504c16883e32967e707061 [id=2125b2fb567a43128346e08a4370ace2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.256397 1562 raft_consensus.cc:2229] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:02.256711 1562 pending_rounds.cc:62] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:02.256688 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 214229a8283b43c4916a5db7ba120e03 (DEFAULT_TABLE table=default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce [id=9b5989d83cc345ba90e2adfcc86f3925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.256982 1562 pending_rounds.cc:68] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976314208215040 op_type: NO_OP noop_request { }
I20260927 15:06:02.257131 1562 raft_consensus.cc:2866] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:02.254177 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8de6246f7904f6c80df624f3631db17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.257599 1562 raft_consensus.cc:2258] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.257542 1827 raft_consensus.cc:504] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.258157 1562 ts_tablet_manager.cc:1905] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.259351 1827 leader_election.cc:288] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:02.259742 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df6d7670381b49bb927943b2ee920c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.259845 1561 tablet_bootstrap.cc:492] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:02.259981 1561 ts_tablet_manager.cc:1397] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.082s user 0.001s sys 0.021s
I20260927 15:06:02.260824 1561 raft_consensus.cc:348] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.261025 1561 raft_consensus.cc:374] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.261615 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 3a8d33202ebc4e37b598d62d66472f31 (table default.Table_dc82ae0788b94be68a26ad903bf087fb [id=26cdf96fac4b455faf5607f72aa6f2f5]) successfully deleted
W20260927 15:06:02.261897 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0df4a23269244191bf1dcd69cb34d371 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0df4a23269244191bf1dcd69cb34d371 already in progress: creating tablet
W20260927 15:06:02.262121 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8790d59beb804acb8e4353f862d7f6f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8790d59beb804acb8e4353f862d7f6f8 already in progress: creating tablet
I20260927 15:06:02.263060 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 214229a8283b43c4916a5db7ba120e03 (DEFAULT_TABLE table=default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce [id=9b5989d83cc345ba90e2adfcc86f3925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.263239 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc971defe6d148439a6a0b8c55d9092e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:02.263852 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 3042c17580d54082971b761433a7dca9 (DEFAULT_TABLE table=default.Table_190c56d51dc446aa8a208d631e35f3d2 [id=d80cbbb5881e42f0b5651563d6f60bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.264668 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214229a8283b43c4916a5db7ba120e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.266943 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 75645963963e4091af0edfcbc794fb2d (DEFAULT_TABLE table=default.Table_702f8a99c52f4aa197c9a40e3cc7dfa4 [id=da5cb53dfb334293a19963596688240b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.267524 1136 tablet_service.cc:1467] Processing CreateTablet for tablet df6d7670381b49bb927943b2ee920c84 (DEFAULT_TABLE table=default.Table_868afe47a2504c16883e32967e707061 [id=2125b2fb567a43128346e08a4370ace2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.267582 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_862695dd435f415a9be8f6394105e76a" } modify_external_catalogs: true
I20260927 15:06:02.267860 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_862695dd435f415a9be8f6394105e76a" } modify_external_catalogs: true
I20260927 15:06:02.269765 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 568ba79ea795403cba76fb6632efd7e2 (DEFAULT_TABLE table=default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.273684 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b9e88c3679d412cac7603f200cf899b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.274310 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214229a8283b43c4916a5db7ba120e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.274636 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75645963963e4091af0edfcbc794fb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.276616 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3042c17580d54082971b761433a7dca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.243428 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 75645963963e4091af0edfcbc794fb2d (DEFAULT_TABLE table=default.Table_702f8a99c52f4aa197c9a40e3cc7dfa4 [id=da5cb53dfb334293a19963596688240b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.279729 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75645963963e4091af0edfcbc794fb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.274286 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 42baac8b7d47433e826eb3bc1980acaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.280854 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df6d7670381b49bb927943b2ee920c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.281286 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 568ba79ea795403cba76fb6632efd7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.281255 1165 raft_consensus.cc:3037] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.283857 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2c4a123886a847d08b2a94ff5e4e01ca
I20260927 15:06:02.227931 1278 tablet_service.cc:1467] Processing CreateTablet for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 (DEFAULT_TABLE table=default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.248181 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc971defe6d148439a6a0b8c55d9092e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:02.259456 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc971defe6d148439a6a0b8c55d9092e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:02.263643 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 42baac8b7d47433e826eb3bc1980acaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.264357 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 568ba79ea795403cba76fb6632efd7e2 (DEFAULT_TABLE table=default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:02.286563 1102 consensus_peers.cc:487] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:02.286695 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 568ba79ea795403cba76fb6632efd7e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.286943 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 28f6bef5f000441090f73eb842450362 (DEFAULT_TABLE table=default.Table_083e1ad3d401408dabc1266d11ab2734 [id=77045a2c0b5143e19139d270564a1a27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.287588 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 81e0be77dff645f795237ffe779ed684 (DEFAULT_TABLE table=default.Table_cd9a04e478fd4b95a2dfc85613965e31 [id=2602f6dfc6ac49a8ac3f4af47b38f21b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.288017 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81e0be77dff645f795237ffe779ed684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.289036 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 4e2c5c3d0f574422be80b318395f199a (DEFAULT_TABLE table=default.Table_8f07b64c8bf84ad088c74e987afe40bb [id=af51707999a3423eb299b4355848753c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.289388 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e2c5c3d0f574422be80b318395f199a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.290354 1165 raft_consensus.cc:2454] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:02.291059 1374 leader_election.cc:302] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:02.265070 1277 tablet_service.cc:1467] Processing CreateTablet for tablet a8de6246f7904f6c80df624f3631db17 (DEFAULT_TABLE table=default.Table_e18064a8c28446469b9ea854acda2a65 [id=f4b1254299c64997962c71b810f7cc67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.291605 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8de6246f7904f6c80df624f3631db17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.291604 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 81e0be77dff645f795237ffe779ed684 (DEFAULT_TABLE table=default.Table_cd9a04e478fd4b95a2dfc85613965e31 [id=2602f6dfc6ac49a8ac3f4af47b38f21b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.265443 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 3042c17580d54082971b761433a7dca9 (DEFAULT_TABLE table=default.Table_190c56d51dc446aa8a208d631e35f3d2 [id=d80cbbb5881e42f0b5651563d6f60bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.295203 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3042c17580d54082971b761433a7dca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.297883 908 catalog_manager.cc:5495] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:02.298202 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 4e2c5c3d0f574422be80b318395f199a (DEFAULT_TABLE table=default.Table_8f07b64c8bf84ad088c74e987afe40bb [id=af51707999a3423eb299b4355848753c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.298348 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 27c3283a40f14eb4868767799cfdf7bd (table default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85]). Expected version 2 got 0
I20260927 15:06:02.266175 1284 tablet_service.cc:1467] Processing CreateTablet for tablet df6d7670381b49bb927943b2ee920c84 (DEFAULT_TABLE table=default.Table_868afe47a2504c16883e32967e707061 [id=2125b2fb567a43128346e08a4370ace2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.298856 1283 tablet_service.cc:1467] Processing CreateTablet for tablet adf68ba5020446bf8b522ac6db0e21e7 (DEFAULT_TABLE table=default.Table_b02433e9b8104b55a95ec09c1725dc4a [id=3fc04b4c774144dd85bbb92d05883018]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.267122 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 214229a8283b43c4916a5db7ba120e03 (DEFAULT_TABLE table=default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce [id=9b5989d83cc345ba90e2adfcc86f3925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.299217 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df6d7670381b49bb927943b2ee920c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.299431 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214229a8283b43c4916a5db7ba120e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.291900 1141 tablet_service.cc:1467] Processing CreateTablet for tablet a8de6246f7904f6c80df624f3631db17 (DEFAULT_TABLE table=default.Table_e18064a8c28446469b9ea854acda2a65 [id=f4b1254299c64997962c71b810f7cc67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.299943 1561 raft_consensus.cc:729] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:06:02.300127 1376 leader_election.cc:341] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:02.300459 1376 leader_election.cc:341] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.306872 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d0cd6cf8e5f94ae4b89d2de16f324e82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.307514 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0cd6cf8e5f94ae4b89d2de16f324e82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.310559 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c4a123886a847d08b2a94ff5e4e01ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.314595 1556 ts_tablet_manager.cc:1428] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.075s user 0.002s sys 0.000s
I20260927 15:06:02.315014 1559 raft_consensus.cc:2229] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.315418 1559 raft_consensus.cc:2258] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.316617 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f6bef5f000441090f73eb842450362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.318876 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d57bcc02349c4f17b76b5a31ec74e0f2" } new_table_name: "default.Table_fac248ae4718435c9ec9d479beaaeae4" modify_external_catalogs: true
I20260927 15:06:02.319131 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81e0be77dff645f795237ffe779ed684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.320850 913 catalog_manager.cc:5495] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:02.322074 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.268486 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 75645963963e4091af0edfcbc794fb2d (DEFAULT_TABLE table=default.Table_702f8a99c52f4aa197c9a40e3cc7dfa4 [id=da5cb53dfb334293a19963596688240b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.327386 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75645963963e4091af0edfcbc794fb2d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.327406 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01b7e017ead242849585679873a69b43 consensus state has no leader
I20260927 15:06:02.334975 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 0e6e3600cbf741419bc7b93eec42eb13 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]). Expected version 1 got 0
I20260927 15:06:02.335980 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf68ba5020446bf8b522ac6db0e21e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.336187 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e2c5c3d0f574422be80b318395f199a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.336376 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f965ac4b72a24b0cbe501fbb22167eab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:02.335004 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b3b3d02944ab4032a2e7b43e366ddf57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.336982 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f965ac4b72a24b0cbe501fbb22167eab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.337422 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_34d1f85060084bebb54e57402ea08b5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.337913 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34d1f85060084bebb54e57402ea08b5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.340323 1866 raft_consensus.cc:2781] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
W20260927 15:06:02.336994 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3b3d02944ab4032a2e7b43e366ddf57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.341133 1866 raft_consensus.cc:686] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:02.341445 1866 consensus_queue.cc:237] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.346431 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4b430696cdec4858aa30fc5189839327"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:02.346845 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_81679c709d29402bb264cff71cf732e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.347162 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b430696cdec4858aa30fc5189839327 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:02.347246 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81679c709d29402bb264cff71cf732e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.351555 1556 tablet_bootstrap.cc:492] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:02.353900 1556 tablet_bootstrap.cc:654] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.355877 1559 ts_tablet_manager.cc:1905] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.275934 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 28f6bef5f000441090f73eb842450362 (DEFAULT_TABLE table=default.Table_083e1ad3d401408dabc1266d11ab2734 [id=77045a2c0b5143e19139d270564a1a27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.284641 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c4a123886a847d08b2a94ff5e4e01ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.274003 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b9e88c3679d412cac7603f200cf899b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.368186 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b33719cf7165405caf26b84396bd5f7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.368979 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b33719cf7165405caf26b84396bd5f7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.375495 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 0e6e3600cbf741419bc7b93eec42eb13 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]). Expected version 1 got 0
I20260927 15:06:02.363281 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_103a22226a8b4b2fa2165b28568f41ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.378273 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_103a22226a8b4b2fa2165b28568f41ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.380425 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f6bef5f000441090f73eb842450362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.377832 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 34822e9f900f4d04b59b810d59e6aa49 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:02.378525 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 429088342b4743c39fb1e38d235024de from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:02.383492 1559 ts_tablet_manager.cc:1918] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:02.383646 1559 log.cc:1196] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/34822e9f900f4d04b59b810d59e6aa49
I20260927 15:06:02.384109 1559 ts_tablet_manager.cc:1939] T 34822e9f900f4d04b59b810d59e6aa49 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:02.385011 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 34822e9f900f4d04b59b810d59e6aa49 (table default.Table_875cbc00c31e4798bf3ed5bf3135b0a7 [id=5c4f0f47acd14538b67f8c8d579b0696]) successfully deleted
I20260927 15:06:02.388180 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 429088342b4743c39fb1e38d235024de
I20260927 15:06:02.388813 912 catalog_manager.cc:6565] ReplaceTablet: tablet 429088342b4743c39fb1e38d235024de deleted and replaced by tablet 79a3125723034cb48bc1a05fc4abbb82
I20260927 15:06:02.389340 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 429088342b4743c39fb1e38d235024de with delete_type TABLET_DATA_DELETED (replaced by tablet 79a3125723034cb48bc1a05fc4abbb82) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:02.390098 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c49913b1763c4a7b9413a801aff93b30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c49913b1763c4a7b9413a801aff93b30 already in progress: creating tablet
I20260927 15:06:02.390429 1559 tablet_replica.cc:330] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:02.390681 1559 raft_consensus.cc:2229] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:02.391000 1559 pending_rounds.cc:62] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:02.391103 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 429088342b4743c39fb1e38d235024de with delete_type TABLET_DATA_DELETED (replaced by tablet 79a3125723034cb48bc1a05fc4abbb82) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.391127 1559 pending_rounds.cc:68] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976316039872512 op_type: NO_OP noop_request { }
I20260927 15:06:02.391340 1559 raft_consensus.cc:2866] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:02.391489 1559 raft_consensus.cc:2258] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.393203 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ade3cb71f3dd4d55ac7e8839474d785a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:02.393746 1559 ts_tablet_manager.cc:1905] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:02.393819 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ade3cb71f3dd4d55ac7e8839474d785a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.395074 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8de6246f7904f6c80df624f3631db17. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.395699 1099 consensus_peers.cc:487] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 443af328e5154bdba9b570224616d77b. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:02.399122 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 429088342b4743c39fb1e38d235024de with delete_type TABLET_DATA_DELETED (replaced by tablet 79a3125723034cb48bc1a05fc4abbb82) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.399313 1805 ts_tablet_manager.cc:1918] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:02.394948 1561 consensus_queue.cc:260] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.399441 1805 log.cc:1196] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/7a42ae7589c24b1bbd833ab8838521ae
I20260927 15:06:02.399776 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 81e0be77dff645f795237ffe779ed684 (DEFAULT_TABLE table=default.Table_cd9a04e478fd4b95a2dfc85613965e31 [id=2602f6dfc6ac49a8ac3f4af47b38f21b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.400020 1805 ts_tablet_manager.cc:1939] T 7a42ae7589c24b1bbd833ab8838521ae P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:02.402172 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 7a42ae7589c24b1bbd833ab8838521ae (table default.Table_590e6d5e78b5436fa3687cf0b70e1921 [id=f8681c26dbe446b19c269790f5078b22]) successfully deleted
I20260927 15:06:02.403868 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 4e2c5c3d0f574422be80b318395f199a (DEFAULT_TABLE table=default.Table_8f07b64c8bf84ad088c74e987afe40bb [id=af51707999a3423eb299b4355848753c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.404642 1805 tablet_replica.cc:330] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:02.404661 1415 tablet_service.cc:1467] Processing CreateTablet for tablet adf68ba5020446bf8b522ac6db0e21e7 (DEFAULT_TABLE table=default.Table_b02433e9b8104b55a95ec09c1725dc4a [id=3fc04b4c774144dd85bbb92d05883018]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.404927 1805 raft_consensus.cc:2229] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.405115 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf68ba5020446bf8b522ac6db0e21e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.408176 1805 raft_consensus.cc:2258] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.408730 1805 ts_tablet_manager.cc:1905] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.412417 1559 ts_tablet_manager.cc:1918] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:02.412614 1559 log.cc:1196] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/bbcffb8cedd74b18871988201f9db2e5
I20260927 15:06:02.413115 1559 ts_tablet_manager.cc:1939] T bbcffb8cedd74b18871988201f9db2e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:02.412818 809 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 53405.9us
I20260927 15:06:02.414247 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet bbcffb8cedd74b18871988201f9db2e5 (table default.Table_bd1398c934c0418eba63a6b9c0646259 [id=83855eb214b1496297178563cb7eb2cd]) successfully deleted
I20260927 15:06:02.414373 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c9e4311049d47d3b2f1e117795624ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:02.415030 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 214229a8283b43c4916a5db7ba120e03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 214229a8283b43c4916a5db7ba120e03 already in progress: creating tablet
W20260927 15:06:02.415597 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a8de6246f7904f6c80df624f3631db17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8de6246f7904f6c80df624f3631db17 already in progress: creating tablet
I20260927 15:06:02.415989 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3c89cbbe4c0242f5b21b7c86fe5199e1" } new_table_name: "default.Table_1a919c358b5340f7a616321c89f236a4" modify_external_catalogs: true
I20260927 15:06:02.417543 1559 tablet_replica.cc:330] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:02.417766 1559 raft_consensus.cc:2229] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.417953 1559 raft_consensus.cc:2258] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:02.416620 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9cb0ab983a444d26b903a0cec64f15f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb0ab983a444d26b903a0cec64f15f0 already in progress: creating tablet
I20260927 15:06:02.417982 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 1a89ce4434ad4171bf613d4bbb3337a8 (DEFAULT_TABLE table=default.Table_55df6d1d64674ec48c904460dbb96a29 [id=c7a0bfa8fa9746db975d61a3b342803b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:02.418334 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6b1f2143af1142eb9f3dbc777299c186 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b1f2143af1142eb9f3dbc777299c186 already in progress: creating tablet
W20260927 15:06:02.418546 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fde632b187eb4180b343d7bddc7f0943 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fde632b187eb4180b343d7bddc7f0943 already in progress: creating tablet
I20260927 15:06:02.418691 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a89ce4434ad4171bf613d4bbb3337a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.418802 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f965ac4b72a24b0cbe501fbb22167eab" } modify_external_catalogs: true
I20260927 15:06:02.419029 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f965ac4b72a24b0cbe501fbb22167eab" } modify_external_catalogs: true
W20260927 15:06:02.418781 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8af844423fc94e2c8380db179103d3aa because the tablet was not found. No further retry: Not found: Tablet not found: 8af844423fc94e2c8380db179103d3aa
I20260927 15:06:02.419303 1415 tablet_service.cc:1467] Processing CreateTablet for tablet bd5b041a4274477895e88d4822b91cca (DEFAULT_TABLE table=default.Table_fa7b0e87e81842e5a14ce4457fd9dafe [id=1f51698c91d64bb38f760d13529935b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.419879 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd5b041a4274477895e88d4822b91cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.420570 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 28f6bef5f000441090f73eb842450362 (DEFAULT_TABLE table=default.Table_083e1ad3d401408dabc1266d11ab2734 [id=77045a2c0b5143e19139d270564a1a27]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:02.422480 1376 consensus_peers.cc:487] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:02.417985 1276 tablet_service.cc:1467] Processing CreateTablet for tablet bd5b041a4274477895e88d4822b91cca (DEFAULT_TABLE table=default.Table_fa7b0e87e81842e5a14ce4457fd9dafe [id=1f51698c91d64bb38f760d13529935b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.423166 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd5b041a4274477895e88d4822b91cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.426195 1562 ts_tablet_manager.cc:1918] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:02.426394 1562 log.cc:1196] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/87cc6cc43a4a4ed1ac79e1902aca9fe5
I20260927 15:06:02.426610 1559 ts_tablet_manager.cc:1905] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.426898 914 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 9855341d19c7463982c085694a293ff3
I20260927 15:06:02.427567 1556 tablet_bootstrap.cc:492] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:02.427904 1556 ts_tablet_manager.cc:1397] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.002s
I20260927 15:06:02.427940 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fb33d66f39634767ba162859269f434e" } new_table_name: "default.Table_b8aa94cb5ee04c6fa81a8b5a2319d15c" modify_external_catalogs: true
I20260927 15:06:02.429148 1556 raft_consensus.cc:348] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.429559 1556 raft_consensus.cc:374] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.429705 1556 raft_consensus.cc:729] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.430568 1562 ts_tablet_manager.cc:1939] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:02.431794 1562 tablet_replica.cc:330] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:02.432045 1562 raft_consensus.cc:2229] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.432220 1562 raft_consensus.cc:2258] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.432758 1562 ts_tablet_manager.cc:1905] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:02.432974 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 46020.5us
I20260927 15:06:02.433699 1725 raft_consensus.cc:482] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.434134 1725 raft_consensus.cc:504] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.434705 1725 leader_election.cc:288] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.435303 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba7faf6e79db420db13999d74fe86062" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:02.435515 1561 ts_tablet_manager.cc:1428] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.142s user 0.000s sys 0.002s
I20260927 15:06:02.436384 1135 tablet_service.cc:1467] Processing CreateTablet for tablet adf68ba5020446bf8b522ac6db0e21e7 (DEFAULT_TABLE table=default.Table_b02433e9b8104b55a95ec09c1725dc4a [id=3fc04b4c774144dd85bbb92d05883018]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:02.436882 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9a97e3e6a5749feb4dd5f835d9c01ac consensus state has no leader
I20260927 15:06:02.432500 1556 consensus_queue.cc:260] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.439783 1556 ts_tablet_manager.cc:1428] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260927 15:06:02.441042 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 1a89ce4434ad4171bf613d4bbb3337a8 (DEFAULT_TABLE table=default.Table_55df6d1d64674ec48c904460dbb96a29 [id=c7a0bfa8fa9746db975d61a3b342803b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.441452 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a89ce4434ad4171bf613d4bbb3337a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.441515 1556 tablet_bootstrap.cc:492] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:02.444221 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81e0be77dff645f795237ffe779ed684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.444617 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f6bef5f000441090f73eb842450362. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.444715 1102 leader_election.cc:341] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.445015 1561 tablet_bootstrap.cc:492] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:02.445825 1799 raft_consensus.cc:482] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.445951 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_305a912a4d114bd5a0d5e527d05ca887" } modify_external_catalogs: true
I20260927 15:06:02.446194 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_305a912a4d114bd5a0d5e527d05ca887" } modify_external_catalogs: true
I20260927 15:06:02.447148 1285 tablet_service.cc:1467] Processing CreateTablet for tablet d463a481cb8c4243961e9b0d2b11822c (DEFAULT_TABLE table=default.Table_f1973c1b1bb545a098000d81bf8c4223 [id=9f11325f98a4445eb6ee1d8c251866fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.447621 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d463a481cb8c4243961e9b0d2b11822c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.447988 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b3b3d02944ab4032a2e7b43e366ddf57" } new_table_name: "default.Table_a26bdbe66d9a438ab4a3a6cf93fbe430" modify_external_catalogs: true
I20260927 15:06:02.449278 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_755d73e8fa1340cf82c0c60ecc9fc5b5" } new_table_name: "default.Table_e8855d7ecbd54e2eb65a1b2dd6addb4c" modify_external_catalogs: true
I20260927 15:06:02.450397 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 (table default.Table_03f21e43b48e4663bf25f8656a9ee2b4 [id=64ae6d29aaaf4705896336b4faa6eb13]) successfully deleted
W20260927 15:06:02.450629 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8f15485b8825436184abe2621c71e356 because the tablet was not found. No further retry: Not found: Tablet not found: 8f15485b8825436184abe2621c71e356
W20260927 15:06:02.448307 1099 leader_election.cc:341] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ba7faf6e79db420db13999d74fe86062
I20260927 15:06:02.456231 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e2c5c3d0f574422be80b318395f199a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.457605 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 2268d824f5324cd1b81879e2fe4fd027 (DEFAULT_TABLE table=default.Table_83597ebfdee14f58abf228d7cd16bbd3 [id=b36bff625e7a4da699490e2921c33802]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.457980 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2268d824f5324cd1b81879e2fe4fd027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.458936 1099 leader_election.cc:302] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:02.459566 1725 raft_consensus.cc:2726] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:02.460021 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fd5f2ab9677c4598b0b8d9a93a6a23c7
W20260927 15:06:02.460116 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e19cd7febe054432899739e21605406d consensus state has no leader
I20260927 15:06:02.461288 1141 tablet_service.cc:1467] Processing CreateTablet for tablet bd5b041a4274477895e88d4822b91cca (DEFAULT_TABLE table=default.Table_fa7b0e87e81842e5a14ce4457fd9dafe [id=1f51698c91d64bb38f760d13529935b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.463605 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.464376 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c4a123886a847d08b2a94ff5e4e01ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.466384 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf68ba5020446bf8b522ac6db0e21e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.467984 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 63fbd388210d4a1aabfcf27c7533efbf (DEFAULT_TABLE table=default.Table_5d29cefe8c174dd89895f67e0784bf77 [id=35b9ecf64d084b66b80115a19fd1055a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.468497 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63fbd388210d4a1aabfcf27c7533efbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.469297 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:02.470932 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac64eacc7d924940aacc8779b5bfeae7 has no consensus state
I20260927 15:06:02.470985 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.471328 1706 raft_consensus.cc:482] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.447608 1799 raft_consensus.cc:504] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.471463 1706 raft_consensus.cc:504] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.472040 1799 leader_election.cc:288] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.472123 1706 leader_election.cc:288] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.472695 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da1812142bb043fba7457dc61ffdb180" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:02.473117 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_024037ff57734bfa973dff7fd4f09896" } modify_external_catalogs: true
I20260927 15:06:02.473327 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_024037ff57734bfa973dff7fd4f09896" } modify_external_catalogs: true
I20260927 15:06:02.474417 1279 tablet_service.cc:1467] Processing CreateTablet for tablet e19cd7febe054432899739e21605406d (DEFAULT_TABLE table=default.Table_1a919c358b5340f7a616321c89f236a4 [id=9a56fa8ed14a4bff867d4648b4491c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.474922 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e19cd7febe054432899739e21605406d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.474992 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_336bf4e2b65f4a6ea300b83b198b1b4f" } modify_external_catalogs: true
I20260927 15:06:02.475153 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_336bf4e2b65f4a6ea300b83b198b1b4f" } modify_external_catalogs: true
I20260927 15:06:02.475430 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_144247c8f6c749539a8c431dd3e74d17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.475996 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_144247c8f6c749539a8c431dd3e74d17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.477351 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 541147938d864cd9ad7208d96533b0f4 (DEFAULT_TABLE table=default.Table_2c585ef1be384bbf993054ce07ec28d2 [id=ad01215da9fd4367aff8c096e377eb4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.477735 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 541147938d864cd9ad7208d96533b0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.479898 1403 tablet_service.cc:1467] Processing CreateTablet for tablet d463a481cb8c4243961e9b0d2b11822c (DEFAULT_TABLE table=default.Table_f1973c1b1bb545a098000d81bf8c4223 [id=9f11325f98a4445eb6ee1d8c251866fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.482321 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d463a481cb8c4243961e9b0d2b11822c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.483695 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4f05da432f041378c5ab808536e6b6f consensus state has no leader
I20260927 15:06:02.483889 1561 tablet_bootstrap.cc:654] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.484148 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd5b041a4274477895e88d4822b91cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.484467 1417 tablet_service.cc:1467] Processing CreateTablet for tablet e19cd7febe054432899739e21605406d (DEFAULT_TABLE table=default.Table_1a919c358b5340f7a616321c89f236a4 [id=9a56fa8ed14a4bff867d4648b4491c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.484925 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e19cd7febe054432899739e21605406d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.484965 1552 tablet_bootstrap.cc:492] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:02.485198 1552 ts_tablet_manager.cc:1397] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.281s user 0.003s sys 0.003s
I20260927 15:06:02.486002 1552 raft_consensus.cc:348] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.486340 1552 raft_consensus.cc:374] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.486492 1552 raft_consensus.cc:729] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:02.486898 1238 leader_election.cc:341] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 148c77a0e88b40f690ca96f091b78d9a
I20260927 15:06:02.487074 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 541147938d864cd9ad7208d96533b0f4 (DEFAULT_TABLE table=default.Table_2c585ef1be384bbf993054ce07ec28d2 [id=ad01215da9fd4367aff8c096e377eb4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.487425 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 541147938d864cd9ad7208d96533b0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.487658 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.488761 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 2268d824f5324cd1b81879e2fe4fd027 (DEFAULT_TABLE table=default.Table_83597ebfdee14f58abf228d7cd16bbd3 [id=b36bff625e7a4da699490e2921c33802]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.492025 1799 raft_consensus.cc:482] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.491994 1133 tablet_service.cc:1467] Processing CreateTablet for tablet d463a481cb8c4243961e9b0d2b11822c (DEFAULT_TABLE table=default.Table_f1973c1b1bb545a098000d81bf8c4223 [id=9f11325f98a4445eb6ee1d8c251866fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.492108 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 2268d824f5324cd1b81879e2fe4fd027 (DEFAULT_TABLE table=default.Table_83597ebfdee14f58abf228d7cd16bbd3 [id=b36bff625e7a4da699490e2921c33802]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.492446 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2268d824f5324cd1b81879e2fe4fd027. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.489910 1102 leader_election.cc:341] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.493283 1552 consensus_queue.cc:260] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.494092 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 63fbd388210d4a1aabfcf27c7533efbf (DEFAULT_TABLE table=default.Table_5d29cefe8c174dd89895f67e0784bf77 [id=35b9ecf64d084b66b80115a19fd1055a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.493397 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 1a89ce4434ad4171bf613d4bbb3337a8 (DEFAULT_TABLE table=default.Table_55df6d1d64674ec48c904460dbb96a29 [id=c7a0bfa8fa9746db975d61a3b342803b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.494395 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63fbd388210d4a1aabfcf27c7533efbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.493835 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da1812142bb043fba7457dc61ffdb180" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:02.494875 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 63fbd388210d4a1aabfcf27c7533efbf (DEFAULT_TABLE table=default.Table_5d29cefe8c174dd89895f67e0784bf77 [id=35b9ecf64d084b66b80115a19fd1055a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.495168 1799 raft_consensus.cc:504] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.495859 1559 ts_tablet_manager.cc:1918] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.496263 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cd76c49eda1c4b4ca0edf0f4d2790188
I20260927 15:06:02.496302 1799 leader_election.cc:288] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:02.496645 1239 leader_election.cc:341] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 148c77a0e88b40f690ca96f091b78d9a
I20260927 15:06:02.496697 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9e4311049d47d3b2f1e117795624ef" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:02.496778 1239 leader_election.cc:302] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:02.497153 1706 raft_consensus.cc:2726] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:02.497509 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2268d824f5324cd1b81879e2fe4fd027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.497876 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d463a481cb8c4243961e9b0d2b11822c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.498310 1142 tablet_service.cc:1467] Processing CreateTablet for tablet e19cd7febe054432899739e21605406d (DEFAULT_TABLE table=default.Table_1a919c358b5340f7a616321c89f236a4 [id=9a56fa8ed14a4bff867d4648b4491c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.498656 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e19cd7febe054432899739e21605406d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.499663 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4239cd3219fb4e32827288ef7222bf2f" } modify_external_catalogs: true
I20260927 15:06:02.499859 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4239cd3219fb4e32827288ef7222bf2f" } modify_external_catalogs: true
I20260927 15:06:02.500576 1439 raft_consensus.cc:2454] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:02.501302 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet cd76c49eda1c4b4ca0edf0f4d2790188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.501725 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 541147938d864cd9ad7208d96533b0f4 (DEFAULT_TABLE table=default.Table_2c585ef1be384bbf993054ce07ec28d2 [id=ad01215da9fd4367aff8c096e377eb4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.501830 1099 leader_election.cc:302] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:02.502864 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63fbd388210d4a1aabfcf27c7533efbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.502931 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9e4311049d47d3b2f1e117795624ef" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:02.504674 1556 tablet_bootstrap.cc:654] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.505610 1559 log.cc:1196] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/7d6d1cfb1a4d4c439e970d966af841b6
I20260927 15:06:02.505800 1438 raft_consensus.cc:2454] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:02.507530 1559 ts_tablet_manager.cc:1939] T 7d6d1cfb1a4d4c439e970d966af841b6 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:02.509105 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet cd76c49eda1c4b4ca0edf0f4d2790188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.509524 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 12623e6767aa4bd4934058f7314a966e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.510131 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 99d4707e599840b3bdc2ab13c348ea80 (DEFAULT_TABLE table=default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.510556 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99d4707e599840b3bdc2ab13c348ea80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.512495 1799 raft_consensus.cc:2781] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260927 15:06:02.513049 1102 leader_election.cc:341] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.513405 1559 tablet_replica.cc:330] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:02.513482 1799 raft_consensus.cc:482] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:02.513618 1799 raft_consensus.cc:3037] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.513629 1559 raft_consensus.cc:2229] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.514006 1559 raft_consensus.cc:2258] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.514292 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 078ba40ca56745b2a2b86402a1519011 (DEFAULT_TABLE table=default.Table_060d882a43514f8abc1ee73fd897d1bf [id=f8a991083fb74bfc9d9969214ac7108f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.514626 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 99d4707e599840b3bdc2ab13c348ea80 (DEFAULT_TABLE table=default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.515339 1099 leader_election.cc:302] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:02.515538 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 9ae003f1ca76472cbaa8b577b66fe84c (DEFAULT_TABLE table=default.Table_fd5116f32d66492291f3209ac235edf0 [id=8e5ae781d15d48f7924076fea8d3d292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.515748 1725 raft_consensus.cc:2781] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:02.516010 1725 raft_consensus.cc:482] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:02.516287 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet cd76c49eda1c4b4ca0edf0f4d2790188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.516731 1559 ts_tablet_manager.cc:1905] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.517028 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 541147938d864cd9ad7208d96533b0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.517261 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99d4707e599840b3bdc2ab13c348ea80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.519953 1134 tablet_service.cc:1467] Processing CreateTablet for tablet db09498a395b4570a34d32fbfc71e8ed (DEFAULT_TABLE table=default.Table_a6f756a6136d48a78b4fb2488323f3fd [id=ed34d1e88ae54c6086ae3a7cbfdf7861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.520370 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 078ba40ca56745b2a2b86402a1519011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.521027 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ae003f1ca76472cbaa8b577b66fe84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.522207 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 078ba40ca56745b2a2b86402a1519011 (DEFAULT_TABLE table=default.Table_060d882a43514f8abc1ee73fd897d1bf [id=f8a991083fb74bfc9d9969214ac7108f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.522595 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 078ba40ca56745b2a2b86402a1519011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.523028 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db09498a395b4570a34d32fbfc71e8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.522141 1725 raft_consensus.cc:3037] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.523132 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 99d4707e599840b3bdc2ab13c348ea80 (DEFAULT_TABLE table=default.Table_d8e4a9d0dbcb49878bf7891e8e712915 [id=8dc10ed6a11843b09a8a9937c145ba25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.523444 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba163e0f6164d65b09da684ee4872e0 (DEFAULT_TABLE table=default.Table_dd7090ea741141e2b5c0b1a207278282 [id=935f8397667e4d338a12c98850a26789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.523604 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99d4707e599840b3bdc2ab13c348ea80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.524544 1146 tablet_service.cc:1467] Processing CreateTablet for tablet b9a97e3e6a5749feb4dd5f835d9c01ac (DEFAULT_TABLE table=default.Table_b8aa94cb5ee04c6fa81a8b5a2319d15c [id=14db419325464ded9b465782c513f3d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.532260 1811 raft_consensus.cc:482] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.532843 1811 raft_consensus.cc:504] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.533512 1811 leader_election.cc:288] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.533826 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 7d6d1cfb1a4d4c439e970d966af841b6 (table default.Table_de263f6e08ac4eed8c0d53662d9a8b00 [id=1ff3964110d34f149e6c3c539a802ff3]) successfully deleted
I20260927 15:06:02.534492 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e6e3600cbf741419bc7b93eec42eb13" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:02.535175 1102 leader_election.cc:341] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.536096 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba163e0f6164d65b09da684ee4872e0 (DEFAULT_TABLE table=default.Table_dd7090ea741141e2b5c0b1a207278282 [id=935f8397667e4d338a12c98850a26789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.536221 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 9ae003f1ca76472cbaa8b577b66fe84c (DEFAULT_TABLE table=default.Table_fd5116f32d66492291f3209ac235edf0 [id=8e5ae781d15d48f7924076fea8d3d292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.536564 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 4714d536373a4bf2a4be9ebeaebe77c1 (DEFAULT_TABLE table=default.Table_b94ff6d2011948078b03af17b4d95fae [id=8af79e2564b34d66be63893f6a90bd04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.536764 1284 tablet_service.cc:1467] Processing CreateTablet for tablet b9a97e3e6a5749feb4dd5f835d9c01ac (DEFAULT_TABLE table=default.Table_b8aa94cb5ee04c6fa81a8b5a2319d15c [id=14db419325464ded9b465782c513f3d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.537246 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 8d533883e3344eca939cd67644895148 (DEFAULT_TABLE table=default.Table_cd87785e4030410da63d85472104fc1e [id=ba95aca9e7c449bd8fe939e896ab1ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.536571 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba163e0f6164d65b09da684ee4872e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.537746 1281 tablet_service.cc:1467] Processing CreateTablet for tablet db09498a395b4570a34d32fbfc71e8ed (DEFAULT_TABLE table=default.Table_a6f756a6136d48a78b4fb2488323f3fd [id=ed34d1e88ae54c6086ae3a7cbfdf7861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.537876 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ae003f1ca76472cbaa8b577b66fe84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.537966 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 (DEFAULT_TABLE table=default.Table_a9cb632191944d39a0dc0da5abee6a22 [id=b09765fbcc8e4859b112206dd59e8ee8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.538116 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db09498a395b4570a34d32fbfc71e8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.538298 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d533883e3344eca939cd67644895148. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.538542 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4714d536373a4bf2a4be9ebeaebe77c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.539324 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f95d664f1134ac9bbb62c1a3d4b5617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.540808 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9a97e3e6a5749feb4dd5f835d9c01ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.546993 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet b9a97e3e6a5749feb4dd5f835d9c01ac (table default.Table_b8aa94cb5ee04c6fa81a8b5a2319d15c [id=14db419325464ded9b465782c513f3d7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b9a97e3e6a5749feb4dd5f835d9c01ac consensus state has no leader
I20260927 15:06:02.552747 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 078ba40ca56745b2a2b86402a1519011 (DEFAULT_TABLE table=default.Table_060d882a43514f8abc1ee73fd897d1bf [id=f8a991083fb74bfc9d9969214ac7108f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.553504 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 078ba40ca56745b2a2b86402a1519011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.553738 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 48e7eac8753f425d90302360d228ee54
I20260927 15:06:02.559829 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 48e7eac8753f425d90302360d228ee54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.564502 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a89ce4434ad4171bf613d4bbb3337a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.565809 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c41cd38355e64590b43b2e1271c43e91
I20260927 15:06:02.573717 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 48e7eac8753f425d90302360d228ee54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.574175 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 (DEFAULT_TABLE table=default.Table_a9cb632191944d39a0dc0da5abee6a22 [id=b09765fbcc8e4859b112206dd59e8ee8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.577371 1552 ts_tablet_manager.cc:1428] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.092s user 0.001s sys 0.001s
I20260927 15:06:02.579890 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet c41cd38355e64590b43b2e1271c43e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.573025 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 8d533883e3344eca939cd67644895148 (DEFAULT_TABLE table=default.Table_cd87785e4030410da63d85472104fc1e [id=ba95aca9e7c449bd8fe939e896ab1ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.581300 1552 tablet_bootstrap.cc:492] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:02.582687 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_effad7577e2d439c8426666a6d741a88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.583518 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_effad7577e2d439c8426666a6d741a88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.585556 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fd5116f32d66492291f3209ac235edf0" } new_table_name: "default.Table_bd1cb8eaacf74059925441393660d956" modify_external_catalogs: true
I20260927 15:06:02.585525 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3ece36785b214c7fb4352a79cb3b4438"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.586059 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ece36785b214c7fb4352a79cb3b4438 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.585954 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_620928666dc94535aafb4210bb2c0411"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.586644 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_620928666dc94535aafb4210bb2c0411 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.588109 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a3ced21ba58141f5bafa240f002887b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.588902 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3ced21ba58141f5bafa240f002887b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.594399 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c46b2f0f6ed04caab359a17bf48da08a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.595032 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c46b2f0f6ed04caab359a17bf48da08a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.596662 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2f4ba0f9cc18490fa3ad87297437e526"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.597227 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f4ba0f9cc18490fa3ad87297437e526 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.598629 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_80b31537a3164aa7ad56ac09e6b8a2a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.599186 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80b31537a3164aa7ad56ac09e6b8a2a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.607229 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba163e0f6164d65b09da684ee4872e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.611379 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9a97e3e6a5749feb4dd5f835d9c01ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.612617 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d533883e3344eca939cd67644895148. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.616604 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_807b252506684a4a804a3f2a52913df8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.617169 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_807b252506684a4a804a3f2a52913df8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.618538 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f95d664f1134ac9bbb62c1a3d4b5617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.624370 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e6e3600cbf741419bc7b93eec42eb13" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:02.625733 1438 raft_consensus.cc:2454] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:02.628351 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 9ae003f1ca76472cbaa8b577b66fe84c (DEFAULT_TABLE table=default.Table_fd5116f32d66492291f3209ac235edf0 [id=8e5ae781d15d48f7924076fea8d3d292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.629607 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ae003f1ca76472cbaa8b577b66fe84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.633432 1706 raft_consensus.cc:482] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.633651 1706 raft_consensus.cc:504] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.634467 1706 leader_election.cc:288] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.635983 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet c41cd38355e64590b43b2e1271c43e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:02.636584 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba163e0f6164d65b09da684ee4872e0 (DEFAULT_TABLE table=default.Table_dd7090ea741141e2b5c0b1a207278282 [id=935f8397667e4d338a12c98850a26789]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.637739 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba163e0f6164d65b09da684ee4872e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.636396 1854 raft_consensus.cc:482] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.638401 1414 tablet_service.cc:1467] Processing CreateTablet for tablet b9a97e3e6a5749feb4dd5f835d9c01ac (DEFAULT_TABLE table=default.Table_b8aa94cb5ee04c6fa81a8b5a2319d15c [id=14db419325464ded9b465782c513f3d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.640802 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet c41cd38355e64590b43b2e1271c43e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:02.641412 1238 leader_election.cc:341] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: bb90faccda0145a7acd153fcd51b4c43
I20260927 15:06:02.641896 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 (DEFAULT_TABLE table=default.Table_a9cb632191944d39a0dc0da5abee6a22 [id=b09765fbcc8e4859b112206dd59e8ee8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.643672 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9a97e3e6a5749feb4dd5f835d9c01ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.644709 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c9e4311049d47d3b2f1e117795624ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.644908 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 4714d536373a4bf2a4be9ebeaebe77c1 (DEFAULT_TABLE table=default.Table_b94ff6d2011948078b03af17b4d95fae [id=8af79e2564b34d66be63893f6a90bd04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.642817 1273 tablet_service.cc:1467] Processing CreateTablet for tablet a8659865bf644458b3b5a78eae36a524 (DEFAULT_TABLE table=default.Table_cf1a116400854111ad696b9bbc4fc97d [id=d6bb694a914342d8b8ae58cf744932fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.643380 1854 raft_consensus.cc:504] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.647686 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8659865bf644458b3b5a78eae36a524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.652985 1405 tablet_service.cc:1467] Processing CreateTablet for tablet a8659865bf644458b3b5a78eae36a524 (DEFAULT_TABLE table=default.Table_cf1a116400854111ad696b9bbc4fc97d [id=d6bb694a914342d8b8ae58cf744932fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.652952 1409 tablet_service.cc:1467] Processing CreateTablet for tablet db09498a395b4570a34d32fbfc71e8ed (DEFAULT_TABLE table=default.Table_a6f756a6136d48a78b4fb2488323f3fd [id=ed34d1e88ae54c6086ae3a7cbfdf7861]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.654531 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 48e7eac8753f425d90302360d228ee54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:02.656490 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2cce454e70640e2a67b3680676b1d93" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:02.657143 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f95d664f1134ac9bbb62c1a3d4b5617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.659785 1556 tablet_bootstrap.cc:492] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:02.660027 1556 ts_tablet_manager.cc:1397] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.219s user 0.015s sys 0.036s
I20260927 15:06:02.660952 1556 raft_consensus.cc:348] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.661186 1556 raft_consensus.cc:374] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.661278 1556 raft_consensus.cc:729] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.661497 1556 consensus_queue.cc:260] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.662174 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db09498a395b4570a34d32fbfc71e8ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.663378 1376 leader_election.cc:341] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.663807 1556 ts_tablet_manager.cc:1428] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:02.666287 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_70317f25e61f4ec48a720a9f34635030"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:02.666579 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8659865bf644458b3b5a78eae36a524. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.666973 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70317f25e61f4ec48a720a9f34635030 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.668556 1556 tablet_bootstrap.cc:492] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:02.673364 1706 raft_consensus.cc:482] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.673475 1805 ts_tablet_manager.cc:1918] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.673642 1805 log.cc:1196] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/714b110a24ca4f3bb8126034dc3e6407
I20260927 15:06:02.673552 1706 raft_consensus.cc:504] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.674067 1805 ts_tablet_manager.cc:1939] T 714b110a24ca4f3bb8126034dc3e6407 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:02.674368 1706 leader_election.cc:288] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.674430 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 240) took 1171 ms. Trace:
I20260927 15:06:02.675294 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4714d536373a4bf2a4be9ebeaebe77c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.675405 1238 leader_election.cc:341] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 46ee85688df04e92accdedb6625406c1
I20260927 15:06:02.678210 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 8d533883e3344eca939cd67644895148 (DEFAULT_TABLE table=default.Table_cd87785e4030410da63d85472104fc1e [id=ba95aca9e7c449bd8fe939e896ab1ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.667382 1854 leader_election.cc:288] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:02.685562 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d533883e3344eca939cd67644895148. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.687378 1552 tablet_bootstrap.cc:654] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.688061 1099 leader_election.cc:302] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:02.695003 1559 ts_tablet_manager.cc:1918] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.692503 1799 raft_consensus.cc:504] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.703356 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3c3f771ede53431eac4f72641bf34c64" } modify_external_catalogs: true
I20260927 15:06:02.703621 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3c3f771ede53431eac4f72641bf34c64" } modify_external_catalogs: true
W20260927 15:06:02.703805 1239 leader_election.cc:341] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: bb90faccda0145a7acd153fcd51b4c43
I20260927 15:06:02.703959 1239 leader_election.cc:302] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:02.704931 1706 raft_consensus.cc:2726] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:02.711822 1811 raft_consensus.cc:2781] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:02.713178 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9e4311049d47d3b2f1e117795624ef" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:02.715540 1239 leader_election.cc:341] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 46ee85688df04e92accdedb6625406c1
I20260927 15:06:02.715706 1239 leader_election.cc:302] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:02.716228 1706 raft_consensus.cc:2726] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:02.721330 1725 raft_consensus.cc:504] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.721930 1725 leader_election.cc:288] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.722101 1725 raft_consensus.cc:482] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.722234 1725 raft_consensus.cc:504] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.726784 1559 log.cc:1196] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/654d3210fd8c46b68880e544c39d5c88
I20260927 15:06:02.722791 1725 leader_election.cc:288] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.674561 1805 rpcz_store.cc:276] 0927 15:06:01.502589 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.503647 (+ 1058us) service_pool.cc:227] Handling call
0927 15:06:02.404576 (+900929us) ts_tablet_manager.cc:1145] Deleting tablet 714b110a24ca4f3bb8126034dc3e6407
0927 15:06:02.404589 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.670228 (+265639us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.673374 (+ 3146us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.674369 (+ 995us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":900665}
I20260927 15:06:02.730192 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 714b110a24ca4f3bb8126034dc3e6407 (table default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]) successfully deleted
I20260927 15:06:02.730980 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 243) took 1169 ms. Trace:
I20260927 15:06:02.731114 1805 rpcz_store.cc:276] 0927 15:06:01.561254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.561308 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:02.730751 (+1169443us) ts_tablet_manager.cc:1145] Deleting tablet b3cc37a97bc145bdaa654bcc193fe93b
0927 15:06:02.730767 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.730919 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169212}
I20260927 15:06:02.731576 1556 tablet_bootstrap.cc:654] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:02.731608 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b3cc37a97bc145bdaa654bcc193fe93b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3cc37a97bc145bdaa654bcc193fe93b already in progress: creating tablet
I20260927 15:06:02.733336 1805 tablet_replica.cc:330] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:02.733558 1805 raft_consensus.cc:2229] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.733767 1805 raft_consensus.cc:2258] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.735589 1854 consensus_queue.cc:1035] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260927 15:06:02.737677 1559 ts_tablet_manager.cc:1939] T 654d3210fd8c46b68880e544c39d5c88 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:02.738996 1805 ts_tablet_manager.cc:1905] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:02.739643 1376 consensus_peers.cc:487] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:02.743482 1559 tablet_replica.cc:330] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:02.743834 1559 raft_consensus.cc:2229] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.744007 1559 raft_consensus.cc:2258] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.745188 1559 ts_tablet_manager.cc:1905] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.759840 1811 raft_consensus.cc:482] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260927 15:06:02.760239 1102 leader_election.cc:341] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.708654 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2cce454e70640e2a67b3680676b1d93" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:02.762243 1799 leader_election.cc:288] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.766542 1805 ts_tablet_manager.cc:1918] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.766692 1805 log.cc:1196] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/148c77a0e88b40f690ca96f091b78d9a
I20260927 15:06:02.775480 1805 ts_tablet_manager.cc:1939] T 148c77a0e88b40f690ca96f091b78d9a P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:02.780279 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 244) took 1207 ms. Trace:
I20260927 15:06:02.782527 1805 rpcz_store.cc:276] 0927 15:06:01.572705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.573675 (+ 970us) service_pool.cc:227] Handling call
0927 15:06:02.733250 (+1159575us) ts_tablet_manager.cc:1145] Deleting tablet 148c77a0e88b40f690ca96f091b78d9a
0927 15:06:02.733266 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.757735 (+ 24469us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.766417 (+ 8682us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.780236 (+ 13819us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159323}
I20260927 15:06:02.783681 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 148c77a0e88b40f690ca96f091b78d9a (table default.Table_d80d3405cea240ec87396ab494d2d04d [id=c4ddc66927a94fd2abc8e44012cf69f7]) successfully deleted
I20260927 15:06:02.784868 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 245) took 1185 ms. Trace:
I20260927 15:06:02.785531 1805 rpcz_store.cc:276] 0927 15:06:01.598998 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.599071 (+ 73us) service_pool.cc:227] Handling call
0927 15:06:02.784166 (+1185095us) ts_tablet_manager.cc:1145] Deleting tablet 3a8d33202ebc4e37b598d62d66472f31
0927 15:06:02.784180 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.784816 (+ 636us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1184853}
W20260927 15:06:02.786540 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3a8d33202ebc4e37b598d62d66472f31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a8d33202ebc4e37b598d62d66472f31 already in progress: creating tablet
I20260927 15:06:02.787107 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 247) took 1171 ms. Trace:
I20260927 15:06:02.788316 1805 rpcz_store.cc:276] 0927 15:06:01.615621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.615676 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:02.786947 (+1171271us) ts_tablet_manager.cc:1145] Deleting tablet 0df4a23269244191bf1dcd69cb34d371
0927 15:06:02.786959 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.787074 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1171036}
W20260927 15:06:02.789312 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0df4a23269244191bf1dcd69cb34d371 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0df4a23269244191bf1dcd69cb34d371 already in progress: creating tablet
I20260927 15:06:02.789824 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 250) took 1142 ms. Trace:
I20260927 15:06:02.790808 1805 rpcz_store.cc:276] 0927 15:06:01.647665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.647713 (+ 48us) service_pool.cc:227] Handling call
0927 15:06:02.789680 (+1141967us) ts_tablet_manager.cc:1145] Deleting tablet 8790d59beb804acb8e4353f862d7f6f8
0927 15:06:02.789691 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.789786 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1141716}
I20260927 15:06:02.792726 1562 ts_tablet_manager.cc:1918] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.793562 1805 tablet_replica.cc:330] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:02.794226 1805 raft_consensus.cc:2229] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.794422 1805 raft_consensus.cc:2258] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.795063 1805 ts_tablet_manager.cc:1905] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:02.804109 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 46553.9us
I20260927 15:06:02.804759 1561 tablet_bootstrap.cc:492] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:02.805919 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d6d1cfb1a4d4c439e970d966af841b6" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:02.807273 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da1812142bb043fba7457dc61ffdb180" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:02.808861 1799 raft_consensus.cc:482] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:02.809027 1799 raft_consensus.cc:504] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.809701 1799 leader_election.cc:288] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.810094 1811 raft_consensus.cc:3037] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.763252 1127 tablet_service.cc:1467] Processing CreateTablet for tablet a8659865bf644458b3b5a78eae36a524 (DEFAULT_TABLE table=default.Table_cf1a116400854111ad696b9bbc4fc97d [id=d6bb694a914342d8b8ae58cf744932fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.819144 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8659865bf644458b3b5a78eae36a524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.822968 1561 ts_tablet_manager.cc:1397] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.360s user 0.027s sys 0.047s
I20260927 15:06:02.824088 1561 raft_consensus.cc:348] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.824398 1561 raft_consensus.cc:374] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.824486 1561 raft_consensus.cc:729] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.824855 1561 consensus_queue.cc:260] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.825451 1561 ts_tablet_manager.cc:1428] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:02.826804 1805 ts_tablet_manager.cc:1918] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.720072 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 4714d536373a4bf2a4be9ebeaebe77c1 (DEFAULT_TABLE table=default.Table_b94ff6d2011948078b03af17b4d95fae [id=8af79e2564b34d66be63893f6a90bd04]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:02.829346 1102 leader_election.cc:341] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.830976 1562 log.cc:1196] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/f2cce454e70640e2a67b3680676b1d93
I20260927 15:06:02.830660 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1d7a98ffc4745ac8eeb93012b55d417" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:02.833658 1805 log.cc:1196] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/34822e9f900f4d04b59b810d59e6aa49
I20260927 15:06:02.834515 1805 ts_tablet_manager.cc:1939] T 34822e9f900f4d04b59b810d59e6aa49 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:02.835860 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 252) took 1178 ms. Trace:
I20260927 15:06:02.837031 1805 rpcz_store.cc:276] 0927 15:06:01.657697 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.663161 (+ 5464us) service_pool.cc:227] Handling call
0927 15:06:02.793491 (+1130330us) ts_tablet_manager.cc:1145] Deleting tablet 34822e9f900f4d04b59b810d59e6aa49
0927 15:06:02.793503 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.808832 (+ 15329us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.826674 (+ 17842us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.835796 (+ 9122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1130018}
I20260927 15:06:02.837829 1561 tablet_bootstrap.cc:492] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:02.838773 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 34822e9f900f4d04b59b810d59e6aa49 (table default.Table_875cbc00c31e4798bf3ed5bf3135b0a7 [id=5c4f0f47acd14538b67f8c8d579b0696]) successfully deleted
I20260927 15:06:02.839491 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 258) took 1123 ms. Trace:
W20260927 15:06:02.840260 1102 leader_election.cc:341] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:02.840547 1102 leader_election.cc:341] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.841944 1805 rpcz_store.cc:276] 0927 15:06:01.715832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.715892 (+ 60us) service_pool.cc:227] Handling call
0927 15:06:02.839304 (+1123412us) ts_tablet_manager.cc:1145] Deleting tablet c49913b1763c4a7b9413a801aff93b30
0927 15:06:02.839318 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.839437 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1105197}
W20260927 15:06:02.843001 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c49913b1763c4a7b9413a801aff93b30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c49913b1763c4a7b9413a801aff93b30 already in progress: creating tablet
I20260927 15:06:02.843612 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 259) took 1109 ms. Trace:
I20260927 15:06:02.844466 1805 rpcz_store.cc:276] 0927 15:06:01.734178 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.734893 (+ 715us) service_pool.cc:227] Handling call
0927 15:06:02.843442 (+1108549us) ts_tablet_manager.cc:1145] Deleting tablet bbcffb8cedd74b18871988201f9db2e5
0927 15:06:02.843456 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.843557 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1108276}
W20260927 15:06:02.845417 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bbcffb8cedd74b18871988201f9db2e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bbcffb8cedd74b18871988201f9db2e5 already in progress: creating tablet
I20260927 15:06:02.846065 1805 tablet_replica.cc:330] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:02.846644 1805 raft_consensus.cc:2229] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.851060 1805 raft_consensus.cc:2258] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.851611 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4714d536373a4bf2a4be9ebeaebe77c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.852427 1805 ts_tablet_manager.cc:1905] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.818619 1811 raft_consensus.cc:504] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.862541 1811 leader_election.cc:288] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:02.863554 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e6e3600cbf741419bc7b93eec42eb13" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:02.864329 1102 leader_election.cc:341] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.874048 1562 ts_tablet_manager.cc:1939] T f2cce454e70640e2a67b3680676b1d93 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:02.874651 1805 ts_tablet_manager.cc:1918] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.878810 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 274) took 1218 ms. Trace:
I20260927 15:06:02.879043 1562 rpcz_store.cc:276] 0927 15:06:01.660412 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.660466 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:02.431729 (+771263us) ts_tablet_manager.cc:1145] Deleting tablet f2cce454e70640e2a67b3680676b1d93
0927 15:06:02.431739 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.573212 (+141473us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.792592 (+219380us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.878379 (+ 85787us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":771056}
I20260927 15:06:02.880271 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet f2cce454e70640e2a67b3680676b1d93 (table default.Table_303dfd972edc4c4db55b80e20fd076c7 [id=a027a86bb6274c5d90e960eede3c398f]) successfully deleted
I20260927 15:06:02.881502 1805 log.cc:1196] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/46ee85688df04e92accdedb6625406c1
I20260927 15:06:02.882000 1805 ts_tablet_manager.cc:1939] T 46ee85688df04e92accdedb6625406c1 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:02.884248 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 46ee85688df04e92accdedb6625406c1 (table default.Table_6cc665540fb24e17b9284fc911758626 [id=31cb67e2dcb54a029ecdc3457b6139c1]) successfully deleted
I20260927 15:06:02.885485 1805 tablet_replica.cc:330] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:02.886257 1805 raft_consensus.cc:2229] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:02.886498 1562 tablet_replica.cc:330] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:02.891032 1805 raft_consensus.cc:2258] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.893522 1805 ts_tablet_manager.cc:1905] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.892838 1562 raft_consensus.cc:2229] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:02.894189 1561 tablet_bootstrap.cc:654] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.894524 1562 pending_rounds.cc:62] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:02.894632 1562 pending_rounds.cc:68] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976314418692096 op_type: NO_OP noop_request { }
I20260927 15:06:02.894984 1562 raft_consensus.cc:2866] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:02.895143 1562 raft_consensus.cc:2258] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.895797 1562 ts_tablet_manager.cc:1905] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.910158 1805 ts_tablet_manager.cc:1918] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.922122 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da1812142bb043fba7457dc61ffdb180" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:02.922299 1562 ts_tablet_manager.cc:1918] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:02.922470 1562 log.cc:1196] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/443af328e5154bdba9b570224616d77b
I20260927 15:06:02.923893 1559 ts_tablet_manager.cc:1918] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:02.924997 1561 tablet_bootstrap.cc:492] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:02.925161 1561 ts_tablet_manager.cc:1397] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.098s user 0.000s sys 0.005s
I20260927 15:06:02.926936 1561 raft_consensus.cc:348] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.927210 1561 raft_consensus.cc:374] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:02.927322 1561 raft_consensus.cc:729] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:02.928081 1561 consensus_queue.cc:260] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.928699 1561 ts_tablet_manager.cc:1428] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:02.928998 1561 tablet_bootstrap.cc:492] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:02.931500 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.62:41167, user_credentials={real_user=slave}} blocked reactor thread for 234965us
I20260927 15:06:02.933498 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 654d3210fd8c46b68880e544c39d5c88 (table default.Table_2b3e81787f35442691853bd186de1a8a [id=353280883f2c4a2d9b472e8ba529acd6]) successfully deleted
I20260927 15:06:02.931227 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9e4311049d47d3b2f1e117795624ef" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
W20260927 15:06:02.935657 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ae003f1ca76472cbaa8b577b66fe84c consensus state has no leader
I20260927 15:06:02.936702 1562 ts_tablet_manager.cc:1939] T 443af328e5154bdba9b570224616d77b P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:02.937693 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 271) took 1278 ms. Trace:
I20260927 15:06:02.937810 1562 rpcz_store.cc:276] 0927 15:06:01.659638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.661244 (+ 1606us) service_pool.cc:227] Handling call
0927 15:06:02.879594 (+1218350us) ts_tablet_manager.cc:1145] Deleting tablet 443af328e5154bdba9b570224616d77b
0927 15:06:02.879610 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.912307 (+ 32697us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.922170 (+ 9863us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.937631 (+ 15461us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1218149}
I20260927 15:06:02.938347 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 443af328e5154bdba9b570224616d77b (table default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]) successfully deleted
I20260927 15:06:02.938814 1561 tablet_bootstrap.cc:654] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:02.939311 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e23e5a0596754267a9314c66227c595f" } new_table_name: "default.Table_ddf0e36781314b2ba5932e7156d9fa25" modify_external_catalogs: true
I20260927 15:06:02.939985 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_083e1ad3d401408dabc1266d11ab2734" } modify_external_catalogs: true
I20260927 15:06:02.940164 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_083e1ad3d401408dabc1266d11ab2734" } modify_external_catalogs: true
I20260927 15:06:02.940793 1562 tablet_replica.cc:330] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:02.940992 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3450181a5d9d4059b161a9cfcc6cb882" } new_table_name: "default.Table_03b7cc2c10fe498b8bbbfa412d58a56d" modify_external_catalogs: true
I20260927 15:06:02.941421 1562 raft_consensus.cc:2229] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:06:02.943727 1374 leader_election.cc:341] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: Tablet not RUNNING: STOPPED
I20260927 15:06:02.944345 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81679c709d29402bb264cff71cf732e2" } new_table_name: "default.Table_5779948a34b2476ba1b05b3a7bc866fc" modify_external_catalogs: true
I20260927 15:06:02.944862 1438 raft_consensus.cc:3037] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.944836 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d776eb9f204f4fc1b328b45d9bb2cf38" } new_table_name: "default.Table_1c87fe2a6c1a4e178dc88d4fd8679835" modify_external_catalogs: true
I20260927 15:06:02.946331 1562 raft_consensus.cc:2258] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:02.947537 1562 ts_tablet_manager.cc:1905] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:02.949268 907 master_service.cc:946] ReplaceTablet: received request to replace tablet fe7816e099094d13887650fc223097c7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:02.949836 905 master_service.cc:946] ReplaceTablet: received request to replace tablet 3d454d65afa94aac9b34c253adfa4b0c from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:02.958446 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet ab08d04c11dd44299ee5f9a911d581c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:02.959378 1129 tablet_service.cc:1467] Processing CreateTablet for tablet efa42545da374ca989199433ce1284c3 (DEFAULT_TABLE table=default.Table_103a22226a8b4b2fa2165b28568f41ec [id=6d1dd8371c594833aab5bf7dfc193107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.959816 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa42545da374ca989199433ce1284c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.961956 1142 tablet_service.cc:1467] Processing CreateTablet for tablet c6a248ec4ee64d0a8d986fdc683d69ba (DEFAULT_TABLE table=default.Table_b33719cf7165405caf26b84396bd5f7b [id=fa89a4b72c5f49589d9ee43f118da869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.962356 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6a248ec4ee64d0a8d986fdc683d69ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.963996 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_90059eaac20f42eead7d864d2e91a12e" } modify_external_catalogs: true
I20260927 15:06:02.964218 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_90059eaac20f42eead7d864d2e91a12e" } modify_external_catalogs: true
I20260927 15:06:02.965143 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 089b6b5ac39d49fea744240261a8010e (DEFAULT_TABLE table=default.Table_ade3cb71f3dd4d55ac7e8839474d785a [id=fd1367da84814f54b92d304168674f0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.965780 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 7f8744e2349e49d3a821eca42c7f89a2 (DEFAULT_TABLE table=default.Table_81679c709d29402bb264cff71cf732e2 [id=4d9dd505f13d4b63ac2b4ea898c9eac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.966358 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 727652500d9a47b68b7a0d0dcf583822 (DEFAULT_TABLE table=default.Table_34d1f85060084bebb54e57402ea08b5d [id=645add1330bd41618f53f3c008b48200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.966517 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_177f5eb468964182a1cb169bf4816efc" } modify_external_catalogs: true
I20260927 15:06:02.966686 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_177f5eb468964182a1cb169bf4816efc" } modify_external_catalogs: true
I20260927 15:06:02.967155 1139 tablet_service.cc:1467] Processing CreateTablet for tablet ac64eacc7d924940aacc8779b5bfeae7 (DEFAULT_TABLE table=default.Table_a26bdbe66d9a438ab4a3a6cf93fbe430 [id=10a0f9e80795470996770db15c99a546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.967828 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 955461f27b6444d4b4c3f9a9f629d5e3 (DEFAULT_TABLE table=default.Table_effad7577e2d439c8426666a6d741a88 [id=e0720391578a4511b5393a5d332985ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.968190 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 769e9b5c08cd44cc8a0d681500d64f54 (DEFAULT_TABLE table=default.Table_144247c8f6c749539a8c431dd3e74d17 [id=e8ef09e7d3114b19a5e62a4ff883166e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.968899 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0d667472ee4f1481c213e03403461e (DEFAULT_TABLE table=default.Table_4b430696cdec4858aa30fc5189839327 [id=4a2d7f51ed0d461dab1ea8add3ba8619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.969368 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 089b6b5ac39d49fea744240261a8010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.970798 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 59d852b4adbc47c58db352535923ff49 (DEFAULT_TABLE table=default.Table_d0cd6cf8e5f94ae4b89d2de16f324e82 [id=9b4f01f111a640e6a3fbe706f9b5cf45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.971175 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59d852b4adbc47c58db352535923ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.972681 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 79a3125723034cb48bc1a05fc4abbb82 (DEFAULT_TABLE table=default.Table_294f26f04be64c4f8564c20e515fabb9 [id=09a85e91664d444eab58b705a3be138d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.973042 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79a3125723034cb48bc1a05fc4abbb82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.974215 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 769e9b5c08cd44cc8a0d681500d64f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.974893 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 727652500d9a47b68b7a0d0dcf583822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.975641 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac64eacc7d924940aacc8779b5bfeae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.976763 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955461f27b6444d4b4c3f9a9f629d5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.978260 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f8744e2349e49d3a821eca42c7f89a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.979346 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0d667472ee4f1481c213e03403461e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.980847 1374 leader_election.cc:302] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:02.981380 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e6e3600cbf741419bc7b93eec42eb13" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
W20260927 15:06:02.981509 1099 leader_election.cc:341] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: Tablet not RUNNING: STOPPED
I20260927 15:06:02.981643 1099 leader_election.cc:302] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:02.981922 1918 raft_consensus.cc:2726] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260927 15:06:02.982101 1099 leader_election.cc:341] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 7d6d1cfb1a4d4c439e970d966af841b6
I20260927 15:06:02.982242 1099 leader_election.cc:302] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:02.982527 1918 raft_consensus.cc:2726] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:02.983815 1559 log.cc:1196] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/da1812142bb043fba7457dc61ffdb180
I20260927 15:06:02.984051 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6eed08273244d28fd15785a09059f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a07831078b48a59807f7da4a42bcec) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:02.984294 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc20a62bbd484c4e9e25cf1c15e1dde0 consensus state has no leader
I20260927 15:06:02.984256 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1d7a98ffc4745ac8eeb93012b55d417" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:02.984488 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a97f9c79720e40e48b56f0dd4c7441cc" } modify_external_catalogs: true
I20260927 15:06:02.984715 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a97f9c79720e40e48b56f0dd4c7441cc" } modify_external_catalogs: true
I20260927 15:06:02.984722 1440 raft_consensus.cc:3037] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.984689 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ad4e7655514c453aa4eaf109ee6a057f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.984834 1099 leader_election.cc:341] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:02.984946 1099 leader_election.cc:302] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:02.985260 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad4e7655514c453aa4eaf109ee6a057f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.986588 906 master_service.cc:946] ReplaceTablet: received request to replace tablet c90e5c66d8564f68b401b3e4280499a7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:02.987275 1918 raft_consensus.cc:2726] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:02.987506 1440 raft_consensus.cc:2454] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:02.987771 1854 raft_consensus.cc:2726] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:02.987964 1099 leader_election.cc:302] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:02.987901 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7f32f20313364f5787a4bb5c09f5ca22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:02.988510 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f32f20313364f5787a4bb5c09f5ca22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:02.989796 1918 raft_consensus.cc:2781] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:02.990000 1918 raft_consensus.cc:686] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:02.990384 1918 consensus_queue.cc:237] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.994656 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 955461f27b6444d4b4c3f9a9f629d5e3 (DEFAULT_TABLE table=default.Table_effad7577e2d439c8426666a6d741a88 [id=e0720391578a4511b5393a5d332985ce]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:02.995411 1102 consensus_peers.cc:487] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:02.995893 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955461f27b6444d4b4c3f9a9f629d5e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:02.994288 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 64115.3us
I20260927 15:06:02.999822 1556 tablet_bootstrap.cc:492] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.002266 1559 ts_tablet_manager.cc:1939] T da1812142bb043fba7457dc61ffdb180 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:03.005610 1438 raft_consensus.cc:2454] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:03.007797 1854 consensus_queue.cc:1035] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260927 15:06:03.014015 1405 tablet_service.cc:1467] Processing CreateTablet for tablet efa42545da374ca989199433ce1284c3 (DEFAULT_TABLE table=default.Table_103a22226a8b4b2fa2165b28568f41ec [id=6d1dd8371c594833aab5bf7dfc193107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.018816 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 79a3125723034cb48bc1a05fc4abbb82 (DEFAULT_TABLE table=default.Table_294f26f04be64c4f8564c20e515fabb9 [id=09a85e91664d444eab58b705a3be138d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.020612 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 089b6b5ac39d49fea744240261a8010e (DEFAULT_TABLE table=default.Table_ade3cb71f3dd4d55ac7e8839474d785a [id=fd1367da84814f54b92d304168674f0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.021147 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0d667472ee4f1481c213e03403461e (DEFAULT_TABLE table=default.Table_4b430696cdec4858aa30fc5189839327 [id=4a2d7f51ed0d461dab1ea8add3ba8619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.021463 1403 tablet_service.cc:1467] Processing CreateTablet for tablet c6a248ec4ee64d0a8d986fdc683d69ba (DEFAULT_TABLE table=default.Table_b33719cf7165405caf26b84396bd5f7b [id=fa89a4b72c5f49589d9ee43f118da869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.032196 1099 leader_election.cc:302] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:03.033650 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 769e9b5c08cd44cc8a0d681500d64f54 (DEFAULT_TABLE table=default.Table_144247c8f6c749539a8c431dd3e74d17 [id=e8ef09e7d3114b19a5e62a4ff883166e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.034160 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa42545da374ca989199433ce1284c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.034386 1811 raft_consensus.cc:2781] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:03.037423 1811 raft_consensus.cc:686] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:03.037742 1811 consensus_queue.cc:237] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.039002 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 7f8744e2349e49d3a821eca42c7f89a2 (DEFAULT_TABLE table=default.Table_81679c709d29402bb264cff71cf732e2 [id=4d9dd505f13d4b63ac2b4ea898c9eac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.039453 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f8744e2349e49d3a821eca42c7f89a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.042971 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 59d852b4adbc47c58db352535923ff49 (DEFAULT_TABLE table=default.Table_d0cd6cf8e5f94ae4b89d2de16f324e82 [id=9b4f01f111a640e6a3fbe706f9b5cf45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.043576 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59d852b4adbc47c58db352535923ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.050922 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 727652500d9a47b68b7a0d0dcf583822 (DEFAULT_TABLE table=default.Table_34d1f85060084bebb54e57402ea08b5d [id=645add1330bd41618f53f3c008b48200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.051502 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 727652500d9a47b68b7a0d0dcf583822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.054908 1417 tablet_service.cc:1467] Processing CreateTablet for tablet ac64eacc7d924940aacc8779b5bfeae7 (DEFAULT_TABLE table=default.Table_a26bdbe66d9a438ab4a3a6cf93fbe430 [id=10a0f9e80795470996770db15c99a546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.055363 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac64eacc7d924940aacc8779b5bfeae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.059270 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79a3125723034cb48bc1a05fc4abbb82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.063712 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 089b6b5ac39d49fea744240261a8010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.066669 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet da1812142bb043fba7457dc61ffdb180 (table default.Table_738223121ff44cda97e408a6b77e0c98 [id=32958d4a1d2d4e048c864f783034e555]) successfully deleted
I20260927 15:06:03.067018 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 769e9b5c08cd44cc8a0d681500d64f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.073479 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0d667472ee4f1481c213e03403461e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.079034 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6a248ec4ee64d0a8d986fdc683d69ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.088256 1866 raft_consensus.cc:482] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.088480 1866 raft_consensus.cc:504] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.090180 1866 leader_election.cc:288] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:03.092202 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6eed08273244d28fd15785a09059f9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:03.092449 1164 raft_consensus.cc:2454] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:03.092928 1374 leader_election.cc:302] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:03.093793 1935 raft_consensus.cc:2781] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:03.093968 1935 raft_consensus.cc:482] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:03.094384 1935 raft_consensus.cc:3037] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:02.952527 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 955461f27b6444d4b4c3f9a9f629d5e3 (DEFAULT_TABLE table=default.Table_effad7577e2d439c8426666a6d741a88 [id=e0720391578a4511b5393a5d332985ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.098086 1805 log.cc:1196] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/bb90faccda0145a7acd153fcd51b4c43
I20260927 15:06:03.098356 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955461f27b6444d4b4c3f9a9f629d5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.098657 1805 ts_tablet_manager.cc:1939] T bb90faccda0145a7acd153fcd51b4c43 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:03.101174 1935 raft_consensus.cc:504] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:02.953398 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 769e9b5c08cd44cc8a0d681500d64f54 (DEFAULT_TABLE table=default.Table_144247c8f6c749539a8c431dd3e74d17 [id=e8ef09e7d3114b19a5e62a4ff883166e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.954303 1273 tablet_service.cc:1467] Processing CreateTablet for tablet efa42545da374ca989199433ce1284c3 (DEFAULT_TABLE table=default.Table_103a22226a8b4b2fa2165b28568f41ec [id=6d1dd8371c594833aab5bf7dfc193107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.103147 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 769e9b5c08cd44cc8a0d681500d64f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.954490 1281 tablet_service.cc:1467] Processing CreateTablet for tablet c6a248ec4ee64d0a8d986fdc683d69ba (DEFAULT_TABLE table=default.Table_b33719cf7165405caf26b84396bd5f7b [id=fa89a4b72c5f49589d9ee43f118da869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.103396 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa42545da374ca989199433ce1284c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.103704 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6a248ec4ee64d0a8d986fdc683d69ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.104717 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 261) took 1119 ms. Trace:
I20260927 15:06:03.105283 1805 rpcz_store.cc:276] 0927 15:06:01.979990 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.980047 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:02.885411 (+905364us) ts_tablet_manager.cc:1145] Deleting tablet bb90faccda0145a7acd153fcd51b4c43
0927 15:06:02.885426 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.906874 (+ 21448us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:02.910051 (+ 3177us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.099031 (+188980us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":905118}
I20260927 15:06:03.105788 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 262) took 1094 ms. Trace:
I20260927 15:06:03.105893 1805 rpcz_store.cc:276] 0927 15:06:02.011431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.011941 (+ 510us) service_pool.cc:227] Handling call
0927 15:06:03.105600 (+1093659us) ts_tablet_manager.cc:1145] Deleting tablet 214229a8283b43c4916a5db7ba120e03
0927 15:06:03.105613 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.105728 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1093459}
I20260927 15:06:03.106297 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 263) took 1094 ms. Trace:
I20260927 15:06:03.106391 1805 rpcz_store.cc:276] 0927 15:06:02.011579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.012200 (+ 621us) service_pool.cc:227] Handling call
0927 15:06:03.106151 (+1093951us) ts_tablet_manager.cc:1145] Deleting tablet a8de6246f7904f6c80df624f3631db17
0927 15:06:03.106159 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.106236 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1093241}
I20260927 15:06:03.106746 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 264) took 1092 ms. Trace:
I20260927 15:06:02.955309 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 7f0d667472ee4f1481c213e03403461e (DEFAULT_TABLE table=default.Table_4b430696cdec4858aa30fc5189839327 [id=4a2d7f51ed0d461dab1ea8add3ba8619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.962939 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 089b6b5ac39d49fea744240261a8010e (DEFAULT_TABLE table=default.Table_ade3cb71f3dd4d55ac7e8839474d785a [id=fd1367da84814f54b92d304168674f0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.963060 1284 tablet_service.cc:1467] Processing CreateTablet for tablet ac64eacc7d924940aacc8779b5bfeae7 (DEFAULT_TABLE table=default.Table_a26bdbe66d9a438ab4a3a6cf93fbe430 [id=10a0f9e80795470996770db15c99a546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.107175 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f0d667472ee4f1481c213e03403461e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.107391 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac64eacc7d924940aacc8779b5bfeae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.107642 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 089b6b5ac39d49fea744240261a8010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:02.963948 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 59d852b4adbc47c58db352535923ff49 (DEFAULT_TABLE table=default.Table_d0cd6cf8e5f94ae4b89d2de16f324e82 [id=9b4f01f111a640e6a3fbe706f9b5cf45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.107774 1561 tablet_bootstrap.cc:492] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:03.108045 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59d852b4adbc47c58db352535923ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.108106 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet bb90faccda0145a7acd153fcd51b4c43 (table default.Table_44ec3dd510cd451a84cf5b0e73fc492d [id=0c63f8578de5475582ff54870c14d14b]) successfully deleted
I20260927 15:06:03.108304 1561 ts_tablet_manager.cc:1397] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.179s user 0.005s sys 0.007s
W20260927 15:06:03.108361 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 214229a8283b43c4916a5db7ba120e03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 214229a8283b43c4916a5db7ba120e03 already in progress: creating tablet
W20260927 15:06:03.108556 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a8de6246f7904f6c80df624f3631db17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8de6246f7904f6c80df624f3631db17 already in progress: creating tablet
I20260927 15:06:03.109114 1561 raft_consensus.cc:348] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.109345 1561 raft_consensus.cc:374] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.109414 1561 raft_consensus.cc:729] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.109650 1561 consensus_queue.cc:260] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.110205 1561 ts_tablet_manager.cc:1428] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:03.110502 1561 tablet_bootstrap.cc:492] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:02.965494 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 7f8744e2349e49d3a821eca42c7f89a2 (DEFAULT_TABLE table=default.Table_81679c709d29402bb264cff71cf732e2 [id=4d9dd505f13d4b63ac2b4ea898c9eac0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.111121 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f8744e2349e49d3a821eca42c7f89a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.112175 1805 rpcz_store.cc:276] 0927 15:06:02.014225 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.014321 (+ 96us) service_pool.cc:227] Handling call
0927 15:06:03.106602 (+1092281us) ts_tablet_manager.cc:1145] Deleting tablet 9cb0ab983a444d26b903a0cec64f15f0
0927 15:06:03.106610 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.106696 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1092067}
I20260927 15:06:03.112622 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 265) took 1098 ms. Trace:
I20260927 15:06:03.112732 1805 rpcz_store.cc:276] 0927 15:06:02.014367 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.014571 (+ 204us) service_pool.cc:227] Handling call
0927 15:06:03.112451 (+1097880us) ts_tablet_manager.cc:1145] Deleting tablet 6b1f2143af1142eb9f3dbc777299c186
0927 15:06:03.112460 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.112564 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1097695}
I20260927 15:06:02.966013 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 79a3125723034cb48bc1a05fc4abbb82 (DEFAULT_TABLE table=default.Table_294f26f04be64c4f8564c20e515fabb9 [id=09a85e91664d444eab58b705a3be138d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:02.985283 1552 tablet_bootstrap.cc:492] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:03.115156 1552 ts_tablet_manager.cc:1397] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.534s user 0.012s sys 0.035s
I20260927 15:06:03.089895 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6eed08273244d28fd15785a09059f9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:02.963157 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 727652500d9a47b68b7a0d0dcf583822 (DEFAULT_TABLE table=default.Table_34d1f85060084bebb54e57402ea08b5d [id=645add1330bd41618f53f3c008b48200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.116046 1552 raft_consensus.cc:348] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.116283 1552 raft_consensus.cc:374] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.116384 1552 raft_consensus.cc:729] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.116786 1552 consensus_queue.cc:260] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.117818 1552 ts_tablet_manager.cc:1428] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:03.119432 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79a3125723034cb48bc1a05fc4abbb82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.121824 1935 leader_election.cc:288] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:03.123093 1376 leader_election.cc:341] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.123312 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6eed08273244d28fd15785a09059f9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:03.124274 1376 leader_election.cc:341] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.126196 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 727652500d9a47b68b7a0d0dcf583822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.127130 1561 tablet_bootstrap.cc:654] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.131183 1552 tablet_bootstrap.cc:492] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:03.131393 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9cb0ab983a444d26b903a0cec64f15f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb0ab983a444d26b903a0cec64f15f0 already in progress: creating tablet
W20260927 15:06:03.131691 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6b1f2143af1142eb9f3dbc777299c186 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b1f2143af1142eb9f3dbc777299c186 already in progress: creating tablet
I20260927 15:06:03.132889 1552 tablet_bootstrap.cc:654] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.133533 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6eed08273244d28fd15785a09059f9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:03.133781 1164 raft_consensus.cc:3037] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:03.134449 1561 tablet_bootstrap.cc:492] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:03.134655 1561 ts_tablet_manager.cc:1397] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260927 15:06:03.135602 1561 raft_consensus.cc:348] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.135878 1561 raft_consensus.cc:374] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.136026 1561 raft_consensus.cc:729] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.126233 1805 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 267) took 1084 ms. Trace:
I20260927 15:06:03.136541 1805 rpcz_store.cc:276] 0927 15:06:02.041587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.041641 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:03.112953 (+1071312us) ts_tablet_manager.cc:1145] Deleting tablet fde632b187eb4180b343d7bddc7f0943
0927 15:06:03.112968 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.126151 (+ 13183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1071079}
I20260927 15:06:03.137344 1164 raft_consensus.cc:2454] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
W20260927 15:06:03.137610 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet fde632b187eb4180b343d7bddc7f0943 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fde632b187eb4180b343d7bddc7f0943 already in progress: creating tablet
W20260927 15:06:03.137863 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet cb859b43634c420382da5c201ce24dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb859b43634c420382da5c201ce24dfc already in progress: creating tablet
W20260927 15:06:03.138088 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c65bc09865bc4a0283eaa4af9f860bdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c65bc09865bc4a0283eaa4af9f860bdd already in progress: creating tablet
W20260927 15:06:03.138317 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 42baac8b7d47433e826eb3bc1980acaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42baac8b7d47433e826eb3bc1980acaa already in progress: creating tablet
I20260927 15:06:03.138667 1561 consensus_queue.cc:260] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.138803 1374 leader_election.cc:302] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:03.139815 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2c4a123886a847d08b2a94ff5e4e01ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c4a123886a847d08b2a94ff5e4e01ca already in progress: creating tablet
W20260927 15:06:03.140100 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 4b9e88c3679d412cac7603f200cf899b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b9e88c3679d412cac7603f200cf899b already in progress: creating tablet
W20260927 15:06:03.140316 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 429088342b4743c39fb1e38d235024de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 429088342b4743c39fb1e38d235024de already in progress: creating tablet
W20260927 15:06:03.140533 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 already in progress: creating tablet
W20260927 15:06:03.140758 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet cd76c49eda1c4b4ca0edf0f4d2790188 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd76c49eda1c4b4ca0edf0f4d2790188 already in progress: creating tablet
I20260927 15:06:03.140990 1935 raft_consensus.cc:2781] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:03.141630 1561 ts_tablet_manager.cc:1428] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 15:06:03.141367 1935 raft_consensus.cc:686] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:03.142542 1561 tablet_bootstrap.cc:492] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:03.142994 1935 consensus_queue.cc:237] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.146024 1561 tablet_bootstrap.cc:654] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.146718 1805 tablet_replica.cc:330] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:03.147183 1805 raft_consensus.cc:2229] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.147996 1805 raft_consensus.cc:2258] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.149106 1805 ts_tablet_manager.cc:1905] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.156555 1561 tablet_bootstrap.cc:492] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:03.156754 1561 ts_tablet_manager.cc:1397] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260927 15:06:03.157668 1561 raft_consensus.cc:348] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.157970 1561 raft_consensus.cc:374] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.158057 1561 raft_consensus.cc:729] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.158278 1561 consensus_queue.cc:260] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.160121 1552 tablet_bootstrap.cc:492] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:03.160392 1552 ts_tablet_manager.cc:1397] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.007s
I20260927 15:06:03.161573 1552 raft_consensus.cc:348] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.161944 1552 raft_consensus.cc:374] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.161960 1561 ts_tablet_manager.cc:1428] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:03.162091 1552 raft_consensus.cc:729] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.162456 1552 consensus_queue.cc:260] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.163353 1552 ts_tablet_manager.cc:1428] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:03.163420 1561 tablet_bootstrap.cc:492] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:03.163738 1552 tablet_bootstrap.cc:492] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:03.165503 1552 tablet_bootstrap.cc:654] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.165643 1561 tablet_bootstrap.cc:654] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.172252 1559 tablet_replica.cc:330] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:03.172688 1562 ts_tablet_manager.cc:1918] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:03.173009 1562 log.cc:1196] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/34822e9f900f4d04b59b810d59e6aa49
I20260927 15:06:03.173619 1562 ts_tablet_manager.cc:1939] T 34822e9f900f4d04b59b810d59e6aa49 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:03.174427 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 270) took 1517 ms. Trace:
I20260927 15:06:03.169561 1805 ts_tablet_manager.cc:1918] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:03.177529 1805 log.cc:1196] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/12623e6767aa4bd4934058f7314a966e
I20260927 15:06:03.178378 1805 ts_tablet_manager.cc:1939] T 12623e6767aa4bd4934058f7314a966e P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:03.181614 1552 tablet_bootstrap.cc:492] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:03.181895 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 12623e6767aa4bd4934058f7314a966e (table default.Table_a6f0eb861ab04bcb8df0053049d90e1b [id=7016faef9bb8460288ace088e5995265]) successfully deleted
W20260927 15:06:03.182262 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 48e7eac8753f425d90302360d228ee54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48e7eac8753f425d90302360d228ee54 already in progress: creating tablet
W20260927 15:06:03.182539 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c41cd38355e64590b43b2e1271c43e91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c41cd38355e64590b43b2e1271c43e91 already in progress: creating tablet
I20260927 15:06:03.183009 1559 raft_consensus.cc:2229] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:03.183279 1552 ts_tablet_manager.cc:1397] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.006s
I20260927 15:06:03.183470 1559 raft_consensus.cc:2258] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.183423 1562 rpcz_store.cc:276] 0927 15:06:01.657255 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.661453 (+ 4198us) service_pool.cc:227] Handling call
0927 15:06:02.940703 (+1279250us) ts_tablet_manager.cc:1145] Deleting tablet 34822e9f900f4d04b59b810d59e6aa49
0927 15:06:02.940716 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:02.987466 (+ 46750us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.172483 (+185017us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.174393 (+ 1910us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1279029}
I20260927 15:06:03.183910 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 34822e9f900f4d04b59b810d59e6aa49 (table default.Table_875cbc00c31e4798bf3ed5bf3135b0a7 [id=5c4f0f47acd14538b67f8c8d579b0696]) successfully deleted
I20260927 15:06:03.185622 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 280) took 1434 ms. Trace:
I20260927 15:06:03.185751 1562 rpcz_store.cc:276] 0927 15:06:01.751664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.752500 (+ 836us) service_pool.cc:227] Handling call
0927 15:06:03.185477 (+1432977us) ts_tablet_manager.cc:1145] Deleting tablet c49913b1763c4a7b9413a801aff93b30
0927 15:06:03.185489 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.185590 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1423207}
I20260927 15:06:03.185858 1552 raft_consensus.cc:348] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:03.186174 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c49913b1763c4a7b9413a801aff93b30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c49913b1763c4a7b9413a801aff93b30 already in progress: creating tablet
I20260927 15:06:03.187139 1552 raft_consensus.cc:374] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.187814 1562 tablet_replica.cc:330] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:03.188052 1562 raft_consensus.cc:2229] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.188220 1562 raft_consensus.cc:2258] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.188773 1562 ts_tablet_manager.cc:1905] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.187433 1552 raft_consensus.cc:729] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.180047 1561 tablet_bootstrap.cc:492] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:03.194983 1561 ts_tablet_manager.cc:1397] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.002s
I20260927 15:06:03.194694 1552 consensus_queue.cc:260] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.196817 1552 ts_tablet_manager.cc:1428] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260927 15:06:03.197364 1559 ts_tablet_manager.cc:1905] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.198400 1552 tablet_bootstrap.cc:492] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:03.200325 1556 ts_tablet_manager.cc:1397] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.337s user 0.026s sys 0.033s
I20260927 15:06:03.202164 1556 raft_consensus.cc:348] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.202498 1556 raft_consensus.cc:374] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.202636 1556 raft_consensus.cc:729] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.202968 1556 consensus_queue.cc:260] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.203399 1552 tablet_bootstrap.cc:654] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.203824 1556 ts_tablet_manager.cc:1428] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:03.204169 1556 tablet_bootstrap.cc:492] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:03.208572 1561 raft_consensus.cc:348] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.208921 1561 raft_consensus.cc:374] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.209044 1561 raft_consensus.cc:729] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.209318 1561 consensus_queue.cc:260] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.210014 1561 ts_tablet_manager.cc:1428] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.015s user 0.000s sys 0.000s
I20260927 15:06:03.210356 1561 tablet_bootstrap.cc:492] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:03.212651 1561 tablet_bootstrap.cc:654] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.213528 1552 tablet_bootstrap.cc:492] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:03.213726 1552 ts_tablet_manager.cc:1397] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260927 15:06:03.216827 1552 raft_consensus.cc:348] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.218622 1552 raft_consensus.cc:374] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.218743 1552 raft_consensus.cc:729] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.219554 1552 consensus_queue.cc:260] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.220211 1552 ts_tablet_manager.cc:1428] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260927 15:06:03.223392 1376 consensus_peers.cc:487] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:03.224256 1552 tablet_bootstrap.cc:492] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:03.232811 1552 tablet_bootstrap.cc:654] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.234653 1562 ts_tablet_manager.cc:1918] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:03.234944 1562 log.cc:1196] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/bbcffb8cedd74b18871988201f9db2e5
I20260927 15:06:03.235528 1562 ts_tablet_manager.cc:1939] T bbcffb8cedd74b18871988201f9db2e5 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:03.236545 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 281) took 1480 ms. Trace:
I20260927 15:06:03.236876 1562 rpcz_store.cc:276] 0927 15:06:01.755672 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.755750 (+ 78us) service_pool.cc:227] Handling call
0927 15:06:03.187754 (+1432004us) ts_tablet_manager.cc:1145] Deleting tablet bbcffb8cedd74b18871988201f9db2e5
0927 15:06:03.187764 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.215410 (+ 27646us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.234506 (+ 19096us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.236481 (+ 1975us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1422159}
I20260927 15:06:03.237520 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet bbcffb8cedd74b18871988201f9db2e5 (table default.Table_bd1398c934c0418eba63a6b9c0646259 [id=83855eb214b1496297178563cb7eb2cd]) successfully deleted
I20260927 15:06:03.237955 1562 tablet_replica.cc:330] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:03.238371 1562 raft_consensus.cc:2229] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:03.239065 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f8744e2349e49d3a821eca42c7f89a2 consensus state has no leader
I20260927 15:06:03.240293 1562 raft_consensus.cc:2258] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.240072 1561 tablet_bootstrap.cc:492] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:03.240819 1561 ts_tablet_manager.cc:1397] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20260927 15:06:03.241705 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9598ac8a916f4bf5b1cf9995a8149c70
I20260927 15:06:03.242710 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 9598ac8a916f4bf5b1cf9995a8149c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.243124 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 28f6bef5f000441090f73eb842450362
I20260927 15:06:03.243489 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3efc44686be2407cbcdca61909301539
I20260927 15:06:03.243846 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 82f6cfd9f4c0424d86df223b0eaab4f7
I20260927 15:06:03.244360 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3d454d65afa94aac9b34c253adfa4b0c
I20260927 15:06:03.245306 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 9598ac8a916f4bf5b1cf9995a8149c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.249394 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.250519 1561 raft_consensus.cc:348] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.250671 908 master_service.cc:946] ReplaceTablet: received request to replace tablet bc20a62bbd484c4e9e25cf1c15e1dde0 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:03.250816 1561 raft_consensus.cc:374] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.250972 1561 raft_consensus.cc:729] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.251235 1561 consensus_queue.cc:260] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.251601 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2c48b816d5304111b8219dab75d9045e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:03.251827 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d454d65afa94aac9b34c253adfa4b0c with delete_type TABLET_DATA_DELETED (replaced by tablet 171ba98418b34aa283b7a7b243678fa9) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.251978 1561 ts_tablet_manager.cc:1428] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
W20260927 15:06:03.252218 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c48b816d5304111b8219dab75d9045e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.252285 1561 tablet_bootstrap.cc:492] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:03.253365 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d33202ebc4e37b598d62d66472f31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:03.253741 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9598ac8a916f4bf5b1cf9995a8149c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9598ac8a916f4bf5b1cf9995a8149c70 already in progress: creating tablet
I20260927 15:06:03.255050 1805 tablet_replica.cc:330] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:03.255286 1805 raft_consensus.cc:2229] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.255458 1805 raft_consensus.cc:2258] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.255880 1935 consensus_queue.cc:1035] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:03.256397 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ddf0e36781314b2ba5932e7156d9fa25" } new_table_name: "default.Table_aa05ab0cb98542a4b84901b5dcd86aee" modify_external_catalogs: true
I20260927 15:06:03.257704 1805 ts_tablet_manager.cc:1905] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.257761 905 catalog_manager.cc:6565] ReplaceTablet: tablet 3d454d65afa94aac9b34c253adfa4b0c deleted and replaced by tablet 171ba98418b34aa283b7a7b243678fa9
I20260927 15:06:03.257854 1854 consensus_queue.cc:1035] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:03.260993 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 3efc44686be2407cbcdca61909301539 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.261292 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f6bef5f000441090f73eb842450362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.262485 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.263451 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_539b633d448c40e6bc9134a8ab4dd16f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:03.263446 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2175c9c46f2449babffc1ff757bfd94c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.264078 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_539b633d448c40e6bc9134a8ab4dd16f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:03.264425 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2175c9c46f2449babffc1ff757bfd94c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.265592 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6eed08273244d28fd15785a09059f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a07831078b48a59807f7da4a42bcec) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.266070 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2addc3d2ba2b42d2b9107764c473cf95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.266538 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2addc3d2ba2b42d2b9107764c473cf95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.267354 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 3efc44686be2407cbcdca61909301539 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.268572 1562 ts_tablet_manager.cc:1905] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.270249 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 9598ac8a916f4bf5b1cf9995a8149c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.251528 1556 tablet_bootstrap.cc:654] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.273267 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d454d65afa94aac9b34c253adfa4b0c with delete_type TABLET_DATA_DELETED (replaced by tablet 171ba98418b34aa283b7a7b243678fa9) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.273545 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f6bef5f000441090f73eb842450362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.274015 1805 ts_tablet_manager.cc:1918] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:03.274158 1805 log.cc:1196] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/3a8d33202ebc4e37b598d62d66472f31
I20260927 15:06:03.278502 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 3efc44686be2407cbcdca61909301539 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.280156 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f6bef5f000441090f73eb842450362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.280761 1962 tablet.cc:1722] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:03.281705 1805 ts_tablet_manager.cc:1939] T 3a8d33202ebc4e37b598d62d66472f31 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:03.282464 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d454d65afa94aac9b34c253adfa4b0c with delete_type TABLET_DATA_DELETED (replaced by tablet 171ba98418b34aa283b7a7b243678fa9) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.287431 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 82f6cfd9f4c0424d86df223b0eaab4f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:03.289678 1376 consensus_peers.cc:487] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:03.294569 1963 tablet.cc:1722] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:03.296957 1561 tablet_bootstrap.cc:654] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.309057 1916 raft_consensus.cc:482] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.309283 1916 raft_consensus.cc:504] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.310120 1916 leader_election.cc:288] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:03.312516 1962 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:03.312855 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 3a8d33202ebc4e37b598d62d66472f31 (table default.Table_dc82ae0788b94be68a26ad903bf087fb [id=26cdf96fac4b455faf5607f72aa6f2f5]) successfully deleted
I20260927 15:06:03.313246 1805 tablet_replica.cc:330] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:03.313474 1805 raft_consensus.cc:2229] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.313715 1805 raft_consensus.cc:2258] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.314244 1805 ts_tablet_manager.cc:1905] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.281975 1552 tablet_bootstrap.cc:492] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:03.311305 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba14b7531bb647248572be10d2b43cf2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:03.316787 1552 ts_tablet_manager.cc:1397] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.094s user 0.006s sys 0.002s
W20260927 15:06:03.317410 1102 leader_election.cc:341] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.317656 1552 raft_consensus.cc:348] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.318025 1552 raft_consensus.cc:374] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.318147 1552 raft_consensus.cc:729] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.318493 1552 consensus_queue.cc:260] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.321256 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ee79d927d2a24080beb4354086ce00f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.321998 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee79d927d2a24080beb4354086ce00f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.323184 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a90039faff27436db7b50fa4c4643d3b
I20260927 15:06:03.323853 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_761ebfb7b5db4cae9ba1208d5e39d897"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.324296 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_761ebfb7b5db4cae9ba1208d5e39d897 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.326090 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet a90039faff27436db7b50fa4c4643d3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.331220 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a8d33202ebc4e37b598d62d66472f31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.331532 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 443af328e5154bdba9b570224616d77b with delete_type TABLET_DATA_DELETED (replaced by tablet 3d454d65afa94aac9b34c253adfa4b0c) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.331758 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet a90039faff27436db7b50fa4c4643d3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.331995 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f15485b8825436184abe2621c71e356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.332074 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf0ef42c0944b049a8ce68531ed8e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.332579 1562 ts_tablet_manager.cc:1918] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:03.332705 1562 log.cc:1196] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/4ead753ba6664829b1262712f35e64f2
I20260927 15:06:03.332718 1552 ts_tablet_manager.cc:1428] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 15:06:03.333153 1562 ts_tablet_manager.cc:1939] T 4ead753ba6664829b1262712f35e64f2 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:03.333926 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 282) took 1348 ms. Trace:
I20260927 15:06:03.334156 1552 tablet_bootstrap.cc:492] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:03.334133 1562 rpcz_store.cc:276] 0927 15:06:01.985121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.985361 (+ 240us) service_pool.cc:227] Handling call
0927 15:06:03.237860 (+1252499us) ts_tablet_manager.cc:1145] Deleting tablet 4ead753ba6664829b1262712f35e64f2
0927 15:06:03.237875 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.329393 (+ 91518us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.332465 (+ 3072us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.333888 (+ 1423us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1240340}
I20260927 15:06:03.334632 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 4ead753ba6664829b1262712f35e64f2 (table default.Table_bf2c59d22fa84330870ea9f394bcc27b [id=5d06fdeffa7142fd8a456f64254ae011]) successfully deleted
I20260927 15:06:03.336360 1552 tablet_bootstrap.cc:654] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.336433 1706 raft_consensus.cc:482] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.336563 1706 raft_consensus.cc:504] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.337131 1706 leader_election.cc:288] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:03.339823 1238 leader_election.cc:341] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 8f15485b8825436184abe2621c71e356
I20260927 15:06:03.342463 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet a90039faff27436db7b50fa4c4643d3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.345666 1811 consensus_queue.cc:1035] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:03.346526 1559 ts_tablet_manager.cc:1918] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:03.346716 1559 log.cc:1196] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/4ead753ba6664829b1262712f35e64f2
W20260927 15:06:03.348387 1239 leader_election.cc:341] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 8f15485b8825436184abe2621c71e356
I20260927 15:06:03.348519 1239 leader_election.cc:302] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:03.348659 1556 tablet_bootstrap.cc:492] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.348847 1556 ts_tablet_manager.cc:1397] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.145s user 0.001s sys 0.002s
I20260927 15:06:03.348912 1706 raft_consensus.cc:2726] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:03.349720 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba14b7531bb647248572be10d2b43cf2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:03.355185 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bc20a62bbd484c4e9e25cf1c15e1dde0
I20260927 15:06:03.358506 1970 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:03.359053 908 catalog_manager.cc:6565] ReplaceTablet: tablet bc20a62bbd484c4e9e25cf1c15e1dde0 deleted and replaced by tablet b2d2501a9f764790818426665e7f0340
I20260927 15:06:03.359169 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 with delete_type TABLET_DATA_DELETED (replaced by tablet b2d2501a9f764790818426665e7f0340) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.359398 1971 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:03.360107 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 9cb0ab983a444d26b903a0cec64f15f0 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:03.361042 910 master_service.cc:946] ReplaceTablet: received request to replace tablet cd901034653b47dbba7912d5338bc3bb from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:03.363250 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_620928666dc94535aafb4210bb2c0411" } new_table_name: "default.Table_1f2da6475c904f0d8aec8dea13410524" modify_external_catalogs: true
I20260927 15:06:03.364857 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6fefd73ed6c6478da6538b5b9c48e998"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.365420 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fefd73ed6c6478da6538b5b9c48e998 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.366931 1706 raft_consensus.cc:482] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.367074 1706 raft_consensus.cc:504] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.368137 1706 leader_election.cc:288] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:03.366703 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8d8d19b1fbfc4a4a8ec451b4af3cf646"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.369161 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d8d19b1fbfc4a4a8ec451b4af3cf646 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.370684 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b34cca200794f3fa6075659ba3851ec" } new_table_name: "default.Table_e09fcea174c647adb26c6caeacda55a6" modify_external_catalogs: true
I20260927 15:06:03.372213 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 with delete_type TABLET_DATA_DELETED (replaced by tablet b2d2501a9f764790818426665e7f0340) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.373104 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 8af844423fc94e2c8380db179103d3aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.373884 1561 tablet_bootstrap.cc:492] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
W20260927 15:06:03.373940 1238 leader_election.cc:341] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 8af844423fc94e2c8380db179103d3aa
I20260927 15:06:03.374078 1561 ts_tablet_manager.cc:1397] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.122s user 0.003s sys 0.002s
I20260927 15:06:03.375454 1561 raft_consensus.cc:348] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.375753 1561 raft_consensus.cc:374] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.375865 1561 raft_consensus.cc:729] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.376127 1561 consensus_queue.cc:260] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.376916 1561 ts_tablet_manager.cc:1428] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:03.365365 1556 raft_consensus.cc:348] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.380086 1556 raft_consensus.cc:374] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:03.380088 1099 leader_election.cc:341] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.380228 1556 raft_consensus.cc:729] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.380223 1099 leader_election.cc:302] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:03.380473 1556 consensus_queue.cc:260] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.375368 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 with delete_type TABLET_DATA_DELETED (replaced by tablet b2d2501a9f764790818426665e7f0340) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.378793 1559 ts_tablet_manager.cc:1939] T 4ead753ba6664829b1262712f35e64f2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:03.382246 1918 raft_consensus.cc:2726] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:03.383381 1556 ts_tablet_manager.cc:1428] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.034s user 0.001s sys 0.002s
I20260927 15:06:03.383648 1556 tablet_bootstrap.cc:492] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:03.385257 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 289) took 1300 ms. Trace:
I20260927 15:06:03.385557 1556 tablet_bootstrap.cc:654] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.385453 1559 rpcz_store.cc:276] 0927 15:06:02.084801 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.084853 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:03.003229 (+918376us) ts_tablet_manager.cc:1145] Deleting tablet 4ead753ba6664829b1262712f35e64f2
0927 15:06:03.003240 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.208978 (+205738us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.346355 (+137377us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.385189 (+ 38834us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10222,"tablet-delete.queue_time_us":918204}
I20260927 15:06:03.386206 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 4ead753ba6664829b1262712f35e64f2 (table default.Table_bf2c59d22fa84330870ea9f394bcc27b [id=5d06fdeffa7142fd8a456f64254ae011]) successfully deleted
I20260927 15:06:03.386765 1559 tablet_replica.cc:330] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:03.387379 1559 raft_consensus.cc:2229] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.387720 1559 raft_consensus.cc:2258] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.388883 1559 ts_tablet_manager.cc:1905] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.393618 913 master_service.cc:946] ReplaceTablet: received request to replace tablet 0129eaa5636544e696076e439d713b1b from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:03.398710 1561 tablet_bootstrap.cc:492] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:03.398890 1239 leader_election.cc:341] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 8af844423fc94e2c8380db179103d3aa
I20260927 15:06:03.399041 1239 leader_election.cc:302] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:03.399616 1706 raft_consensus.cc:2726] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:03.400697 1561 tablet_bootstrap.cc:654] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.411907 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 377847d06b534883ba2b870ca3317fe0 (table default.Table_1c87fe2a6c1a4e178dc88d4fd8679835 [id=56574e770aa74f04a7bf24b7718e4960]). Expected version 1 got 0
W20260927 15:06:03.412528 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e9b07ea3ec9457399e2b765580d06e7 consensus state has no leader
I20260927 15:06:03.412257 906 catalog_manager.cc:5495] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:03.412787 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0e6e3600cbf741419bc7b93eec42eb13 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]). Expected version 1 got 0
I20260927 15:06:03.413058 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet ba14b7531bb647248572be10d2b43cf2 (table default.Table_bc0cef144e2c48f6883df97308937a76 [id=43c20c5b532545b5b66ad52dc5af5fc2]). Expected version 1 got 0
I20260927 15:06:03.413300 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]). Expected version 4 got 0
W20260927 15:06:03.414268 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52e7439320dd48aba25b5f7dc627964c consensus state has no leader
I20260927 15:06:03.420200 1275 tablet_service.cc:1467] Processing CreateTablet for tablet b44e2611d2bf40ae90c4fd857225e39e (DEFAULT_TABLE table=default.Table_c46b2f0f6ed04caab359a17bf48da08a [id=9be8df1ac1d44d99a54426f250216921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.420588 1276 tablet_service.cc:1467] Processing CreateTablet for tablet fd1f51cb124d4d20a9d6024e6eb6810f (DEFAULT_TABLE table=default.Table_80b31537a3164aa7ad56ac09e6b8a2a6 [id=4bd55908fae746d192e45bb674ecc75d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.420745 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b44e2611d2bf40ae90c4fd857225e39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.421051 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd1f51cb124d4d20a9d6024e6eb6810f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.421361 1281 tablet_service.cc:1467] Processing CreateTablet for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (DEFAULT_TABLE table=default.Table_70317f25e61f4ec48a720a9f34635030 [id=239ff5a7776c4a469e14137b23b6544a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.421763 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb5f4a30bac94d72b5265c8a7a0d4d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.420200 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 0141fdf4d1ef47b8b3e758ea3ff8b7c8 (DEFAULT_TABLE table=default.Table_2f4ba0f9cc18490fa3ad87297437e526 [id=1c7ec947b5e64b758eb132f7c75dc45d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.424604 1129 tablet_service.cc:1467] Processing CreateTablet for tablet fd1f51cb124d4d20a9d6024e6eb6810f (DEFAULT_TABLE table=default.Table_80b31537a3164aa7ad56ac09e6b8a2a6 [id=4bd55908fae746d192e45bb674ecc75d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.424973 1561 tablet_bootstrap.cc:492] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:03.425100 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd1f51cb124d4d20a9d6024e6eb6810f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.425156 1561 ts_tablet_manager.cc:1397] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260927 15:06:03.425755 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 283) took 1440 ms. Trace:
I20260927 15:06:03.426074 1561 raft_consensus.cc:348] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.426340 1561 raft_consensus.cc:374] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.426420 1561 raft_consensus.cc:729] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.426194 1562 rpcz_store.cc:276] 0927 15:06:01.985231 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.985521 (+ 290us) service_pool.cc:227] Handling call
0927 15:06:03.425244 (+1439723us) ts_tablet_manager.cc:1145] Deleting tablet 8af844423fc94e2c8380db179103d3aa
0927 15:06:03.425255 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.425620 (+ 365us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1427569}
I20260927 15:06:03.426687 1561 consensus_queue.cc:260] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.427219 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 0141fdf4d1ef47b8b3e758ea3ff8b7c8 (DEFAULT_TABLE table=default.Table_2f4ba0f9cc18490fa3ad87297437e526 [id=1c7ec947b5e64b758eb132f7c75dc45d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.427434 1561 ts_tablet_manager.cc:1428] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:03.427608 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0141fdf4d1ef47b8b3e758ea3ff8b7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.431290 1132 tablet_service.cc:1467] Processing CreateTablet for tablet b44e2611d2bf40ae90c4fd857225e39e (DEFAULT_TABLE table=default.Table_c46b2f0f6ed04caab359a17bf48da08a [id=9be8df1ac1d44d99a54426f250216921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.431701 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 289bea546c8a41bf97edfdc9a453a024 (DEFAULT_TABLE table=default.Table_3ece36785b214c7fb4352a79cb3b4438 [id=37dab0cf0ab84245acb1fda4e02b1ded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.431857 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b44e2611d2bf40ae90c4fd857225e39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.432085 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 289bea546c8a41bf97edfdc9a453a024. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:03.433632 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8af844423fc94e2c8380db179103d3aa because the tablet was not found. No further retry: Not found: Tablet not found: 8af844423fc94e2c8380db179103d3aa
I20260927 15:06:03.435359 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 0141fdf4d1ef47b8b3e758ea3ff8b7c8 (DEFAULT_TABLE table=default.Table_2f4ba0f9cc18490fa3ad87297437e526 [id=1c7ec947b5e64b758eb132f7c75dc45d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.435950 1415 tablet_service.cc:1467] Processing CreateTablet for tablet b44e2611d2bf40ae90c4fd857225e39e (DEFAULT_TABLE table=default.Table_c46b2f0f6ed04caab359a17bf48da08a [id=9be8df1ac1d44d99a54426f250216921]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.436456 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 289bea546c8a41bf97edfdc9a453a024 (DEFAULT_TABLE table=default.Table_3ece36785b214c7fb4352a79cb3b4438 [id=37dab0cf0ab84245acb1fda4e02b1ded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.431289 1561 tablet_bootstrap.cc:492] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:03.436977 1417 tablet_service.cc:1467] Processing CreateTablet for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (DEFAULT_TABLE table=default.Table_70317f25e61f4ec48a720a9f34635030 [id=239ff5a7776c4a469e14137b23b6544a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.439455 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb5f4a30bac94d72b5265c8a7a0d4d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.445519 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cd9a04e478fd4b95a2dfc85613965e31" } new_table_name: "default.Table_806abc9f7da043179a751515c37b1170" modify_external_catalogs: true
I20260927 15:06:03.445568 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c8f0a331bf1f4f7c969299f5f0c4d5a6" } modify_external_catalogs: true
I20260927 15:06:03.445855 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c8f0a331bf1f4f7c969299f5f0c4d5a6" } modify_external_catalogs: true
I20260927 15:06:03.446880 1963 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 15:06:03.448861 1962 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 15:06:03.449263 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 289bea546c8a41bf97edfdc9a453a024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.450572 1143 tablet_service.cc:1467] Processing CreateTablet for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (DEFAULT_TABLE table=default.Table_70317f25e61f4ec48a720a9f34635030 [id=239ff5a7776c4a469e14137b23b6544a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.451180 1562 tablet_replica.cc:330] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:03.451658 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb5f4a30bac94d72b5265c8a7a0d4d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.453068 1562 raft_consensus.cc:2229] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.453245 1562 raft_consensus.cc:2258] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.453145 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a1a1af250bd547f592b309be7c518a2a" } new_table_name: "default.Table_d498ea4d76e248a98a4c6e184d194324" modify_external_catalogs: true
I20260927 15:06:03.454748 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 3540982dd7544e60af6c153fc41a412c (DEFAULT_TABLE table=default.Table_807b252506684a4a804a3f2a52913df8 [id=eb67e70601274115808752561ecaa5e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.457810 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 52e7439320dd48aba25b5f7dc627964c (DEFAULT_TABLE table=default.Table_1f2da6475c904f0d8aec8dea13410524 [id=6ae561a83b5543a89dd0dedc630d9e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.461407 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3540982dd7544e60af6c153fc41a412c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.462095 1562 ts_tablet_manager.cc:1905] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.462339 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52e7439320dd48aba25b5f7dc627964c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.463903 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d824f1399fb8451dad058a93321740ce" } modify_external_catalogs: true
I20260927 15:06:03.464466 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ad4e7655514c453aa4eaf109ee6a057f" } modify_external_catalogs: true
I20260927 15:06:03.464515 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d824f1399fb8451dad058a93321740ce" } modify_external_catalogs: true
I20260927 15:06:03.464712 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ad4e7655514c453aa4eaf109ee6a057f" } modify_external_catalogs: true
I20260927 15:06:03.467309 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9e37ca2b041a439aa503560c17e5b391" } modify_external_catalogs: true
I20260927 15:06:03.467510 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9e37ca2b041a439aa503560c17e5b391" } modify_external_catalogs: true
I20260927 15:06:03.480123 1562 ts_tablet_manager.cc:1918] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:03.480531 1562 log.cc:1196] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/654d3210fd8c46b68880e544c39d5c88
I20260927 15:06:03.500149 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 3540982dd7544e60af6c153fc41a412c (DEFAULT_TABLE table=default.Table_807b252506684a4a804a3f2a52913df8 [id=eb67e70601274115808752561ecaa5e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.503978 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0129eaa5636544e696076e439d713b1b
I20260927 15:06:03.504510 913 catalog_manager.cc:6565] ReplaceTablet: tablet 0129eaa5636544e696076e439d713b1b deleted and replaced by tablet 7fd8311955974e1cbcdda1961c318588
W20260927 15:06:03.504971 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81e0be77dff645f795237ffe779ed684 consensus state has no leader
I20260927 15:06:03.508872 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0141fdf4d1ef47b8b3e758ea3ff8b7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.510725 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 289bea546c8a41bf97edfdc9a453a024 (DEFAULT_TABLE table=default.Table_3ece36785b214c7fb4352a79cb3b4438 [id=37dab0cf0ab84245acb1fda4e02b1ded]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:03.511264 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0702d9501ac047938d02ef2521dbf0d5 consensus state has no leader
I20260927 15:06:03.512462 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a19c9cc5859f49a58a35460e504b3f84
I20260927 15:06:03.513906 912 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet db1b4ca3202b4493ba84a2c252b3c358
I20260927 15:06:03.515749 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 52e7439320dd48aba25b5f7dc627964c (DEFAULT_TABLE table=default.Table_1f2da6475c904f0d8aec8dea13410524 [id=6ae561a83b5543a89dd0dedc630d9e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.517495 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_888f9d56600b4020992ab5dbd99a1f14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.518379 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_888f9d56600b4020992ab5dbd99a1f14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.522100 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f585bcdadbcc4032aa484481cdf94b72
I20260927 15:06:03.524340 905 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 08f28c023473434ba73b1142a041be97 (table default.Table_d5fcfba46cd94c3a98d626e476a85b71 [id=67762455acad44448ba24d18c2863816]). Expected version 2 got 0
I20260927 15:06:03.524598 905 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 377847d06b534883ba2b870ca3317fe0 (table default.Table_1c87fe2a6c1a4e178dc88d4fd8679835 [id=56574e770aa74f04a7bf24b7718e4960]). Expected version 1 got 0
I20260927 15:06:03.527179 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3540982dd7544e60af6c153fc41a412c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.527667 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 54a07831078b48a59807f7da4a42bcec
I20260927 15:06:03.528252 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f473e7d31ecc4adfbda7d8a1df28ec33" } modify_external_catalogs: true
I20260927 15:06:03.528445 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f473e7d31ecc4adfbda7d8a1df28ec33" } modify_external_catalogs: true
I20260927 15:06:03.530983 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b44e2611d2bf40ae90c4fd857225e39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.533366 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cb47d8e094f84808bbcf64674dd9f797"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.534111 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb47d8e094f84808bbcf64674dd9f797 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.534336 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a07831078b48a59807f7da4a42bcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.534909 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9cc5859f49a58a35460e504b3f84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.535079 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 0129eaa5636544e696076e439d713b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 7fd8311955974e1cbcdda1961c318588) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.535497 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0141fdf4d1ef47b8b3e758ea3ff8b7c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.536964 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52e7439320dd48aba25b5f7dc627964c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.538182 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet f585bcdadbcc4032aa484481cdf94b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.538600 1706 raft_consensus.cc:482] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.538717 911 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 27c3283a40f14eb4868767799cfdf7bd (table default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85]). Expected version 2 got 0
I20260927 15:06:03.538736 1706 raft_consensus.cc:504] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.539394 1706 leader_election.cc:288] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:03.539985 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 289bea546c8a41bf97edfdc9a453a024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.544370 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8f4bd8182c9d48c7b6e6175ab98d405a
I20260927 15:06:03.547713 914 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_aa05ab0cb98542a4b84901b5dcd86aee [id=b1106aee6c804da4a603364cee1c1116]). Expected version 5 got 4
I20260927 15:06:03.549568 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f4bd8182c9d48c7b6e6175ab98d405a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:03.554942 1419 tablet_service.cc:1467] Processing CreateTablet for tablet fd1f51cb124d4d20a9d6024e6eb6810f (DEFAULT_TABLE table=default.Table_80b31537a3164aa7ad56ac09e6b8a2a6 [id=4bd55908fae746d192e45bb674ecc75d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.556732 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_93ff0be74d8c494e902ce0f7d5b74150"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.557829 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93ff0be74d8c494e902ce0f7d5b74150 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.560637 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d80d3405cea240ec87396ab494d2d04d" } new_table_name: "default.Table_5bc19744aafd42cdb0a1bb656853619b" modify_external_catalogs: true
W20260927 15:06:03.563807 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 81e0be77dff645f795237ffe779ed684 (table default.Table_806abc9f7da043179a751515c37b1170 [id=2602f6dfc6ac49a8ac3f4af47b38f21b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 81e0be77dff645f795237ffe779ed684 consensus state has no leader
I20260927 15:06:03.568442 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_995d720be4324759bc78c1c0aaae8213"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.569046 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_995d720be4324759bc78c1c0aaae8213 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.568512 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9308e69b438d4173a3e71eb08336c30a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.571806 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9308e69b438d4173a3e71eb08336c30a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.573285 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_15a237c8bd7b4f18884441d871424a91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.574120 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15a237c8bd7b4f18884441d871424a91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.575289 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 3540982dd7544e60af6c153fc41a412c (DEFAULT_TABLE table=default.Table_807b252506684a4a804a3f2a52913df8 [id=eb67e70601274115808752561ecaa5e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.577572 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd1f51cb124d4d20a9d6024e6eb6810f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.578804 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3540982dd7544e60af6c153fc41a412c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.579872 911 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_1c87fe2a6c1a4e178dc88d4fd8679835 [id=56574e770aa74f04a7bf24b7718e4960] alter complete (version 1)
W20260927 15:06:03.583757 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f88b401dc12e451c80abe1b509e2b532 consensus state has no leader
W20260927 15:06:03.585085 1238 leader_election.cc:341] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6cf0ef42c0944b049a8ce68531ed8e45
I20260927 15:06:03.587173 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 52e7439320dd48aba25b5f7dc627964c (DEFAULT_TABLE table=default.Table_1f2da6475c904f0d8aec8dea13410524 [id=6ae561a83b5543a89dd0dedc630d9e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.587571 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52e7439320dd48aba25b5f7dc627964c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.594671 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f4bd8182c9d48c7b6e6175ab98d405a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.595146 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a07831078b48a59807f7da4a42bcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.595290 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead753ba6664829b1262712f35e64f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.595741 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet f585bcdadbcc4032aa484481cdf94b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.599972 911 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_aa05ab0cb98542a4b84901b5dcd86aee [id=b1106aee6c804da4a603364cee1c1116] alter complete (version 5)
I20260927 15:06:03.601972 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet ab08d04c11dd44299ee5f9a911d581c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.602224 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9cc5859f49a58a35460e504b3f84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.604131 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 0129eaa5636544e696076e439d713b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 7fd8311955974e1cbcdda1961c318588) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.604382 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet f585bcdadbcc4032aa484481cdf94b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.605373 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a07831078b48a59807f7da4a42bcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.605630 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df4a23269244191bf1dcd69cb34d371 with delete_type TABLET_DATA_DELETED (replaced by tablet 3042c17580d54082971b761433a7dca9) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.606704 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d1f23f91bce4df480dd9991659f2e81 with delete_type TABLET_DATA_DELETED (replaced by tablet cd901034653b47dbba7912d5338bc3bb) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.607390 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8314c67a0ac344ac978f6ec17eb62d72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:03.607889 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f4bd8182c9d48c7b6e6175ab98d405a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:03.608003 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8314c67a0ac344ac978f6ec17eb62d72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.608712 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead753ba6664829b1262712f35e64f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.607460 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_01e58c54d7e14dac9f422ff99a6b893e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:03.609766 1562 ts_tablet_manager.cc:1939] T 654d3210fd8c46b68880e544c39d5c88 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:06:03.609819 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01e58c54d7e14dac9f422ff99a6b893e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.611855 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 0129eaa5636544e696076e439d713b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 7fd8311955974e1cbcdda1961c318588) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.614097 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b452a2bdaeb9412b8372f173d1cd27dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.614786 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b452a2bdaeb9412b8372f173d1cd27dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.616530 1552 tablet_bootstrap.cc:492] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:03.617813 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4ef11790dfe1412eb7dc43efcb8088ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.618426 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ef11790dfe1412eb7dc43efcb8088ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.619125 1556 tablet_bootstrap.cc:492] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.619278 1556 ts_tablet_manager.cc:1397] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.236s user 0.031s sys 0.032s
I20260927 15:06:03.619786 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4b430696cdec4858aa30fc5189839327" } new_table_name: "default.Table_0943f2008bdd407da6fe0e4dbe4c69bb" modify_external_catalogs: true
I20260927 15:06:03.619992 1556 raft_consensus.cc:348] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.620245 1556 raft_consensus.cc:374] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.620319 1556 raft_consensus.cc:729] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.621023 1561 tablet_bootstrap.cc:654] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.621449 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 284) took 1634 ms. Trace:
I20260927 15:06:03.622442 1562 rpcz_store.cc:276] 0927 15:06:01.985316 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:01.985652 (+ 336us) service_pool.cc:227] Handling call
0927 15:06:03.432807 (+1447155us) ts_tablet_manager.cc:1145] Deleting tablet 654d3210fd8c46b68880e544c39d5c88
0927 15:06:03.432818 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.457388 (+ 24570us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x60f00005db68. stack: 00007f344c23b66e 00007f344c23b430 00007f344b2c25ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f345f130f9d 00007f34588efc2e 00007f3458a1ba57 00007f345b3aa2e6 00007f345b3dc404 00007f345b3bd870 00007f345b3bd5fd 00000000009edb7c 00007f344c281344 00007f344c28491b
0927 15:06:03.469740 (+ 12352us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.479929 (+ 10189us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.619654 (+139725us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6740864,"tablet-delete.queue_time_us":1434951}
I20260927 15:06:03.622948 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 654d3210fd8c46b68880e544c39d5c88 (table default.Table_2b3e81787f35442691853bd186de1a8a [id=353280883f2c4a2d9b472e8ba529acd6]) successfully deleted
I20260927 15:06:03.623380 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 285) took 1614 ms. Trace:
I20260927 15:06:03.623472 1562 rpcz_store.cc:276] 0927 15:06:02.009239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.009292 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:03.623182 (+1613890us) ts_tablet_manager.cc:1145] Deleting tablet 214229a8283b43c4916a5db7ba120e03
0927 15:06:03.623191 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.623290 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1613563}
I20260927 15:06:03.623668 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_03b7cc2c10fe498b8bbbfa412d58a56d" } new_table_name: "default.Table_565f7d1851f74565b073c0e1c74d9403" modify_external_catalogs: true
W20260927 15:06:03.623893 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 214229a8283b43c4916a5db7ba120e03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 214229a8283b43c4916a5db7ba120e03 already in progress: creating tablet
I20260927 15:06:03.624454 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 286) took 1610 ms. Trace:
I20260927 15:06:03.625030 1562 rpcz_store.cc:276] 0927 15:06:02.013452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.013563 (+ 111us) service_pool.cc:227] Handling call
0927 15:06:03.624148 (+1610585us) ts_tablet_manager.cc:1145] Deleting tablet a8de6246f7904f6c80df624f3631db17
0927 15:06:03.624157 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.624241 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1610353}
W20260927 15:06:03.625566 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet a8de6246f7904f6c80df624f3631db17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8de6246f7904f6c80df624f3631db17 already in progress: creating tablet
I20260927 15:06:03.625957 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 288) took 1610 ms. Trace:
I20260927 15:06:03.626044 1562 rpcz_store.cc:276] 0927 15:06:02.015170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.015219 (+ 49us) service_pool.cc:227] Handling call
0927 15:06:03.625775 (+1610556us) ts_tablet_manager.cc:1145] Deleting tablet 6b1f2143af1142eb9f3dbc777299c186
0927 15:06:03.625784 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.625873 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1610358}
W20260927 15:06:03.626474 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6b1f2143af1142eb9f3dbc777299c186 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b1f2143af1142eb9f3dbc777299c186 already in progress: creating tablet
I20260927 15:06:03.627485 1556 consensus_queue.cc:260] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.629288 1556 ts_tablet_manager.cc:1428] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 15:06:03.630452 1556 tablet_bootstrap.cc:492] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:03.632284 1556 tablet_bootstrap.cc:654] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.637955 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 287) took 1611 ms. Trace:
I20260927 15:06:03.638077 1562 rpcz_store.cc:276] 0927 15:06:02.015018 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.015495 (+ 477us) service_pool.cc:227] Handling call
0927 15:06:03.626693 (+1611198us) ts_tablet_manager.cc:1145] Deleting tablet 9cb0ab983a444d26b903a0cec64f15f0
0927 15:06:03.626702 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.626774 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1611003}
W20260927 15:06:03.638473 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9cb0ab983a444d26b903a0cec64f15f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb0ab983a444d26b903a0cec64f15f0 already in progress: creating tablet
I20260927 15:06:03.639113 1556 tablet_bootstrap.cc:492] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.639271 1556 ts_tablet_manager.cc:1397] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260927 15:06:03.639400 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.639487 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 290) took 1564 ms. Trace:
I20260927 15:06:03.639585 1562 rpcz_store.cc:276] 0927 15:06:02.074593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.074659 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:03.638719 (+1564060us) ts_tablet_manager.cc:1145] Deleting tablet fde632b187eb4180b343d7bddc7f0943
0927 15:06:03.638730 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.638813 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1561268}
W20260927 15:06:03.639976 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet fde632b187eb4180b343d7bddc7f0943 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fde632b187eb4180b343d7bddc7f0943 already in progress: creating tablet
I20260927 15:06:03.640064 1556 raft_consensus.cc:348] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.640291 1556 raft_consensus.cc:374] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.640388 1556 raft_consensus.cc:729] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.640600 1556 consensus_queue.cc:260] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.641162 1556 ts_tablet_manager.cc:1428] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:03.641536 1556 tablet_bootstrap.cc:492] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:03.643669 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 27c3283a40f14eb4868767799cfdf7bd (table default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85]). Expected version 2 got 0
I20260927 15:06:03.643908 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 08f28c023473434ba73b1142a041be97 (table default.Table_d5fcfba46cd94c3a98d626e476a85b71 [id=67762455acad44448ba24d18c2863816]). Expected version 2 got 0
I20260927 15:06:03.644047 1556 tablet_bootstrap.cc:654] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.649672 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 30244d596d4d4090af7656027b48f22e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.650394 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 3fff31ceb379400bbfa4586c749e6d6e (DEFAULT_TABLE table=default.Table_761ebfb7b5db4cae9ba1208d5e39d897 [id=5b1a6c0ccb0541acbcbea845dd239b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.650882 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fff31ceb379400bbfa4586c749e6d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.652618 1552 ts_tablet_manager.cc:1397] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.283s user 0.015s sys 0.028s
I20260927 15:06:03.653667 1552 raft_consensus.cc:348] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.656337 1971 tablet.cc:1722] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 15:06:03.661008 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 9d4487cbbce24e60ae76ec0aca2760f4 (DEFAULT_TABLE table=default.Table_ee79d927d2a24080beb4354086ce00f6 [id=0b25a43ed4b5477d96c9d8def871a63b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.661543 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d4487cbbce24e60ae76ec0aca2760f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.663583 1556 tablet_bootstrap.cc:492] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.664089 1556 ts_tablet_manager.cc:1397] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.000s
I20260927 15:06:03.664812 1556 raft_consensus.cc:348] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.665045 1556 raft_consensus.cc:374] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.665114 1556 raft_consensus.cc:729] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.665329 1556 consensus_queue.cc:260] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.665866 1556 ts_tablet_manager.cc:1428] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:03.666174 1556 tablet_bootstrap.cc:492] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:03.666285 1130 tablet_service.cc:1467] Processing CreateTablet for tablet e2ba3bdf50b14aec85a99742426e9298 (DEFAULT_TABLE table=default.Table_539b633d448c40e6bc9134a8ab4dd16f [id=15667aae5a2449ad8c392b8883db7ea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.666710 1140 tablet_service.cc:1467] Processing CreateTablet for tablet af25950fd08043f18a6eaaf46ded4378 (DEFAULT_TABLE table=default.Table_2addc3d2ba2b42d2b9107764c473cf95 [id=79d05bf7ebaf49db86db1dd40492e4ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.667315 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 20d349cb04314c388e2f72b243c629ba (DEFAULT_TABLE table=default.Table_2175c9c46f2449babffc1ff757bfd94c [id=afca5fe4316b4f5f97dfaf1ce641d832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.667657 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 9d4487cbbce24e60ae76ec0aca2760f4 (DEFAULT_TABLE table=default.Table_ee79d927d2a24080beb4354086ce00f6 [id=0b25a43ed4b5477d96c9d8def871a63b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.667796 1556 tablet_bootstrap.cc:654] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.672452 1137 tablet_service.cc:1467] Processing CreateTablet for tablet cdcc55fb32b14935922e5870819bc266 (DEFAULT_TABLE table=default.Table_7f32f20313364f5787a4bb5c09f5ca22 [id=bd365b2e211141e197d5a42c429e7d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.672665 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 3fff31ceb379400bbfa4586c749e6d6e (DEFAULT_TABLE table=default.Table_761ebfb7b5db4cae9ba1208d5e39d897 [id=5b1a6c0ccb0541acbcbea845dd239b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.673617 1131 tablet_service.cc:1467] Processing CreateTablet for tablet d9fecfb2325046f98e69797ff8342892 (DEFAULT_TABLE table=default.Table_a3ced21ba58141f5bafa240f002887b7 [id=9fd363aa53b74b68a9537af688cbb110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.675228 1144 tablet_service.cc:1467] Processing CreateTablet for tablet b2d2501a9f764790818426665e7f0340 (DEFAULT_TABLE table=default.Table_03b7cc2c10fe498b8bbbfa412d58a56d [id=3305179f942c4133896ea7b9b1bc898b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.678658 1562 tablet_replica.cc:330] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:03.678942 1562 raft_consensus.cc:2229] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.679234 1562 raft_consensus.cc:2258] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.679930 1562 ts_tablet_manager.cc:1905] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.683251 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ba3bdf50b14aec85a99742426e9298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.687075 1916 raft_consensus.cc:482] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.687747 1916 raft_consensus.cc:504] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.688323 1916 leader_election.cc:288] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:03.694381 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 30244d596d4d4090af7656027b48f22e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.694473 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d454d65afa94aac9b34c253adfa4b0c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:03.698632 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 12f6403cde734c1394aabfc92c093290 (DEFAULT_TABLE table=default.Table_2c48b816d5304111b8219dab75d9045e [id=0edcbb91cd0c40a786b015c417ed12f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.699903 1132 tablet_service.cc:1467] Processing CreateTablet for tablet a97f72ddef5346c297d73589e926260c (DEFAULT_TABLE table=default.Table_8d8d19b1fbfc4a4a8ec451b4af3cf646 [id=5d0dd65f7df0425d8164dc60f19fdb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.700894 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 171ba98418b34aa283b7a7b243678fa9 (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.701654 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 796eef27ca8341b1a1ccc95770892e04 (DEFAULT_TABLE table=default.Table_6fefd73ed6c6478da6538b5b9c48e998 [id=32d3cd5a0cf6490ba3b2567d39e29cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.704244 1556 tablet_bootstrap.cc:492] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.704389 1556 ts_tablet_manager.cc:1397] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.016s
I20260927 15:06:03.705098 1556 raft_consensus.cc:348] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.705331 1556 raft_consensus.cc:374] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.705411 1556 raft_consensus.cc:729] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.705633 1556 consensus_queue.cc:260] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.706203 1556 ts_tablet_manager.cc:1428] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:03.707674 1556 tablet_bootstrap.cc:492] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:03.709414 1935 raft_consensus.cc:482] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.709594 1935 raft_consensus.cc:504] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.709950 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f1973c1b1bb545a098000d81bf8c4223" } new_table_name: "default.Table_04e241fd53a64c76b188ab49cd5ea266" modify_external_catalogs: true
I20260927 15:06:03.710203 1935 leader_election.cc:288] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:03.709286 1556 tablet_bootstrap.cc:654] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.716421 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7c7824484c624468a8ccbd47f7ea4ca8" } modify_external_catalogs: true
I20260927 15:06:03.716480 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d5fcfba46cd94c3a98d626e476a85b71" } new_table_name: "default.Table_826c1efeddc74a17ad2db271286974ac" modify_external_catalogs: true
I20260927 15:06:03.716717 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7c7824484c624468a8ccbd47f7ea4ca8" } modify_external_catalogs: true
I20260927 15:06:03.718088 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c6d23c73ae904261ac5ed42420c0eaab" } modify_external_catalogs: true
I20260927 15:06:03.718307 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c6d23c73ae904261ac5ed42420c0eaab" } modify_external_catalogs: true
I20260927 15:06:03.719693 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af25950fd08043f18a6eaaf46ded4378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.719949 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 171ba98418b34aa283b7a7b243678fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.720924 1916 raft_consensus.cc:482] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.721098 1916 raft_consensus.cc:504] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.721827 1556 tablet_bootstrap.cc:492] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.721985 1556 ts_tablet_manager.cc:1397] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.003s
I20260927 15:06:03.722204 1916 leader_election.cc:288] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:03.722635 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30244d596d4d4090af7656027b48f22e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:03.722710 1556 raft_consensus.cc:348] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.722945 1556 raft_consensus.cc:374] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.723012 1556 raft_consensus.cc:729] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.723235 1556 consensus_queue.cc:260] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.723374 1163 raft_consensus.cc:2454] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:03.725163 1374 leader_election.cc:302] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:03.725579 1854 raft_consensus.cc:2781] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:03.725690 1854 raft_consensus.cc:482] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:03.725777 1854 raft_consensus.cc:3037] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:03.726357 1556 ts_tablet_manager.cc:1428] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:03.726665 1556 tablet_bootstrap.cc:492] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:03.728992 1854 raft_consensus.cc:504] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.729710 1556 tablet_bootstrap.cc:654] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.730739 1854 leader_election.cc:288] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:03.738917 1099 leader_election.cc:341] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.739866 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdcc55fb32b14935922e5870819bc266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.740137 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9fecfb2325046f98e69797ff8342892. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:03.740757 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 43977.1us
I20260927 15:06:03.741966 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1f23f91bce4df480dd9991659f2e81" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:03.742247 1437 raft_consensus.cc:2454] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:03.742580 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30244d596d4d4090af7656027b48f22e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:03.742817 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a97f72ddef5346c297d73589e926260c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.745687 1163 raft_consensus.cc:3037] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:03.746598 1916 raft_consensus.cc:482] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.747094 1916 raft_consensus.cc:504] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.747848 1916 leader_election.cc:288] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:03.747972 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12f6403cde734c1394aabfc92c093290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.748198 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 796eef27ca8341b1a1ccc95770892e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.748250 1811 raft_consensus.cc:482] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.749802 1811 raft_consensus.cc:504] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.750553 1811 leader_election.cc:288] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:03.751581 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2d2501a9f764790818426665e7f0340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.753932 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4a23269244191bf1dcd69cb34d371" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:03.754235 1437 raft_consensus.cc:2454] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:03.755149 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "765b3ee3323846c5ba598f47478fd367" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:03.758910 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fff31ceb379400bbfa4586c749e6d6e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:03.760033 1239 leader_election.cc:341] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 6cf0ef42c0944b049a8ce68531ed8e45
I20260927 15:06:03.760201 1239 leader_election.cc:302] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:03.760527 1419 tablet_service.cc:1467] Processing CreateTablet for tablet af25950fd08043f18a6eaaf46ded4378 (DEFAULT_TABLE table=default.Table_2addc3d2ba2b42d2b9107764c473cf95 [id=79d05bf7ebaf49db86db1dd40492e4ef]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:03.760501 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 143763us
I20260927 15:06:03.761026 1412 tablet_service.cc:1467] Processing CreateTablet for tablet e2ba3bdf50b14aec85a99742426e9298 (DEFAULT_TABLE table=default.Table_539b633d448c40e6bc9134a8ab4dd16f [id=15667aae5a2449ad8c392b8883db7ea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.761471 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 12f6403cde734c1394aabfc92c093290 (DEFAULT_TABLE table=default.Table_2c48b816d5304111b8219dab75d9045e [id=0edcbb91cd0c40a786b015c417ed12f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.761919 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 20d349cb04314c388e2f72b243c629ba (DEFAULT_TABLE table=default.Table_2175c9c46f2449babffc1ff757bfd94c [id=afca5fe4316b4f5f97dfaf1ce641d832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.762331 1417 tablet_service.cc:1467] Processing CreateTablet for tablet a97f72ddef5346c297d73589e926260c (DEFAULT_TABLE table=default.Table_8d8d19b1fbfc4a4a8ec451b4af3cf646 [id=5d0dd65f7df0425d8164dc60f19fdb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.762742 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 171ba98418b34aa283b7a7b243678fa9 (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.763597 1416 tablet_service.cc:1467] Processing CreateTablet for tablet cdcc55fb32b14935922e5870819bc266 (DEFAULT_TABLE table=default.Table_7f32f20313364f5787a4bb5c09f5ca22 [id=bd365b2e211141e197d5a42c429e7d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.763993 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 796eef27ca8341b1a1ccc95770892e04 (DEFAULT_TABLE table=default.Table_6fefd73ed6c6478da6538b5b9c48e998 [id=32d3cd5a0cf6490ba3b2567d39e29cc3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:03.764101 898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260927 15:06:03.764374 1406 tablet_service.cc:1467] Processing CreateTablet for tablet d9fecfb2325046f98e69797ff8342892 (DEFAULT_TABLE table=default.Table_a3ced21ba58141f5bafa240f002887b7 [id=9fd363aa53b74b68a9537af688cbb110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.764707 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 67cf4dae943e4092b2c490ad770e4a94 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f6bdef4ddb4f9c9c0d1f933768cd14) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.765120 1408 tablet_service.cc:1467] Processing CreateTablet for tablet b2d2501a9f764790818426665e7f0340 (DEFAULT_TABLE table=default.Table_03b7cc2c10fe498b8bbbfa412d58a56d [id=3305179f942c4133896ea7b9b1bc898b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.765379 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d1f23f91bce4df480dd9991659f2e81 with delete_type TABLET_DATA_DELETED (replaced by tablet cd901034653b47dbba7912d5338bc3bb) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.767155 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af25950fd08043f18a6eaaf46ded4378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.771497 1552 raft_consensus.cc:374] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.776222 1706 raft_consensus.cc:2726] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:03.785312 1274 tablet_service.cc:1467] Processing CreateTablet for tablet af25950fd08043f18a6eaaf46ded4378 (DEFAULT_TABLE table=default.Table_2addc3d2ba2b42d2b9107764c473cf95 [id=79d05bf7ebaf49db86db1dd40492e4ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.782945 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1f23f91bce4df480dd9991659f2e81" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:03.786084 1552 raft_consensus.cc:729] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.787622 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d454d65afa94aac9b34c253adfa4b0c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:03.788538 1552 consensus_queue.cc:260] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.789160 1552 ts_tablet_manager.cc:1428] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.136s user 0.001s sys 0.001s
I20260927 15:06:03.789258 1285 tablet_service.cc:1467] Processing CreateTablet for tablet e2ba3bdf50b14aec85a99742426e9298 (DEFAULT_TABLE table=default.Table_539b633d448c40e6bc9134a8ab4dd16f [id=15667aae5a2449ad8c392b8883db7ea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.789554 1552 tablet_bootstrap.cc:492] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:03.775312 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4a23269244191bf1dcd69cb34d371" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:03.793135 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 9d4487cbbce24e60ae76ec0aca2760f4 (DEFAULT_TABLE table=default.Table_ee79d927d2a24080beb4354086ce00f6 [id=0b25a43ed4b5477d96c9d8def871a63b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.795835 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "765b3ee3323846c5ba598f47478fd367" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:03.796353 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30244d596d4d4090af7656027b48f22e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:03.797117 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af25950fd08043f18a6eaaf46ded4378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.802945 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30244d596d4d4090af7656027b48f22e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:03.803798 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 12f6403cde734c1394aabfc92c093290 (DEFAULT_TABLE table=default.Table_2c48b816d5304111b8219dab75d9045e [id=0edcbb91cd0c40a786b015c417ed12f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.807528 1805 ts_tablet_manager.cc:1918] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.7
I20260927 15:06:03.807672 1805 log.cc:1196] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/82f6cfd9f4c0424d86df223b0eaab4f7
I20260927 15:06:03.807818 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9cc5859f49a58a35460e504b3f84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:03.808195 1805 ts_tablet_manager.cc:1939] T 82f6cfd9f4c0424d86df223b0eaab4f7 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:03.808506 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ba3bdf50b14aec85a99742426e9298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.811129 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d4487cbbce24e60ae76ec0aca2760f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.815387 1099 leader_election.cc:302] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:03.815543 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d4487cbbce24e60ae76ec0aca2760f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.817090 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12f6403cde734c1394aabfc92c093290. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:03.817674 1376 leader_election.cc:341] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.818428 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2ba3bdf50b14aec85a99742426e9298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.819484 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a97f72ddef5346c297d73589e926260c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.819726 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 20d349cb04314c388e2f72b243c629ba (DEFAULT_TABLE table=default.Table_2175c9c46f2449babffc1ff757bfd94c [id=afca5fe4316b4f5f97dfaf1ce641d832]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:03.819921 1376 leader_election.cc:341] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.826177 1277 tablet_service.cc:1467] Processing CreateTablet for tablet cdcc55fb32b14935922e5870819bc266 (DEFAULT_TABLE table=default.Table_7f32f20313364f5787a4bb5c09f5ca22 [id=bd365b2e211141e197d5a42c429e7d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.826182 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 171ba98418b34aa283b7a7b243678fa9 (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.827419 1811 raft_consensus.cc:482] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.827579 1811 raft_consensus.cc:504] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.829046 1272 tablet_service.cc:1467] Processing CreateTablet for tablet d9fecfb2325046f98e69797ff8342892 (DEFAULT_TABLE table=default.Table_a3ced21ba58141f5bafa240f002887b7 [id=9fd363aa53b74b68a9537af688cbb110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.829336 1273 tablet_service.cc:1467] Processing CreateTablet for tablet a97f72ddef5346c297d73589e926260c (DEFAULT_TABLE table=default.Table_8d8d19b1fbfc4a4a8ec451b4af3cf646 [id=5d0dd65f7df0425d8164dc60f19fdb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.829592 1706 raft_consensus.cc:482] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.829707 1706 raft_consensus.cc:504] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.830225 1706 leader_election.cc:288] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:03.830545 1271 tablet_service.cc:1467] Processing CreateTablet for tablet b2d2501a9f764790818426665e7f0340 (DEFAULT_TABLE table=default.Table_03b7cc2c10fe498b8bbbfa412d58a56d [id=3305179f942c4133896ea7b9b1bc898b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.830952 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20d349cb04314c388e2f72b243c629ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.831066 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdcc55fb32b14935922e5870819bc266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.831823 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 796eef27ca8341b1a1ccc95770892e04 (DEFAULT_TABLE table=default.Table_6fefd73ed6c6478da6538b5b9c48e998 [id=32d3cd5a0cf6490ba3b2567d39e29cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.835421 1552 tablet_bootstrap.cc:654] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:03.836809 1238 leader_election.cc:341] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 443af328e5154bdba9b570224616d77b
W20260927 15:06:03.838353 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 62942.1us
I20260927 15:06:03.840009 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20d349cb04314c388e2f72b243c629ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.841684 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2d2501a9f764790818426665e7f0340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.841956 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 171ba98418b34aa283b7a7b243678fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.842127 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdcc55fb32b14935922e5870819bc266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.842563 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 171ba98418b34aa283b7a7b243678fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.842566 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12f6403cde734c1394aabfc92c093290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.842955 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a97f72ddef5346c297d73589e926260c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.843555 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9fecfb2325046f98e69797ff8342892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.843966 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2d2501a9f764790818426665e7f0340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.846482 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 796eef27ca8341b1a1ccc95770892e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.846994 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 796eef27ca8341b1a1ccc95770892e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.847093 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9fecfb2325046f98e69797ff8342892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.849787 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20d349cb04314c388e2f72b243c629ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.851089 1805 tablet_replica.cc:330] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:03.851292 1805 raft_consensus.cc:2229] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.851444 1805 raft_consensus.cc:2258] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.852007 1805 ts_tablet_manager.cc:1905] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.852033 1559 ts_tablet_manager.cc:1918] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:03.852175 1559 log.cc:1196] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/f2cce454e70640e2a67b3680676b1d93
I20260927 15:06:03.852567 1559 ts_tablet_manager.cc:1939] T f2cce454e70640e2a67b3680676b1d93 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:03.853346 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 286) took 1770 ms. Trace:
I20260927 15:06:03.853452 1559 rpcz_store.cc:276] 0927 15:06:02.083194 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.087521 (+ 4327us) service_pool.cc:227] Handling call
0927 15:06:03.386631 (+1299110us) ts_tablet_manager.cc:1145] Deleting tablet f2cce454e70640e2a67b3680676b1d93
0927 15:06:03.386671 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.808252 (+421581us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.851924 (+ 43672us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.853278 (+ 1354us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1298903}
W20260927 15:06:03.855701 1376 consensus_peers.cc:487] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:03.859221 1559 tablet_replica.cc:330] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:03.859603 1099 leader_election.cc:302] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:03.859848 1559 raft_consensus.cc:2229] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:06:03.860044 1099 leader_election.cc:341] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.860196 1559 raft_consensus.cc:2258] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:03.861205 1239 leader_election.cc:341] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 443af328e5154bdba9b570224616d77b
I20260927 15:06:03.861366 1239 leader_election.cc:302] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:03.861553 1239 raft_consensus.cc:2670] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 15:06:03.862311 1559 ts_tablet_manager.cc:1905] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.863435 1935 raft_consensus.cc:482] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:03.863605 1935 raft_consensus.cc:504] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.864289 1935 leader_election.cc:288] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:03.864351 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab08d04c11dd44299ee5f9a911d581c3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:03.864542 1437 raft_consensus.cc:2454] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:03.866081 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cf4dae943e4092b2c490ad770e4a94" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:03.867152 1376 leader_election.cc:341] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:03.838966 1102 leader_election.cc:341] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.872104 1918 raft_consensus.cc:2781] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:03.873893 1916 raft_consensus.cc:2781] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:03.874023 1916 raft_consensus.cc:482] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:03.874136 1916 raft_consensus.cc:3037] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:03.875881 1559 ts_tablet_manager.cc:1918] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:03.880034 1099 leader_election.cc:302] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:03.880313 1559 log.cc:1196] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/bc971defe6d148439a6a0b8c55d9092e
I20260927 15:06:03.881364 1559 ts_tablet_manager.cc:1939] T bc971defe6d148439a6a0b8c55d9092e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:03.882076 1811 leader_election.cc:288] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:03.882088 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 292) took 1778 ms. Trace:
I20260927 15:06:03.882197 1559 rpcz_store.cc:276] 0927 15:06:02.103878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.103948 (+ 70us) service_pool.cc:227] Handling call
0927 15:06:03.859141 (+1755193us) ts_tablet_manager.cc:1145] Deleting tablet bc971defe6d148439a6a0b8c55d9092e
0927 15:06:03.859152 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.866467 (+ 7315us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.875775 (+ 9308us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.882056 (+ 6281us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1754975}
I20260927 15:06:03.883899 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 300) took 1684 ms. Trace:
I20260927 15:06:03.884073 1559 rpcz_store.cc:276] 0927 15:06:02.199935 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.199993 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:03.883766 (+1683773us) ts_tablet_manager.cc:1145] Deleting tablet cb859b43634c420382da5c201ce24dfc
0927 15:06:03.883776 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.883870 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1683519}
I20260927 15:06:03.884979 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 299) took 1685 ms. Trace:
I20260927 15:06:03.886965 1561 tablet_bootstrap.cc:492] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:03.887147 1561 ts_tablet_manager.cc:1397] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.456s user 0.013s sys 0.020s
I20260927 15:06:03.881601 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cf4dae943e4092b2c490ad770e4a94" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:03.887367 1559 rpcz_store.cc:276] 0927 15:06:02.198707 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.214438 (+ 15731us) service_pool.cc:227] Handling call
0927 15:06:03.884465 (+1670027us) ts_tablet_manager.cc:1145] Deleting tablet c65bc09865bc4a0283eaa4af9f860bdd
0927 15:06:03.884475 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.884565 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1669706}
W20260927 15:06:03.887912 1374 leader_election.cc:341] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.887972 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 302) took 1652 ms. Trace:
I20260927 15:06:03.888091 1374 leader_election.cc:302] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:03.888180 1559 rpcz_store.cc:276] 0927 15:06:02.235615 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.236466 (+ 851us) service_pool.cc:227] Handling call
0927 15:06:03.887848 (+1651382us) ts_tablet_manager.cc:1145] Deleting tablet 4b9e88c3679d412cac7603f200cf899b
0927 15:06:03.887858 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.887937 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1651146}
I20260927 15:06:03.888787 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 303) took 1648 ms. Trace:
I20260927 15:06:03.888824 1935 raft_consensus.cc:2726] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:03.889099 1559 rpcz_store.cc:276] 0927 15:06:02.240362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.240468 (+ 106us) service_pool.cc:227] Handling call
0927 15:06:03.888660 (+1648192us) ts_tablet_manager.cc:1145] Deleting tablet 42baac8b7d47433e826eb3bc1980acaa
0927 15:06:03.888670 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.888750 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1647286}
I20260927 15:06:03.889698 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 310) took 1604 ms. Trace:
I20260927 15:06:03.893714 1559 rpcz_store.cc:276] 0927 15:06:02.285609 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.310404 (+ 24795us) service_pool.cc:227] Handling call
0927 15:06:03.889581 (+1579177us) ts_tablet_manager.cc:1145] Deleting tablet 2c4a123886a847d08b2a94ff5e4e01ca
0927 15:06:03.889591 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.889670 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1578767}
I20260927 15:06:03.894033 1811 raft_consensus.cc:2781] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:03.894300 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 314) took 1505 ms. Trace:
I20260927 15:06:03.894513 1559 rpcz_store.cc:276] 0927 15:06:02.389181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.389232 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:03.894180 (+1504948us) ts_tablet_manager.cc:1145] Deleting tablet 429088342b4743c39fb1e38d235024de
0927 15:06:03.894189 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.894271 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1504707}
I20260927 15:06:03.895174 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 320) took 1415 ms. Trace:
I20260927 15:06:03.895339 1559 rpcz_store.cc:276] 0927 15:06:02.479899 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.480561 (+ 662us) service_pool.cc:227] Handling call
0927 15:06:03.895019 (+1414458us) ts_tablet_manager.cc:1145] Deleting tablet fd5f2ab9677c4598b0b8d9a93a6a23c7
0927 15:06:03.895030 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.895143 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1407235}
W20260927 15:06:03.895520 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 93661.9us
I20260927 15:06:03.896014 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 324) took 1396 ms. Trace:
I20260927 15:06:03.896116 1559 rpcz_store.cc:276] 0927 15:06:02.499744 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.500654 (+ 910us) service_pool.cc:227] Handling call
0927 15:06:03.895904 (+1395250us) ts_tablet_manager.cc:1145] Deleting tablet cd76c49eda1c4b4ca0edf0f4d2790188
0927 15:06:03.895913 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.895987 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1394437}
W20260927 15:06:03.896245 1102 leader_election.cc:341] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.896535 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 334) took 1258 ms. Trace:
W20260927 15:06:03.896549 1102 leader_election.cc:341] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.896643 1102 leader_election.cc:302] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:03.896637 1559 rpcz_store.cc:276] 0927 15:06:02.637860 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.638029 (+ 169us) service_pool.cc:227] Handling call
0927 15:06:03.896407 (+1258378us) ts_tablet_manager.cc:1145] Deleting tablet c41cd38355e64590b43b2e1271c43e91
0927 15:06:03.896416 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.896483 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1255414}
I20260927 15:06:03.896977 1559 tablet_replica.cc:330] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:03.897030 1102 leader_election.cc:341] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.897140 1102 leader_election.cc:302] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:03.897204 1559 raft_consensus.cc:2229] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.897365 1559 raft_consensus.cc:2258] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.897713 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 3fff31ceb379400bbfa4586c749e6d6e (DEFAULT_TABLE table=default.Table_761ebfb7b5db4cae9ba1208d5e39d897 [id=5b1a6c0ccb0541acbcbea845dd239b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:03.898439 1559 ts_tablet_manager.cc:1905] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.899624 1918 raft_consensus.cc:482] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:03.900770 1918 raft_consensus.cc:3037] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:03.904582 1102 consensus_peers.cc:487] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:03.904822 1102 consensus_peers.cc:487] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:03.904673 1561 raft_consensus.cc:348] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.905028 1561 raft_consensus.cc:374] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.905428 1811 raft_consensus.cc:482] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:03.906380 1561 raft_consensus.cc:729] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.906776 1561 consensus_queue.cc:260] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.908025 1556 tablet_bootstrap.cc:492] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.913338 1556 ts_tablet_manager.cc:1397] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.187s user 0.042s sys 0.009s
I20260927 15:06:03.917301 1556 raft_consensus.cc:348] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.917856 1561 ts_tablet_manager.cc:1428] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.029s user 0.002s sys 0.001s
I20260927 15:06:03.918699 1556 raft_consensus.cc:374] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.918932 1556 raft_consensus.cc:729] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.919317 1556 consensus_queue.cc:260] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.922235 1811 raft_consensus.cc:3037] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:03.922752 1556 ts_tablet_manager.cc:1428] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 15:06:03.927610 1556 tablet_bootstrap.cc:492] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:03.932322 1561 tablet_bootstrap.cc:492] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:03.925017 1559 ts_tablet_manager.cc:1918] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:03.932300 1556 tablet_bootstrap.cc:654] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.935691 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab08d04c11dd44299ee5f9a911d581c3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:03.933439 1559 log.cc:1196] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/9c9e4311049d47d3b2f1e117795624ef
I20260927 15:06:03.936403 1559 ts_tablet_manager.cc:1939] T 9c9e4311049d47d3b2f1e117795624ef P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:03.937599 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 335) took 1299 ms. Trace:
I20260927 15:06:03.937777 1559 rpcz_store.cc:276] 0927 15:06:02.639143 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.639799 (+ 656us) service_pool.cc:227] Handling call
0927 15:06:03.896919 (+1257120us) ts_tablet_manager.cc:1145] Deleting tablet 9c9e4311049d47d3b2f1e117795624ef
0927 15:06:03.896927 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.913013 (+ 16086us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.924877 (+ 11864us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.937537 (+ 12660us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1252043}
I20260927 15:06:03.938462 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 333) took 1300 ms. Trace:
I20260927 15:06:03.938628 1559 rpcz_store.cc:276] 0927 15:06:02.637773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.638029 (+ 256us) service_pool.cc:227] Handling call
0927 15:06:03.938280 (+1300251us) ts_tablet_manager.cc:1145] Deleting tablet 48e7eac8753f425d90302360d228ee54
0927 15:06:03.938291 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.938407 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1283598}
I20260927 15:06:03.939126 1559 tablet_replica.cc:330] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:03.939379 1559 raft_consensus.cc:2229] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:03.939698 1559 pending_rounds.cc:62] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:03.939816 1559 pending_rounds.cc:68] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976322639847424 op_type: NO_OP noop_request { }
I20260927 15:06:03.940024 1559 raft_consensus.cc:2866] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:03.940176 1559 raft_consensus.cc:2258] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.941437 1559 ts_tablet_manager.cc:1905] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.944377 1805 ts_tablet_manager.cc:1918] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:03.944573 1805 log.cc:1196] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/443af328e5154bdba9b570224616d77b
I20260927 15:06:03.944984 1805 ts_tablet_manager.cc:1939] T 443af328e5154bdba9b570224616d77b P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:03.945765 1805 tablet_replica.cc:330] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:03.946008 1805 raft_consensus.cc:2229] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.946223 1805 raft_consensus.cc:2258] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.947641 1556 tablet_bootstrap.cc:492] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.947852 1556 ts_tablet_manager.cc:1397] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.003s
I20260927 15:06:03.948707 1556 raft_consensus.cc:348] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.949015 1556 raft_consensus.cc:374] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.949129 1556 raft_consensus.cc:729] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.949435 1556 consensus_queue.cc:260] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.950349 1556 ts_tablet_manager.cc:1428] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:03.950683 1556 tablet_bootstrap.cc:492] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:03.952621 1556 tablet_bootstrap.cc:654] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.953691 1805 ts_tablet_manager.cc:1905] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.954274 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fff31ceb379400bbfa4586c749e6d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:03.960803 1559 ts_tablet_manager.cc:1918] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:03.961009 1559 log.cc:1196] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/6d6eed08273244d28fd15785a09059f9
I20260927 15:06:03.962055 1559 ts_tablet_manager.cc:1939] T 6d6eed08273244d28fd15785a09059f9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:03.965425 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 338) took 1019 ms. Trace:
I20260927 15:06:03.965598 1559 rpcz_store.cc:276] 0927 15:06:02.945721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.945780 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:03.939055 (+993275us) ts_tablet_manager.cc:1145] Deleting tablet 6d6eed08273244d28fd15785a09059f9
0927 15:06:03.939064 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.945686 (+ 6622us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.960687 (+ 15001us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.965370 (+ 4683us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":954869}
I20260927 15:06:03.966948 1561 tablet_bootstrap.cc:654] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:03.955222 1102 leader_election.cc:341] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:03.967312 1559 tablet_replica.cc:330] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:03.967564 1559 raft_consensus.cc:2229] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:03.967795 1559 raft_consensus.cc:2258] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:03.968570 1559 ts_tablet_manager.cc:1905] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:03.971716 1163 raft_consensus.cc:2454] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:03.975666 1562 ts_tablet_manager.cc:1918] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:03.975759 1556 tablet_bootstrap.cc:492] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:03.975806 1562 log.cc:1196] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/da1812142bb043fba7457dc61ffdb180
I20260927 15:06:03.975888 1556 ts_tablet_manager.cc:1397] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20260927 15:06:03.976763 1556 raft_consensus.cc:348] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:03.977124 1556 raft_consensus.cc:374] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.977294 1556 raft_consensus.cc:729] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:03.977603 1556 consensus_queue.cc:260] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:03.785012 898 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 -> Peer dbf522d70373412b87815d33c0f1f745 (127.0.201.62:41167): Couldn't send request to peer dbf522d70373412b87815d33c0f1f745. Status: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260927 15:06:03.786177 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5c817097aae54fadb81259c5729c0b56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.979446 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.62:41167, user_credentials={real_user=slave}} blocked reactor thread for 195697us
W20260927 15:06:03.979955 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c817097aae54fadb81259c5729c0b56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.980518 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet f2cce454e70640e2a67b3680676b1d93 (table default.Table_303dfd972edc4c4db55b80e20fd076c7 [id=a027a86bb6274c5d90e960eede3c398f]) successfully deleted
W20260927 15:06:03.786423 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f0d667472ee4f1481c213e03403461e consensus state has no leader
I20260927 15:06:03.981352 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet bc971defe6d148439a6a0b8c55d9092e (table default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]) successfully deleted
W20260927 15:06:03.981667 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet cb859b43634c420382da5c201ce24dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb859b43634c420382da5c201ce24dfc already in progress: creating tablet
W20260927 15:06:03.981969 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c65bc09865bc4a0283eaa4af9f860bdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c65bc09865bc4a0283eaa4af9f860bdd already in progress: creating tablet
W20260927 15:06:03.982250 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 4b9e88c3679d412cac7603f200cf899b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b9e88c3679d412cac7603f200cf899b already in progress: creating tablet
W20260927 15:06:03.982547 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 42baac8b7d47433e826eb3bc1980acaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42baac8b7d47433e826eb3bc1980acaa already in progress: creating tablet
I20260927 15:06:03.983078 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f460864092f142578f5dc17d264586a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:03.983639 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f460864092f142578f5dc17d264586a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:03.985610 1552 tablet_bootstrap.cc:492] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
W20260927 15:06:03.788681 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2d2501a9f764790818426665e7f0340 consensus state has no leader
I20260927 15:06:03.986654 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fa7b0e87e81842e5a14ce4457fd9dafe" } new_table_name: "default.Table_215f907352cd4345ae56604d6322ded9" modify_external_catalogs: true
I20260927 15:06:03.790009 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_80b31537a3164aa7ad56ac09e6b8a2a6" } modify_external_catalogs: true
I20260927 15:06:03.988871 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_80b31537a3164aa7ad56ac09e6b8a2a6" } modify_external_catalogs: true
I20260927 15:06:03.785306 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ade3cb71f3dd4d55ac7e8839474d785a" } modify_external_catalogs: true
I20260927 15:06:03.990871 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ade3cb71f3dd4d55ac7e8839474d785a" } modify_external_catalogs: true
I20260927 15:06:03.785751 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a26bdbe66d9a438ab4a3a6cf93fbe430" } modify_external_catalogs: true
I20260927 15:06:03.991631 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a26bdbe66d9a438ab4a3a6cf93fbe430" } modify_external_catalogs: true
W20260927 15:06:03.992640 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 115661us
W20260927 15:06:03.992772 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2c4a123886a847d08b2a94ff5e4e01ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c4a123886a847d08b2a94ff5e4e01ca already in progress: creating tablet
W20260927 15:06:03.994068 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 429088342b4743c39fb1e38d235024de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 429088342b4743c39fb1e38d235024de already in progress: creating tablet
I20260927 15:06:03.994270 2003 raft_consensus.cc:2726] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:03.994421 2000 raft_consensus.cc:2726] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:03.994599 2003 raft_consensus.cc:482] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:03.995525 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 already in progress: creating tablet
I20260927 15:06:03.995775 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df4a23269244191bf1dcd69cb34d371 with delete_type TABLET_DATA_DELETED (replaced by tablet 3042c17580d54082971b761433a7dca9) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:03.872321 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_177f5eb468964182a1cb169bf4816efc [id=861d1dea54204625a6d1ad99fb8f6873]) successfully deleted
W20260927 15:06:03.996090 901 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 123762us
W20260927 15:06:03.996172 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet cd76c49eda1c4b4ca0edf0f4d2790188 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd76c49eda1c4b4ca0edf0f4d2790188 already in progress: creating tablet
W20260927 15:06:03.996320 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3efc44686be2407cbcdca61909301539 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3efc44686be2407cbcdca61909301539 already in progress: creating tablet
W20260927 15:06:03.996397 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c41cd38355e64590b43b2e1271c43e91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c41cd38355e64590b43b2e1271c43e91 already in progress: creating tablet
W20260927 15:06:03.996554 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3d454d65afa94aac9b34c253adfa4b0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d454d65afa94aac9b34c253adfa4b0c already in progress: creating tablet
W20260927 15:06:03.996744 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 28f6bef5f000441090f73eb842450362 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28f6bef5f000441090f73eb842450362 already in progress: creating tablet
W20260927 15:06:03.996925 901 catalog_manager.cc:4808] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3a8d33202ebc4e37b598d62d66472f31 because the tablet was not found. No further retry: Not found: Tablet not found: 3a8d33202ebc4e37b598d62d66472f31
I20260927 15:06:03.998284 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 443af328e5154bdba9b570224616d77b (table default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]) successfully deleted
W20260927 15:06:03.998474 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a90039faff27436db7b50fa4c4643d3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a90039faff27436db7b50fa4c4643d3b already in progress: creating tablet
I20260927 15:06:03.999603 1556 ts_tablet_manager.cc:1428] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260927 15:06:04.000286 1556 tablet_bootstrap.cc:492] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:04.000409 1562 ts_tablet_manager.cc:1939] T da1812142bb043fba7457dc61ffdb180 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:04.004261 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 9c9e4311049d47d3b2f1e117795624ef (table default.Table_195d86242b4c4d008065aee0ea319f60 [id=e70d41731a9442ea9dbe00db169e3b3b]) successfully deleted
W20260927 15:06:04.004505 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 48e7eac8753f425d90302360d228ee54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48e7eac8753f425d90302360d228ee54 already in progress: creating tablet
W20260927 15:06:04.004781 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9598ac8a916f4bf5b1cf9995a8149c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9598ac8a916f4bf5b1cf9995a8149c70 already in progress: creating tablet
I20260927 15:06:04.002403 1559 ts_tablet_manager.cc:1918] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.005019 1559 log.cc:1196] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3d454d65afa94aac9b34c253adfa4b0c
W20260927 15:06:04.005010 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3efc44686be2407cbcdca61909301539 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3efc44686be2407cbcdca61909301539 already in progress: creating tablet
W20260927 15:06:04.005231 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 28f6bef5f000441090f73eb842450362 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28f6bef5f000441090f73eb842450362 already in progress: creating tablet
I20260927 15:06:04.005656 1556 tablet_bootstrap.cc:654] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:03.999099 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet bbcffb8cedd74b18871988201f9db2e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.006210 1552 ts_tablet_manager.cc:1397] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.217s user 0.008s sys 0.029s
I20260927 15:06:04.005865 1559 ts_tablet_manager.cc:1939] T 3d454d65afa94aac9b34c253adfa4b0c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:04.008067 1559 tablet_replica.cc:330] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:04.008327 1559 raft_consensus.cc:2229] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:04.008687 1559 raft_consensus.cc:2258] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.009235 1559 ts_tablet_manager.cc:1905] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.013353 1552 raft_consensus.cc:348] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.013643 1552 raft_consensus.cc:374] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:03.994853 2003 raft_consensus.cc:504] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.013763 1552 raft_consensus.cc:729] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.014211 1916 raft_consensus.cc:504] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.016853 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1f23f91bce4df480dd9991659f2e81" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:04.017603 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 292) took 1935 ms. Trace:
I20260927 15:06:04.018419 1556 tablet_bootstrap.cc:492] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:04.018666 1556 ts_tablet_manager.cc:1397] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260927 15:06:04.019506 1556 raft_consensus.cc:348] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.019770 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1f23f91bce4df480dd9991659f2e81" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:04.019991 1438 raft_consensus.cc:3037] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.021311 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 3d454d65afa94aac9b34c253adfa4b0c (table default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]) successfully deleted
I20260927 15:06:04.022557 1438 raft_consensus.cc:2454] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:04.026599 1102 leader_election.cc:341] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:04.027060 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d463a481cb8c4243961e9b0d2b11822c consensus state has no leader
I20260927 15:06:04.027139 1552 consensus_queue.cc:260] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:04.027884 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08f28c023473434ba73b1142a041be97 consensus state has no leader
I20260927 15:06:04.028949 1916 leader_election.cc:288] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:04.032269 1374 leader_election.cc:302] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.034415 1284 tablet_service.cc:1467] Processing CreateTablet for tablet ea3220df595848258d0f53fa941b2beb (DEFAULT_TABLE table=default.Table_995d720be4324759bc78c1c0aaae8213 [id=897414435dff415ea9c597e1ade8caab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.034621 1279 tablet_service.cc:1467] Processing CreateTablet for tablet b911b7f278ce4e5f8946fe8381fd9ba7 (DEFAULT_TABLE table=default.Table_15a237c8bd7b4f18884441d871424a91 [id=c6f967f411b24a11acaecf27c7ed7ae8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.034724 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 (DEFAULT_TABLE table=default.Table_cb47d8e094f84808bbcf64674dd9f797 [id=959be14ff5134cd286ca43fa57db2078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.034896 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea3220df595848258d0f53fa941b2beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.035141 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5aa58fa9a1384013ac1674bc7d53c3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.035071 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2843bf6dbf4117b3f44cd39c328b99 (DEFAULT_TABLE table=default.Table_9308e69b438d4173a3e71eb08336c30a [id=e535d77458dc4a71a14e0f60585c5779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.035331 1935 raft_consensus.cc:482] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:04.035409 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2843bf6dbf4117b3f44cd39c328b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.035524 1935 raft_consensus.cc:504] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.036185 1935 leader_election.cc:288] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:04.036339 1935 raft_consensus.cc:2781] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:04.036469 1935 raft_consensus.cc:686] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:04.036720 1935 consensus_queue.cc:237] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.037915 1415 tablet_service.cc:1467] Processing CreateTablet for tablet ea3220df595848258d0f53fa941b2beb (DEFAULT_TABLE table=default.Table_995d720be4324759bc78c1c0aaae8213 [id=897414435dff415ea9c597e1ade8caab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.038378 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea3220df595848258d0f53fa941b2beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.039108 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 (DEFAULT_TABLE table=default.Table_cb47d8e094f84808bbcf64674dd9f797 [id=959be14ff5134cd286ca43fa57db2078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.039119 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5c8e8865a34f01addbb505cf777a0d (DEFAULT_TABLE table=default.Table_93ff0be74d8c494e902ce0f7d5b74150 [id=aabccd10145946b78e5ddb0ce9aebae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.039152 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5c8e8865a34f01addbb505cf777a0d (DEFAULT_TABLE table=default.Table_93ff0be74d8c494e902ce0f7d5b74150 [id=aabccd10145946b78e5ddb0ce9aebae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.039491 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5aa58fa9a1384013ac1674bc7d53c3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.039496 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5c8e8865a34f01addbb505cf777a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.039690 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5c8e8865a34f01addbb505cf777a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.039969 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b911b7f278ce4e5f8946fe8381fd9ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.041880 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f28c023473434ba73b1142a041be97" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:04.043000 1376 leader_election.cc:341] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.044734 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f28c023473434ba73b1142a041be97" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:04.047145 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd5b041a4274477895e88d4822b91cca consensus state has no leader
I20260927 15:06:04.051352 1552 ts_tablet_manager.cc:1428] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260927 15:06:04.053674 1805 ts_tablet_manager.cc:1918] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.053802 1805 log.cc:1196] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/8f15485b8825436184abe2621c71e356
I20260927 15:06:04.054138 1805 ts_tablet_manager.cc:1939] T 8f15485b8825436184abe2621c71e356 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.059142 1552 tablet_bootstrap.cc:492] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:04.031869 1562 rpcz_store.cc:276] 0927 15:06:02.075659 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.075817 (+ 158us) service_pool.cc:227] Handling call
0927 15:06:03.640190 (+1564373us) ts_tablet_manager.cc:1145] Deleting tablet da1812142bb043fba7457dc61ffdb180
0927 15:06:03.640200 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:03.791018 (+150818us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:03.974548 (+183530us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:04.011610 (+ 37062us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1555935}
I20260927 15:06:04.064670 1552 tablet_bootstrap.cc:654] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.066263 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_496540a0bb89481f9fe87eba8447e549"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:04.066771 1805 tablet_replica.cc:330] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.067037 1805 raft_consensus.cc:2229] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.067042 1963 tablet.cc:1722] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:04.067209 1805 raft_consensus.cc:2258] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.067266 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7b626dee65d244319052156e5e5fe7bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:04.067802 1805 ts_tablet_manager.cc:1905] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.066275 2003 leader_election.cc:288] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:04.068682 1562 tablet_replica.cc:330] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:04.071376 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ae5225c2de1945e888122b6387e848ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:04.032971 2000 consensus_queue.cc:1035] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260927 15:06:04.072923 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 8f15485b8825436184abe2621c71e356 (table default.Table_a0201a60665941a48eabe2de029dcfa4 [id=c2f5f4026b514c7e978c0b30f7a359ec]) successfully deleted
I20260927 15:06:04.074782 1918 raft_consensus.cc:504] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.075471 1918 leader_election.cc:288] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:04.075932 1552 tablet_bootstrap.cc:492] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:04.075857 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2843bf6dbf4117b3f44cd39c328b99 (DEFAULT_TABLE table=default.Table_9308e69b438d4173a3e71eb08336c30a [id=e535d77458dc4a71a14e0f60585c5779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.076134 1552 ts_tablet_manager.cc:1397] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.003s
I20260927 15:06:04.076877 1552 raft_consensus.cc:348] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.077126 1552 raft_consensus.cc:374] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.077225 1552 raft_consensus.cc:729] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.077478 1552 consensus_queue.cc:260] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.078533 1552 ts_tablet_manager.cc:1428] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:04.079031 1552 tablet_bootstrap.cc:492] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:04.079504 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet da1812142bb043fba7457dc61ffdb180 (table default.Table_738223121ff44cda97e408a6b77e0c98 [id=32958d4a1d2d4e048c864f783034e555]) successfully deleted
I20260927 15:06:04.080679 1552 tablet_bootstrap.cc:654] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:04.088778 1102 leader_election.cc:341] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.089131 1141 tablet_service.cc:1467] Processing CreateTablet for tablet b911b7f278ce4e5f8946fe8381fd9ba7 (DEFAULT_TABLE table=default.Table_15a237c8bd7b4f18884441d871424a91 [id=c6f967f411b24a11acaecf27c7ed7ae8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.089932 1562 raft_consensus.cc:2229] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:04.090224 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_496540a0bb89481f9fe87eba8447e549 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.090269 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4a23269244191bf1dcd69cb34d371" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:04.090962 1102 leader_election.cc:341] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.091195 1099 leader_election.cc:302] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.091532 1811 raft_consensus.cc:504] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:04.092139 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b626dee65d244319052156e5e5fe7bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.093096 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2843bf6dbf4117b3f44cd39c328b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.093365 1811 leader_election.cc:288] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:04.093745 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 (DEFAULT_TABLE table=default.Table_cb47d8e094f84808bbcf64674dd9f797 [id=959be14ff5134cd286ca43fa57db2078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.094389 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab08d04c11dd44299ee5f9a911d581c3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:04.094753 1805 ts_tablet_manager.cc:1918] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.094607 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_25c945ca9a864192a29061360e38dc1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.095032 1102 leader_election.cc:341] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.095347 1805 log.cc:1196] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/6cf0ef42c0944b049a8ce68531ed8e45
I20260927 15:06:04.095465 1131 tablet_service.cc:1467] Processing CreateTablet for tablet ea3220df595848258d0f53fa941b2beb (DEFAULT_TABLE table=default.Table_995d720be4324759bc78c1c0aaae8213 [id=897414435dff415ea9c597e1ade8caab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.096043 1805 ts_tablet_manager.cc:1939] T 6cf0ef42c0944b049a8ce68531ed8e45 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.096233 1561 tablet_bootstrap.cc:492] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:04.096413 1561 ts_tablet_manager.cc:1397] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.178s user 0.005s sys 0.020s
W20260927 15:06:04.096846 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25c945ca9a864192a29061360e38dc1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.098152 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 6cf0ef42c0944b049a8ce68531ed8e45 (table default.Table_607ad366580d4bd58b8879b581554873 [id=22e6dc77a3c3419aa3e7034a48773f8f]) successfully deleted
W20260927 15:06:04.098551 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae5225c2de1945e888122b6387e848ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.099737 910 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_5bc19744aafd42cdb0a1bb656853619b [id=c4ddc66927a94fd2abc8e44012cf69f7]). Expected version 1 got 0
I20260927 15:06:04.100972 1552 tablet_bootstrap.cc:492] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:04.101169 1552 ts_tablet_manager.cc:1397] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260927 15:06:04.102124 910 master_service.cc:946] ReplaceTablet: received request to replace tablet d463a481cb8c4243961e9b0d2b11822c from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:04.102280 1552 raft_consensus.cc:348] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.102558 1552 raft_consensus.cc:374] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.102679 1552 raft_consensus.cc:729] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.102972 1552 consensus_queue.cc:260] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.103765 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 654d3210fd8c46b68880e544c39d5c88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.104030 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.104662 1552 ts_tablet_manager.cc:1428] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:04.105742 1552 tablet_bootstrap.cc:492] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:04.107148 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc20a62bbd484c4e9e25cf1c15e1dde0 already in progress: creating tablet
I20260927 15:06:04.107496 1805 tablet_replica.cc:330] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.107753 1805 raft_consensus.cc:2229] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.108017 1805 raft_consensus.cc:2258] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.111369 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea3220df595848258d0f53fa941b2beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.107955 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 7fd8311955974e1cbcdda1961c318588 (DEFAULT_TABLE table=default.Table_0393b69c63dc4c42b67201f634d5c6fa [id=3d369788b9e44a0b9befbbb44303d24e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.115124 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fd8311955974e1cbcdda1961c318588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.116812 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b911b7f278ce4e5f8946fe8381fd9ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.108312 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 6b4beb4112734b9c91e32b300fd266d7 (DEFAULT_TABLE table=default.Table_888f9d56600b4020992ab5dbd99a1f14 [id=8c8bd97266a2496babd70e882c94152b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.119319 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b4beb4112734b9c91e32b300fd266d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.120620 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f28c023473434ba73b1142a041be97" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:04.120956 1163 raft_consensus.cc:2454] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:04.121452 1374 leader_election.cc:302] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.122051 1854 raft_consensus.cc:2781] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:04.122159 1854 raft_consensus.cc:482] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:04.122277 1854 raft_consensus.cc:3037] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.123593 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5aa58fa9a1384013ac1674bc7d53c3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.125697 1854 raft_consensus.cc:504] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.126976 1854 leader_election.cc:288] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:04.127311 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f28c023473434ba73b1142a041be97" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:04.127900 1376 leader_election.cc:341] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.129635 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f28c023473434ba73b1142a041be97" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:04.129863 1805 ts_tablet_manager.cc:1905] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.129899 1163 raft_consensus.cc:3037] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.130303 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 7fd8311955974e1cbcdda1961c318588 (DEFAULT_TABLE table=default.Table_0393b69c63dc4c42b67201f634d5c6fa [id=3d369788b9e44a0b9befbbb44303d24e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.131173 1706 raft_consensus.cc:482] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:04.131348 1706 raft_consensus.cc:504] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.131963 1706 leader_election.cc:288] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:04.133353 1238 leader_election.cc:341] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 654d3210fd8c46b68880e544c39d5c88
W20260927 15:06:04.133760 1239 leader_election.cc:341] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 654d3210fd8c46b68880e544c39d5c88
I20260927 15:06:04.133903 1239 leader_election.cc:302] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:04.134328 1706 raft_consensus.cc:2726] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:04.134665 1552 tablet_bootstrap.cc:654] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.130801 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fd8311955974e1cbcdda1961c318588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.136449 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d454d65afa94aac9b34c253adfa4b0c with delete_type TABLET_DATA_DELETED (replaced by tablet 171ba98418b34aa283b7a7b243678fa9) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.137336 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 6b4beb4112734b9c91e32b300fd266d7 (DEFAULT_TABLE table=default.Table_888f9d56600b4020992ab5dbd99a1f14 [id=8c8bd97266a2496babd70e882c94152b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.137750 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b4beb4112734b9c91e32b300fd266d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.137943 1805 ts_tablet_manager.cc:1918] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.138062 1805 log.cc:1196] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/8af844423fc94e2c8380db179103d3aa
I20260927 15:06:04.138455 1805 ts_tablet_manager.cc:1939] T 8af844423fc94e2c8380db179103d3aa P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.132748 1163 raft_consensus.cc:2454] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:04.144160 1552 tablet_bootstrap.cc:492] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:04.144326 1552 ts_tablet_manager.cc:1397] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.005s
I20260927 15:06:04.145236 1552 raft_consensus.cc:348] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.145392 1374 leader_election.cc:302] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.145602 1552 raft_consensus.cc:374] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.145718 1552 raft_consensus.cc:729] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.145913 1854 raft_consensus.cc:2781] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:04.146086 1552 consensus_queue.cc:260] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.146727 1552 ts_tablet_manager.cc:1428] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:04.146869 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 6b4beb4112734b9c91e32b300fd266d7 (DEFAULT_TABLE table=default.Table_888f9d56600b4020992ab5dbd99a1f14 [id=8c8bd97266a2496babd70e882c94152b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.147310 1552 tablet_bootstrap.cc:492] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:04.148300 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b4beb4112734b9c91e32b300fd266d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.149175 1552 tablet_bootstrap.cc:654] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.150605 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 8af844423fc94e2c8380db179103d3aa (table default.Table_54aa4b63a0734bcca9d77b4a4c2a31c1 [id=8dbd285d921c4a44926c443a601add72]) successfully deleted
W20260927 15:06:04.150998 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 54a07831078b48a59807f7da4a42bcec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54a07831078b48a59807f7da4a42bcec already in progress: creating tablet
W20260927 15:06:04.151335 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a19c9cc5859f49a58a35460e504b3f84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19c9cc5859f49a58a35460e504b3f84 already in progress: creating tablet
I20260927 15:06:04.153373 1562 raft_consensus.cc:2258] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.153514 1805 tablet_replica.cc:330] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.153970 1562 ts_tablet_manager.cc:1905] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:04.154142 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0129eaa5636544e696076e439d713b1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0129eaa5636544e696076e439d713b1b already in progress: creating tablet
W20260927 15:06:04.154408 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f585bcdadbcc4032aa484481cdf94b72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f585bcdadbcc4032aa484481cdf94b72 already in progress: creating tablet
W20260927 15:06:04.154645 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8f4bd8182c9d48c7b6e6175ab98d405a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f4bd8182c9d48c7b6e6175ab98d405a already in progress: creating tablet
I20260927 15:06:04.154999 1805 raft_consensus.cc:2229] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.155208 1805 raft_consensus.cc:2258] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.157552 1805 ts_tablet_manager.cc:1905] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.158375 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 7fd8311955974e1cbcdda1961c318588 (DEFAULT_TABLE table=default.Table_0393b69c63dc4c42b67201f634d5c6fa [id=3d369788b9e44a0b9befbbb44303d24e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.158898 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fd8311955974e1cbcdda1961c318588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.159992 1561 raft_consensus.cc:348] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.160323 1561 raft_consensus.cc:374] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.160432 1561 raft_consensus.cc:729] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.160671 1561 consensus_queue.cc:260] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.161252 1561 ts_tablet_manager.cc:1428] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.065s user 0.001s sys 0.001s
I20260927 15:06:04.161388 1562 ts_tablet_manager.cc:1918] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.161557 1561 tablet_bootstrap.cc:492] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:04.161586 1562 log.cc:1196] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/ba7faf6e79db420db13999d74fe86062
I20260927 15:06:04.161960 1562 ts_tablet_manager.cc:1939] T ba7faf6e79db420db13999d74fe86062 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:04.162740 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 293) took 2086 ms. Trace:
I20260927 15:06:04.162870 1562 rpcz_store.cc:276] 0927 15:06:02.075750 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.075856 (+ 106us) service_pool.cc:227] Handling call
0927 15:06:04.064797 (+1988941us) ts_tablet_manager.cc:1145] Deleting tablet ba7faf6e79db420db13999d74fe86062
0927 15:06:04.064812 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.157336 (+ 92524us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:04.161278 (+ 3942us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:04.162680 (+ 1402us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":63226,"tablet-delete.queue_time_us":1980012}
I20260927 15:06:04.163251 1561 tablet_bootstrap.cc:654] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.163322 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet ba7faf6e79db420db13999d74fe86062 (table default.Table_46da6881be584d4982a6cdafe3fb1c31 [id=f2c85989a55c4f62bb100381a5d68dce]) successfully deleted
I20260927 15:06:04.163592 1300 raft_consensus.cc:3037] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:04.163715 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 140074us
I20260927 15:06:04.164631 1811 raft_consensus.cc:2781] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:04.165100 1811 raft_consensus.cc:686] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:04.165424 1811 consensus_queue.cc:237] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.166172 1854 raft_consensus.cc:686] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:04.166432 1854 consensus_queue.cc:237] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.169337 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f28c023473434ba73b1142a041be97" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:04.170598 1099 leader_election.cc:302] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:04.171190 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df4a23269244191bf1dcd69cb34d371" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:04.171424 1437 raft_consensus.cc:3037] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.173534 951 master_runner.cc:186] Error getting master registration for 127.0.201.62:41167: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection refused (error 111),
I20260927 15:06:04.173705 951 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:06:04.173763 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab08d04c11dd44299ee5f9a911d581c3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:04.174005 1439 raft_consensus.cc:3037] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.174639 1918 raft_consensus.cc:2726] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:04.174722 1561 tablet_bootstrap.cc:492] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:04.174892 1561 ts_tablet_manager.cc:1397] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.003s
I20260927 15:06:04.175709 1561 raft_consensus.cc:348] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.175988 1561 raft_consensus.cc:374] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.176093 1561 raft_consensus.cc:729] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.176354 1561 consensus_queue.cc:260] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.176892 1439 raft_consensus.cc:2454] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:04.177001 1561 ts_tablet_manager.cc:1428] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:04.177296 1561 tablet_bootstrap.cc:492] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:04.177635 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 089b6b5ac39d49fea744240261a8010e
I20260927 15:06:04.178632 1099 leader_election.cc:302] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.178733 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 033e71f60c3e47fd9647db090d4d6cd5
I20260927 15:06:04.178856 1437 raft_consensus.cc:2454] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:04.184484 1918 raft_consensus.cc:2781] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:04.184636 1918 raft_consensus.cc:686] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:04.184906 1918 consensus_queue.cc:237] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.186017 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 089b6b5ac39d49fea744240261a8010e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.186285 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.187981 1552 tablet_bootstrap.cc:492] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:04.188120 1552 ts_tablet_manager.cc:1397] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.001s
I20260927 15:06:04.188592 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.189289 1552 raft_consensus.cc:348] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.189512 1552 raft_consensus.cc:374] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.189610 1552 raft_consensus.cc:729] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.189705 2024 raft_consensus.cc:482] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:04.189836 1552 consensus_queue.cc:260] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.189884 2024 raft_consensus.cc:504] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.190546 1552 ts_tablet_manager.cc:1428] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:04.191305 1552 tablet_bootstrap.cc:492] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:04.194638 1552 tablet_bootstrap.cc:654] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.194599 1099 leader_election.cc:302] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.194561 1405 tablet_service.cc:1467] Processing CreateTablet for tablet b911b7f278ce4e5f8946fe8381fd9ba7 (DEFAULT_TABLE table=default.Table_15a237c8bd7b4f18884441d871424a91 [id=c6f967f411b24a11acaecf27c7ed7ae8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.194940 2000 raft_consensus.cc:2781] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:04.195112 2000 raft_consensus.cc:686] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:04.195336 2000 consensus_queue.cc:237] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.195533 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b911b7f278ce4e5f8946fe8381fd9ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.199187 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.200165 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 8f2843bf6dbf4117b3f44cd39c328b99 (DEFAULT_TABLE table=default.Table_9308e69b438d4173a3e71eb08336c30a [id=e535d77458dc4a71a14e0f60585c5779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.200796 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f2843bf6dbf4117b3f44cd39c328b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.019842 1556 raft_consensus.cc:374] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.203082 1556 raft_consensus.cc:729] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.203536 1556 consensus_queue.cc:260] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.205407 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 089b6b5ac39d49fea744240261a8010e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.206691 1805 ts_tablet_manager.cc:1918] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.206758 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 089b6b5ac39d49fea744240261a8010e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.208012 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1d7a98ffc4745ac8eeb93012b55d417" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:04.208412 1163 raft_consensus.cc:2454] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:04.208947 1374 leader_election.cc:302] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:04.180490 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5c8e8865a34f01addbb505cf777a0d (DEFAULT_TABLE table=default.Table_93ff0be74d8c494e902ce0f7d5b74150 [id=aabccd10145946b78e5ddb0ce9aebae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.181392 1561 tablet_bootstrap.cc:654] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.210031 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5c8e8865a34f01addbb505cf777a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.217941 2032 raft_consensus.cc:2781] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:04.218684 2032 raft_consensus.cc:482] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:04.218941 2032 raft_consensus.cc:3037] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.219730 2024 leader_election.cc:288] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:04.224196 2032 raft_consensus.cc:504] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.229064 1561 tablet_bootstrap.cc:492] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:04.229250 1561 ts_tablet_manager.cc:1397] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.052s user 0.011s sys 0.002s
I20260927 15:06:04.207999 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1d7a98ffc4745ac8eeb93012b55d417" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:04.229720 1559 ts_tablet_manager.cc:1918] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.7
I20260927 15:06:04.226755 1552 tablet_bootstrap.cc:492] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:04.229880 1559 log.cc:1196] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/82f6cfd9f4c0424d86df223b0eaab4f7
W20260927 15:06:04.230058 1376 leader_election.cc:341] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.230127 1552 ts_tablet_manager.cc:1397] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.007s
I20260927 15:06:04.230355 1559 ts_tablet_manager.cc:1939] T 82f6cfd9f4c0424d86df223b0eaab4f7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:04.230629 1561 raft_consensus.cc:348] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.230878 1561 raft_consensus.cc:374] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.230963 1561 raft_consensus.cc:729] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.230959 1552 raft_consensus.cc:348] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.231607 1562 tablet_replica.cc:330] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:04.231534 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_177f5eb468964182a1cb169bf4816efc [id=861d1dea54204625a6d1ad99fb8f6873]) successfully deleted
I20260927 15:06:04.231206 1561 consensus_queue.cc:260] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.232231 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1d7a98ffc4745ac8eeb93012b55d417" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:04.232520 1163 raft_consensus.cc:3037] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.232765 1562 raft_consensus.cc:2229] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.232993 1562 raft_consensus.cc:2258] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.233791 1562 ts_tablet_manager.cc:1905] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.234771 1561 ts_tablet_manager.cc:1428] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260927 15:06:04.235112 1561 tablet_bootstrap.cc:492] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:04.235416 1163 raft_consensus.cc:2454] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:04.235937 1374 leader_election.cc:302] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:04.236277 2024 raft_consensus.cc:2781] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:04.236449 2024 raft_consensus.cc:686] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:04.236752 1561 tablet_bootstrap.cc:654] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.236760 2024 consensus_queue.cc:237] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.243198 1561 tablet_bootstrap.cc:492] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:04.243301 1552 raft_consensus.cc:374] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.243409 1561 ts_tablet_manager.cc:1397] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260927 15:06:04.232232 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1d7a98ffc4745ac8eeb93012b55d417" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:04.243788 1552 raft_consensus.cc:729] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.244138 1552 consensus_queue.cc:260] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.244225 1561 raft_consensus.cc:348] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.246271 1561 raft_consensus.cc:374] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.246279 1552 ts_tablet_manager.cc:1428] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 15:06:04.246397 1561 raft_consensus.cc:729] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.246467 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9576d1a36d7547bf81faabe9c362e3cb
I20260927 15:06:04.246637 1561 consensus_queue.cc:260] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.247217 913 master_service.cc:946] ReplaceTablet: received request to replace tablet 9cb0ab983a444d26b903a0cec64f15f0 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:04.247613 1552 tablet_bootstrap.cc:492] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:04.248216 1561 ts_tablet_manager.cc:1428] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:04.248520 1561 tablet_bootstrap.cc:492] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:04.249336 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2e6fedff929f4c0bbe9df08fc0314680"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.249894 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e6fedff929f4c0bbe9df08fc0314680 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.253055 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_85f7e805a2b84ca3a600cfa46ebc660f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.253675 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85f7e805a2b84ca3a600cfa46ebc660f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.254336 1561 tablet_bootstrap.cc:654] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.255088 1552 tablet_bootstrap.cc:654] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.256108 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_5bc19744aafd42cdb0a1bb656853619b [id=c4ddc66927a94fd2abc8e44012cf69f7]). Expected version 1 got 0
I20260927 15:06:04.231463 1805 log.cc:1196] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/bbcffb8cedd74b18871988201f9db2e5
I20260927 15:06:04.257140 1805 ts_tablet_manager.cc:1939] T bbcffb8cedd74b18871988201f9db2e5 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.257040 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cb426815b34f4e6c89470b4b3904b673"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.257776 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb426815b34f4e6c89470b4b3904b673 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.259166 1805 tablet_replica.cc:330] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.259575 1805 raft_consensus.cc:2229] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.261082 1805 raft_consensus.cc:2258] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.261984 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet bbcffb8cedd74b18871988201f9db2e5 (table default.Table_bd1398c934c0418eba63a6b9c0646259 [id=83855eb214b1496297178563cb7eb2cd]) successfully deleted
I20260927 15:06:04.262984 1805 ts_tablet_manager.cc:1905] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.268193 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 9576d1a36d7547bf81faabe9c362e3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.269062 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet da1812142bb043fba7457dc61ffdb180 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.270190 2032 leader_election.cc:288] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:04.272585 1376 leader_election.cc:341] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.274884 1971 tablet.cc:1722] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:04.278373 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ac64eacc7d924940aacc8779b5bfeae7
I20260927 15:06:04.280187 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 27c3283a40f14eb4868767799cfdf7bd (table default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85]). Expected version 2 got 0
I20260927 15:06:04.281414 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8a01cb508f7143c699903f946e72bacf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.282019 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a01cb508f7143c699903f946e72bacf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.284868 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fd1f51cb124d4d20a9d6024e6eb6810f
I20260927 15:06:04.285362 911 master_service.cc:946] ReplaceTablet: received request to replace tablet fe7816e099094d13887650fc223097c7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:04.290726 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 30244d596d4d4090af7656027b48f22e from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:04.291415 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 67ad68a0adad407a92b2335f43e67227 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:04.294102 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bd1cb8eaacf74059925441393660d956" } new_table_name: "default.Table_9cb03ce349ee4cefa2a1b109f59c75ee" modify_external_catalogs: true
I20260927 15:06:04.297372 1805 ts_tablet_manager.cc:1918] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.297966 1805 log.cc:1196] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/654d3210fd8c46b68880e544c39d5c88
I20260927 15:06:04.299183 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0943f2008bdd407da6fe0e4dbe4c69bb" } new_table_name: "default.Table_47142ae009c646398d187fa84231faa2" modify_external_catalogs: true
I20260927 15:06:04.303050 1805 ts_tablet_manager.cc:1939] T 654d3210fd8c46b68880e544c39d5c88 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.303144 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2175c9c46f2449babffc1ff757bfd94c" } new_table_name: "default.Table_fe611237a8bb400a86751f2eed953ea9" modify_external_catalogs: true
I20260927 15:06:04.305414 1805 tablet_replica.cc:330] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.306089 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet ac64eacc7d924940aacc8779b5bfeae7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.308066 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet d463a481cb8c4243961e9b0d2b11822c
I20260927 15:06:04.308463 1805 raft_consensus.cc:2229] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.308504 910 catalog_manager.cc:6565] ReplaceTablet: tablet d463a481cb8c4243961e9b0d2b11822c deleted and replaced by tablet 1c018f11de9842bc883409f8af35fb5f
I20260927 15:06:04.309206 1805 raft_consensus.cc:2258] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.308945 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a4bac136e6e84e30bc4cc39549204c9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.309789 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4bac136e6e84e30bc4cc39549204c9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.310992 1805 ts_tablet_manager.cc:1905] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.313772 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dd7090ea741141e2b5c0b1a207278282" } new_table_name: "default.Table_df75a53e443d434aaa888fab1ad38e36" modify_external_catalogs: true
I20260927 15:06:04.315956 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet f2cce454e70640e2a67b3680676b1d93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.316567 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ead753ba6664829b1262712f35e64f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.316987 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet fd1f51cb124d4d20a9d6024e6eb6810f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.318133 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet d463a481cb8c4243961e9b0d2b11822c with delete_type TABLET_DATA_DELETED (replaced by tablet 1c018f11de9842bc883409f8af35fb5f) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.321374 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_577464bde8c2424da3403e8f3a06ca36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.322103 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_577464bde8c2424da3403e8f3a06ca36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.323377 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 654d3210fd8c46b68880e544c39d5c88 (table default.Table_2b3e81787f35442691853bd186de1a8a [id=353280883f2c4a2d9b472e8ba529acd6]) successfully deleted
I20260927 15:06:04.325045 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1b15320c32a54a9ab7a584a195d7aca8" } new_table_name: "default.Table_28678b473eb34fc98fdfa5b51c8f9ecc" modify_external_catalogs: true
I20260927 15:06:04.330791 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 9576d1a36d7547bf81faabe9c362e3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.331104 2000 raft_consensus.cc:482] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:04.331228 911 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85] alter complete (version 2)
I20260927 15:06:04.334087 1935 raft_consensus.cc:482] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:04.334237 1935 raft_consensus.cc:504] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.335830 1935 leader_election.cc:288] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:04.337179 2000 raft_consensus.cc:504] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.337772 2000 leader_election.cc:288] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:04.338613 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b63e63f7cd4075bcf10a463ce16e05" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:04.338886 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 9576d1a36d7547bf81faabe9c362e3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:04.339109 1102 leader_election.cc:341] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.341859 1805 ts_tablet_manager.cc:1918] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.341944 2020 tablet.cc:1722] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:04.344506 1805 log.cc:1196] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/87cc6cc43a4a4ed1ac79e1902aca9fe5
I20260927 15:06:04.344514 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet ac64eacc7d924940aacc8779b5bfeae7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.343809 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "765b3ee3323846c5ba598f47478fd367" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:04.345988 1805 ts_tablet_manager.cc:1939] T 87cc6cc43a4a4ed1ac79e1902aca9fe5 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.347270 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet fd1f51cb124d4d20a9d6024e6eb6810f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:04.347735 1376 leader_election.cc:341] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.347762 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 87cc6cc43a4a4ed1ac79e1902aca9fe5 (table default.Table_03f21e43b48e4663bf25f8656a9ee2b4 [id=64ae6d29aaaf4705896336b4faa6eb13]) successfully deleted
I20260927 15:06:04.347852 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet ac64eacc7d924940aacc8779b5bfeae7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:04.348356 2025 log.cc:924] Time spent T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Append to log took a long time: real 0.093s user 0.000s sys 0.000s
W20260927 15:06:04.348659 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 089b6b5ac39d49fea744240261a8010e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 089b6b5ac39d49fea744240261a8010e already in progress: creating tablet
W20260927 15:06:04.349356 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 033e71f60c3e47fd9647db090d4d6cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033e71f60c3e47fd9647db090d4d6cd5 already in progress: creating tablet
I20260927 15:06:04.349715 1918 raft_consensus.cc:482] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:04.350080 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9576d1a36d7547bf81faabe9c362e3cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9576d1a36d7547bf81faabe9c362e3cb already in progress: creating tablet
I20260927 15:06:04.350499 1805 tablet_replica.cc:330] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.350785 1805 raft_consensus.cc:2229] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.351076 1805 raft_consensus.cc:2258] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.351131 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "765b3ee3323846c5ba598f47478fd367" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:04.351414 1163 raft_consensus.cc:2454] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:04.351846 1805 ts_tablet_manager.cc:1905] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:04.353528 1099 consensus_peers.cc:487] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c9e4311049d47d3b2f1e117795624ef. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:04.353860 1918 raft_consensus.cc:504] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.355181 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88b401dc12e451c80abe1b509e2b532" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:04.355999 1918 leader_election.cc:288] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:04.357249 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet d463a481cb8c4243961e9b0d2b11822c with delete_type TABLET_DATA_DELETED (replaced by tablet 1c018f11de9842bc883409f8af35fb5f) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.360878 1805 ts_tablet_manager.cc:1918] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.361804 1374 leader_election.cc:302] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.364282 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet fd1f51cb124d4d20a9d6024e6eb6810f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.364437 1963 tablet.cc:1722] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260927 15:06:04.364831 1102 leader_election.cc:341] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.367169 1805 log.cc:1196] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/da1812142bb043fba7457dc61ffdb180
I20260927 15:06:04.367844 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b63e63f7cd4075bcf10a463ce16e05" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:04.368187 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet d463a481cb8c4243961e9b0d2b11822c with delete_type TABLET_DATA_DELETED (replaced by tablet 1c018f11de9842bc883409f8af35fb5f) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.368402 1805 ts_tablet_manager.cc:1939] T da1812142bb043fba7457dc61ffdb180 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.370651 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet da1812142bb043fba7457dc61ffdb180 (table default.Table_738223121ff44cda97e408a6b77e0c98 [id=32958d4a1d2d4e048c864f783034e555]) successfully deleted
I20260927 15:06:04.370710 2030 raft_consensus.cc:2781] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:04.370797 2030 raft_consensus.cc:482] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:04.370937 2030 raft_consensus.cc:3037] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:04.372416 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ac64eacc7d924940aacc8779b5bfeae7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac64eacc7d924940aacc8779b5bfeae7 already in progress: creating tablet
I20260927 15:06:04.373062 1805 tablet_replica.cc:330] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.373410 2030 raft_consensus.cc:504] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.374279 2030 leader_election.cc:288] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:04.374895 1556 ts_tablet_manager.cc:1428] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.342s user 0.004s sys 0.001s
I20260927 15:06:04.374804 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "765b3ee3323846c5ba598f47478fd367" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:04.375119 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88b401dc12e451c80abe1b509e2b532" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:04.375317 1440 raft_consensus.cc:2454] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:04.376931 1376 leader_election.cc:341] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.377297 880 master_runner.cc:186] Error getting master registration for 127.0.201.62:41167: Network error: Client connection negotiation failed: client connection to 127.0.201.62:41167: connect: Connection refused (error 111),
I20260927 15:06:04.377512 880 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:06:04.377626 2020 tablet.cc:1722] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:04.381372 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 357) took 1039 ms. Trace:
I20260927 15:06:04.381822 1559 rpcz_store.cc:276] 0927 15:06:03.341987 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.342363 (+ 376us) service_pool.cc:227] Handling call
0927 15:06:04.361096 (+1018733us) ts_tablet_manager.cc:1145] Deleting tablet a90039faff27436db7b50fa4c4643d3b
0927 15:06:04.361106 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.381323 (+ 20217us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1018365}
I20260927 15:06:04.382161 1805 raft_consensus.cc:2229] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:04.382421 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a90039faff27436db7b50fa4c4643d3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a90039faff27436db7b50fa4c4643d3b already in progress: creating tablet
I20260927 15:06:04.382675 1805 raft_consensus.cc:2258] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.382817 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 358) took 1007 ms. Trace:
W20260927 15:06:04.382997 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ae003f1ca76472cbaa8b577b66fe84c consensus state has no leader
I20260927 15:06:04.382951 1559 rpcz_store.cc:276] 0927 15:06:03.375156 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.375228 (+ 72us) service_pool.cc:227] Handling call
0927 15:06:04.382652 (+1007424us) ts_tablet_manager.cc:1145] Deleting tablet bc20a62bbd484c4e9e25cf1c15e1dde0
0927 15:06:04.382662 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.382772 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1000502}
W20260927 15:06:04.383481 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc20a62bbd484c4e9e25cf1c15e1dde0 already in progress: creating tablet
W20260927 15:06:04.384145 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f0d667472ee4f1481c213e03403461e consensus state has no leader
I20260927 15:06:04.384145 1805 ts_tablet_manager.cc:1905] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.384616 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 67ad68a0adad407a92b2335f43e67227
I20260927 15:06:04.385061 914 catalog_manager.cc:6565] ReplaceTablet: tablet 67ad68a0adad407a92b2335f43e67227 deleted and replaced by tablet 20278f979638419db92105e55310f605
I20260927 15:06:04.385604 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ad68a0adad407a92b2335f43e67227 with delete_type TABLET_DATA_DELETED (replaced by tablet 20278f979638419db92105e55310f605) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.386758 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ad68a0adad407a92b2335f43e67227 with delete_type TABLET_DATA_DELETED (replaced by tablet 20278f979638419db92105e55310f605) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.387549 1556 tablet_bootstrap.cc:492] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:04.389425 1556 tablet_bootstrap.cc:654] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.399737 1805 ts_tablet_manager.cc:1918] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:06:04.397066 1099 leader_election.cc:341] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.400957 1805 log.cc:1196] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/f2cce454e70640e2a67b3680676b1d93
I20260927 15:06:04.401587 1805 ts_tablet_manager.cc:1939] T f2cce454e70640e2a67b3680676b1d93 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.403095 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet f2cce454e70640e2a67b3680676b1d93 (table default.Table_303dfd972edc4c4db55b80e20fd076c7 [id=a027a86bb6274c5d90e960eede3c398f]) successfully deleted
I20260927 15:06:04.404322 1805 tablet_replica.cc:330] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.404950 1805 raft_consensus.cc:2229] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.405401 1805 raft_consensus.cc:2258] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:04.405460 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20d349cb04314c388e2f72b243c629ba consensus state has no leader
I20260927 15:06:04.406443 1805 ts_tablet_manager.cc:1905] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.400681 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "765b3ee3323846c5ba598f47478fd367" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:04.406854 1163 raft_consensus.cc:3037] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.408614 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_166945d9ee0740f2b92a0138063f8891" } modify_external_catalogs: true
I20260927 15:06:04.408831 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_166945d9ee0740f2b92a0138063f8891" } modify_external_catalogs: true
I20260927 15:06:04.409475 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f460864092f142578f5dc17d264586a0" } modify_external_catalogs: true
I20260927 15:06:04.409693 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f460864092f142578f5dc17d264586a0" } modify_external_catalogs: true
I20260927 15:06:04.410197 1099 leader_election.cc:302] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:04.413501 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ba163e0f6164d65b09da684ee4872e0 consensus state has no leader
I20260927 15:06:04.419842 1559 tablet_replica.cc:330] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:04.420061 1559 raft_consensus.cc:2229] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.420243 1559 raft_consensus.cc:2258] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.420457 1163 raft_consensus.cc:2454] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:04.420949 2006 raft_consensus.cc:2726] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:04.421062 1374 leader_election.cc:302] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.421307 1562 ts_tablet_manager.cc:1918] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:06:04.421394 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8f4bd8182c9d48c7b6e6175ab98d405a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f4bd8182c9d48c7b6e6175ab98d405a already in progress: creating tablet
I20260927 15:06:04.421471 1562 log.cc:1196] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/7d6d1cfb1a4d4c439e970d966af841b6
I20260927 15:06:04.420765 1099 leader_election.cc:302] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:04.421635 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 54a07831078b48a59807f7da4a42bcec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54a07831078b48a59807f7da4a42bcec already in progress: creating tablet
W20260927 15:06:04.421785 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 4ead753ba6664829b1262712f35e64f2 because the tablet was not found. No further retry: Not found: Tablet not found: 4ead753ba6664829b1262712f35e64f2
W20260927 15:06:04.421962 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f585bcdadbcc4032aa484481cdf94b72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f585bcdadbcc4032aa484481cdf94b72 already in progress: creating tablet
I20260927 15:06:04.422816 2030 raft_consensus.cc:2781] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:04.423741 2030 raft_consensus.cc:686] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:04.423884 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ad68a0adad407a92b2335f43e67227 with delete_type TABLET_DATA_DELETED (replaced by tablet 20278f979638419db92105e55310f605) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.424338 1562 ts_tablet_manager.cc:1939] T 7d6d1cfb1a4d4c439e970d966af841b6 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:04.425227 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 291) took 2349 ms. Trace:
I20260927 15:06:04.425853 1562 rpcz_store.cc:276] 0927 15:06:02.075510 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.075921 (+ 411us) service_pool.cc:227] Handling call
0927 15:06:04.231506 (+2155585us) ts_tablet_manager.cc:1145] Deleting tablet 7d6d1cfb1a4d4c439e970d966af841b6
0927 15:06:04.231520 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.367713 (+136193us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:04.414423 (+ 46710us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:04.425186 (+ 10763us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2146576}
I20260927 15:06:04.425509 2030 consensus_queue.cc:237] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.426403 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 7d6d1cfb1a4d4c439e970d966af841b6 (table default.Table_de263f6e08ac4eed8c0d53662d9a8b00 [id=1ff3964110d34f149e6c3c539a802ff3]) successfully deleted
I20260927 15:06:04.423471 1559 ts_tablet_manager.cc:1905] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.426811 1562 tablet_replica.cc:330] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:04.427168 1562 raft_consensus.cc:2229] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.427234 2006 raft_consensus.cc:2781] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:04.427570 1562 raft_consensus.cc:2258] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.427580 2006 raft_consensus.cc:482] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:04.427811 2006 raft_consensus.cc:3037] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.428202 1561 tablet_bootstrap.cc:492] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:04.428761 1805 ts_tablet_manager.cc:1918] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.425247 1556 tablet_bootstrap.cc:492] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:04.428908 1805 log.cc:1196] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/4ead753ba6664829b1262712f35e64f2
I20260927 15:06:04.429006 1556 ts_tablet_manager.cc:1397] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.004s
I20260927 15:06:04.429316 1805 ts_tablet_manager.cc:1939] T 4ead753ba6664829b1262712f35e64f2 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.429728 1556 raft_consensus.cc:348] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.429926 1556 raft_consensus.cc:374] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.430011 1556 raft_consensus.cc:729] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.430198 1556 consensus_queue.cc:260] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.430481 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 4ead753ba6664829b1262712f35e64f2 (table default.Table_bf2c59d22fa84330870ea9f394bcc27b [id=5d06fdeffa7142fd8a456f64254ae011]) successfully deleted
I20260927 15:06:04.432639 1805 tablet_replica.cc:330] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.432843 1805 raft_consensus.cc:2229] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:04.433719 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet fd1f51cb124d4d20a9d6024e6eb6810f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd1f51cb124d4d20a9d6024e6eb6810f already in progress: creating tablet
I20260927 15:06:04.433755 1805 raft_consensus.cc:2258] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:04.433971 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet d463a481cb8c4243961e9b0d2b11822c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d463a481cb8c4243961e9b0d2b11822c already in progress: creating tablet
I20260927 15:06:04.434912 1805 ts_tablet_manager.cc:1905] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.435082 1552 tablet_bootstrap.cc:492] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:04.435233 1552 ts_tablet_manager.cc:1397] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.188s user 0.031s sys 0.017s
I20260927 15:06:04.435973 1552 raft_consensus.cc:348] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.436189 1552 raft_consensus.cc:374] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.436276 1552 raft_consensus.cc:729] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.436631 1552 consensus_queue.cc:260] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.437196 1552 ts_tablet_manager.cc:1428] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:04.439257 2020 tablet.cc:1722] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:04.441203 1562 ts_tablet_manager.cc:1905] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.442847 1561 ts_tablet_manager.cc:1397] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.180s user 0.006s sys 0.017s
I20260927 15:06:04.443109 1552 tablet_bootstrap.cc:492] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:04.444662 1556 ts_tablet_manager.cc:1428] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.016s user 0.000s sys 0.001s
I20260927 15:06:04.444981 1556 tablet_bootstrap.cc:492] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:04.446524 1556 tablet_bootstrap.cc:654] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.447629 1971 tablet.cc:1722] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:04.449306 1552 tablet_bootstrap.cc:654] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:04.450026 1102 consensus_peers.cc:487] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:04.443643 1561 raft_consensus.cc:348] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.451045 1561 raft_consensus.cc:374] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.451148 1561 raft_consensus.cc:729] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.451404 1561 consensus_queue.cc:260] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.451784 1559 ts_tablet_manager.cc:1918] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:04.451897 1559 log.cc:1196] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/ab08d04c11dd44299ee5f9a911d581c3
I20260927 15:06:04.452005 1561 ts_tablet_manager.cc:1428] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260927 15:06:04.452303 1561 tablet_bootstrap.cc:492] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:04.453250 1559 ts_tablet_manager.cc:1939] T ab08d04c11dd44299ee5f9a911d581c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:04.454878 1559 tablet_replica.cc:330] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:04.455119 1559 raft_consensus.cc:2229] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:04.455344 1559 pending_rounds.cc:62] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:04.455418 1559 pending_rounds.cc:68] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976327117025280 op_type: NO_OP noop_request { }
I20260927 15:06:04.455569 1559 raft_consensus.cc:2866] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:04.456164 1559 raft_consensus.cc:2258] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.456382 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet ab08d04c11dd44299ee5f9a911d581c3 (table default.Table_f1b5de8ecfe842e69ba40febba9c6ee1 [id=7f171341d8ee4ed68a7d8a4fc3e7ecb0]) successfully deleted
W20260927 15:06:04.456686 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a19c9cc5859f49a58a35460e504b3f84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19c9cc5859f49a58a35460e504b3f84 already in progress: creating tablet
W20260927 15:06:04.456943 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0129eaa5636544e696076e439d713b1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0129eaa5636544e696076e439d713b1b already in progress: creating tablet
I20260927 15:06:04.463234 1805 ts_tablet_manager.cc:1918] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:04.463404 1805 log.cc:1196] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/67ad68a0adad407a92b2335f43e67227
I20260927 15:06:04.464017 911 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]). Expected version 4 got 0
I20260927 15:06:04.464282 911 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_5bc19744aafd42cdb0a1bb656853619b [id=c4ddc66927a94fd2abc8e44012cf69f7]). Expected version 1 got 0
I20260927 15:06:04.464969 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet a260c9d3b8fb4316864e6f986559bef1 (table default.Table_b592f94f43ea4ffe8068db6aed19c5ef [id=61c39607ad5b482c80883c0e60f0da9c]). Expected version 1 got 0
I20260927 15:06:04.467308 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet 63289edbdd734dd5a817df42d83e422e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.467564 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.467712 1805 ts_tablet_manager.cc:1939] T 67ad68a0adad407a92b2335f43e67227 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.468029 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_995d720be4324759bc78c1c0aaae8213" } modify_external_catalogs: true
I20260927 15:06:04.468205 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_995d720be4324759bc78c1c0aaae8213" } modify_external_catalogs: true
I20260927 15:06:04.469152 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 67cf4dae943e4092b2c490ad770e4a94 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f6bdef4ddb4f9c9c0d1f933768cd14) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.472277 1559 ts_tablet_manager.cc:1905] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.475459 908 catalog_manager.cc:5495] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:04.475951 908 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]). Expected version 4 got 0
I20260927 15:06:04.476624 1417 tablet_service.cc:1467] Processing CreateTablet for tablet e9f171fd62d644f38262a2257d47fafe (DEFAULT_TABLE table=default.Table_5c817097aae54fadb81259c5729c0b56 [id=20f8b048eb614535a4f2602745f2edf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.476998 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9f171fd62d644f38262a2257d47fafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.477162 1285 tablet_service.cc:1467] Processing CreateTablet for tablet e9f171fd62d644f38262a2257d47fafe (DEFAULT_TABLE table=default.Table_5c817097aae54fadb81259c5729c0b56 [id=20f8b048eb614535a4f2602745f2edf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.477520 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9f171fd62d644f38262a2257d47fafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.478883 1141 tablet_service.cc:1467] Processing CreateTablet for tablet e9f171fd62d644f38262a2257d47fafe (DEFAULT_TABLE table=default.Table_5c817097aae54fadb81259c5729c0b56 [id=20f8b048eb614535a4f2602745f2edf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.480020 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 52a4360599644da0921de9ff0e4111c6 (DEFAULT_TABLE table=default.Table_4ef11790dfe1412eb7dc43efcb8088ad [id=feb4ed1589054fc8af75808a9374bebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.480474 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9f171fd62d644f38262a2257d47fafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.482363 1561 tablet_bootstrap.cc:654] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.482703 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52a4360599644da0921de9ff0e4111c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.483323 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 67ad68a0adad407a92b2335f43e67227 (table default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]) successfully deleted
I20260927 15:06:04.483433 1132 tablet_service.cc:1467] Processing CreateTablet for tablet f0a71cf0ee554b3eafca3f054cc16b28 (DEFAULT_TABLE table=default.Table_b452a2bdaeb9412b8372f173d1cd27dc [id=a377cb3f421c4976b9725fceac939926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.483871 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0a71cf0ee554b3eafca3f054cc16b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.484949 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 52a4360599644da0921de9ff0e4111c6 (DEFAULT_TABLE table=default.Table_4ef11790dfe1412eb7dc43efcb8088ad [id=feb4ed1589054fc8af75808a9374bebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.485289 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52a4360599644da0921de9ff0e4111c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.485523 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 (DEFAULT_TABLE table=default.Table_8314c67a0ac344ac978f6ec17eb62d72 [id=476ee068cefa474298baab50827b6122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.485852 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.487118 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 219639c0184f4888984fa04a1f84bd83
I20260927 15:06:04.487672 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 87b54364a63b48e9981463d1019dad59 (DEFAULT_TABLE table=default.Table_01e58c54d7e14dac9f422ff99a6b893e [id=530ccac0880047cfb6d45de2528cf595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.487749 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 566aa5caa012443ea63fcb7389c8b7c0
I20260927 15:06:04.478089 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 52a4360599644da0921de9ff0e4111c6 (DEFAULT_TABLE table=default.Table_4ef11790dfe1412eb7dc43efcb8088ad [id=feb4ed1589054fc8af75808a9374bebd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.488906 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52a4360599644da0921de9ff0e4111c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.489794 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 219639c0184f4888984fa04a1f84bd83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.490221 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 87b54364a63b48e9981463d1019dad59 (DEFAULT_TABLE table=default.Table_01e58c54d7e14dac9f422ff99a6b893e [id=530ccac0880047cfb6d45de2528cf595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.490595 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87b54364a63b48e9981463d1019dad59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.492293 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 (DEFAULT_TABLE table=default.Table_8314c67a0ac344ac978f6ec17eb62d72 [id=476ee068cefa474298baab50827b6122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.492628 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.493605 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 566aa5caa012443ea63fcb7389c8b7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.494004 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 219639c0184f4888984fa04a1f84bd83 (DEFAULT_TABLE table=default.Table_f460864092f142578f5dc17d264586a0 [id=80690e27ef044148b9638249e2d7d5ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.494359 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 219639c0184f4888984fa04a1f84bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.482257 1406 tablet_service.cc:1467] Processing CreateTablet for tablet f0a71cf0ee554b3eafca3f054cc16b28 (DEFAULT_TABLE table=default.Table_b452a2bdaeb9412b8372f173d1cd27dc [id=a377cb3f421c4976b9725fceac939926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.494915 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0a71cf0ee554b3eafca3f054cc16b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.495405 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 87b54364a63b48e9981463d1019dad59 (DEFAULT_TABLE table=default.Table_01e58c54d7e14dac9f422ff99a6b893e [id=530ccac0880047cfb6d45de2528cf595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.495658 1559 ts_tablet_manager.cc:1918] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:04.495760 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87b54364a63b48e9981463d1019dad59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.495781 1559 log.cc:1196] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/f1d7a98ffc4745ac8eeb93012b55d417
I20260927 15:06:04.496284 1559 ts_tablet_manager.cc:1939] T f1d7a98ffc4745ac8eeb93012b55d417 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:04.497164 1559 tablet_replica.cc:330] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:04.497359 1559 raft_consensus.cc:2229] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:04.497588 1559 pending_rounds.cc:62] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:04.497663 1559 pending_rounds.cc:68] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976326296842240 op_type: NO_OP noop_request { }
I20260927 15:06:04.497792 1559 raft_consensus.cc:2866] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:04.497905 1559 raft_consensus.cc:2258] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.498689 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 566aa5caa012443ea63fcb7389c8b7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.498852 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 219639c0184f4888984fa04a1f84bd83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.499696 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_83597ebfdee14f58abf228d7cd16bbd3" } modify_external_catalogs: true
I20260927 15:06:04.499936 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_83597ebfdee14f58abf228d7cd16bbd3" } modify_external_catalogs: true
I20260927 15:06:04.500012 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet f1d7a98ffc4745ac8eeb93012b55d417 (table default.Table_af607bdf84604e1d89e4b679360ed558 [id=5928f9637b7c4e569baf987137d28383]) successfully deleted
I20260927 15:06:04.484369 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 (DEFAULT_TABLE table=default.Table_8314c67a0ac344ac978f6ec17eb62d72 [id=476ee068cefa474298baab50827b6122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.500813 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.502317 1559 ts_tablet_manager.cc:1905] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.503557 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_108c4b5538b94b6fad6c4f46eb9a2b1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.504592 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_108c4b5538b94b6fad6c4f46eb9a2b1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.505787 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d443f4fb7bc84bf3a8d190ef7ac8a570"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.506217 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d443f4fb7bc84bf3a8d190ef7ac8a570 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.507251 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9cb03ce349ee4cefa2a1b109f59c75ee" } modify_external_catalogs: true
I20260927 15:06:04.507457 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9cb03ce349ee4cefa2a1b109f59c75ee" } modify_external_catalogs: true
I20260927 15:06:04.508145 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ea3220df595848258d0f53fa941b2beb
I20260927 15:06:04.509110 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet ea3220df595848258d0f53fa941b2beb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.511132 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 219639c0184f4888984fa04a1f84bd83 (DEFAULT_TABLE table=default.Table_f460864092f142578f5dc17d264586a0 [id=80690e27ef044148b9638249e2d7d5ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.511966 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 219639c0184f4888984fa04a1f84bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.512307 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2268d824f5324cd1b81879e2fe4fd027
I20260927 15:06:04.513145 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 2268d824f5324cd1b81879e2fe4fd027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.513635 908 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet ba14b7531bb647248572be10d2b43cf2 (table default.Table_bc0cef144e2c48f6883df97308937a76 [id=43c20c5b532545b5b66ad52dc5af5fc2]). Expected version 1 got 0
I20260927 15:06:04.513957 908 catalog_manager.cc:5495] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:04.514374 908 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 08f28c023473434ba73b1142a041be97 (table default.Table_826c1efeddc74a17ad2db271286974ac [id=67762455acad44448ba24d18c2863816]). Expected version 3 got 0
I20260927 15:06:04.515111 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a] alter complete (version 1)
I20260927 15:06:04.515724 905 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_28678b473eb34fc98fdfa5b51c8f9ecc [id=4686792aaf36414380f3f894a5635874] alter complete (version 4)
I20260927 15:06:04.518456 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f75fed3fee5b474c89a743876719cbfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.518972 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f75fed3fee5b474c89a743876719cbfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.519204 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9ae003f1ca76472cbaa8b577b66fe84c
I20260927 15:06:04.519809 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ceb6674fa07f4d06a23e13778cc087d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:04.520007 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ae003f1ca76472cbaa8b577b66fe84c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:04.520335 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceb6674fa07f4d06a23e13778cc087d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.520330 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet ea3220df595848258d0f53fa941b2beb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.520569 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet a46e15ea145b4eae8f94b664067b4f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.520653 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 2268d824f5324cd1b81879e2fe4fd027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.521587 2006 raft_consensus.cc:504] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.522717 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87b54364a63b48e9981463d1019dad59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.522897 2006 leader_election.cc:288] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:04.527024 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ae003f1ca76472cbaa8b577b66fe84c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.527352 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dcbcc1860c1b43909fbfb98553932758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.527932 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcbcc1860c1b43909fbfb98553932758 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.530438 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7888b7559b574fa29792a622e564a3bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.531003 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7888b7559b574fa29792a622e564a3bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.530784 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2ce9c820c65b45b898ff9bdb14012f1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.531623 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ce9c820c65b45b898ff9bdb14012f1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.536115 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88b401dc12e451c80abe1b509e2b532" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:04.536378 1440 raft_consensus.cc:3037] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.538897 1279 tablet_service.cc:1467] Processing CreateTablet for tablet f0a71cf0ee554b3eafca3f054cc16b28 (DEFAULT_TABLE table=default.Table_b452a2bdaeb9412b8372f173d1cd27dc [id=a377cb3f421c4976b9725fceac939926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.539188 1440 raft_consensus.cc:2454] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:04.539285 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0a71cf0ee554b3eafca3f054cc16b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.546630 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88b401dc12e451c80abe1b509e2b532" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:04.547683 1102 leader_election.cc:341] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.549444 1099 leader_election.cc:302] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.549686 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.549960 2006 raft_consensus.cc:2781] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:04.551263 2050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.201.62:41167 every 8 connection(s)
I20260927 15:06:04.551723 2006 raft_consensus.cc:686] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:04.554951 1271 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d41d55fdb504b95921f46e7aed99ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.552075 2006 consensus_queue.cc:237] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.558945 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 566aa5caa012443ea63fcb7389c8b7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.559777 1805 tablet_replica.cc:330] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:04.560029 1805 raft_consensus.cc:2229] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.560786 1805 raft_consensus.cc:2258] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.561061 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ae003f1ca76472cbaa8b577b66fe84c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.562078 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 2268d824f5324cd1b81879e2fe4fd027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.562412 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.565263 1805 ts_tablet_manager.cc:1905] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.568884 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 219639c0184f4888984fa04a1f84bd83 (DEFAULT_TABLE table=default.Table_f460864092f142578f5dc17d264586a0 [id=80690e27ef044148b9638249e2d7d5ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.569263 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 219639c0184f4888984fa04a1f84bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.570735 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet ea3220df595848258d0f53fa941b2beb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.571002 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 219639c0184f4888984fa04a1f84bd83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.575744 1552 tablet_bootstrap.cc:492] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
W20260927 15:06:04.579035 898 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7f8744e2349e49d3a821eca42c7f89a2 (table default.Table_5779948a34b2476ba1b05b3a7bc866fc [id=4d9dd505f13d4b63ac2b4ea898c9eac0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f8744e2349e49d3a821eca42c7f89a2 consensus state has no leader
I20260927 15:06:04.588274 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_661afffa3463498f9b3ef33b46bda8e5" } new_table_name: "default.Table_1b1639fc47724907a79f94e34f6b9469" modify_external_catalogs: true
I20260927 15:06:04.590044 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5779948a34b2476ba1b05b3a7bc866fc" } new_table_name: "default.Table_b41934087f854d64a321278e59bf95ed" modify_external_catalogs: true
I20260927 15:06:04.591523 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_30034347f11e4920a17119f94d7a65df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.592207 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30034347f11e4920a17119f94d7a65df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.600484 1562 ts_tablet_manager.cc:1918] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:04.601260 1562 log.cc:1196] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/bc971defe6d148439a6a0b8c55d9092e
I20260927 15:06:04.601701 1562 ts_tablet_manager.cc:1939] T bc971defe6d148439a6a0b8c55d9092e P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:04.602484 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 294) took 2518 ms. Trace:
I20260927 15:06:04.605316 1212 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
W20260927 15:06:04.607076 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f4cff4a06db44269defca578af289d8 consensus state has no leader
W20260927 15:06:04.607704 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f8744e2349e49d3a821eca42c7f89a2 consensus state has no leader
I20260927 15:06:04.612450 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_50468591e06d4c9bb7eec72646b0e846"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.613121 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50468591e06d4c9bb7eec72646b0e846 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.614888 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2ce9c820c65b45b898ff9bdb14012f1d" } new_table_name: "default.Table_68916c1b40d644d9846b0a85f7a075ce" modify_external_catalogs: true
I20260927 15:06:04.615093 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0d6069947977462cae4376eb9ccfe2ad" } new_table_name: "default.Table_b3d8c342ab564cf8a14311ab99ac9615" modify_external_catalogs: true
I20260927 15:06:04.602582 1562 rpcz_store.cc:276] 0927 15:06:02.084213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.084264 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:04.426725 (+2342461us) ts_tablet_manager.cc:1145] Deleting tablet bc971defe6d148439a6a0b8c55d9092e
0927 15:06:04.426740 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.515076 (+ 88336us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:04.600376 (+ 85300us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:04.602431 (+ 2055us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2323375}
I20260927 15:06:04.608253 1552 ts_tablet_manager.cc:1397] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.133s user 0.004s sys 0.038s
I20260927 15:06:04.620429 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet bc971defe6d148439a6a0b8c55d9092e (table default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]) successfully deleted
I20260927 15:06:04.620594 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c17aba6177d54467b2120ce673c0dfb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:04.621106 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 303) took 2419 ms. Trace:
I20260927 15:06:04.621235 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_103a22226a8b4b2fa2165b28568f41ec" } new_table_name: "default.Table_68376a56de55491a97cd372ac2473b62" modify_external_catalogs: true
I20260927 15:06:04.621250 1562 rpcz_store.cc:276] 0927 15:06:02.201318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.201365 (+ 47us) service_pool.cc:227] Handling call
0927 15:06:04.620899 (+2419534us) ts_tablet_manager.cc:1145] Deleting tablet c65bc09865bc4a0283eaa4af9f860bdd
0927 15:06:04.620913 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.621043 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2419071}
W20260927 15:06:04.621649 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c65bc09865bc4a0283eaa4af9f860bdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c65bc09865bc4a0283eaa4af9f860bdd already in progress: creating tablet
I20260927 15:06:04.622036 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 304) took 2420 ms. Trace:
I20260927 15:06:04.622133 1562 rpcz_store.cc:276] 0927 15:06:02.201662 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.201754 (+ 92us) service_pool.cc:227] Handling call
0927 15:06:04.621869 (+2420115us) ts_tablet_manager.cc:1145] Deleting tablet cb859b43634c420382da5c201ce24dfc
0927 15:06:04.621877 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.621982 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2419836}
W20260927 15:06:04.622350 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c17aba6177d54467b2120ce673c0dfb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:04.622539 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet cb859b43634c420382da5c201ce24dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb859b43634c420382da5c201ce24dfc already in progress: creating tablet
I20260927 15:06:04.628144 1556 tablet_bootstrap.cc:492] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:04.628316 1556 ts_tablet_manager.cc:1397] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.183s user 0.004s sys 0.008s
I20260927 15:06:04.629029 1556 raft_consensus.cc:348] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.629274 1556 raft_consensus.cc:374] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:04.629317 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 921db5dbe31a4d0381bdd823cb497424 has no consensus state
I20260927 15:06:04.629334 1556 raft_consensus.cc:729] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.629544 1556 consensus_queue.cc:260] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.630023 1556 ts_tablet_manager.cc:1428] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:04.630347 1556 tablet_bootstrap.cc:492] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:04.632637 1556 tablet_bootstrap.cc:654] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:04.633528 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 278205071701447e8ee7457b2ee84be4 consensus state has no leader
I20260927 15:06:04.634130 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 109f9088371e4f008b2b5f993f2b4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.636358 1688 rpc_server.cc:307] RPC server started. Bound to: 127.0.201.62:41167
I20260927 15:06:04.637341 1486 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:06:04.642503 1688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-0/data/info.pb
W20260927 15:06:04.646518 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet efa42545da374ca989199433ce1284c3 consensus state has no leader
I20260927 15:06:04.648617 1559 ts_tablet_manager.cc:1918] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:04.648747 1559 log.cc:1196] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/30244d596d4d4090af7656027b48f22e
I20260927 15:06:04.648936 804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu as pid 1688
I20260927 15:06:04.649173 1559 ts_tablet_manager.cc:1939] T 30244d596d4d4090af7656027b48f22e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:04.650898 1556 tablet_bootstrap.cc:492] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:04.651439 905 master_service.cc:946] ReplaceTablet: received request to replace tablet cb859b43634c420382da5c201ce24dfc from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:04.655261 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 306) took 2401 ms. Trace:
I20260927 15:06:04.656097 1552 raft_consensus.cc:348] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.657787 1212 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:06:04.658293 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 375) took 1008 ms. Trace:
I20260927 15:06:04.658877 1552 raft_consensus.cc:374] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.658980 1552 raft_consensus.cc:729] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.658978 1559 rpcz_store.cc:276] 0927 15:06:03.649523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.649573 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:04.497096 (+847523us) ts_tablet_manager.cc:1145] Deleting tablet 30244d596d4d4090af7656027b48f22e
0927 15:06:04.497108 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.569517 (+ 72409us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:04.648072 (+ 78555us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:04.658255 (+ 10183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":847294}
I20260927 15:06:04.659392 1559 tablet_replica.cc:330] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:04.659515 1562 rpcz_store.cc:276] 0927 15:06:02.235123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.273564 (+ 38441us) service_pool.cc:227] Handling call
0927 15:06:04.622756 (+2349192us) ts_tablet_manager.cc:1145] Deleting tablet 4b9e88c3679d412cac7603f200cf899b
0927 15:06:04.622767 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.636420 (+ 13653us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2348921}
I20260927 15:06:04.659551 1552 consensus_queue.cc:260] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.660126 1552 ts_tablet_manager.cc:1428] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.040s user 0.000s sys 0.002s
I20260927 15:06:04.660386 1559 raft_consensus.cc:2229] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:04.660562 1559 raft_consensus.cc:2258] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.658702 1556 ts_tablet_manager.cc:1397] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.003s
I20260927 15:06:04.654810 914 catalog_manager.cc:5495] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:04.662298 1552 tablet_bootstrap.cc:492] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:04.662276 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 30244d596d4d4090af7656027b48f22e (table default.Table_46238c103f2247faa5ba7f68d8b744c4 [id=5577906b11a841d58884c42d471a4427]) successfully deleted
I20260927 15:06:04.662744 1556 raft_consensus.cc:348] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.662974 1556 raft_consensus.cc:374] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.663071 1556 raft_consensus.cc:729] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.663087 1805 ts_tablet_manager.cc:1918] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:06:04.663244 1376 consensus_peers.cc:487] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:04.663204 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 921db5dbe31a4d0381bdd823cb497424 (DEFAULT_TABLE table=default.Table_68916c1b40d644d9846b0a85f7a075ce [id=b11f83d1010940d5bbd03efa06497202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.663456 914 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_5bc19744aafd42cdb0a1bb656853619b [id=c4ddc66927a94fd2abc8e44012cf69f7]). Expected version 1 got 0
W20260927 15:06:04.663559 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 4b9e88c3679d412cac7603f200cf899b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b9e88c3679d412cac7603f200cf899b already in progress: creating tablet
I20260927 15:06:04.664598 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 921db5dbe31a4d0381bdd823cb497424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.664551 1556 consensus_queue.cc:260] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.665164 1556 ts_tablet_manager.cc:1428] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:04.667680 1556 tablet_bootstrap.cc:492] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:04.668097 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 54f5c4b7c7a045bea1a79bc67a913f65 (DEFAULT_TABLE table=default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.670720 1556 tablet_bootstrap.cc:654] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.671492 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 921db5dbe31a4d0381bdd823cb497424 (DEFAULT_TABLE table=default.Table_68916c1b40d644d9846b0a85f7a075ce [id=b11f83d1010940d5bbd03efa06497202]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.671949 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 921db5dbe31a4d0381bdd823cb497424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.672375 1405 tablet_service.cc:1467] Processing CreateTablet for tablet ec3d823781234015aa8a48421a23bbd2 (DEFAULT_TABLE table=default.Table_ceb6674fa07f4d06a23e13778cc087d5 [id=7e1f7a430cb04d6c8b0167431c33ba9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.673770 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 1d221f14ad57462e95017b9068eb8714 (DEFAULT_TABLE table=default.Table_f75fed3fee5b474c89a743876719cbfb [id=36c8b90a707644c6bccc421821b00404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.663735 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 307) took 2401 ms. Trace:
I20260927 15:06:04.677080 1562 rpcz_store.cc:276] 0927 15:06:02.259977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.274174 (+ 14197us) service_pool.cc:227] Handling call
0927 15:06:04.660096 (+2385922us) ts_tablet_manager.cc:1145] Deleting tablet 42baac8b7d47433e826eb3bc1980acaa
0927 15:06:04.660109 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.661559 (+ 1450us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2379269}
I20260927 15:06:04.677196 1131 tablet_service.cc:1467] Processing CreateTablet for tablet ec3d823781234015aa8a48421a23bbd2 (DEFAULT_TABLE table=default.Table_ceb6674fa07f4d06a23e13778cc087d5 [id=7e1f7a430cb04d6c8b0167431c33ba9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.677577 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec3d823781234015aa8a48421a23bbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.677685 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 318) took 2286 ms. Trace:
I20260927 15:06:04.677769 1562 rpcz_store.cc:276] 0927 15:06:02.390955 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.391011 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:04.677504 (+2286493us) ts_tablet_manager.cc:1145] Deleting tablet 429088342b4743c39fb1e38d235024de
0927 15:06:04.677512 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.677631 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2286252}
I20260927 15:06:04.678341 1562 tablet_replica.cc:330] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:04.676561 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 921db5dbe31a4d0381bdd823cb497424 (DEFAULT_TABLE table=default.Table_68916c1b40d644d9846b0a85f7a075ce [id=b11f83d1010940d5bbd03efa06497202]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:04.679306 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 42baac8b7d47433e826eb3bc1980acaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42baac8b7d47433e826eb3bc1980acaa already in progress: creating tablet
I20260927 15:06:04.676841 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 54f5c4b7c7a045bea1a79bc67a913f65 (DEFAULT_TABLE table=default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:04.679607 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 429088342b4743c39fb1e38d235024de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 429088342b4743c39fb1e38d235024de already in progress: creating tablet
I20260927 15:06:04.679950 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54f5c4b7c7a045bea1a79bc67a913f65. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:04.680120 2049 log.cc:924] Time spent T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Append to log took a long time: real 0.179s user 0.000s sys 0.000s
I20260927 15:06:04.684012 1406 tablet_service.cc:1467] Processing CreateTablet for tablet b88cb2c53be4463eb17e748d2c17f0e2 (DEFAULT_TABLE table=default.Table_d443f4fb7bc84bf3a8d190ef7ac8a570 [id=96953715591f43f59840239078714b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.684340 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 921db5dbe31a4d0381bdd823cb497424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.684870 1562 raft_consensus.cc:2229] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:04.685679 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 54f5c4b7c7a045bea1a79bc67a913f65 (DEFAULT_TABLE table=default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.686121 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54f5c4b7c7a045bea1a79bc67a913f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.688140 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 396cafb9a2ff4f8c9922745ad85b307c (DEFAULT_TABLE table=default.Table_a4bac136e6e84e30bc4cc39549204c9d [id=90bb9335452844cd9980d515792d9434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.690085 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 05d525c1128e4042aa97ff786ffa7ba9 (DEFAULT_TABLE table=default.Table_85f7e805a2b84ca3a600cfa46ebc660f [id=cc99cf87912b45d4a4f20bb3dc31b41e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.692126 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7258841dfdbd45b0a5745d0a4cbd5551" } modify_external_catalogs: true
I20260927 15:06:04.692365 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7258841dfdbd45b0a5745d0a4cbd5551" } modify_external_catalogs: true
I20260927 15:06:04.693292 1414 tablet_service.cc:1467] Processing CreateTablet for tablet f199e9507a894fdabe2ccd2cef699fd8 (DEFAULT_TABLE table=default.Table_2e6fedff929f4c0bbe9df08fc0314680 [id=05e0628c4a1943d3b157b2687b7d0df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.694087 1805 log.cc:1196] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/0d41d55fdb504b95921f46e7aed99ac1
I20260927 15:06:04.697031 1281 tablet_service.cc:1467] Processing CreateTablet for tablet ec3d823781234015aa8a48421a23bbd2 (DEFAULT_TABLE table=default.Table_ceb6674fa07f4d06a23e13778cc087d5 [id=7e1f7a430cb04d6c8b0167431c33ba9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.697556 1351 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:06:04.702000 1163 raft_consensus.cc:1261] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Refusing update from remote peer fabb59e74b7d48fa9be047d7f4c4cc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:06:04.702042 1559 ts_tablet_manager.cc:1905] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.702548 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 85e8909687fb40fdbccad15cd99b6eaf (DEFAULT_TABLE table=default.Table_25c945ca9a864192a29061360e38dc1d [id=96266e4cf3f943a7b0a4210747d10d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.706596 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e066308fcdfc49ed926cd81963c5f1a7
I20260927 15:06:04.707384 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_83c5d552eb044e369bac27b9e1aac15c" } modify_external_catalogs: true
I20260927 15:06:04.707592 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_83c5d552eb044e369bac27b9e1aac15c" } modify_external_catalogs: true
I20260927 15:06:04.707644 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet e066308fcdfc49ed926cd81963c5f1a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.709067 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 1d221f14ad57462e95017b9068eb8714 (DEFAULT_TABLE table=default.Table_f75fed3fee5b474c89a743876719cbfb [id=36c8b90a707644c6bccc421821b00404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.709249 1562 pending_rounds.cc:62] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:04.709921 1561 tablet_bootstrap.cc:492] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:04.710575 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 396cafb9a2ff4f8c9922745ad85b307c (DEFAULT_TABLE table=default.Table_a4bac136e6e84e30bc4cc39549204c9d [id=90bb9335452844cd9980d515792d9434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.710983 2060 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:06:04.712829 1561 ts_tablet_manager.cc:1397] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.259s user 0.003s sys 0.015s
I20260927 15:06:04.713414 1273 tablet_service.cc:1467] Processing CreateTablet for tablet b88cb2c53be4463eb17e748d2c17f0e2 (DEFAULT_TABLE table=default.Table_d443f4fb7bc84bf3a8d190ef7ac8a570 [id=96953715591f43f59840239078714b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.714143 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 85e8909687fb40fdbccad15cd99b6eaf (DEFAULT_TABLE table=default.Table_25c945ca9a864192a29061360e38dc1d [id=96266e4cf3f943a7b0a4210747d10d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.714272 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 05d525c1128e4042aa97ff786ffa7ba9 (DEFAULT_TABLE table=default.Table_85f7e805a2b84ca3a600cfa46ebc660f [id=cc99cf87912b45d4a4f20bb3dc31b41e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.715240 1128 tablet_service.cc:1467] Processing CreateTablet for tablet b88cb2c53be4463eb17e748d2c17f0e2 (DEFAULT_TABLE table=default.Table_d443f4fb7bc84bf3a8d190ef7ac8a570 [id=96953715591f43f59840239078714b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.715601 1552 tablet_bootstrap.cc:654] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:04.716413 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 6f3bdfede5744513aeadb22da73b6f8a (DEFAULT_TABLE table=default.Table_108c4b5538b94b6fad6c4f46eb9a2b1b [id=441cd1970e024331bea46979f73efac4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.716673 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet e066308fcdfc49ed926cd81963c5f1a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.716883 2006 raft_consensus.cc:482] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:04.717247 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 1c018f11de9842bc883409f8af35fb5f (DEFAULT_TABLE table=default.Table_04e241fd53a64c76b188ab49cd5ea266 [id=9f11325f98a4445eb6ee1d8c251866fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.718209 1556 tablet_bootstrap.cc:492] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:04.718498 2060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: Bootstrap starting.
I20260927 15:06:04.719934 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 6f3bdfede5744513aeadb22da73b6f8a (DEFAULT_TABLE table=default.Table_108c4b5538b94b6fad6c4f46eb9a2b1b [id=441cd1970e024331bea46979f73efac4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.720485 1146 tablet_service.cc:1467] Processing CreateTablet for tablet d9c032a06c0b497fa21a3553375978ca (DEFAULT_TABLE table=default.Table_7b626dee65d244319052156e5e5fe7bc [id=814a8a2b49e348b4b4e653d7b122945b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.720827 1419 tablet_service.cc:1467] Processing CreateTablet for tablet d9c032a06c0b497fa21a3553375978ca (DEFAULT_TABLE table=default.Table_7b626dee65d244319052156e5e5fe7bc [id=814a8a2b49e348b4b4e653d7b122945b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.721071 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 1d221f14ad57462e95017b9068eb8714 (DEFAULT_TABLE table=default.Table_f75fed3fee5b474c89a743876719cbfb [id=36c8b90a707644c6bccc421821b00404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.715030 1562 pending_rounds.cc:68] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976322209255424 op_type: NO_OP noop_request { }
I20260927 15:06:04.722453 1275 tablet_service.cc:1467] Processing CreateTablet for tablet f199e9507a894fdabe2ccd2cef699fd8 (DEFAULT_TABLE table=default.Table_2e6fedff929f4c0bbe9df08fc0314680 [id=05e0628c4a1943d3b157b2687b7d0df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.722800 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec3d823781234015aa8a48421a23bbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.724365 1805 ts_tablet_manager.cc:1939] T 0d41d55fdb504b95921f46e7aed99ac1 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:04.725039 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_68376a56de55491a97cd372ac2473b62" } modify_external_catalogs: true
I20260927 15:06:04.725275 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_68376a56de55491a97cd372ac2473b62" } modify_external_catalogs: true
I20260927 15:06:04.726225 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_55b153455b5b46ed916f0a47ccc6b0ec" } modify_external_catalogs: true
I20260927 15:06:04.726440 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_55b153455b5b46ed916f0a47ccc6b0ec" } modify_external_catalogs: true
I20260927 15:06:04.727916 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ed661692282c45d28295246e14c25bc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.728590 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed661692282c45d28295246e14c25bc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.729802 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8fc1fc04814147d8843aa734fd1794da
I20260927 15:06:04.729877 1963 tablet.cc:1722] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:04.730372 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 396cafb9a2ff4f8c9922745ad85b307c (DEFAULT_TABLE table=default.Table_a4bac136e6e84e30bc4cc39549204c9d [id=90bb9335452844cd9980d515792d9434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.730945 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ddb5bec424b947abba941419a9136bdc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:04.731052 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f" } modify_external_catalogs: true
I20260927 15:06:04.731263 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f" } modify_external_catalogs: true
W20260927 15:06:04.731488 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddb5bec424b947abba941419a9136bdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.731593 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 05d525c1128e4042aa97ff786ffa7ba9 (DEFAULT_TABLE table=default.Table_85f7e805a2b84ca3a600cfa46ebc660f [id=cc99cf87912b45d4a4f20bb3dc31b41e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.732290 2060 log.cc:824] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: Log is configured to *not* fsync() on all Append() calls
I20260927 15:06:04.733319 1137 tablet_service.cc:1467] Processing CreateTablet for tablet f199e9507a894fdabe2ccd2cef699fd8 (DEFAULT_TABLE table=default.Table_2e6fedff929f4c0bbe9df08fc0314680 [id=05e0628c4a1943d3b157b2687b7d0df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.734596 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54f5c4b7c7a045bea1a79bc67a913f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.716364 2028 consensus_queue.cc:1035] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260927 15:06:04.735033 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d221f14ad57462e95017b9068eb8714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.735426 1556 ts_tablet_manager.cc:1397] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.051s user 0.011s sys 0.018s
I20260927 15:06:04.735743 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f199e9507a894fdabe2ccd2cef699fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.736500 1556 raft_consensus.cc:348] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.736861 1556 raft_consensus.cc:374] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.736964 1556 raft_consensus.cc:729] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.742676 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85e8909687fb40fdbccad15cd99b6eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.742690 1561 raft_consensus.cc:348] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.743011 1561 raft_consensus.cc:374] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:04.743132 1561 raft_consensus.cc:729] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:04.743399 1561 consensus_queue.cc:260] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.743952 2006 raft_consensus.cc:504] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.744246 1561 ts_tablet_manager.cc:1428] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260927 15:06:04.744716 2006 leader_election.cc:288] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:04.746394 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_188aafdea09e48319c0cdf8b390d1e3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.747396 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_188aafdea09e48319c0cdf8b390d1e3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.747987 1562 raft_consensus.cc:2866] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:04.746289 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6c4c26664bee4787987ec6c3e462d871"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.748726 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c4c26664bee4787987ec6c3e462d871 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.748648 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dadef58d086c4d76835d468c68898f6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.749127 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dadef58d086c4d76835d468c68898f6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.749498 1556 consensus_queue.cc:260] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.749789 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_abf58979f24a466485e0b343a6a3feac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:04.750298 1556 ts_tablet_manager.cc:1428] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
W20260927 15:06:04.750350 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abf58979f24a466485e0b343a6a3feac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.751677 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 20278f979638419db92105e55310f605 (DEFAULT_TABLE table=default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.759320 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63289edbdd734dd5a817df42d83e422e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:04.772548 1562 raft_consensus.cc:2258] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:04.772979 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 047fe4ed761642ccbfecdf543900d064 (DEFAULT_TABLE table=default.Table_7888b7559b574fa29792a622e564a3bf [id=5b0182bd937d41d2bb0f615cc82b7e39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.773761 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f199e9507a894fdabe2ccd2cef699fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.774025 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fc1fc04814147d8843aa734fd1794da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.781977 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 1c018f11de9842bc883409f8af35fb5f (DEFAULT_TABLE table=default.Table_04e241fd53a64c76b188ab49cd5ea266 [id=9f11325f98a4445eb6ee1d8c251866fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.782698 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 85e8909687fb40fdbccad15cd99b6eaf (DEFAULT_TABLE table=default.Table_25c945ca9a864192a29061360e38dc1d [id=96266e4cf3f943a7b0a4210747d10d92]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:04.783977 1102 leader_election.cc:341] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:04.790985 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05d525c1128e4042aa97ff786ffa7ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.796159 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet e066308fcdfc49ed926cd81963c5f1a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.796129 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 6f3bdfede5744513aeadb22da73b6f8a (DEFAULT_TABLE table=default.Table_108c4b5538b94b6fad6c4f46eb9a2b1b [id=441cd1970e024331bea46979f73efac4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.796375 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d221f14ad57462e95017b9068eb8714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.796497 1562 ts_tablet_manager.cc:1905] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:04.796633 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f3bdfede5744513aeadb22da73b6f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.796918 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63289edbdd734dd5a817df42d83e422e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:04.804955 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 20278f979638419db92105e55310f605 (DEFAULT_TABLE table=default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.808807 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 66b54ee47e424aacb7f53fd95b0ce889
I20260927 15:06:04.814525 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet efa42545da374ca989199433ce1284c3
I20260927 15:06:04.831067 1142 tablet_service.cc:1467] Processing CreateTablet for tablet f86725bd5d5247faa0dff164857629d3 (DEFAULT_TABLE table=default.Table_577464bde8c2424da3403e8f3a06ca36 [id=7535f27e13704592ab7951f3508ebd98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.832679 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 15609a2240ff42bfb30c3a318ce7ef91 (DEFAULT_TABLE table=default.Table_496540a0bb89481f9fe87eba8447e549 [id=1b92bd67dfe141e4bc7a74ba958ae72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.833070 1138 tablet_service.cc:1467] Processing CreateTablet for tablet d2e4f338ecf74608b6261d74cbd6db9b (DEFAULT_TABLE table=default.Table_ae5225c2de1945e888122b6387e848ba [id=7f2d5f98ab62449da015bd58173ce825]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.833519 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 66b54ee47e424aacb7f53fd95b0ce889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.834038 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet efa42545da374ca989199433ce1284c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:04.833963 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_304808acc5d54345ad85bb6a5dc817fb" } new_table_name: "default.Table_299a7e2d3b174b50b6f535e3971c1f35" modify_external_catalogs: true
I20260927 15:06:04.834604 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 611e63080dcb474c8dde370c54a0e777 (DEFAULT_TABLE table=default.Table_8a01cb508f7143c699903f946e72bacf [id=6cc2c220d4b04a528912503102c73727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.835158 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 396cafb9a2ff4f8c9922745ad85b307c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.835693 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a56d879e7b0840c5a012eb740af3d016" } new_table_name: "default.Table_53f5b1728e4947fca524ecea11ae3d37" modify_external_catalogs: true
I20260927 15:06:04.838093 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4fb14661edfd40989eb155bc053dab72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.839087 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fb14661edfd40989eb155bc053dab72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.837261 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 90619b7804324c9589b53342e2f6d0e8 (DEFAULT_TABLE table=default.Table_cb426815b34f4e6c89470b4b3904b673 [id=73db4702741b4cfa8b58c9e2af9a8259]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.840423 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_56be64a6763e44c0aa51e5715a9a67e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.840960 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56be64a6763e44c0aa51e5715a9a67e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.843151 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c5c7a3c4978a4100b3e643bcbb8e6b70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:04.843870 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5c7a3c4978a4100b3e643bcbb8e6b70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:04.846230 1561 tablet_bootstrap.cc:492] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:04.854732 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 047fe4ed761642ccbfecdf543900d064 (DEFAULT_TABLE table=default.Table_7888b7559b574fa29792a622e564a3bf [id=5b0182bd937d41d2bb0f615cc82b7e39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.856601 2006 raft_consensus.cc:482] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:04.858254 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3a231aff1a39485db36979208d871ab3
I20260927 15:06:04.872915 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 047fe4ed761642ccbfecdf543900d064 (DEFAULT_TABLE table=default.Table_7888b7559b574fa29792a622e564a3bf [id=5b0182bd937d41d2bb0f615cc82b7e39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.876310 1413 tablet_service.cc:1467] Processing CreateTablet for tablet f86725bd5d5247faa0dff164857629d3 (DEFAULT_TABLE table=default.Table_577464bde8c2424da3403e8f3a06ca36 [id=7535f27e13704592ab7951f3508ebd98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.876392 1440 raft_consensus.cc:2454] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:04.877146 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 396cafb9a2ff4f8c9922745ad85b307c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.877853 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 63289edbdd734dd5a817df42d83e422e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.878070 1556 tablet_bootstrap.cc:492] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:04.880496 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_888f9d56600b4020992ab5dbd99a1f14" } new_table_name: "default.Table_56a3935c2e7e42f3a601932943f67459" modify_external_catalogs: true
I20260927 15:06:04.881038 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85e8909687fb40fdbccad15cd99b6eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.876340 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 20278f979638419db92105e55310f605 (DEFAULT_TABLE table=default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.886511 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c018f11de9842bc883409f8af35fb5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.887364 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 047fe4ed761642ccbfecdf543900d064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.890770 1271 tablet_service.cc:1467] Processing CreateTablet for tablet d9c032a06c0b497fa21a3553375978ca (DEFAULT_TABLE table=default.Table_7b626dee65d244319052156e5e5fe7bc [id=814a8a2b49e348b4b4e653d7b122945b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.891314 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 1c018f11de9842bc883409f8af35fb5f (DEFAULT_TABLE table=default.Table_04e241fd53a64c76b188ab49cd5ea266 [id=9f11325f98a4445eb6ee1d8c251866fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.893594 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 90619b7804324c9589b53342e2f6d0e8 (DEFAULT_TABLE table=default.Table_cb426815b34f4e6c89470b4b3904b673 [id=73db4702741b4cfa8b58c9e2af9a8259]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.894345 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fc1fc04814147d8843aa734fd1794da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.899418 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 90619b7804324c9589b53342e2f6d0e8 (DEFAULT_TABLE table=default.Table_cb426815b34f4e6c89470b4b3904b673 [id=73db4702741b4cfa8b58c9e2af9a8259]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.900517 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f3bdfede5744513aeadb22da73b6f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.900836 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 15609a2240ff42bfb30c3a318ce7ef91 (DEFAULT_TABLE table=default.Table_496540a0bb89481f9fe87eba8447e549 [id=1b92bd67dfe141e4bc7a74ba958ae72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.903779 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 611e63080dcb474c8dde370c54a0e777 (DEFAULT_TABLE table=default.Table_8a01cb508f7143c699903f946e72bacf [id=6cc2c220d4b04a528912503102c73727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.905300 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f86725bd5d5247faa0dff164857629d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.905982 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 66b54ee47e424aacb7f53fd95b0ce889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.906929 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 611e63080dcb474c8dde370c54a0e777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.905900 1407 tablet_service.cc:1467] Processing CreateTablet for tablet d2e4f338ecf74608b6261d74cbd6db9b (DEFAULT_TABLE table=default.Table_ae5225c2de1945e888122b6387e848ba [id=7f2d5f98ab62449da015bd58173ce825]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.909358 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15609a2240ff42bfb30c3a318ce7ef91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.907191 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet efa42545da374ca989199433ce1284c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.909919 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2e4f338ecf74608b6261d74cbd6db9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.912858 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fc1fc04814147d8843aa734fd1794da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.927052 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 396cafb9a2ff4f8c9922745ad85b307c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.928610 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 66b54ee47e424aacb7f53fd95b0ce889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.912534 1270 tablet_service.cc:1467] Processing CreateTablet for tablet f86725bd5d5247faa0dff164857629d3 (DEFAULT_TABLE table=default.Table_577464bde8c2424da3403e8f3a06ca36 [id=7535f27e13704592ab7951f3508ebd98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.941496 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f199e9507a894fdabe2ccd2cef699fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.943264 2006 raft_consensus.cc:504] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.948697 1099 leader_election.cc:302] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:04.953264 2009 raft_consensus.cc:2781] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:04.953397 2009 raft_consensus.cc:482] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:04.953521 2009 raft_consensus.cc:3037] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:04.956683 2009 raft_consensus.cc:504] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:04.957644 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15609a2240ff42bfb30c3a318ce7ef91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.971661 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d62fe8ec9c694017bb26e4b692b51007" } new_table_name: "default.Table_2acab08ececa48aab9e6139d3e031e59" modify_external_catalogs: true
I20260927 15:06:04.975344 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20278f979638419db92105e55310f605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.975430 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a231aff1a39485db36979208d871ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:04.978096 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f86725bd5d5247faa0dff164857629d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.978546 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2e4f338ecf74608b6261d74cbd6db9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.978994 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 611e63080dcb474c8dde370c54a0e777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.980296 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90619b7804324c9589b53342e2f6d0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.981133 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 047fe4ed761642ccbfecdf543900d064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.981629 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f3bdfede5744513aeadb22da73b6f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:04.912716 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 611e63080dcb474c8dde370c54a0e777 (DEFAULT_TABLE table=default.Table_8a01cb508f7143c699903f946e72bacf [id=6cc2c220d4b04a528912503102c73727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:04.983038 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet efa42545da374ca989199433ce1284c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:04.984450 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 0d41d55fdb504b95921f46e7aed99ac1 (table default.Table_9ab37ccf6e0a4d6ab107eacd40ea43d4 [id=1f37615c984042b9a2f7cfec93acd7ba]) successfully deleted
W20260927 15:06:04.984822 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 566aa5caa012443ea63fcb7389c8b7c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 566aa5caa012443ea63fcb7389c8b7c0 already in progress: creating tablet
W20260927 15:06:04.989110 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 71598us
I20260927 15:06:04.990706 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a6b84fe2576f4557af001177805017c3" } new_table_name: "default.Table_d80304854a5249a08e5c2098c97d7c1c" modify_external_catalogs: true
I20260927 15:06:04.989593 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a231aff1a39485db36979208d871ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.004311 2006 leader_election.cc:288] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.004781 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.006008 2009 leader_election.cc:288] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.017000 2060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: Bootstrap replayed 1/1 log segments. Stats: ops{read=26 overwritten=0 applied=26 ignored=0} inserts{seen=23 ignored=0} mutations{seen=20 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260927 15:06:05.017902 2060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: Bootstrap complete.
I20260927 15:06:05.018438 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_29e962b1033e4710bf2fde659683678e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.019069 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29e962b1033e4710bf2fde659683678e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.032838 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90619b7804324c9589b53342e2f6d0e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:05.036290 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9ae003f1ca76472cbaa8b577b66fe84c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ae003f1ca76472cbaa8b577b66fe84c already in progress: creating tablet
W20260927 15:06:05.036659 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2268d824f5324cd1b81879e2fe4fd027 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2268d824f5324cd1b81879e2fe4fd027 already in progress: creating tablet
I20260927 15:06:05.034085 2028 raft_consensus.cc:482] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:05.036916 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ea3220df595848258d0f53fa941b2beb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea3220df595848258d0f53fa941b2beb already in progress: creating tablet
W20260927 15:06:05.037300 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 219639c0184f4888984fa04a1f84bd83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 219639c0184f4888984fa04a1f84bd83 already in progress: creating tablet
W20260927 15:06:05.037523 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e066308fcdfc49ed926cd81963c5f1a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e066308fcdfc49ed926cd81963c5f1a7 already in progress: creating tablet
W20260927 15:06:05.037755 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8fc1fc04814147d8843aa734fd1794da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fc1fc04814147d8843aa734fd1794da already in progress: creating tablet
I20260927 15:06:05.040659 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9c032a06c0b497fa21a3553375978ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.041105 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.041524 2030 raft_consensus.cc:482] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.038949 2060 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:06:05.042351 2060 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf522d70373412b87815d33c0f1f745, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.043753 2060 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 26, Last appended: 1.26, Last appended by leader: 26, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:06:05.046367 2030 raft_consensus.cc:504] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.046762 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3ece36785b214c7fb4352a79cb3b4438" } modify_external_catalogs: true
I20260927 15:06:05.046996 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3ece36785b214c7fb4352a79cb3b4438" } modify_external_catalogs: true
I20260927 15:06:05.047669 1440 raft_consensus.cc:1261] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Refusing update from remote peer c4264874db964ff2830b7894c2b3d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:06:05.048147 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63289edbdd734dd5a817df42d83e422e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:05.048463 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9a7ed6e23e1479a86e2abcf6aa5b317" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:05.050304 2028 raft_consensus.cc:504] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.053130 1437 raft_consensus.cc:3037] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.056507 1438 raft_consensus.cc:2454] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:05.057410 1556 tablet_bootstrap.cc:654] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.059075 2030 leader_election.cc:288] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:05.059784 2028 leader_election.cc:288] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:05.062706 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec3d823781234015aa8a48421a23bbd2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:05.068885 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ebb4e007cefa4f18bdaa461b43c5c810 consensus state has no leader
I20260927 15:06:05.075093 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20278f979638419db92105e55310f605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.076421 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05d525c1128e4042aa97ff786ffa7ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.080344 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_52dfae347a16444d9d03a84c7a88721d" } modify_external_catalogs: true
I20260927 15:06:05.080642 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_52dfae347a16444d9d03a84c7a88721d" } modify_external_catalogs: true
I20260927 15:06:05.083863 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b88cb2c53be4463eb17e748d2c17f0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.085289 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9c032a06c0b497fa21a3553375978ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.093142 1559 ts_tablet_manager.cc:1918] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.096848 1559 log.cc:1196] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/67cf4dae943e4092b2c490ad770e4a94
W20260927 15:06:05.097194 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 434e9390f1fd4a3ebb65924c37b85bd4 consensus state has no leader
I20260927 15:06:05.097522 905 master_service.cc:946] ReplaceTablet: received request to replace tablet 109f9088371e4f008b2b5f993f2b4c3b from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:05.101480 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2c585ef1be384bbf993054ce07ec28d2" } modify_external_catalogs: true
I20260927 15:06:05.101637 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9a7ed6e23e1479a86e2abcf6aa5b317" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:05.101711 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2c585ef1be384bbf993054ce07ec28d2" } modify_external_catalogs: true
I20260927 15:06:05.101881 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a231aff1a39485db36979208d871ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.102120 1552 tablet_bootstrap.cc:492] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:05.102285 1552 ts_tablet_manager.cc:1397] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.442s user 0.005s sys 0.000s
I20260927 15:06:05.102413 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63289edbdd734dd5a817df42d83e422e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:05.105409 1102 consensus_peers.cc:487] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:05.105532 2006 raft_consensus.cc:482] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:05.105590 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 66b54ee47e424aacb7f53fd95b0ce889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66b54ee47e424aacb7f53fd95b0ce889 already in progress: creating tablet
I20260927 15:06:05.105966 1561 tablet_bootstrap.cc:654] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.106163 2009 raft_consensus.cc:482] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.106156 1552 raft_consensus.cc:348] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.106369 1552 raft_consensus.cc:374] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.106460 1552 raft_consensus.cc:729] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.106662 1552 consensus_queue.cc:260] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.107393 1552 ts_tablet_manager.cc:1428] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:05.109509 1552 tablet_bootstrap.cc:492] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:05.109637 1351 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:06:05.110482 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b88cb2c53be4463eb17e748d2c17f0e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.111264 1559 ts_tablet_manager.cc:1939] T 67cf4dae943e4092b2c490ad770e4a94 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:05.104530 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 15609a2240ff42bfb30c3a318ce7ef91 (DEFAULT_TABLE table=default.Table_496540a0bb89481f9fe87eba8447e549 [id=1b92bd67dfe141e4bc7a74ba958ae72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.106236 1267 tablet_service.cc:1467] Processing CreateTablet for tablet d2e4f338ecf74608b6261d74cbd6db9b (DEFAULT_TABLE table=default.Table_ae5225c2de1945e888122b6387e848ba [id=7f2d5f98ab62449da015bd58173ce825]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.116592 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b88cb2c53be4463eb17e748d2c17f0e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:05.122112 1102 leader_election.cc:341] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.122738 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba14b7531bb647248572be10d2b43cf2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:05.122970 1166 raft_consensus.cc:2454] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:05.123217 2009 raft_consensus.cc:504] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.123792 2009 leader_election.cc:288] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.127441 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20278f979638419db92105e55310f605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.127707 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f86725bd5d5247faa0dff164857629d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.127936 1437 raft_consensus.cc:2454] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:05.129405 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b63e63f7cd4075bcf10a463ce16e05" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:05.130510 2006 raft_consensus.cc:504] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.131191 1374 leader_election.cc:302] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
W20260927 15:06:05.131882 1376 leader_election.cc:341] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.133622 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d221f14ad57462e95017b9068eb8714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.136389 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b63e63f7cd4075bcf10a463ce16e05" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:05.136797 2030 raft_consensus.cc:2781] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:05.137805 2030 raft_consensus.cc:482] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:05.137948 2030 raft_consensus.cc:3037] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:05.138051 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet efa42545da374ca989199433ce1284c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efa42545da374ca989199433ce1284c3 already in progress: creating tablet
I20260927 15:06:05.134799 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba14b7531bb647248572be10d2b43cf2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:05.139564 1376 leader_election.cc:341] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.140244 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 611e63080dcb474c8dde370c54a0e777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.140578 2006 leader_election.cc:288] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.141368 2030 raft_consensus.cc:504] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.142396 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 387) took 1365 ms. Trace:
I20260927 15:06:05.144801 1559 rpcz_store.cc:276] 0927 15:06:03.759946 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.764620 (+ 4674us) service_pool.cc:227] Handling call
0927 15:06:04.659316 (+894696us) ts_tablet_manager.cc:1145] Deleting tablet 67cf4dae943e4092b2c490ad770e4a94
0927 15:06:04.659330 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.892118 (+232788us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.085792 (+193674us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.125829 (+ 40037us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":894468}
I20260927 15:06:05.145011 1164 raft_consensus.cc:2454] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:05.145478 1374 leader_election.cc:302] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.145520 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 67cf4dae943e4092b2c490ad770e4a94 (table default.Table_6f254b1d0eb949238df41c88797697e5 [id=9ac1472258a24d01892257dd9c9874a8]) successfully deleted
I20260927 15:06:05.145840 1559 tablet_replica.cc:330] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:05.145954 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05d525c1128e4042aa97ff786ffa7ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.146036 1559 raft_consensus.cc:2229] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.146240 1559 raft_consensus.cc:2258] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:05.146225 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3a231aff1a39485db36979208d871ab3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a231aff1a39485db36979208d871ab3 already in progress: creating tablet
I20260927 15:06:05.146860 1559 ts_tablet_manager.cc:1905] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.149372 1706 raft_consensus.cc:482] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.150678 1706 raft_consensus.cc:504] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.152498 1706 leader_election.cc:288] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.153057 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba14b7531bb647248572be10d2b43cf2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:05.153764 1376 leader_election.cc:341] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.153995 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2e4f338ecf74608b6261d74cbd6db9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:05.156081 1102 consensus_peers.cc:487] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:05.156560 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85e8909687fb40fdbccad15cd99b6eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.158043 1963 tablet.cc:1722] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:05.159762 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9c032a06c0b497fa21a3553375978ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.161171 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c018f11de9842bc883409f8af35fb5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.168834 2030 leader_election.cc:288] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:05.169072 2030 raft_consensus.cc:2781] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:05.169170 2030 raft_consensus.cc:482] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:05.169274 2030 raft_consensus.cc:3037] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.178211 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c018f11de9842bc883409f8af35fb5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.180282 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90619b7804324c9589b53342e2f6d0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.184643 2030 raft_consensus.cc:504] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.185628 2030 leader_election.cc:288] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:05.190804 1102 leader_election.cc:341] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.167199 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04caae16db84d8ea9050b648c1ba354" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:05.197131 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cf4dae943e4092b2c490ad770e4a94" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:05.197566 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b63e63f7cd4075bcf10a463ce16e05" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:05.198664 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a46e15ea145b4eae8f94b664067b4f92" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:05.198283 1556 tablet_bootstrap.cc:492] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.200055 1556 ts_tablet_manager.cc:1397] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.416s user 0.015s sys 0.019s
I20260927 15:06:05.200315 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15609a2240ff42bfb30c3a318ce7ef91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.202958 1556 raft_consensus.cc:348] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:05.203437 1376 leader_election.cc:341] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:05.206748 1102 leader_election.cc:341] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.211114 2006 raft_consensus.cc:482] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.215575 2006 raft_consensus.cc:504] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.220292 1556 raft_consensus.cc:374] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.220772 2006 leader_election.cc:288] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:05.224378 1102 leader_election.cc:341] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.224884 2074 tablet.cc:1722] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:05.225544 1556 raft_consensus.cc:729] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.225960 1556 consensus_queue.cc:260] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.226177 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 047fe4ed761642ccbfecdf543900d064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.226796 1556 ts_tablet_manager.cc:1428] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260927 15:06:05.227154 1556 tablet_bootstrap.cc:492] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:05.228849 1556 tablet_bootstrap.cc:654] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.233887 1562 ts_tablet_manager.cc:1918] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:05.244513 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a260c9d3b8fb4316864e6f986559bef1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:05.247318 1102 leader_election.cc:341] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.258342 1562 log.cc:1196] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/9c9e4311049d47d3b2f1e117795624ef
I20260927 15:06:05.262686 1562 ts_tablet_manager.cc:1939] T 9c9e4311049d47d3b2f1e117795624ef P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:05.265727 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 319) took 2848 ms. Trace:
I20260927 15:06:05.265884 1562 rpcz_store.cc:276] 0927 15:06:02.414227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.414283 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:04.678221 (+2263938us) ts_tablet_manager.cc:1145] Deleting tablet 9c9e4311049d47d3b2f1e117795624ef
0927 15:06:04.678235 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:04.963645 (+285410us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.217128 (+253483us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.263108 (+ 45980us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2263691}
I20260927 15:06:05.266607 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 9c9e4311049d47d3b2f1e117795624ef (table default.Table_195d86242b4c4d008065aee0ea319f60 [id=e70d41731a9442ea9dbe00db169e3b3b]) successfully deleted
W20260927 15:06:05.267074 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 51292.8us
I20260927 15:06:05.267604 1562 tablet_replica.cc:330] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:05.267650 1559 ts_tablet_manager.cc:1918] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.268121 1559 log.cc:1196] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/7d1f23f91bce4df480dd9991659f2e81
I20260927 15:06:05.268569 1559 ts_tablet_manager.cc:1939] T 7d1f23f91bce4df480dd9991659f2e81 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:05.269387 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 389) took 1509 ms. Trace:
I20260927 15:06:05.270361 1559 rpcz_store.cc:276] 0927 15:06:03.760169 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.765303 (+ 5134us) service_pool.cc:227] Handling call
0927 15:06:05.145755 (+1380452us) ts_tablet_manager.cc:1145] Deleting tablet 7d1f23f91bce4df480dd9991659f2e81
0927 15:06:05.145768 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.189454 (+ 43686us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.224343 (+ 34889us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.269349 (+ 45006us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1380275}
I20260927 15:06:05.270741 1559 tablet_replica.cc:330] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:05.270908 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 7d1f23f91bce4df480dd9991659f2e81 (table default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]) successfully deleted
I20260927 15:06:05.270977 1559 raft_consensus.cc:2229] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.271138 1559 raft_consensus.cc:2258] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.271693 1559 ts_tablet_manager.cc:1905] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.273504 1562 raft_consensus.cc:2229] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.274435 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07b63e63f7cd4075bcf10a463ce16e05" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:05.274652 1163 raft_consensus.cc:3037] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.277027 1562 raft_consensus.cc:2258] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.277588 1562 ts_tablet_manager.cc:1905] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.277755 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba14b7531bb647248572be10d2b43cf2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:05.278607 1164 raft_consensus.cc:3037] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.280228 1556 tablet_bootstrap.cc:492] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.280407 1556 ts_tablet_manager.cc:1397] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.015s
I20260927 15:06:05.281217 1556 raft_consensus.cc:348] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.281512 1556 raft_consensus.cc:374] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.281597 1556 raft_consensus.cc:729] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.284730 1556 consensus_queue.cc:260] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.285290 1556 ts_tablet_manager.cc:1428] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:05.285971 1556 tablet_bootstrap.cc:492] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:05.287607 1556 tablet_bootstrap.cc:654] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.300850 1164 raft_consensus.cc:2454] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:05.303884 1556 tablet_bootstrap.cc:492] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.304030 1556 ts_tablet_manager.cc:1397] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.000s
I20260927 15:06:05.304760 1556 raft_consensus.cc:348] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.304970 1556 raft_consensus.cc:374] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.305047 1556 raft_consensus.cc:729] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.305236 1556 consensus_queue.cc:260] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.305917 1556 ts_tablet_manager.cc:1428] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:05.306169 1556 tablet_bootstrap.cc:492] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:05.306981 1163 raft_consensus.cc:2454] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:05.308697 1556 tablet_bootstrap.cc:654] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.311221 1559 ts_tablet_manager.cc:1918] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.311368 1559 log.cc:1196] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/0df4a23269244191bf1dcd69cb34d371
I20260927 15:06:05.311703 1559 ts_tablet_manager.cc:1939] T 0df4a23269244191bf1dcd69cb34d371 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:05.312427 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 390) took 1327 ms. Trace:
I20260927 15:06:05.312552 1559 rpcz_store.cc:276] 0927 15:06:03.984740 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.995660 (+ 10920us) service_pool.cc:227] Handling call
0927 15:06:05.270671 (+1275011us) ts_tablet_manager.cc:1145] Deleting tablet 0df4a23269244191bf1dcd69cb34d371
0927 15:06:05.270684 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.280994 (+ 10310us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.311110 (+ 30116us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.312375 (+ 1265us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1274670}
I20260927 15:06:05.313007 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 0df4a23269244191bf1dcd69cb34d371 (table default.Table_190c56d51dc446aa8a208d631e35f3d2 [id=d80cbbb5881e42f0b5651563d6f60bb5]) successfully deleted
I20260927 15:06:05.313619 1552 tablet_bootstrap.cc:654] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.322220 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 396) took 1185 ms. Trace:
I20260927 15:06:05.323149 1559 rpcz_store.cc:276] 0927 15:06:04.136296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.136360 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:05.320744 (+1184384us) ts_tablet_manager.cc:1145] Deleting tablet 3d454d65afa94aac9b34c253adfa4b0c
0927 15:06:05.320881 (+ 137us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.321618 (+ 737us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1183953}
W20260927 15:06:05.325374 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3d454d65afa94aac9b34c253adfa4b0c because the tablet was not found. No further retry: Not found: Tablet not found: 3d454d65afa94aac9b34c253adfa4b0c
I20260927 15:06:05.327705 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 400) took 1145 ms. Trace:
W20260927 15:06:05.330180 1102 consensus_peers.cc:487] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:05.330621 1559 rpcz_store.cc:276] 0927 15:06:04.181313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.199088 (+ 17775us) service_pool.cc:227] Handling call
0927 15:06:05.326221 (+1127133us) ts_tablet_manager.cc:1145] Deleting tablet 033e71f60c3e47fd9647db090d4d6cd5
0927 15:06:05.326235 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.327140 (+ 905us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1126764}
W20260927 15:06:05.332471 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 033e71f60c3e47fd9647db090d4d6cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033e71f60c3e47fd9647db090d4d6cd5 already in progress: creating tablet
I20260927 15:06:05.334610 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 399) took 1154 ms. Trace:
I20260927 15:06:05.335596 1559 rpcz_store.cc:276] 0927 15:06:04.180077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.205311 (+ 25234us) service_pool.cc:227] Handling call
0927 15:06:05.333335 (+1128024us) ts_tablet_manager.cc:1145] Deleting tablet 089b6b5ac39d49fea744240261a8010e
0927 15:06:05.333348 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.334315 (+ 967us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1127570}
W20260927 15:06:05.337271 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 089b6b5ac39d49fea744240261a8010e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 089b6b5ac39d49fea744240261a8010e already in progress: creating tablet
I20260927 15:06:05.339011 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 401) took 1065 ms. Trace:
I20260927 15:06:05.339804 1559 rpcz_store.cc:276] 0927 15:06:04.272992 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.274950 (+ 1958us) service_pool.cc:227] Handling call
0927 15:06:05.338015 (+1063065us) ts_tablet_manager.cc:1145] Deleting tablet 9576d1a36d7547bf81faabe9c362e3cb
0927 15:06:05.338122 (+ 107us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.338532 (+ 410us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":998860}
W20260927 15:06:05.341337 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9576d1a36d7547bf81faabe9c362e3cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9576d1a36d7547bf81faabe9c362e3cb already in progress: creating tablet
I20260927 15:06:05.343160 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 402) took 1014 ms. Trace:
I20260927 15:06:05.343767 1559 rpcz_store.cc:276] 0927 15:06:04.327994 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.328188 (+ 194us) service_pool.cc:227] Handling call
0927 15:06:05.342009 (+1013821us) ts_tablet_manager.cc:1145] Deleting tablet ac64eacc7d924940aacc8779b5bfeae7
0927 15:06:05.342019 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.342783 (+ 764us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":997245}
W20260927 15:06:05.345448 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ac64eacc7d924940aacc8779b5bfeae7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac64eacc7d924940aacc8779b5bfeae7 already in progress: creating tablet
I20260927 15:06:05.348333 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 403) took 1008 ms. Trace:
I20260927 15:06:05.349382 2030 raft_consensus.cc:482] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.349443 1374 leader_election.cc:302] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.349562 2030 raft_consensus.cc:504] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.349924 2076 raft_consensus.cc:2781] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:05.350100 2076 raft_consensus.cc:686] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:05.350230 2030 leader_election.cc:288] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:05.350426 2076 consensus_queue.cc:237] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.350607 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "109f9088371e4f008b2b5f993f2b4c3b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:05.351151 1376 leader_election.cc:341] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.349226 1559 rpcz_store.cc:276] 0927 15:06:04.339149 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.339254 (+ 105us) service_pool.cc:227] Handling call
0927 15:06:05.347138 (+1007884us) ts_tablet_manager.cc:1145] Deleting tablet fd1f51cb124d4d20a9d6024e6eb6810f
0927 15:06:05.347334 (+ 196us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.347941 (+ 607us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":999576}
W20260927 15:06:05.352252 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fd1f51cb124d4d20a9d6024e6eb6810f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd1f51cb124d4d20a9d6024e6eb6810f already in progress: creating tablet
I20260927 15:06:05.354447 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 404) took 1009 ms. Trace:
I20260927 15:06:05.355535 1099 leader_election.cc:302] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.356202 1706 raft_consensus.cc:482] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.356135 2009 consensus_queue.cc:1035] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:05.356346 1706 raft_consensus.cc:504] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.355490 1559 rpcz_store.cc:276] 0927 15:06:04.344202 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.344604 (+ 402us) service_pool.cc:227] Handling call
0927 15:06:05.353143 (+1008539us) ts_tablet_manager.cc:1145] Deleting tablet d463a481cb8c4243961e9b0d2b11822c
0927 15:06:05.353155 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.354038 (+ 883us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":984729}
I20260927 15:06:05.356617 2009 raft_consensus.cc:2781] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:05.356737 2009 raft_consensus.cc:482] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:05.356817 2009 raft_consensus.cc:3037] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.356904 1706 leader_election.cc:288] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:05.357266 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet d463a481cb8c4243961e9b0d2b11822c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d463a481cb8c4243961e9b0d2b11822c already in progress: creating tablet
I20260927 15:06:05.358439 1559 tablet_replica.cc:330] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:05.360278 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04caae16db84d8ea9050b648c1ba354" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:05.360397 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377847d06b534883ba2b870ca3317fe0" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:05.359906 1559 raft_consensus.cc:2229] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.361218 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a46e15ea145b4eae8f94b664067b4f92" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:05.361446 1438 raft_consensus.cc:2454] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:05.361845 1559 raft_consensus.cc:2258] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.362792 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a260c9d3b8fb4316864e6f986559bef1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:05.362984 1438 raft_consensus.cc:2454] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:05.363679 1099 leader_election.cc:302] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.364071 2006 raft_consensus.cc:2781] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:05.364130 1300 raft_consensus.cc:3037] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.364223 2006 raft_consensus.cc:686] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:05.364450 2006 consensus_queue.cc:237] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.367362 2009 raft_consensus.cc:504] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.368017 2009 leader_election.cc:288] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.373459 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9a7ed6e23e1479a86e2abcf6aa5b317" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:05.373762 1102 consensus_peers.cc:487] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:05.375530 1102 leader_election.cc:341] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.377897 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "377847d06b534883ba2b870ca3317fe0" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:05.381533 1561 tablet_bootstrap.cc:492] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:05.381793 1561 ts_tablet_manager.cc:1397] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.536s user 0.027s sys 0.006s
I20260927 15:06:05.383275 1561 raft_consensus.cc:348] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.383673 1561 raft_consensus.cc:374] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.383810 1561 raft_consensus.cc:729] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.384215 1561 consensus_queue.cc:260] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.385142 1561 ts_tablet_manager.cc:1428] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:05.385701 1561 tablet_bootstrap.cc:492] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:05.388829 1561 tablet_bootstrap.cc:654] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.392417 2072 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:06:05.393296 2072 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:06:05.395370 1238 leader_election.cc:302] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:05.395810 2060 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: configured and running, proceeding with master startup.
I20260927 15:06:05.395988 1238 leader_election.cc:302] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:05.398869 1559 ts_tablet_manager.cc:1905] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.400314 1374 leader_election.cc:302] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.401455 2076 raft_consensus.cc:2781] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:05.401871 2076 raft_consensus.cc:686] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:05.401952 1552 tablet_bootstrap.cc:492] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:05.402132 1552 ts_tablet_manager.cc:1397] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.293s user 0.009s sys 0.001s
I20260927 15:06:05.402145 2076 consensus_queue.cc:237] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.403638 1552 raft_consensus.cc:348] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.403867 1552 raft_consensus.cc:374] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.403944 1552 raft_consensus.cc:729] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.404606 1552 consensus_queue.cc:260] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.408560 2090 raft_consensus.cc:2726] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:05.409780 1706 raft_consensus.cc:2726] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:05.400628 1099 leader_election.cc:341] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 67cf4dae943e4092b2c490ad770e4a94
I20260927 15:06:05.411588 1099 leader_election.cc:302] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:05.411623 1552 ts_tablet_manager.cc:1428] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 15:06:05.412217 1099 leader_election.cc:302] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:05.412665 1099 consensus_peers.cc:487] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab08d04c11dd44299ee5f9a911d581c3. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:05.412823 1099 leader_election.cc:302] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.414969 2087 raft_consensus.cc:2726] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:05.415141 2087 raft_consensus.cc:2781] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:05.415222 2087 raft_consensus.cc:482] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:05.415292 2087 raft_consensus.cc:3037] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.418298 2087 raft_consensus.cc:504] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.418864 1559 ts_tablet_manager.cc:1918] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:05.418979 1559 log.cc:1196] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/67ad68a0adad407a92b2335f43e67227
I20260927 15:06:05.401211 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "109f9088371e4f008b2b5f993f2b4c3b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:05.419626 1559 ts_tablet_manager.cc:1939] T 67ad68a0adad407a92b2335f43e67227 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:05.419926 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 405) took 1033 ms. Trace:
I20260927 15:06:05.420092 1559 rpcz_store.cc:276] 0927 15:06:04.386398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.386686 (+ 288us) service_pool.cc:227] Handling call
0927 15:06:05.357864 (+971178us) ts_tablet_manager.cc:1145] Deleting tablet 67ad68a0adad407a92b2335f43e67227
0927 15:06:05.358039 (+ 175us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.411071 (+ 53032us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.418719 (+ 7648us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.419899 (+ 1180us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":970894}
I20260927 15:06:05.420332 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 08f28c023473434ba73b1142a041be97 (table default.Table_826c1efeddc74a17ad2db271286974ac [id=67762455acad44448ba24d18c2863816]). Expected version 3 got 0
I20260927 15:06:05.420662 2009 raft_consensus.cc:2781] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:05.420620 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 67ad68a0adad407a92b2335f43e67227 (table default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]) successfully deleted
I20260927 15:06:05.420737 2009 raft_consensus.cc:482] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:05.420835 2009 raft_consensus.cc:3037] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:05.421341 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 219639c0184f4888984fa04a1f84bd83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 219639c0184f4888984fa04a1f84bd83 already in progress: creating tablet
W20260927 15:06:05.422207 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 566aa5caa012443ea63fcb7389c8b7c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 566aa5caa012443ea63fcb7389c8b7c0 already in progress: creating tablet
I20260927 15:06:05.422981 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a46e15ea145b4eae8f94b664067b4f92" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:05.423440 1102 leader_election.cc:341] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.423655 2087 leader_election.cc:288] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.424366 2009 raft_consensus.cc:504] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.424894 2009 leader_election.cc:288] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:05.425554 1374 leader_election.cc:341] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.425679 1374 leader_election.cc:302] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:05.392064 1562 ts_tablet_manager.cc:1918] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.426993 1562 log.cc:1196] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/f1d7a98ffc4745ac8eeb93012b55d417
I20260927 15:06:05.427343 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a260c9d3b8fb4316864e6f986559bef1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:05.427821 1102 leader_election.cc:341] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.428530 2071 raft_consensus.cc:2726] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:05.428663 1559 tablet_replica.cc:330] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:05.428893 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ea3220df595848258d0f53fa941b2beb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea3220df595848258d0f53fa941b2beb already in progress: creating tablet
I20260927 15:06:05.428939 1559 raft_consensus.cc:2229] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:05.429148 1559 pending_rounds.cc:62] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:05.429229 1559 pending_rounds.cc:68] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976331889295360 op_type: NO_OP noop_request { }
I20260927 15:06:05.429347 1559 raft_consensus.cc:2866] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:05.429472 1559 raft_consensus.cc:2258] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:05.429971 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2268d824f5324cd1b81879e2fe4fd027 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2268d824f5324cd1b81879e2fe4fd027 already in progress: creating tablet
I20260927 15:06:05.431553 1562 ts_tablet_manager.cc:1939] T f1d7a98ffc4745ac8eeb93012b55d417 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:05.429069 908 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 08f28c023473434ba73b1142a041be97 (table default.Table_826c1efeddc74a17ad2db271286974ac [id=67762455acad44448ba24d18c2863816]). Expected version 3 got 0
I20260927 15:06:05.432440 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 377847d06b534883ba2b870ca3317fe0 (table default.Table_1c87fe2a6c1a4e178dc88d4fd8679835 [id=56574e770aa74f04a7bf24b7718e4960]). Expected version 1 got 0
W20260927 15:06:05.432451 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9ae003f1ca76472cbaa8b577b66fe84c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ae003f1ca76472cbaa8b577b66fe84c already in progress: creating tablet
I20260927 15:06:05.432996 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 322) took 2969 ms. Trace:
I20260927 15:06:05.433107 1562 rpcz_store.cc:276] 0927 15:06:02.463426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.463512 (+ 86us) service_pool.cc:227] Handling call
0927 15:06:05.266270 (+2802758us) ts_tablet_manager.cc:1145] Deleting tablet f1d7a98ffc4745ac8eeb93012b55d417
0927 15:06:05.266284 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.345607 (+ 79323us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.391883 (+ 46276us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.432953 (+ 41070us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2802525}
I20260927 15:06:05.433666 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet f1d7a98ffc4745ac8eeb93012b55d417 (table default.Table_af607bdf84604e1d89e4b679360ed558 [id=5928f9637b7c4e569baf987137d28383]) successfully deleted
I20260927 15:06:05.434214 1559 ts_tablet_manager.cc:1905] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:05.438378 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6b4beb4112734b9c91e32b300fd266d7 consensus state has no leader
W20260927 15:06:05.438900 1376 consensus_peers.cc:487] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:05.439819 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 6d167c390ed546e09f31f1e08988500c (DEFAULT_TABLE table=default.Table_c17aba6177d54467b2120ce673c0dfb4 [id=234c00587e784ecead8e41b402bbfd57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.439810 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 81f65ad693894e7c8b575cd8e1942c14 (DEFAULT_TABLE table=default.Table_50468591e06d4c9bb7eec72646b0e846 [id=b340e6cd89c040578901cf9c762ce902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.440209 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d167c390ed546e09f31f1e08988500c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.440543 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f65ad693894e7c8b575cd8e1942c14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.443454 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 6d167c390ed546e09f31f1e08988500c (DEFAULT_TABLE table=default.Table_c17aba6177d54467b2120ce673c0dfb4 [id=234c00587e784ecead8e41b402bbfd57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.443965 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 81f65ad693894e7c8b575cd8e1942c14 (DEFAULT_TABLE table=default.Table_50468591e06d4c9bb7eec72646b0e846 [id=b340e6cd89c040578901cf9c762ce902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.443965 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 723df898361144aeb16065868885d120 (DEFAULT_TABLE table=default.Table_30034347f11e4920a17119f94d7a65df [id=66d552f6b56b4f35be0292c624e6cb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.444260 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9a7ed6e23e1479a86e2abcf6aa5b317" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:05.444449 1437 raft_consensus.cc:3037] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.445762 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 723df898361144aeb16065868885d120 (DEFAULT_TABLE table=default.Table_30034347f11e4920a17119f94d7a65df [id=66d552f6b56b4f35be0292c624e6cb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.446166 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 723df898361144aeb16065868885d120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.448777 1437 raft_consensus.cc:2454] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:05.451193 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a46e15ea145b4eae8f94b664067b4f92" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:05.451453 1437 raft_consensus.cc:3037] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.448071 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 723df898361144aeb16065868885d120 (DEFAULT_TABLE table=default.Table_30034347f11e4920a17119f94d7a65df [id=66d552f6b56b4f35be0292c624e6cb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.451869 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 723df898361144aeb16065868885d120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.453655 1561 tablet_bootstrap.cc:492] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:05.453794 1561 ts_tablet_manager.cc:1397] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.068s user 0.000s sys 0.005s
I20260927 15:06:05.454528 1561 raft_consensus.cc:348] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.454792 1561 raft_consensus.cc:374] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.454892 1561 raft_consensus.cc:729] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.455325 1437 raft_consensus.cc:2454] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:05.456117 1099 consensus_peers.cc:487] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d1f23f91bce4df480dd9991659f2e81. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:05.456135 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a260c9d3b8fb4316864e6f986559bef1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:05.456319 1437 raft_consensus.cc:3037] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.448554 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 81f65ad693894e7c8b575cd8e1942c14 (DEFAULT_TABLE table=default.Table_50468591e06d4c9bb7eec72646b0e846 [id=b340e6cd89c040578901cf9c762ce902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.457886 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f65ad693894e7c8b575cd8e1942c14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.448915 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 6d167c390ed546e09f31f1e08988500c (DEFAULT_TABLE table=default.Table_c17aba6177d54467b2120ce673c0dfb4 [id=234c00587e784ecead8e41b402bbfd57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.462193 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d167c390ed546e09f31f1e08988500c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.463100 1561 consensus_queue.cc:260] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.463706 1561 ts_tablet_manager.cc:1428] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 15:06:05.463994 1561 tablet_bootstrap.cc:492] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:05.464181 2094 raft_consensus.cc:482] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.464318 2094 raft_consensus.cc:504] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.464936 1099 leader_election.cc:302] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.465037 2094 leader_election.cc:288] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.465541 1561 tablet_bootstrap.cc:654] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:05.465772 1239 leader_election.cc:341] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: bc971defe6d148439a6a0b8c55d9092e
W20260927 15:06:05.465925 1099 consensus_peers.cc:487] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0df4a23269244191bf1dcd69cb34d371. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:05.466550 2006 raft_consensus.cc:2781] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:05.466706 2006 raft_consensus.cc:686] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:05.467074 2006 consensus_queue.cc:237] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.467185 1099 leader_election.cc:302] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.467530 2070 raft_consensus.cc:2781] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:05.467682 2070 raft_consensus.cc:686] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:05.467978 2070 consensus_queue.cc:237] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:05.470757 1238 leader_election.cc:341] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: bc971defe6d148439a6a0b8c55d9092e
I20260927 15:06:05.470952 1238 leader_election.cc:302] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:05.471240 2094 raft_consensus.cc:2726] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:05.475817 1300 raft_consensus.cc:3037] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.477185 1559 ts_tablet_manager.cc:1918] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:05.477316 1559 log.cc:1196] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/07b63e63f7cd4075bcf10a463ce16e05
I20260927 15:06:05.477746 1559 ts_tablet_manager.cc:1939] T 07b63e63f7cd4075bcf10a463ce16e05 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:05.479732 2009 raft_consensus.cc:482] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.479894 2009 raft_consensus.cc:504] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.481045 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "109f9088371e4f008b2b5f993f2b4c3b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:05.481683 1102 leader_election.cc:341] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.484083 2009 leader_election.cc:288] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.485476 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "109f9088371e4f008b2b5f993f2b4c3b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:05.485764 1440 raft_consensus.cc:2454] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:05.486646 1099 leader_election.cc:302] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.487010 2009 raft_consensus.cc:2781] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:05.487093 2009 raft_consensus.cc:482] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:05.487174 2009 raft_consensus.cc:3037] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.494730 1437 raft_consensus.cc:2454] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:05.495198 1559 tablet_replica.cc:330] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:05.495182 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 07b63e63f7cd4075bcf10a463ce16e05 (table default.Table_f1c5c1132cab4343b25f94cd31941336 [id=36810bbe6edd4d769f3f5da76c71e6e2]) successfully deleted
I20260927 15:06:05.495416 1559 raft_consensus.cc:2229] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.495594 1559 raft_consensus.cc:2258] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:05.495738 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f1d7a98ffc4745ac8eeb93012b55d417 because the tablet was not found. No further retry: Not found: Tablet not found: f1d7a98ffc4745ac8eeb93012b55d417
I20260927 15:06:05.496145 1559 ts_tablet_manager.cc:1905] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.501989 1963 tablet.cc:1722] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:05.502871 2074 tablet.cc:1722] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:05.504662 1099 leader_election.cc:302] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.504946 2103 raft_consensus.cc:2781] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:05.505162 2103 raft_consensus.cc:686] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:05.505505 2103 consensus_queue.cc:237] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.509009 1552 tablet_bootstrap.cc:492] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:05.509151 1559 ts_tablet_manager.cc:1918] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.509296 1559 log.cc:1196] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/109f9088371e4f008b2b5f993f2b4c3b
I20260927 15:06:05.509634 1559 ts_tablet_manager.cc:1939] T 109f9088371e4f008b2b5f993f2b4c3b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:05.510638 1559 tablet_replica.cc:330] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:05.510704 1552 tablet_bootstrap.cc:654] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.510949 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 109f9088371e4f008b2b5f993f2b4c3b (table default.Table_5e5da599fcef4b94ac03384faad9c44a [id=807446b6eab74770aa64683a5cf590a9]) successfully deleted
W20260927 15:06:05.511291 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e066308fcdfc49ed926cd81963c5f1a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e066308fcdfc49ed926cd81963c5f1a7 already in progress: creating tablet
I20260927 15:06:05.512169 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d167c390ed546e09f31f1e08988500c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.515231 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81f65ad693894e7c8b575cd8e1942c14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.515786 2009 raft_consensus.cc:504] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.516937 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "109f9088371e4f008b2b5f993f2b4c3b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:05.517583 1102 leader_election.cc:341] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.519269 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 723df898361144aeb16065868885d120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.525218 2009 leader_election.cc:288] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.435101 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 314) took 3149 ms. Trace:
I20260927 15:06:05.527292 1562 rpcz_store.cc:276] 0927 15:06:02.285523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.297228 (+ 11705us) service_pool.cc:227] Handling call
0927 15:06:05.434969 (+3137741us) ts_tablet_manager.cc:1145] Deleting tablet 2c4a123886a847d08b2a94ff5e4e01ca
0927 15:06:05.434979 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.435069 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2970314}
W20260927 15:06:05.527976 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 2c4a123886a847d08b2a94ff5e4e01ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c4a123886a847d08b2a94ff5e4e01ca already in progress: creating tablet
I20260927 15:06:05.528545 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 325) took 3061 ms. Trace:
I20260927 15:06:05.529305 1562 rpcz_store.cc:276] 0927 15:06:02.467379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.470891 (+ 3512us) service_pool.cc:227] Handling call
0927 15:06:05.528368 (+3057477us) ts_tablet_manager.cc:1145] Deleting tablet fd5f2ab9677c4598b0b8d9a93a6a23c7
0927 15:06:05.528383 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.528501 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3057208}
W20260927 15:06:05.529721 1099 leader_election.cc:341] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 109f9088371e4f008b2b5f993f2b4c3b
W20260927 15:06:05.530205 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 already in progress: creating tablet
I20260927 15:06:05.530263 1099 leader_election.cc:302] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:05.532407 2071 consensus_queue.cc:1035] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:05.532841 1559 raft_consensus.cc:2229] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.533277 1559 raft_consensus.cc:2258] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.534437 1559 ts_tablet_manager.cc:1905] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.533068 2009 raft_consensus.cc:2726] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 15:06:05.540968 1552 tablet_bootstrap.cc:492] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:05.541170 1552 ts_tablet_manager.cc:1397] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.004s
W20260927 15:06:05.541254 1099 consensus_peers.cc:487] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67ad68a0adad407a92b2335f43e67227. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:05.542212 1552 raft_consensus.cc:348] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.542495 1552 raft_consensus.cc:374] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.542635 1552 raft_consensus.cc:729] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.542932 1552 consensus_queue.cc:260] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.543678 1552 ts_tablet_manager.cc:1428] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:05.543977 1552 tablet_bootstrap.cc:492] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:05.546039 1552 tablet_bootstrap.cc:654] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.546662 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_27a7140bf7c847d8acb10f2ac4c04bcf" } modify_external_catalogs: true
I20260927 15:06:05.546914 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_27a7140bf7c847d8acb10f2ac4c04bcf" } modify_external_catalogs: true
W20260927 15:06:05.547752 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cad4605da5e045e7969da2d6f56a7e70 consensus state has no leader
I20260927 15:06:05.550004 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_5bc19744aafd42cdb0a1bb656853619b [id=c4ddc66927a94fd2abc8e44012cf69f7]). Expected version 1 got 0
I20260927 15:06:05.550446 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet cad4605da5e045e7969da2d6f56a7e70 (table default.Table_2acab08ececa48aab9e6139d3e031e59 [id=672533238895472b9bfb06706e4b41bb]). Expected version 1 got 0
I20260927 15:06:05.551186 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_281eba53292f402cb45d978e48f00c4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.551820 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_281eba53292f402cb45d978e48f00c4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.553169 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8bba9c3b196c4bb59fa2ef8c1b4945df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.553673 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bba9c3b196c4bb59fa2ef8c1b4945df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.555701 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 331) took 3044 ms. Trace:
I20260927 15:06:05.555879 1562 rpcz_store.cc:276] 0927 15:06:02.510900 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.511002 (+ 102us) service_pool.cc:227] Handling call
0927 15:06:05.555555 (+3044553us) ts_tablet_manager.cc:1145] Deleting tablet cd76c49eda1c4b4ca0edf0f4d2790188
0927 15:06:05.555566 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.555666 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3039129}
W20260927 15:06:05.556488 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet cd76c49eda1c4b4ca0edf0f4d2790188 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd76c49eda1c4b4ca0edf0f4d2790188 already in progress: creating tablet
I20260927 15:06:05.556931 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 339) took 2985 ms. Trace:
I20260927 15:06:05.557108 1562 rpcz_store.cc:276] 0927 15:06:02.571883 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.572041 (+ 158us) service_pool.cc:227] Handling call
0927 15:06:05.556810 (+2984769us) ts_tablet_manager.cc:1145] Deleting tablet 48e7eac8753f425d90302360d228ee54
0927 15:06:05.556819 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.556901 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2982886}
W20260927 15:06:05.557583 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 48e7eac8753f425d90302360d228ee54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48e7eac8753f425d90302360d228ee54 already in progress: creating tablet
I20260927 15:06:05.557979 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 340) took 2978 ms. Trace:
I20260927 15:06:05.558131 1562 rpcz_store.cc:276] 0927 15:06:02.579610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.579793 (+ 183us) service_pool.cc:227] Handling call
0927 15:06:05.557842 (+2978049us) ts_tablet_manager.cc:1145] Deleting tablet c41cd38355e64590b43b2e1271c43e91
0927 15:06:05.557851 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.557933 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2977800}
W20260927 15:06:05.558812 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c41cd38355e64590b43b2e1271c43e91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c41cd38355e64590b43b2e1271c43e91 already in progress: creating tablet
I20260927 15:06:05.559393 1562 tablet_replica.cc:330] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:05.560439 1556 tablet_bootstrap.cc:492] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.560480 1562 raft_consensus.cc:2229] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:05.560695 1556 ts_tablet_manager.cc:1397] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.255s user 0.024s sys 0.015s
I20260927 15:06:05.562021 1556 raft_consensus.cc:348] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.562315 1556 raft_consensus.cc:374] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.562390 1556 raft_consensus.cc:729] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.562633 1556 consensus_queue.cc:260] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.562767 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet cad4605da5e045e7969da2d6f56a7e70 (table default.Table_2acab08ececa48aab9e6139d3e031e59 [id=672533238895472b9bfb06706e4b41bb]). Expected version 1 got 0
I20260927 15:06:05.563045 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_5bc19744aafd42cdb0a1bb656853619b [id=c4ddc66927a94fd2abc8e44012cf69f7]). Expected version 1 got 0
I20260927 15:06:05.563150 1556 ts_tablet_manager.cc:1428] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:05.563274 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet a260c9d3b8fb4316864e6f986559bef1 (table default.Table_b592f94f43ea4ffe8068db6aed19c5ef [id=61c39607ad5b482c80883c0e60f0da9c]). Expected version 1 got 0
I20260927 15:06:05.563519 912 catalog_manager.cc:5495] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:05.563984 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet ba14b7531bb647248572be10d2b43cf2 (table default.Table_bc0cef144e2c48f6883df97308937a76 [id=43c20c5b532545b5b66ad52dc5af5fc2]). Expected version 1 got 0
I20260927 15:06:05.564567 1556 tablet_bootstrap.cc:492] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:05.564939 1552 tablet_bootstrap.cc:492] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:05.565151 1552 ts_tablet_manager.cc:1397] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
I20260927 15:06:05.565996 1552 raft_consensus.cc:348] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.566355 1556 tablet_bootstrap.cc:654] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.566547 1552 raft_consensus.cc:374] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.566848 1552 raft_consensus.cc:729] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.567600 1552 consensus_queue.cc:260] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.568913 1552 ts_tablet_manager.cc:1428] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:05.569388 1552 tablet_bootstrap.cc:492] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:05.571230 1552 tablet_bootstrap.cc:654] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.571385 1556 tablet_bootstrap.cc:492] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.571585 1556 ts_tablet_manager.cc:1397] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260927 15:06:05.572358 1556 raft_consensus.cc:348] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.573218 1556 raft_consensus.cc:374] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.573472 1556 raft_consensus.cc:729] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.574293 1556 consensus_queue.cc:260] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:05.579586 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 454e637ec622424e81a8770c16bbc941 consensus state has no leader
I20260927 15:06:05.573113 1559 ts_tablet_manager.cc:1918] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.579818 1559 log.cc:1196] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/63289edbdd734dd5a817df42d83e422e
W20260927 15:06:05.580096 899 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet cad4605da5e045e7969da2d6f56a7e70 (table default.Table_2acab08ececa48aab9e6139d3e031e59 [id=672533238895472b9bfb06706e4b41bb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cad4605da5e045e7969da2d6f56a7e70 consensus state has no leader
I20260927 15:06:05.580289 1559 ts_tablet_manager.cc:1939] T 63289edbdd734dd5a817df42d83e422e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:05.581776 1559 tablet_replica.cc:330] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:05.582353 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 63289edbdd734dd5a817df42d83e422e (table default.Table_b093eeae2295436bb418ac8610a19dd0 [id=9680ba832c914d98b077951ac46dc2b6]) successfully deleted
W20260927 15:06:05.582608 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8fc1fc04814147d8843aa734fd1794da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fc1fc04814147d8843aa734fd1794da already in progress: creating tablet
W20260927 15:06:05.582815 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 66b54ee47e424aacb7f53fd95b0ce889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66b54ee47e424aacb7f53fd95b0ce889 already in progress: creating tablet
W20260927 15:06:05.583058 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet efa42545da374ca989199433ce1284c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efa42545da374ca989199433ce1284c3 already in progress: creating tablet
W20260927 15:06:05.583279 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3a231aff1a39485db36979208d871ab3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a231aff1a39485db36979208d871ab3 already in progress: creating tablet
I20260927 15:06:05.583899 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 541147938d864cd9ad7208d96533b0f4
I20260927 15:06:05.584794 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 5c0d51b50b414721a255fdde2fe1732f
I20260927 15:06:05.585534 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 289bea546c8a41bf97edfdc9a453a024
I20260927 15:06:05.586966 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 58d6bdc1ac004d889aac36db65afbbbe
I20260927 15:06:05.583158 1556 ts_tablet_manager.cc:1428] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 15:06:05.587774 1556 tablet_bootstrap.cc:492] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:05.588495 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c0d51b50b414721a255fdde2fe1732f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.588723 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 541147938d864cd9ad7208d96533b0f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.588937 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 289bea546c8a41bf97edfdc9a453a024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.589586 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.590566 1556 tablet_bootstrap.cc:654] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.587477 1559 raft_consensus.cc:2229] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.593628 1559 raft_consensus.cc:2258] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.594535 1559 ts_tablet_manager.cc:1905] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.603593 1486 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:06:05.623679 1556 tablet_bootstrap.cc:492] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.625236 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_826c1efeddc74a17ad2db271286974ac [id=67762455acad44448ba24d18c2863816] alter complete (version 3)
I20260927 15:06:05.626091 909 master_service.cc:946] ReplaceTablet: received request to replace tablet cb859b43634c420382da5c201ce24dfc from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:05.589802 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 289bea546c8a41bf97edfdc9a453a024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.589900 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.590103 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c0d51b50b414721a255fdde2fe1732f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.627554 1562 pending_rounds.cc:62] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:05.627647 1562 pending_rounds.cc:68] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976326904532992 op_type: NO_OP noop_request { }
I20260927 15:06:05.628100 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 45b610025b1a4b68bdc34f870654f9d1 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:05.627794 1562 raft_consensus.cc:2866] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:05.628305 1562 raft_consensus.cc:2258] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.630275 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5d328fa614e143f8a058dd36eaf11755" } new_table_name: "default.Table_0c4d630a1b634322b0d6ffdf591dfc97" modify_external_catalogs: true
I20260927 15:06:05.630966 1556 ts_tablet_manager.cc:1397] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.003s
I20260927 15:06:05.578392 2106 tablet.cc:1722] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:05.582086 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet bc971defe6d148439a6a0b8c55d9092e with delete_type TABLET_DATA_DELETED (replaced by tablet 8fc1fc04814147d8843aa734fd1794da) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.586759 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 541147938d864cd9ad7208d96533b0f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.586938 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c0d51b50b414721a255fdde2fe1732f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.587702 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.589890 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 289bea546c8a41bf97edfdc9a453a024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.631839 1559 ts_tablet_manager.cc:1918] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.633751 1559 log.cc:1196] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/e9a7ed6e23e1479a86e2abcf6aa5b317
I20260927 15:06:05.634420 1559 ts_tablet_manager.cc:1939] T e9a7ed6e23e1479a86e2abcf6aa5b317 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:05.634562 1562 ts_tablet_manager.cc:1905] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.632709 1556 raft_consensus.cc:348] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.634970 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet a46e15ea145b4eae8f94b664067b4f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.635083 1556 raft_consensus.cc:374] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.635167 1556 raft_consensus.cc:729] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.635494 1556 consensus_queue.cc:260] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.636116 1556 ts_tablet_manager.cc:1428] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:05.636451 1556 tablet_bootstrap.cc:492] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:05.637055 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d6af061238d5449ba54326f29719fe5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.637778 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6af061238d5449ba54326f29719fe5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.638031 1556 tablet_bootstrap.cc:654] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.639796 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet e9a7ed6e23e1479a86e2abcf6aa5b317 (table default.Table_bbb9f9f890a54220b1065de77e571c1e [id=da0dd555186044f2ac3825b4fbeb645a]) successfully deleted
I20260927 15:06:05.640317 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6bf0172924f44feb8a2467e2ad14781b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.640939 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bf0172924f44feb8a2467e2ad14781b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:05.641865 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 5c0d51b50b414721a255fdde2fe1732f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c0d51b50b414721a255fdde2fe1732f already in progress: creating tablet
W20260927 15:06:05.642764 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 541147938d864cd9ad7208d96533b0f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 541147938d864cd9ad7208d96533b0f4 already in progress: creating tablet
I20260927 15:06:05.642633 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7632e621dc1f45af8d18583654bfd90b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.643178 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7632e621dc1f45af8d18583654bfd90b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.644519 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_eab3b8f9831948c8a78c4484d3911e0c" } modify_external_catalogs: true
I20260927 15:06:05.644713 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_eab3b8f9831948c8a78c4484d3911e0c" } modify_external_catalogs: true
I20260927 15:06:05.634723 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.646445 2119 tablet_replica.cc:330] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:05.646677 2119 raft_consensus.cc:2229] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.646745 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d20ecfc838184a7ebbcaae59355b53e1" } new_table_name: "default.Table_fc15353bc7ae407b85aece886ce4db99" modify_external_catalogs: true
I20260927 15:06:05.647800 1556 tablet_bootstrap.cc:492] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.647917 1556 ts_tablet_manager.cc:1397] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20260927 15:06:05.639797 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5e1d680b47b249bab5ff802cf85872ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.648517 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e1d680b47b249bab5ff802cf85872ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:05.648911 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 289bea546c8a41bf97edfdc9a453a024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 289bea546c8a41bf97edfdc9a453a024 already in progress: creating tablet
I20260927 15:06:05.649030 2119 raft_consensus.cc:2258] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:05.649597 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 58d6bdc1ac004d889aac36db65afbbbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d6bdc1ac004d889aac36db65afbbbe already in progress: creating tablet
I20260927 15:06:05.650440 1556 raft_consensus.cc:348] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.650660 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 377847d06b534883ba2b870ca3317fe0 (table default.Table_1c87fe2a6c1a4e178dc88d4fd8679835 [id=56574e770aa74f04a7bf24b7718e4960]). Expected version 1 got 0
I20260927 15:06:05.650686 2119 ts_tablet_manager.cc:1905] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.652372 1552 tablet_bootstrap.cc:492] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:05.650908 1559 tablet_replica.cc:330] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:05.652495 1552 ts_tablet_manager.cc:1397] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.000s
I20260927 15:06:05.652599 1559 raft_consensus.cc:2229] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.652763 1559 raft_consensus.cc:2258] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.653188 1552 raft_consensus.cc:348] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.653357 1559 ts_tablet_manager.cc:1905] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.655160 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet ba7faf6e79db420db13999d74fe86062 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.653540 1556 raft_consensus.cc:374] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.655354 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d6d1cfb1a4d4c439e970d966af841b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:57 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.656757 1552 raft_consensus.cc:374] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.656780 1556 raft_consensus.cc:729] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.656914 1552 raft_consensus.cc:729] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.657117 1556 consensus_queue.cc:260] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.657161 1552 consensus_queue.cc:260] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.657943 1552 ts_tablet_manager.cc:1428] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:05.658080 1556 ts_tablet_manager.cc:1428] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260927 15:06:05.659091 1552 tablet_bootstrap.cc:492] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:05.663143 1556 tablet_bootstrap.cc:492] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:05.664958 1556 tablet_bootstrap.cc:654] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.666033 2094 raft_consensus.cc:482] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.666168 2094 raft_consensus.cc:504] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.666805 2094 leader_election.cc:288] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.598182 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 541147938d864cd9ad7208d96533b0f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:05.667495 1239 leader_election.cc:341] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: ba7faf6e79db420db13999d74fe86062
W20260927 15:06:05.667912 1238 leader_election.cc:341] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ba7faf6e79db420db13999d74fe86062
I20260927 15:06:05.668084 1238 leader_election.cc:302] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:05.668490 2094 raft_consensus.cc:2726] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:05.675922 1561 tablet_bootstrap.cc:492] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:05.676095 1561 ts_tablet_manager.cc:1397] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.212s user 0.016s sys 0.019s
I20260927 15:06:05.676805 1561 raft_consensus.cc:348] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.677022 1561 raft_consensus.cc:374] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.677083 1561 raft_consensus.cc:729] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.677304 1561 consensus_queue.cc:260] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.677891 1561 ts_tablet_manager.cc:1428] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:05.678664 1561 tablet_bootstrap.cc:492] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:05.679241 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_303a13aa2672477ebf8bf526bc854047"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:05.680375 1561 tablet_bootstrap.cc:654] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:05.682364 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_303a13aa2672477ebf8bf526bc854047 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.683619 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0e6e3600cbf741419bc7b93eec42eb13
I20260927 15:06:05.684585 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e6e3600cbf741419bc7b93eec42eb13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.685936 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_22c0d3e744ba48aea839eee1f067df2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:05.686685 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c9e4311049d47d3b2f1e117795624ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:05.687364 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22c0d3e744ba48aea839eee1f067df2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:05.688344 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd2687f65780481c86a9942960ce7be1 consensus state has no leader
I20260927 15:06:05.691426 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e6e3600cbf741419bc7b93eec42eb13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.692325 1561 tablet_bootstrap.cc:492] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:05.692473 1561 ts_tablet_manager.cc:1397] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260927 15:06:05.670686 1559 ts_tablet_manager.cc:1918] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.692659 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e6e3600cbf741419bc7b93eec42eb13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.692710 1559 log.cc:1196] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/a46e15ea145b4eae8f94b664067b4f92
I20260927 15:06:05.693156 1559 ts_tablet_manager.cc:1939] T a46e15ea145b4eae8f94b664067b4f92 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:05.695235 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet a46e15ea145b4eae8f94b664067b4f92 (table default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20 [id=3fea2c5530204bb9ada53551032065b7]) successfully deleted
W20260927 15:06:05.696247 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 07b63e63f7cd4075bcf10a463ce16e05 because the tablet was not found. No further retry: Not found: Tablet not found: 07b63e63f7cd4075bcf10a463ce16e05
I20260927 15:06:05.696286 1562 ts_tablet_manager.cc:1918] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:05.696396 1562 log.cc:1196] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/ab08d04c11dd44299ee5f9a911d581c3
I20260927 15:06:05.696604 1561 raft_consensus.cc:348] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.697046 1561 raft_consensus.cc:374] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.697312 1559 tablet_replica.cc:330] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:05.697496 1561 raft_consensus.cc:729] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.698025 1559 raft_consensus.cc:2229] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.698439 1561 consensus_queue.cc:260] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.699143 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c160b8f77fd948d783d82f95625ff38c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:05.699613 1559 raft_consensus.cc:2258] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:05.699641 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c160b8f77fd948d783d82f95625ff38c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.700232 1561 ts_tablet_manager.cc:1428] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260927 15:06:05.700960 1559 ts_tablet_manager.cc:1905] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.701514 906 master_service.cc:946] ReplaceTablet: received request to replace tablet ea3220df595848258d0f53fa941b2beb from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:05.702420 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ed661692282c45d28295246e14c25bc2" } new_table_name: "default.Table_26486391140d4bc0922b79f92fbd5dce" modify_external_catalogs: true
I20260927 15:06:05.702682 1561 tablet_bootstrap.cc:492] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:05.704945 1556 tablet_bootstrap.cc:492] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.707050 1556 ts_tablet_manager.cc:1397] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.005s
I20260927 15:06:05.707831 1556 raft_consensus.cc:348] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.708101 1556 raft_consensus.cc:374] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.708216 1556 raft_consensus.cc:729] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.708479 1556 consensus_queue.cc:260] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.709069 1556 ts_tablet_manager.cc:1428] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:05.710116 1556 tablet_bootstrap.cc:492] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:05.696820 1562 ts_tablet_manager.cc:1939] T ab08d04c11dd44299ee5f9a911d581c3 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:05.711709 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 343) took 2754 ms. Trace:
I20260927 15:06:05.712308 1556 tablet_bootstrap.cc:654] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.716764 1562 rpcz_store.cc:276] 0927 15:06:02.957573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:02.958153 (+ 580us) service_pool.cc:227] Handling call
0927 15:06:05.559294 (+2601141us) ts_tablet_manager.cc:1145] Deleting tablet ab08d04c11dd44299ee5f9a911d581c3
0927 15:06:05.559307 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.666321 (+107014us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.694497 (+ 28176us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.711673 (+ 17176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2600696}
W20260927 15:06:05.721053 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4470df4cd407401ab03b6f62452c0dc7 has no consensus state
I20260927 15:06:05.723069 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet ab08d04c11dd44299ee5f9a911d581c3 (table default.Table_f1b5de8ecfe842e69ba40febba9c6ee1 [id=7f171341d8ee4ed68a7d8a4fc3e7ecb0]) successfully deleted
I20260927 15:06:05.723937 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 356) took 2481 ms. Trace:
I20260927 15:06:05.725719 1561 tablet_bootstrap.cc:654] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.727697 1556 tablet_bootstrap.cc:492] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.727919 1556 ts_tablet_manager.cc:1397] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260927 15:06:05.728681 1556 raft_consensus.cc:348] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.729035 1556 raft_consensus.cc:374] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.729168 1556 raft_consensus.cc:729] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.729460 1556 consensus_queue.cc:260] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.726404 1562 rpcz_store.cc:276] 0927 15:06:03.242523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.242592 (+ 69us) service_pool.cc:227] Handling call
0927 15:06:05.723738 (+2481146us) ts_tablet_manager.cc:1145] Deleting tablet 9598ac8a916f4bf5b1cf9995a8149c70
0927 15:06:05.723749 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.723905 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2480860}
I20260927 15:06:05.730248 1556 ts_tablet_manager.cc:1428] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:05.730384 1562 tablet_replica.cc:330] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:06:05.730454 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9598ac8a916f4bf5b1cf9995a8149c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9598ac8a916f4bf5b1cf9995a8149c70 already in progress: creating tablet
I20260927 15:06:05.706825 2119 ts_tablet_manager.cc:1918] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.730644 2119 log.cc:1196] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/bc971defe6d148439a6a0b8c55d9092e
I20260927 15:06:05.730652 1562 raft_consensus.cc:2229] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.731110 2119 ts_tablet_manager.cc:1939] T bc971defe6d148439a6a0b8c55d9092e P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:05.732117 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet bc971defe6d148439a6a0b8c55d9092e (table default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]) successfully deleted
I20260927 15:06:05.716524 1552 tablet_bootstrap.cc:654] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.733146 1562 raft_consensus.cc:2258] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.733587 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 8f4bd8182c9d48c7b6e6175ab98d405a from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:05.734820 1562 ts_tablet_manager.cc:1905] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.737798 1556 tablet_bootstrap.cc:492] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:05.740530 1556 tablet_bootstrap.cc:654] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:05.741238 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 541147938d864cd9ad7208d96533b0f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 541147938d864cd9ad7208d96533b0f4 already in progress: creating tablet
W20260927 15:06:05.742750 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 5c0d51b50b414721a255fdde2fe1732f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c0d51b50b414721a255fdde2fe1732f already in progress: creating tablet
W20260927 15:06:05.743440 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 58d6bdc1ac004d889aac36db65afbbbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d6bdc1ac004d889aac36db65afbbbe already in progress: creating tablet
W20260927 15:06:05.744313 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 289bea546c8a41bf97edfdc9a453a024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 289bea546c8a41bf97edfdc9a453a024 already in progress: creating tablet
I20260927 15:06:05.745124 2119 tablet_replica.cc:330] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:05.745575 2119 raft_consensus.cc:2229] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.746454 2119 raft_consensus.cc:2258] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.748229 909 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 988ae3a67a4b436583cb475fbcf07b8f (table default.Table_d20ecfc838184a7ebbcaae59355b53e1 [id=19258732f721448fadcdb38690160dd4]). Expected version 1 got 0
I20260927 15:06:05.748514 909 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]). Expected version 4 got 0
I20260927 15:06:05.749007 1559 ts_tablet_manager.cc:1918] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:05.749157 1559 log.cc:1196] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/0e6e3600cbf741419bc7b93eec42eb13
I20260927 15:06:05.749583 1559 ts_tablet_manager.cc:1939] T 0e6e3600cbf741419bc7b93eec42eb13 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:05.749720 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 988ae3a67a4b436583cb475fbcf07b8f consensus state has no leader
I20260927 15:06:05.750509 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 0e6e3600cbf741419bc7b93eec42eb13 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]) successfully deleted
I20260927 15:06:05.751044 2119 ts_tablet_manager.cc:1905] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.751271 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b452a2bdaeb9412b8372f173d1cd27dc" } new_table_name: "default.Table_24cb81a378f04185be135842bae6db54" modify_external_catalogs: true
I20260927 15:06:05.751751 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]). Expected version 4 got 0
I20260927 15:06:05.752045 907 catalog_manager.cc:5495] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:05.752480 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet a260c9d3b8fb4316864e6f986559bef1 (table default.Table_b592f94f43ea4ffe8068db6aed19c5ef [id=61c39607ad5b482c80883c0e60f0da9c]). Expected version 1 got 0
I20260927 15:06:05.753449 1561 tablet_bootstrap.cc:492] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:05.753633 1561 ts_tablet_manager.cc:1397] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20260927 15:06:05.754307 1561 raft_consensus.cc:348] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.754586 1561 raft_consensus.cc:374] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.754666 1561 raft_consensus.cc:729] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.754923 1561 consensus_queue.cc:260] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.755472 1561 ts_tablet_manager.cc:1428] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:05.755887 1561 tablet_bootstrap.cc:492] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:05.756650 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 6d05f7db323e40b780b050b560e1c846 (DEFAULT_TABLE table=default.Table_c5c7a3c4978a4100b3e643bcbb8e6b70 [id=6fe2593b379947a6ae019e3de2628c4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.757057 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d05f7db323e40b780b050b560e1c846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.757177 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 6d05f7db323e40b780b050b560e1c846 (DEFAULT_TABLE table=default.Table_c5c7a3c4978a4100b3e643bcbb8e6b70 [id=6fe2593b379947a6ae019e3de2628c4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.757802 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 6d05f7db323e40b780b050b560e1c846 (DEFAULT_TABLE table=default.Table_c5c7a3c4978a4100b3e643bcbb8e6b70 [id=6fe2593b379947a6ae019e3de2628c4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.758105 1212 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:06:05.758188 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d05f7db323e40b780b050b560e1c846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.759632 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 5b1fe1a561d04185a3703b8ec2e9ccf6 (DEFAULT_TABLE table=default.Table_56be64a6763e44c0aa51e5715a9a67e1 [id=9739637cce574bc19086444ad95cbfaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.760000 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b1fe1a561d04185a3703b8ec2e9ccf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.764681 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 45b610025b1a4b68bdc34f870654f9d1
I20260927 15:06:05.765055 912 catalog_manager.cc:6565] ReplaceTablet: tablet 45b610025b1a4b68bdc34f870654f9d1 deleted and replaced by tablet 96ac92258c6044a891b3325b7aaf3b8f
I20260927 15:06:05.765360 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 5b1fe1a561d04185a3703b8ec2e9ccf6 (DEFAULT_TABLE table=default.Table_56be64a6763e44c0aa51e5715a9a67e1 [id=9739637cce574bc19086444ad95cbfaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.765753 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b1fe1a561d04185a3703b8ec2e9ccf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.766038 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d05f7db323e40b780b050b560e1c846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.767237 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 5b1fe1a561d04185a3703b8ec2e9ccf6 (DEFAULT_TABLE table=default.Table_56be64a6763e44c0aa51e5715a9a67e1 [id=9739637cce574bc19086444ad95cbfaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.767570 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b1fe1a561d04185a3703b8ec2e9ccf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.767673 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 9363b28f91804bb2a8667e0b107499a2 (DEFAULT_TABLE table=default.Table_6c4c26664bee4787987ec6c3e462d871 [id=25ee63d8efe94fe9baf80c38bec6efa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.768023 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9363b28f91804bb2a8667e0b107499a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.771386 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 7a9c96abcfd347a9881b99df093da490 (DEFAULT_TABLE table=default.Table_abf58979f24a466485e0b343a6a3feac [id=856a68d57ffa42018c7114cd3d569d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.771494 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 4470df4cd407401ab03b6f62452c0dc7 (DEFAULT_TABLE table=default.Table_26486391140d4bc0922b79f92fbd5dce [id=d6ef3ff68e3648f38f06a22ed2a6e959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.771770 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a9c96abcfd347a9881b99df093da490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.772001 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 9363b28f91804bb2a8667e0b107499a2 (DEFAULT_TABLE table=default.Table_6c4c26664bee4787987ec6c3e462d871 [id=25ee63d8efe94fe9baf80c38bec6efa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.772356 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9363b28f91804bb2a8667e0b107499a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.773639 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 9363b28f91804bb2a8667e0b107499a2 (DEFAULT_TABLE table=default.Table_6c4c26664bee4787987ec6c3e462d871 [id=25ee63d8efe94fe9baf80c38bec6efa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.774076 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9363b28f91804bb2a8667e0b107499a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.774966 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 45b610025b1a4b68bdc34f870654f9d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 96ac92258c6044a891b3325b7aaf3b8f) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.775310 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 7a9c96abcfd347a9881b99df093da490 (DEFAULT_TABLE table=default.Table_abf58979f24a466485e0b343a6a3feac [id=856a68d57ffa42018c7114cd3d569d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.776065 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a9c96abcfd347a9881b99df093da490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.777590 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 7a9c96abcfd347a9881b99df093da490 (DEFAULT_TABLE table=default.Table_abf58979f24a466485e0b343a6a3feac [id=856a68d57ffa42018c7114cd3d569d23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.777944 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a9c96abcfd347a9881b99df093da490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.779325 1561 tablet_bootstrap.cc:654] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:05.779618 2006 raft_consensus.cc:482] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.780165 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6523d56f344208abc30f0d82138998 (DEFAULT_TABLE table=default.Table_ddb5bec424b947abba941419a9136bdc [id=a6a404910b2247fa9cdca76d4e9a183d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.780175 2006 raft_consensus.cc:504] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.780488 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6523d56f344208abc30f0d82138998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.780769 2006 leader_election.cc:288] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.781236 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_5bc19744aafd42cdb0a1bb656853619b [id=c4ddc66927a94fd2abc8e44012cf69f7] alter complete (version 1)
I20260927 15:06:05.781194 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 4470df4cd407401ab03b6f62452c0dc7 (DEFAULT_TABLE table=default.Table_26486391140d4bc0922b79f92fbd5dce [id=d6ef3ff68e3648f38f06a22ed2a6e959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.781570 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4470df4cd407401ab03b6f62452c0dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.782557 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cad4605da5e045e7969da2d6f56a7e70" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:05.782871 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 45b610025b1a4b68bdc34f870654f9d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 96ac92258c6044a891b3325b7aaf3b8f) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:05.783274 1102 leader_election.cc:341] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.785408 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 4470df4cd407401ab03b6f62452c0dc7 (DEFAULT_TABLE table=default.Table_26486391140d4bc0922b79f92fbd5dce [id=d6ef3ff68e3648f38f06a22ed2a6e959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.785744 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4470df4cd407401ab03b6f62452c0dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.778551 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 643ec85d098444d6b082fe4038c50c4d (DEFAULT_TABLE table=default.Table_188aafdea09e48319c0cdf8b390d1e3f [id=54147d46ad094905902131da9b76f02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.787140 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 643ec85d098444d6b082fe4038c50c4d (DEFAULT_TABLE table=default.Table_188aafdea09e48319c0cdf8b390d1e3f [id=54147d46ad094905902131da9b76f02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.787626 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 643ec85d098444d6b082fe4038c50c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.781968 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cad4605da5e045e7969da2d6f56a7e70" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:05.788547 1437 raft_consensus.cc:2454] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:05.789093 1099 leader_election.cc:302] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.789436 2006 raft_consensus.cc:2781] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:05.789535 2006 raft_consensus.cc:482] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:05.789669 2006 raft_consensus.cc:3037] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.791010 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 45b610025b1a4b68bdc34f870654f9d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 96ac92258c6044a891b3325b7aaf3b8f) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.791352 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6523d56f344208abc30f0d82138998 (DEFAULT_TABLE table=default.Table_ddb5bec424b947abba941419a9136bdc [id=a6a404910b2247fa9cdca76d4e9a183d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.791685 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6523d56f344208abc30f0d82138998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.793434 2006 raft_consensus.cc:504] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.794356 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cad4605da5e045e7969da2d6f56a7e70" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:05.794910 1102 leader_election.cc:341] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:05.795007 1562 ts_tablet_manager.cc:1918] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.7
I20260927 15:06:05.795132 1562 log.cc:1196] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/82f6cfd9f4c0424d86df223b0eaab4f7
I20260927 15:06:05.795073 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 0e34a679010b4b4fa3a76aec5ae05db4 (DEFAULT_TABLE table=default.Table_dadef58d086c4d76835d468c68898f6b [id=176c92ae344840c39a1c522c7887875e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.795393 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e34a679010b4b4fa3a76aec5ae05db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.795629 2006 leader_election.cc:288] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:05.795609 1562 ts_tablet_manager.cc:1939] T 82f6cfd9f4c0424d86df223b0eaab4f7 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:05.796554 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 357) took 2547 ms. Trace:
I20260927 15:06:05.796643 1562 rpcz_store.cc:276] 0927 15:06:03.249127 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.249311 (+ 184us) service_pool.cc:227] Handling call
0927 15:06:05.730322 (+2481011us) ts_tablet_manager.cc:1145] Deleting tablet 82f6cfd9f4c0424d86df223b0eaab4f7
0927 15:06:05.730334 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.738542 (+ 8208us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.794899 (+ 56357us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.796506 (+ 1607us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2480774}
I20260927 15:06:05.796939 1562 tablet_replica.cc:330] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:05.797143 1562 raft_consensus.cc:2229] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.797303 1562 raft_consensus.cc:2258] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.797540 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 643ec85d098444d6b082fe4038c50c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.797789 1562 ts_tablet_manager.cc:1905] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.800418 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 480e3d9b3d31443fad163542c6681110 (DEFAULT_TABLE table=default.Table_4fb14661edfd40989eb155bc053dab72 [id=dfbcaff0f38444e8ad0ea4ebe6932caf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.800756 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480e3d9b3d31443fad163542c6681110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.803799 1562 ts_tablet_manager.cc:1918] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:05.803910 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8d8d19b1fbfc4a4a8ec451b4af3cf646" } modify_external_catalogs: true
I20260927 15:06:05.804147 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8d8d19b1fbfc4a4a8ec451b4af3cf646" } modify_external_catalogs: true
I20260927 15:06:05.804270 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b41934087f854d64a321278e59bf95ed" } new_table_name: "default.Table_fb84ec6d634043ce8005943e925ef9fd" modify_external_catalogs: true
I20260927 15:06:05.804754 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_af3d6c72bfa14a6d8f04be3fb4a72235" } modify_external_catalogs: true
I20260927 15:06:05.804916 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_af3d6c72bfa14a6d8f04be3fb4a72235" } modify_external_catalogs: true
I20260927 15:06:05.805436 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c46b2f0f6ed04caab359a17bf48da08a" } modify_external_catalogs: true
I20260927 15:06:05.805601 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c46b2f0f6ed04caab359a17bf48da08a" } modify_external_catalogs: true
I20260927 15:06:05.805671 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_59fba975ee904a36b51d48dcc5c0816a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.806250 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59fba975ee904a36b51d48dcc5c0816a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.805459 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 0e6e3600cbf741419bc7b93eec42eb13 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:05.806764 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a231aff1a39485db36979208d871ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.806912 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 480e3d9b3d31443fad163542c6681110 (DEFAULT_TABLE table=default.Table_4fb14661edfd40989eb155bc053dab72 [id=dfbcaff0f38444e8ad0ea4ebe6932caf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.807349 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_565f7d1851f74565b073c0e1c74d9403" } modify_external_catalogs: true
I20260927 15:06:05.807509 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_565f7d1851f74565b073c0e1c74d9403" } modify_external_catalogs: true
I20260927 15:06:05.807749 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480e3d9b3d31443fad163542c6681110. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:05.808722 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0a71cf0ee554b3eafca3f054cc16b28 consensus state has no leader
I20260927 15:06:05.809623 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 82f6cfd9f4c0424d86df223b0eaab4f7 (table default.Table_177f5eb468964182a1cb169bf4816efc [id=861d1dea54204625a6d1ad99fb8f6873]) successfully deleted
I20260927 15:06:05.809094 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4470df4cd407401ab03b6f62452c0dc7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:05.814035 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f8744e2349e49d3a821eca42c7f89a2 consensus state has no leader
I20260927 15:06:05.810005 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6523d56f344208abc30f0d82138998 (DEFAULT_TABLE table=default.Table_ddb5bec424b947abba941419a9136bdc [id=a6a404910b2247fa9cdca76d4e9a183d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.815104 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6523d56f344208abc30f0d82138998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.815045 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cad4605da5e045e7969da2d6f56a7e70" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:05.820464 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 988ae3a67a4b436583cb475fbcf07b8f (table default.Table_fc15353bc7ae407b85aece886ce4db99 [id=19258732f721448fadcdb38690160dd4]). Expected version 2 got 0
I20260927 15:06:05.810280 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 0e34a679010b4b4fa3a76aec5ae05db4 (DEFAULT_TABLE table=default.Table_dadef58d086c4d76835d468c68898f6b [id=176c92ae344840c39a1c522c7887875e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.810631 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 480e3d9b3d31443fad163542c6681110 (DEFAULT_TABLE table=default.Table_4fb14661edfd40989eb155bc053dab72 [id=dfbcaff0f38444e8ad0ea4ebe6932caf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.810885 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 109f9088371e4f008b2b5f993f2b4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.821221 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e34a679010b4b4fa3a76aec5ae05db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.822033 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480e3d9b3d31443fad163542c6681110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.822849 1437 raft_consensus.cc:3037] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:05.827898 1559 tablet_replica.cc:330] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:05.811218 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 643ec85d098444d6b082fe4038c50c4d (DEFAULT_TABLE table=default.Table_188aafdea09e48319c0cdf8b390d1e3f [id=54147d46ad094905902131da9b76f02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.828125 1559 raft_consensus.cc:2229] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:05.831367 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 45b610025b1a4b68bdc34f870654f9d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45b610025b1a4b68bdc34f870654f9d1 already in progress: creating tablet
I20260927 15:06:05.832955 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 424b66c69254487f932894516d570204
I20260927 15:06:05.828315 1559 raft_consensus.cc:2258] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.836591 1271 tablet_service.cc:1514] Processing DeleteTablet for tablet 424b66c69254487f932894516d570204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.835516 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 424b66c69254487f932894516d570204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.833678 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 0e34a679010b4b4fa3a76aec5ae05db4 (DEFAULT_TABLE table=default.Table_dadef58d086c4d76835d468c68898f6b [id=176c92ae344840c39a1c522c7887875e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.837527 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e34a679010b4b4fa3a76aec5ae05db4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.837646 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 2bb9540030834895ac069a0d516d7ee4 (DEFAULT_TABLE table=default.Table_c160b8f77fd948d783d82f95625ff38c [id=536558521cdc4bf4b7d815fc912d6895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.838544 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bb9540030834895ac069a0d516d7ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.839166 1559 ts_tablet_manager.cc:1905] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.840867 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet e066308fcdfc49ed926cd81963c5f1a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.841096 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 42baac8b7d47433e826eb3bc1980acaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.841259 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b2d2501a9f764790818426665e7f0340
I20260927 15:06:05.841450 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet fde632b187eb4180b343d7bddc7f0943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.841578 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5af5df58824fe88d607a93216bd228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.841318 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a97f72ddef5346c297d73589e926260c
I20260927 15:06:05.843740 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b44e2611d2bf40ae90c4fd857225e39e
I20260927 15:06:05.844383 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet a97f72ddef5346c297d73589e926260c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.844669 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_742e2e6361fc4669971abfa8d7a436a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.845289 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_742e2e6361fc4669971abfa8d7a436a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.845884 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet b44e2611d2bf40ae90c4fd857225e39e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.846489 1552 tablet_bootstrap.cc:492] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:05.848001 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 643ec85d098444d6b082fe4038c50c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.848675 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet b44e2611d2bf40ae90c4fd857225e39e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.848881 1437 raft_consensus.cc:2454] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:05.850935 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d2501a9f764790818426665e7f0340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:05.852154 1556 tablet_bootstrap.cc:492] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:05.852494 1556 ts_tablet_manager.cc:1397] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.003s
I20260927 15:06:05.853899 1556 raft_consensus.cc:348] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.854681 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5af5df58824fe88d607a93216bd228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.854977 1562 log.cc:1196] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/3d454d65afa94aac9b34c253adfa4b0c
I20260927 15:06:05.855645 1562 ts_tablet_manager.cc:1939] T 3d454d65afa94aac9b34c253adfa4b0c P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:05.856456 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 358) took 2607 ms. Trace:
I20260927 15:06:05.857000 1562 rpcz_store.cc:276] 0927 15:06:03.249247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.251736 (+ 2489us) service_pool.cc:227] Handling call
0927 15:06:05.796872 (+2545136us) ts_tablet_manager.cc:1145] Deleting tablet 3d454d65afa94aac9b34c253adfa4b0c
0927 15:06:05.796881 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.800613 (+ 3732us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.803689 (+ 3076us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:05.856415 (+ 52726us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2544914}
I20260927 15:06:05.857375 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 359) took 2596 ms. Trace:
I20260927 15:06:05.857471 1099 leader_election.cc:302] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:05.863124 1562 rpcz_store.cc:276] 0927 15:06:03.260652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.260889 (+ 237us) service_pool.cc:227] Handling call
0927 15:06:05.857255 (+2596366us) ts_tablet_manager.cc:1145] Deleting tablet 3efc44686be2407cbcdca61909301539
0927 15:06:05.857264 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.857351 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2596116}
I20260927 15:06:05.863536 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 360) took 2602 ms. Trace:
I20260927 15:06:05.864037 1562 rpcz_store.cc:276] 0927 15:06:03.260809 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.261205 (+ 396us) service_pool.cc:227] Handling call
0927 15:06:05.863401 (+2602196us) ts_tablet_manager.cc:1145] Deleting tablet 28f6bef5f000441090f73eb842450362
0927 15:06:05.863410 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.863507 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2602002}
I20260927 15:06:05.864312 1562 tablet_replica.cc:330] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:05.864871 1562 raft_consensus.cc:2229] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:05.865209 2006 raft_consensus.cc:2781] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:05.866983 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 8448b281a9d14e3eb681e18889ca6369 (DEFAULT_TABLE table=default.Table_29e962b1033e4710bf2fde659683678e [id=3ef41eb563204774ad94aa9bf2d8d914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.865525 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 424b66c69254487f932894516d570204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.867825 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 929425d7dab14084acef649e54a9b32b (DEFAULT_TABLE table=default.Table_22c0d3e744ba48aea839eee1f067df2c [id=5a81db4902ef46e6b9c22adba0984bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.867911 1556 raft_consensus.cc:374] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.869220 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet a97f72ddef5346c297d73589e926260c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.869802 1556 raft_consensus.cc:729] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.869828 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 34348cffe35b46728e77df7dede29682 (DEFAULT_TABLE table=default.Table_6bf0172924f44feb8a2467e2ad14781b [id=6cedfa7e39f14b6a8ce009633972d95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.871093 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 53ddb28f419d42afbaddf36966fa1509 (DEFAULT_TABLE table=default.Table_281eba53292f402cb45d978e48f00c4e [id=414b6c942453455ab541f7e08c7e1c73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.871534 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet fde632b187eb4180b343d7bddc7f0943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.871568 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet a97f72ddef5346c297d73589e926260c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.866123 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d2501a9f764790818426665e7f0340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.873194 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 96ac92258c6044a891b3325b7aaf3b8f (DEFAULT_TABLE table=default.Table_fdbd726355df419fae94cbf8fce53375 [id=f6284e29d38143b38fc421ab5c09538c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.874155 2006 raft_consensus.cc:686] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:05.874246 1562 raft_consensus.cc:2258] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:05.874446 2006 consensus_queue.cc:237] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.876143 1562 ts_tablet_manager.cc:1905] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:05.878378 1271 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d2501a9f764790818426665e7f0340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:05.879565 1552 ts_tablet_manager.cc:1397] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.188s user 0.005s sys 0.001s
I20260927 15:06:05.881268 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 2bb9540030834895ac069a0d516d7ee4 (DEFAULT_TABLE table=default.Table_c160b8f77fd948d783d82f95625ff38c [id=536558521cdc4bf4b7d815fc912d6895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.880891 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 21651dc1231c4faf9053a465a1874092 (DEFAULT_TABLE table=default.Table_d6af061238d5449ba54326f29719fe5c [id=d1f70a989c3645b29c4da5fad4934a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.884542 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bb9540030834895ac069a0d516d7ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.884675 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 2bb9540030834895ac069a0d516d7ee4 (DEFAULT_TABLE table=default.Table_c160b8f77fd948d783d82f95625ff38c [id=536558521cdc4bf4b7d815fc912d6895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.885385 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8448b281a9d14e3eb681e18889ca6369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.885694 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 34348cffe35b46728e77df7dede29682 (DEFAULT_TABLE table=default.Table_6bf0172924f44feb8a2467e2ad14781b [id=6cedfa7e39f14b6a8ce009633972d95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.886157 1561 tablet_bootstrap.cc:492] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:05.886287 1561 ts_tablet_manager.cc:1397] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.130s user 0.008s sys 0.005s
I20260927 15:06:05.887491 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21651dc1231c4faf9053a465a1874092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.889991 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 8448b281a9d14e3eb681e18889ca6369 (DEFAULT_TABLE table=default.Table_29e962b1033e4710bf2fde659683678e [id=3ef41eb563204774ad94aa9bf2d8d914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.894171 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 53ddb28f419d42afbaddf36966fa1509 (DEFAULT_TABLE table=default.Table_281eba53292f402cb45d978e48f00c4e [id=414b6c942453455ab541f7e08c7e1c73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.895234 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34348cffe35b46728e77df7dede29682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.897042 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53ddb28f419d42afbaddf36966fa1509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.896777 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 929425d7dab14084acef649e54a9b32b (DEFAULT_TABLE table=default.Table_22c0d3e744ba48aea839eee1f067df2c [id=5a81db4902ef46e6b9c22adba0984bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.897360 1279 tablet_service.cc:1467] Processing CreateTablet for tablet c74dfa20ed9a4eb197a846b62d859146 (DEFAULT_TABLE table=default.Table_303a13aa2672477ebf8bf526bc854047 [id=f2353596e013449e927adc65861570e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.897670 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8448b281a9d14e3eb681e18889ca6369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.898595 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 53ddb28f419d42afbaddf36966fa1509 (DEFAULT_TABLE table=default.Table_281eba53292f402cb45d978e48f00c4e [id=414b6c942453455ab541f7e08c7e1c73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.899351 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8f3f5117c7a949e59bf75560bbec6325"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:05.899519 1556 consensus_queue.cc:260] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:05.899906 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f3f5117c7a949e59bf75560bbec6325 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.900971 2076 raft_consensus.cc:482] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.901119 2076 raft_consensus.cc:504] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.901397 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 929425d7dab14084acef649e54a9b32b (DEFAULT_TABLE table=default.Table_22c0d3e744ba48aea839eee1f067df2c [id=5a81db4902ef46e6b9c22adba0984bb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.901751 2076 leader_election.cc:288] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:05.903268 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b6e5f1f761934a87b742fc501fea7048"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.904112 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6e5f1f761934a87b742fc501fea7048 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.904114 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_539b633d448c40e6bc9134a8ab4dd16f" } modify_external_catalogs: true
I20260927 15:06:05.905416 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_539b633d448c40e6bc9134a8ab4dd16f" } modify_external_catalogs: true
I20260927 15:06:05.906073 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_577464bde8c2424da3403e8f3a06ca36" } new_table_name: "default.Table_b63a429933e047478bdd814d02fa6d5a" modify_external_catalogs: true
I20260927 15:06:05.906447 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3b207b7b6ab747b7a2e504f26bcf201d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:05.906914 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988ae3a67a4b436583cb475fbcf07b8f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:05.907675 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet b44e2611d2bf40ae90c4fd857225e39e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:05.907814 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b207b7b6ab747b7a2e504f26bcf201d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.907109 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 9b14f02426df4839b98f012042d8ee9b (DEFAULT_TABLE table=default.Table_5e1d680b47b249bab5ff802cf85872ed [id=1d30b1e6fe97477393c91515d5115984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.908739 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 8448b281a9d14e3eb681e18889ca6369 (DEFAULT_TABLE table=default.Table_29e962b1033e4710bf2fde659683678e [id=3ef41eb563204774ad94aa9bf2d8d914]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.909145 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 96ac92258c6044a891b3325b7aaf3b8f (DEFAULT_TABLE table=default.Table_fdbd726355df419fae94cbf8fce53375 [id=f6284e29d38143b38fc421ab5c09538c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.910162 1164 raft_consensus.cc:2454] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:05.910712 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ab38ee49123642b6b2546b1eca782405"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:05.911540 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929425d7dab14084acef649e54a9b32b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:05.911530 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab38ee49123642b6b2546b1eca782405 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.911818 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b14f02426df4839b98f012042d8ee9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.911105 1561 raft_consensus.cc:348] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.914083 1140 tablet_service.cc:1467] Processing CreateTablet for tablet c74dfa20ed9a4eb197a846b62d859146 (DEFAULT_TABLE table=default.Table_303a13aa2672477ebf8bf526bc854047 [id=f2353596e013449e927adc65861570e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.915793 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 59de157335d8475e9e44db8f1d040bb2 (DEFAULT_TABLE table=default.Table_59fba975ee904a36b51d48dcc5c0816a [id=508c3e81dd27448eb134ee2f2657ae89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.915985 1409 tablet_service.cc:1467] Processing CreateTablet for tablet c74dfa20ed9a4eb197a846b62d859146 (DEFAULT_TABLE table=default.Table_303a13aa2672477ebf8bf526bc854047 [id=f2353596e013449e927adc65861570e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.916527 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ac92258c6044a891b3325b7aaf3b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.918159 1561 raft_consensus.cc:374] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.918794 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 3d454d65afa94aac9b34c253adfa4b0c (table default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]) successfully deleted
W20260927 15:06:05.919049 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 3efc44686be2407cbcdca61909301539 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3efc44686be2407cbcdca61909301539 already in progress: creating tablet
I20260927 15:06:05.919201 2076 raft_consensus.cc:482] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:05.919247 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 28f6bef5f000441090f73eb842450362 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28f6bef5f000441090f73eb842450362 already in progress: creating tablet
I20260927 15:06:05.920377 1561 raft_consensus.cc:729] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.920626 1561 consensus_queue.cc:260] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.921280 1411 tablet_service.cc:1467] Processing CreateTablet for tablet f1ad3b9d5f8244c99a01f5951007e1fd (DEFAULT_TABLE table=default.Table_7632e621dc1f45af8d18583654bfd90b [id=726120b4baf7415dabae409509b01996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.922161 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c74dfa20ed9a4eb197a846b62d859146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.922434 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1f61faf056bc40f6bda21f355e152927" } new_table_name: "default.Table_9e1c88622f89474285f6bdb98faffffb" modify_external_catalogs: true
I20260927 15:06:05.923561 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 5ac629961f0e4838a6d7899b37612843 (DEFAULT_TABLE table=default.Table_742e2e6361fc4669971abfa8d7a436a2 [id=f8189ecadece47b489ed4b464b40e59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.924558 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_30959463ca2946d29587919310f2556e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.925057 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30959463ca2946d29587919310f2556e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.925104 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ac629961f0e4838a6d7899b37612843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.926229 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_430e7778dcb44f198d75c01d39fba60b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:05.926522 1561 ts_tablet_manager.cc:1428] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
W20260927 15:06:05.926721 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_430e7778dcb44f198d75c01d39fba60b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.925963 1143 tablet_service.cc:1467] Processing CreateTablet for tablet ee27f67bc245495a9e29bcac3e7d3846 (DEFAULT_TABLE table=default.Table_8bba9c3b196c4bb59fa2ef8c1b4945df [id=acbd92ce628d4d67928cc561eb733f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.927202 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0dd6d9a00c7743d0954e4d8fea0f2847"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:05.927281 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee27f67bc245495a9e29bcac3e7d3846. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:05.927631 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0dd6d9a00c7743d0954e4d8fea0f2847 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.933911 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59de157335d8475e9e44db8f1d040bb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.934271 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d334a5b55c8742d5a64be44e9a645da4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:05.934831 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d334a5b55c8742d5a64be44e9a645da4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:05.937522 1561 tablet_bootstrap.cc:492] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:05.940845 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e2ba3bdf50b14aec85a99742426e9298
W20260927 15:06:05.942536 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f86725bd5d5247faa0dff164857629d3 consensus state has no leader
I20260927 15:06:05.945613 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 9b14f02426df4839b98f012042d8ee9b (DEFAULT_TABLE table=default.Table_5e1d680b47b249bab5ff802cf85872ed [id=1d30b1e6fe97477393c91515d5115984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.945957 1275 tablet_service.cc:1467] Processing CreateTablet for tablet ee27f67bc245495a9e29bcac3e7d3846 (DEFAULT_TABLE table=default.Table_8bba9c3b196c4bb59fa2ef8c1b4945df [id=acbd92ce628d4d67928cc561eb733f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.948271 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ba3bdf50b14aec85a99742426e9298 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:05.946105 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 21651dc1231c4faf9053a465a1874092 (DEFAULT_TABLE table=default.Table_d6af061238d5449ba54326f29719fe5c [id=d1f70a989c3645b29c4da5fad4934a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.948376 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53ddb28f419d42afbaddf36966fa1509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.951063 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c74dfa20ed9a4eb197a846b62d859146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.952096 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_22c0d3e744ba48aea839eee1f067df2c" } new_table_name: "default.Table_677f83923ad647b08ba28a091be71775" modify_external_catalogs: true
I20260927 15:06:05.954962 1278 tablet_service.cc:1467] Processing CreateTablet for tablet f1ad3b9d5f8244c99a01f5951007e1fd (DEFAULT_TABLE table=default.Table_7632e621dc1f45af8d18583654bfd90b [id=726120b4baf7415dabae409509b01996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.956614 1374 leader_election.cc:302] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:05.958545 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988ae3a67a4b436583cb475fbcf07b8f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:05.959283 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 5ac629961f0e4838a6d7899b37612843 (DEFAULT_TABLE table=default.Table_742e2e6361fc4669971abfa8d7a436a2 [id=f8189ecadece47b489ed4b464b40e59a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.960611 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929425d7dab14084acef649e54a9b32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.961930 1556 ts_tablet_manager.cc:1428] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20260927 15:06:05.962203 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b14f02426df4839b98f012042d8ee9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.962904 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8448b281a9d14e3eb681e18889ca6369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.963685 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ac92258c6044a891b3325b7aaf3b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.965747 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 34348cffe35b46728e77df7dede29682 (DEFAULT_TABLE table=default.Table_6bf0172924f44feb8a2467e2ad14781b [id=6cedfa7e39f14b6a8ce009633972d95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.967232 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee27f67bc245495a9e29bcac3e7d3846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.973964 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bb9540030834895ac069a0d516d7ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.975025 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21651dc1231c4faf9053a465a1874092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.981379 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1ad3b9d5f8244c99a01f5951007e1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:05.981074 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 59de157335d8475e9e44db8f1d040bb2 (DEFAULT_TABLE table=default.Table_59fba975ee904a36b51d48dcc5c0816a [id=508c3e81dd27448eb134ee2f2657ae89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:05.991011 2070 raft_consensus.cc:482] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:05.992129 1552 raft_consensus.cc:348] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:05.992563 1552 raft_consensus.cc:374] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:05.992691 1552 raft_consensus.cc:729] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:05.993019 1552 consensus_queue.cc:260] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.000912 1552 ts_tablet_manager.cc:1428] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.121s user 0.001s sys 0.001s
I20260927 15:06:06.004457 2070 raft_consensus.cc:504] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:06.005211 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 929425d7dab14084acef649e54a9b32b consensus state has no leader
I20260927 15:06:06.005242 2070 leader_election.cc:288] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:06.008272 1146 tablet_service.cc:1467] Processing CreateTablet for tablet f1ad3b9d5f8244c99a01f5951007e1fd (DEFAULT_TABLE table=default.Table_7632e621dc1f45af8d18583654bfd90b [id=726120b4baf7415dabae409509b01996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.015461 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8bba9c3b196c4bb59fa2ef8c1b4945df" } new_table_name: "default.Table_fb7c213a3fc9488a9108413667662865" modify_external_catalogs: true
I20260927 15:06:06.017057 1561 tablet_bootstrap.cc:654] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:06.017277 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3cc6cd481b6a4ca798cf1c63e940902d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.017872 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cc6cd481b6a4ca798cf1c63e940902d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.020906 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_060d882a43514f8abc1ee73fd897d1bf" } new_table_name: "default.Table_4e61792c99664faca894de841edc089d" modify_external_catalogs: true
I20260927 15:06:06.022891 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1ad3b9d5f8244c99a01f5951007e1fd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:06.028633 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee27f67bc245495a9e29bcac3e7d3846 consensus state has no leader
W20260927 15:06:06.035045 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 078ba40ca56745b2a2b86402a1519011 consensus state has no leader
I20260927 15:06:06.035739 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8314c67a0ac344ac978f6ec17eb62d72" } modify_external_catalogs: true
I20260927 15:06:06.035964 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8314c67a0ac344ac978f6ec17eb62d72" } modify_external_catalogs: true
I20260927 15:06:06.036404 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 929425d7dab14084acef649e54a9b32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.036654 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34348cffe35b46728e77df7dede29682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.003449 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ba3bdf50b14aec85a99742426e9298 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.011191 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5af5df58824fe88d607a93216bd228" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:06.025153 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 54cf2f6a6a5042a1be0d53d9ea66bd29 (DEFAULT_TABLE table=default.Table_8f3f5117c7a949e59bf75560bbec6325 [id=9279382dd09a4dd5b4891524eb785740]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:06.039124 1102 leader_election.cc:341] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.037822 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 21651dc1231c4faf9053a465a1874092 (DEFAULT_TABLE table=default.Table_d6af061238d5449ba54326f29719fe5c [id=d1f70a989c3645b29c4da5fad4934a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.040946 1552 tablet_bootstrap.cc:492] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:06.044009 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1b1639fc47724907a79f94e34f6b9469" } modify_external_catalogs: true
I20260927 15:06:06.044188 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1b1639fc47724907a79f94e34f6b9469" } modify_external_catalogs: true
I20260927 15:06:06.044795 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_28678b473eb34fc98fdfa5b51c8f9ecc" } modify_external_catalogs: true
I20260927 15:06:06.045301 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_28678b473eb34fc98fdfa5b51c8f9ecc" } modify_external_catalogs: true
I20260927 15:06:06.048103 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b6e5f1f761934a87b742fc501fea7048" } modify_external_catalogs: true
I20260927 15:06:06.048276 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b6e5f1f761934a87b742fc501fea7048" } modify_external_catalogs: true
I20260927 15:06:06.055610 1271 tablet_service.cc:1467] Processing CreateTablet for tablet cf2d3438867a45319645a7b6bee7022a (DEFAULT_TABLE table=default.Table_b6e5f1f761934a87b742fc501fea7048 [id=dd36abde3ba04448b170e4bc36913a74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.056293 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59de157335d8475e9e44db8f1d040bb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.057168 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 1e0508139d3f403a94638c6a7cfb6a35 (DEFAULT_TABLE table=default.Table_ab38ee49123642b6b2546b1eca782405 [id=f3ebdacb287b4f59a79be8dad90e846c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.057770 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 1a05574f0f734e6d912b375137482a21 (DEFAULT_TABLE table=default.Table_3b207b7b6ab747b7a2e504f26bcf201d [id=46ec35287bcb45619de1b3e305579a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.058425 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 1c5c0d205937415ab0214a5bdbd939c1 (DEFAULT_TABLE table=default.Table_30959463ca2946d29587919310f2556e [id=27ece23120564c3097a2d4d9ec9cf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.059540 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4e3722eb6b6f4ea0ae4dae79367377fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.059862 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 50d786631fc849789164e83efaca333d (DEFAULT_TABLE table=default.Table_430e7778dcb44f198d75c01d39fba60b [id=f6c952dc4cb04ec2b6cda5e1b5da3256]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:06.060070 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e3722eb6b6f4ea0ae4dae79367377fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.062656 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 50d786631fc849789164e83efaca333d (DEFAULT_TABLE table=default.Table_430e7778dcb44f198d75c01d39fba60b [id=f6c952dc4cb04ec2b6cda5e1b5da3256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.063519 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 6cba64a85ff14281a662bb41189a2c5e (DEFAULT_TABLE table=default.Table_d334a5b55c8742d5a64be44e9a645da4 [id=cb988a5652f44db3a4e379d2784bce11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.063839 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0f4cff4a06db44269defca578af289d8
I20260927 15:06:06.063956 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cf2d3438867a45319645a7b6bee7022a
I20260927 15:06:06.064525 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d786631fc849789164e83efaca333d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.064662 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34348cffe35b46728e77df7dede29682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.065459 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ac629961f0e4838a6d7899b37612843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.069979 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 1a05574f0f734e6d912b375137482a21 (DEFAULT_TABLE table=default.Table_3b207b7b6ab747b7a2e504f26bcf201d [id=46ec35287bcb45619de1b3e305579a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.072543 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 89bd5b459caa42e7a9153d9273ad52c4
I20260927 15:06:06.073844 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a05574f0f734e6d912b375137482a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.073891 1137 tablet_service.cc:1467] Processing CreateTablet for tablet cf2d3438867a45319645a7b6bee7022a (DEFAULT_TABLE table=default.Table_b6e5f1f761934a87b742fc501fea7048 [id=dd36abde3ba04448b170e4bc36913a74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.076398 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 1c5c0d205937415ab0214a5bdbd939c1 (DEFAULT_TABLE table=default.Table_30959463ca2946d29587919310f2556e [id=27ece23120564c3097a2d4d9ec9cf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.078601 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 54cf2f6a6a5042a1be0d53d9ea66bd29 (DEFAULT_TABLE table=default.Table_8f3f5117c7a949e59bf75560bbec6325 [id=9279382dd09a4dd5b4891524eb785740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.080555 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85
I20260927 15:06:06.081638 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 30186548510642fab1533ab7183fa7dd (DEFAULT_TABLE table=default.Table_0dd6d9a00c7743d0954e4d8fea0f2847 [id=d5aec959110749b1b71c4db687a12878]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.082919 1412 tablet_service.cc:1467] Processing CreateTablet for tablet ee27f67bc245495a9e29bcac3e7d3846 (DEFAULT_TABLE table=default.Table_8bba9c3b196c4bb59fa2ef8c1b4945df [id=acbd92ce628d4d67928cc561eb733f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.083527 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 89bd5b459caa42e7a9153d9273ad52c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.083736 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2d3438867a45319645a7b6bee7022a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.083822 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c74dfa20ed9a4eb197a846b62d859146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.086614 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 9b14f02426df4839b98f012042d8ee9b (DEFAULT_TABLE table=default.Table_5e1d680b47b249bab5ff802cf85872ed [id=1d30b1e6fe97477393c91515d5115984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.084916 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 6cba64a85ff14281a662bb41189a2c5e (DEFAULT_TABLE table=default.Table_d334a5b55c8742d5a64be44e9a645da4 [id=cb988a5652f44db3a4e379d2784bce11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.087939 1562 ts_tablet_manager.cc:1918] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:06.088140 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet cf2d3438867a45319645a7b6bee7022a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.088440 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.089380 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e9d03457dac43038b4e6fb120ff572c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.090167 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30186548510642fab1533ab7183fa7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.091533 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4cff4a06db44269defca578af289d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.091912 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c5c0d205937415ab0214a5bdbd939c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.093294 1562 log.cc:1196] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/6d6eed08273244d28fd15785a09059f9
I20260927 15:06:06.093909 1562 ts_tablet_manager.cc:1939] T 6d6eed08273244d28fd15785a09059f9 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:06.094446 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cba64a85ff14281a662bb41189a2c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.095561 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee27f67bc245495a9e29bcac3e7d3846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.101573 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 59de157335d8475e9e44db8f1d040bb2 (DEFAULT_TABLE table=default.Table_59fba975ee904a36b51d48dcc5c0816a [id=508c3e81dd27448eb134ee2f2657ae89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.102195 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b14f02426df4839b98f012042d8ee9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:06.102316 1099 consensus_peers.cc:487] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e6e3600cbf741419bc7b93eec42eb13. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:06.095342 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 1e0508139d3f403a94638c6a7cfb6a35 (DEFAULT_TABLE table=default.Table_ab38ee49123642b6b2546b1eca782405 [id=f3ebdacb287b4f59a79be8dad90e846c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.102780 2076 raft_consensus.cc:504] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.105608 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54cf2f6a6a5042a1be0d53d9ea66bd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.106946 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59de157335d8475e9e44db8f1d040bb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.107255 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 361) took 2828 ms. Trace:
I20260927 15:06:06.107386 1562 rpcz_store.cc:276] 0927 15:06:03.265469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.265518 (+ 49us) service_pool.cc:227] Handling call
0927 15:06:05.864243 (+2598725us) ts_tablet_manager.cc:1145] Deleting tablet 6d6eed08273244d28fd15785a09059f9
0927 15:06:05.864251 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:05.939160 (+ 74909us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:06.077492 (+138332us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:06.094368 (+ 16876us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2598527}
I20260927 15:06:06.107978 2028 raft_consensus.cc:482] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:06.108136 2028 raft_consensus.cc:504] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.108399 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 362) took 2782 ms. Trace:
I20260927 15:06:06.108515 1562 rpcz_store.cc:276] 0927 15:06:03.325722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.325960 (+ 238us) service_pool.cc:227] Handling call
0927 15:06:06.108184 (+2782224us) ts_tablet_manager.cc:1145] Deleting tablet a90039faff27436db7b50fa4c4643d3b
0927 15:06:06.108199 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.108335 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2781966}
I20260927 15:06:06.108675 2028 leader_election.cc:288] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:06.108827 2028 raft_consensus.cc:2781] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:06.108922 2028 raft_consensus.cc:482] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:06.109004 2028 raft_consensus.cc:3037] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:06.109457 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 5ac629961f0e4838a6d7899b37612843 (DEFAULT_TABLE table=default.Table_742e2e6361fc4669971abfa8d7a436a2 [id=f8189ecadece47b489ed4b464b40e59a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:06.109733 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet a90039faff27436db7b50fa4c4643d3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a90039faff27436db7b50fa4c4643d3b already in progress: creating tablet
W20260927 15:06:06.109797 1376 leader_election.cc:341] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:06.109925 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 148629us
I20260927 15:06:06.110234 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 364) took 2751 ms. Trace:
I20260927 15:06:06.110361 1556 tablet_bootstrap.cc:492] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:06.110344 1562 rpcz_store.cc:276] 0927 15:06:03.358992 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.359080 (+ 88us) service_pool.cc:227] Handling call
0927 15:06:06.110056 (+2750976us) ts_tablet_manager.cc:1145] Deleting tablet bc20a62bbd484c4e9e25cf1c15e1dde0
0927 15:06:06.110071 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.110173 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2750752}
I20260927 15:06:06.110788 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 96ac92258c6044a891b3325b7aaf3b8f (DEFAULT_TABLE table=default.Table_fdbd726355df419fae94cbf8fce53375 [id=f6284e29d38143b38fc421ab5c09538c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.111936 2071 raft_consensus.cc:482] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:06.114547 2076 leader_election.cc:288] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:06.126039 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 434e9390f1fd4a3ebb65924c37b85bd4 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:06.127084 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_417406b595a848f1a8eb064e1e51257f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.127822 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_417406b595a848f1a8eb064e1e51257f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.129297 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e0508139d3f403a94638c6a7cfb6a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.130614 2094 raft_consensus.cc:482] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:06.133473 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ba3bdf50b14aec85a99742426e9298 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.133900 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 50d786631fc849789164e83efaca333d (DEFAULT_TABLE table=default.Table_430e7778dcb44f198d75c01d39fba60b [id=f6c952dc4cb04ec2b6cda5e1b5da3256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.134274 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5af5df58824fe88d607a93216bd228" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:06.134516 1437 raft_consensus.cc:2454] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:06.135006 1099 leader_election.cc:302] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:06.135635 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 1a05574f0f734e6d912b375137482a21 (DEFAULT_TABLE table=default.Table_3b207b7b6ab747b7a2e504f26bcf201d [id=46ec35287bcb45619de1b3e305579a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.136420 1405 tablet_service.cc:1467] Processing CreateTablet for tablet cf2d3438867a45319645a7b6bee7022a (DEFAULT_TABLE table=default.Table_b6e5f1f761934a87b742fc501fea7048 [id=dd36abde3ba04448b170e4bc36913a74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.137662 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42baac8b7d47433e826eb3bc1980acaa" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:06.138224 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 54cf2f6a6a5042a1be0d53d9ea66bd29 (DEFAULT_TABLE table=default.Table_8f3f5117c7a949e59bf75560bbec6325 [id=9279382dd09a4dd5b4891524eb785740]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:06.138448 1376 leader_election.cc:341] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.138535 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53ddb28f419d42afbaddf36966fa1509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.130781 2094 raft_consensus.cc:504] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.139204 2070 raft_consensus.cc:2781] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:06.139323 2070 raft_consensus.cc:482] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:06.140362 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 1e0508139d3f403a94638c6a7cfb6a35 (DEFAULT_TABLE table=default.Table_ab38ee49123642b6b2546b1eca782405 [id=f3ebdacb287b4f59a79be8dad90e846c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.140823 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 1c5c0d205937415ab0214a5bdbd939c1 (DEFAULT_TABLE table=default.Table_30959463ca2946d29587919310f2556e [id=27ece23120564c3097a2d4d9ec9cf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.141541 2071 raft_consensus.cc:504] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.143951 2071 leader_election.cc:288] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:06.145299 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet cf2d3438867a45319645a7b6bee7022a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.145841 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54cf2f6a6a5042a1be0d53d9ea66bd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.146709 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1ad3b9d5f8244c99a01f5951007e1fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.146709 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4cff4a06db44269defca578af289d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.148734 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c5c0d205937415ab0214a5bdbd939c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.148977 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ac629961f0e4838a6d7899b37612843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.151046 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 6cba64a85ff14281a662bb41189a2c5e (DEFAULT_TABLE table=default.Table_d334a5b55c8742d5a64be44e9a645da4 [id=cb988a5652f44db3a4e379d2784bce11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.154850 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e0508139d3f403a94638c6a7cfb6a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.156428 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d786631fc849789164e83efaca333d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.157037 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21651dc1231c4faf9053a465a1874092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.160068 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_04e241fd53a64c76b188ab49cd5ea266" } modify_external_catalogs: true
I20260927 15:06:06.160650 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_04e241fd53a64c76b188ab49cd5ea266" } modify_external_catalogs: true
I20260927 15:06:06.161896 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2d3438867a45319645a7b6bee7022a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.162986 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50d786631fc849789164e83efaca333d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.161799 2119 ts_tablet_manager.cc:1918] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:06.164287 2119 log.cc:1196] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/ba7faf6e79db420db13999d74fe86062
I20260927 15:06:06.164677 2119 ts_tablet_manager.cc:1939] T ba7faf6e79db420db13999d74fe86062 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:06.165248 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c5c0d205937415ab0214a5bdbd939c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.165766 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e0508139d3f403a94638c6a7cfb6a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.166417 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cba64a85ff14281a662bb41189a2c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.166988 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a05574f0f734e6d912b375137482a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.169437 1561 tablet_bootstrap.cc:492] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:06.169492 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 372) took 2536 ms. Trace:
I20260927 15:06:06.171653 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet ba7faf6e79db420db13999d74fe86062 (table default.Table_46da6881be584d4982a6cdafe3fb1c31 [id=f2c85989a55c4f62bb100381a5d68dce]) successfully deleted
I20260927 15:06:06.169633 1561 ts_tablet_manager.cc:1397] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.243s user 0.007s sys 0.010s
I20260927 15:06:06.174445 1561 raft_consensus.cc:348] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.171885 1562 rpcz_store.cc:276] 0927 15:06:03.603294 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.604063 (+ 769us) service_pool.cc:227] Handling call
0927 15:06:06.123468 (+2519405us) ts_tablet_manager.cc:1145] Deleting tablet 0129eaa5636544e696076e439d713b1b
0927 15:06:06.123483 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.139653 (+ 16170us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2519182}
I20260927 15:06:06.175285 1561 raft_consensus.cc:374] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:06.176007 1561 raft_consensus.cc:729] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:06.188179 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fde632b187eb4180b343d7bddc7f0943" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:06.194787 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_da4a80fa90b442bdb4fb9928235f6f05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.195613 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da4a80fa90b442bdb4fb9928235f6f05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.195676 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ac92258c6044a891b3325b7aaf3b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.139734 2070 raft_consensus.cc:3037] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:06.179178 1561 consensus_queue.cc:260] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.199872 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e066308fcdfc49ed926cd81963c5f1a7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:06.210448 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet cf2d3438867a45319645a7b6bee7022a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.210726 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 89bd5b459caa42e7a9153d9273ad52c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.210979 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.211153 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 30186548510642fab1533ab7183fa7dd (DEFAULT_TABLE table=default.Table_0dd6d9a00c7743d0954e4d8fea0f2847 [id=d5aec959110749b1b71c4db687a12878]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.211520 2119 tablet_replica.cc:330] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:06.211712 2119 raft_consensus.cc:2229] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:06.211884 2119 raft_consensus.cc:2258] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:06.212488 2119 ts_tablet_manager.cc:1905] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:06.212639 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4cff4a06db44269defca578af289d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.212819 2094 leader_election.cc:288] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:06.212949 2094 raft_consensus.cc:482] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:06.213500 2094 raft_consensus.cc:504] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.214257 2094 leader_election.cc:288] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:06.217105 907 catalog_manager.cc:5495] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:06.217561 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet cad4605da5e045e7969da2d6f56a7e70 (table default.Table_2acab08ececa48aab9e6139d3e031e59 [id=672533238895472b9bfb06706e4b41bb]). Expected version 1 got 0
I20260927 15:06:06.222766 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54cf2f6a6a5042a1be0d53d9ea66bd29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.240226 2070 raft_consensus.cc:504] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.260259 2070 leader_election.cc:288] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:06.268934 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 434e9390f1fd4a3ebb65924c37b85bd4
I20260927 15:06:06.269371 912 catalog_manager.cc:6565] ReplaceTablet: tablet 434e9390f1fd4a3ebb65924c37b85bd4 deleted and replaced by tablet 6de2fca4b792491993fcf23ce6db61e0
I20260927 15:06:06.274885 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 374) took 2671 ms. Trace:
I20260927 15:06:06.275151 1562 rpcz_store.cc:276] 0927 15:06:03.603573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.604310 (+ 737us) service_pool.cc:227] Handling call
0927 15:06:06.274460 (+2670150us) ts_tablet_manager.cc:1145] Deleting tablet f585bcdadbcc4032aa484481cdf94b72
0927 15:06:06.274510 (+ 50us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.274777 (+ 267us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2669950}
I20260927 15:06:06.280470 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30186548510642fab1533ab7183fa7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.282886 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 375) took 2679 ms. Trace:
I20260927 15:06:06.282127 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 5bc96d1626f24cfab49bf6a36e1da33e (DEFAULT_TABLE table=default.Table_3cc6cd481b6a4ca798cf1c63e940902d [id=471cdcbca51d482c94f354f83446d0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.284745 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a05574f0f734e6d912b375137482a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.285176 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bc96d1626f24cfab49bf6a36e1da33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.286654 2136 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b6a41e027f0448cafe3365f23103f92)
I20260927 15:06:06.286984 2136 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:06:06.288548 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 434e9390f1fd4a3ebb65924c37b85bd4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6de2fca4b792491993fcf23ce6db61e0) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.290269 2072 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b6a41e027f0448cafe3365f23103f92. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:06:06.290668 2072 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [sys.catalog]: This master's current role is: FOLLOWER
I20260927 15:06:06.283234 1561 ts_tablet_manager.cc:1428] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.109s user 0.000s sys 0.003s
I20260927 15:06:06.283753 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e6e3600cbf741419bc7b93eec42eb13" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:06.293581 2136 leader_election.cc:288] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b6a41e027f0448cafe3365f23103f92 (127.0.201.61:43763), 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799)
I20260927 15:06:06.296986 1561 tablet_bootstrap.cc:492] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:06.297727 1376 leader_election.cc:341] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.297159 1562 rpcz_store.cc:276] 0927 15:06:03.603664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.604543 (+ 879us) service_pool.cc:227] Handling call
0927 15:06:06.277546 (+2673003us) ts_tablet_manager.cc:1145] Deleting tablet 54a07831078b48a59807f7da4a42bcec
0927 15:06:06.278861 (+ 1315us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.282801 (+ 3940us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2672046}
I20260927 15:06:06.305176 1562 tablet_replica.cc:330] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:06.305516 1562 raft_consensus.cc:2229] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:06.306684 1562 pending_rounds.cc:62] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:06.306846 1562 pending_rounds.cc:68] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976326946201600 op_type: NO_OP noop_request { }
I20260927 15:06:06.307865 1562 raft_consensus.cc:2866] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:06.308086 1562 raft_consensus.cc:2258] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:06.309784 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 100570us
W20260927 15:06:06.310163 1376 leader_election.cc:341] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.310662 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5af5df58824fe88d607a93216bd228" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:06.310920 1440 raft_consensus.cc:3037] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:06.313241 1562 ts_tablet_manager.cc:1905] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:06.314210 1440 raft_consensus.cc:2454] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:06.315069 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 384536us
I20260927 15:06:06.315387 1099 leader_election.cc:302] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:06.316205 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42baac8b7d47433e826eb3bc1980acaa" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:06.316974 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cba64a85ff14281a662bb41189a2c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.317020 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fde632b187eb4180b343d7bddc7f0943" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:06.317312 1164 raft_consensus.cc:2454] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:06.318336 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e066308fcdfc49ed926cd81963c5f1a7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:06.318416 2071 raft_consensus.cc:482] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:06.321833 1913 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" instance_seqno: 1790521555124349) as {username='slave'} at 127.0.201.1:39587; Asking this server to re-register.
I20260927 15:06:06.322039 2071 raft_consensus.cc:504] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.322718 2071 leader_election.cc:288] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:06.322800 1163 raft_consensus.cc:2454] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:06.323444 2142 raft_consensus.cc:2781] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:06.324216 2142 raft_consensus.cc:686] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:06.324998 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2d3438867a45319645a7b6bee7022a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.325436 2142 consensus_queue.cc:237] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.326339 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e9d03457dac43038b4e6fb120ff572c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:06.327566 1212 heartbeater.cc:464] Registering TS with master...
I20260927 15:06:06.330289 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1c018f11de9842bc883409f8af35fb5f
I20260927 15:06:06.330324 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 30186548510642fab1533ab7183fa7dd (DEFAULT_TABLE table=default.Table_0dd6d9a00c7743d0954e4d8fea0f2847 [id=d5aec959110749b1b71c4db687a12878]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.330729 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30186548510642fab1533ab7183fa7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.333626 1561 tablet_bootstrap.cc:654] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:06.336127 1374 leader_election.cc:341] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.339177 1374 leader_election.cc:302] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:06.339613 1374 leader_election.cc:302] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:06.345954 2071 raft_consensus.cc:2781] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:06.346068 2071 raft_consensus.cc:482] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:06.347800 2071 raft_consensus.cc:3037] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:06.349069 2137 raft_consensus.cc:2726] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:06.349259 1374 leader_election.cc:302] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:06.351137 1561 tablet_bootstrap.cc:492] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:06.351554 2148 catalog_manager.cc:1259] Loaded cluster ID: a08215f58a7f46c68a561816e301758f
I20260927 15:06:06.361505 2137 raft_consensus.cc:2781] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:06.362767 2137 raft_consensus.cc:482] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:06.362792 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 89bd5b459caa42e7a9153d9273ad52c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.362942 2137 raft_consensus.cc:3037] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:06.363078 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.363518 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 5bc96d1626f24cfab49bf6a36e1da33e (DEFAULT_TABLE table=default.Table_3cc6cd481b6a4ca798cf1c63e940902d [id=471cdcbca51d482c94f354f83446d0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.363938 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bc96d1626f24cfab49bf6a36e1da33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.362087 1913 ts_manager.cc:194] Registered new tserver with Master: c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:06.365612 1561 ts_tablet_manager.cc:1397] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.003s
I20260927 15:06:06.365876 2137 raft_consensus.cc:504] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.366721 2148 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: loading cluster ID for follower catalog manager: success
I20260927 15:06:06.366448 1561 raft_consensus.cc:348] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.369758 1561 raft_consensus.cc:374] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:06.369920 1561 raft_consensus.cc:729] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:06.371940 1561 consensus_queue.cc:260] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.380851 1561 ts_tablet_manager.cc:1428] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260927 15:06:06.381301 1561 tablet_bootstrap.cc:492] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:06.371630 1562 ts_tablet_manager.cc:1918] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:06.384829 1562 log.cc:1196] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/0df4a23269244191bf1dcd69cb34d371
I20260927 15:06:06.384688 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_edb92ee651224ae8ac03471012ebb44b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.385268 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edb92ee651224ae8ac03471012ebb44b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.385645 1562 ts_tablet_manager.cc:1939] T 0df4a23269244191bf1dcd69cb34d371 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:06.387104 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_066bd6c1063544008f82fa386dd2e5a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.387199 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b8aa94cb5ee04c6fa81a8b5a2319d15c" } new_table_name: "default.Table_81fc47a80ea6475cacc27b37367105f4" modify_external_catalogs: true
W20260927 15:06:06.387612 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_066bd6c1063544008f82fa386dd2e5a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.388846 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6ad2d890db9e4a95b7b8f9e73b6580b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.389325 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ad2d890db9e4a95b7b8f9e73b6580b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.387154 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_761ebfb7b5db4cae9ba1208d5e39d897" } new_table_name: "default.Table_017e45d4e58a4ee7963c291a4aa901c7" modify_external_catalogs: true
I20260927 15:06:06.287599 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad5af5df58824fe88d607a93216bd228" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:06.392248 1239 leader_election.cc:341] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 9c9e4311049d47d3b2f1e117795624ef
I20260927 15:06:06.396193 1561 tablet_bootstrap.cc:654] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:06.397943 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
W20260927 15:06:06.398259 1238 leader_election.cc:341] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 0e6e3600cbf741419bc7b93eec42eb13
I20260927 15:06:06.395859 2028 raft_consensus.cc:504] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:06.407209 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 107982us
W20260927 15:06:06.407437 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9a97e3e6a5749feb4dd5f835d9c01ac consensus state has no leader
W20260927 15:06:06.407439 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3fff31ceb379400bbfa4586c749e6d6e consensus state has no leader
W20260927 15:06:06.407729 1102 leader_election.cc:341] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.386577 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 377) took 2782 ms. Trace:
I20260927 15:06:06.413318 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_85e4afa525a840fb88a84cc7cd8042a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.413846 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_53a07a501dad4901a14b534a8fecea27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.414049 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85e4afa525a840fb88a84cc7cd8042a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.413314 1562 rpcz_store.cc:276] 0927 15:06:03.603831 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.604670 (+ 839us) service_pool.cc:227] Handling call
0927 15:06:06.298346 (+2693676us) ts_tablet_manager.cc:1145] Deleting tablet 0df4a23269244191bf1dcd69cb34d371
0927 15:06:06.304764 (+ 6418us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.340733 (+ 35969us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:06.371519 (+ 30786us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:06.386525 (+ 15006us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2692618}
I20260927 15:06:06.414269 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0992c54eabeb45b19758c9660f2de1f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.414400 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53a07a501dad4901a14b534a8fecea27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.413318 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f52a44b8e26c4239ad332cec0499eead"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.414770 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0992c54eabeb45b19758c9660f2de1f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:06.415015 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f52a44b8e26c4239ad332cec0499eead in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.415282 1562 tablet_replica.cc:330] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:06.415750 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1c87fe2a6c1a4e178dc88d4fd8679835" } new_table_name: "default.Table_0021fd56477c4debbfe492c5673d41c2" modify_external_catalogs: true
I20260927 15:06:06.416165 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cd87785e4030410da63d85472104fc1e" } new_table_name: "default.Table_d072149ddba94cff935fb906dcf0524c" modify_external_catalogs: true
I20260927 15:06:06.416884 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dadef58d086c4d76835d468c68898f6b" } new_table_name: "default.Table_df52c90f7b0745ef8832a53df04307b9" modify_external_catalogs: true
I20260927 15:06:06.417484 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bc0cef144e2c48f6883df97308937a76" } modify_external_catalogs: true
I20260927 15:06:06.417696 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bc0cef144e2c48f6883df97308937a76" } modify_external_catalogs: true
I20260927 15:06:06.417773 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0c13e1b918e8461fb684b657939d128c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.418037 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d334a5b55c8742d5a64be44e9a645da4" } modify_external_catalogs: true
I20260927 15:06:06.418200 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d334a5b55c8742d5a64be44e9a645da4" } modify_external_catalogs: true
W20260927 15:06:06.418278 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c13e1b918e8461fb684b657939d128c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.418779 1562 raft_consensus.cc:2229] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:06.420089 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 5bc96d1626f24cfab49bf6a36e1da33e (DEFAULT_TABLE table=default.Table_3cc6cd481b6a4ca798cf1c63e940902d [id=471cdcbca51d482c94f354f83446d0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.420485 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bc96d1626f24cfab49bf6a36e1da33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.424435 1128 tablet_service.cc:1467] Processing CreateTablet for tablet d8baa02df777404187611de3ae220e39 (DEFAULT_TABLE table=default.Table_4e3722eb6b6f4ea0ae4dae79367377fc [id=4ee4476e8a124df1a3fb54626a2d7f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.424813 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8baa02df777404187611de3ae220e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.426613 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cb47d8e094f84808bbcf64674dd9f797" } modify_external_catalogs: true
I20260927 15:06:06.426678 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e8855d7ecbd54e2eb65a1b2dd6addb4c" } modify_external_catalogs: true
I20260927 15:06:06.426810 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cb47d8e094f84808bbcf64674dd9f797" } modify_external_catalogs: true
I20260927 15:06:06.426905 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e8855d7ecbd54e2eb65a1b2dd6addb4c" } modify_external_catalogs: true
I20260927 15:06:06.426944 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c018f11de9842bc883409f8af35fb5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.427366 1137 tablet_service.cc:1467] Processing CreateTablet for tablet d827f6a3a6834ecd86d8722b1f1e4444 (DEFAULT_TABLE table=default.Table_da4a80fa90b442bdb4fb9928235f6f05 [id=612b1b17cb3a43d5a13734758d317e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.427703 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d827f6a3a6834ecd86d8722b1f1e4444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.428357 2137 leader_election.cc:288] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:06.431218 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb6d2c9c3b24ad49366d52bdd7cff3c (DEFAULT_TABLE table=default.Table_417406b595a848f1a8eb064e1e51257f [id=531b726141db41159f1e1f177b330cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.431571 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb6d2c9c3b24ad49366d52bdd7cff3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.435083 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 6de2fca4b792491993fcf23ce6db61e0 (DEFAULT_TABLE table=default.Table_53f5b1728e4947fca524ecea11ae3d37 [id=fe47ea48cef44035b7d9df3be08eabb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.435421 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6de2fca4b792491993fcf23ce6db61e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:06.437621 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d533883e3344eca939cd67644895148 consensus state has no leader
W20260927 15:06:06.437736 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e34a679010b4b4fa3a76aec5ae05db4 consensus state has no leader
I20260927 15:06:06.437885 911 master_service.cc:946] ReplaceTablet: received request to replace tablet ba14b7531bb647248572be10d2b43cf2 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:06.441431 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 434e9390f1fd4a3ebb65924c37b85bd4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6de2fca4b792491993fcf23ce6db61e0) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.447207 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet d4f05da432f041378c5ab808536e6b6f
I20260927 15:06:06.447546 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ba14b7531bb647248572be10d2b43cf2
I20260927 15:06:06.447854 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6cba64a85ff14281a662bb41189a2c5e
I20260927 15:06:06.452509 2148 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: acquiring CA information for follower catalog manager: success
I20260927 15:06:06.461411 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c018f11de9842bc883409f8af35fb5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.468586 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988ae3a67a4b436583cb475fbcf07b8f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:06.473554 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 434e9390f1fd4a3ebb65924c37b85bd4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6de2fca4b792491993fcf23ce6db61e0) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:06.474341 1238 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 93680.5us
I20260927 15:06:06.411790 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e9d03457dac43038b4e6fb120ff572c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:06.475837 1419 tablet_service.cc:1467] Processing CreateTablet for tablet d8baa02df777404187611de3ae220e39 (DEFAULT_TABLE table=default.Table_4e3722eb6b6f4ea0ae4dae79367377fc [id=4ee4476e8a124df1a3fb54626a2d7f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.464707 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e066308fcdfc49ed926cd81963c5f1a7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:06.482583 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0129eaa5636544e696076e439d713b1b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0129eaa5636544e696076e439d713b1b already in progress: creating tablet
I20260927 15:06:06.485107 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 5aa58fa9a1384013ac1674bc7d53c3b1
W20260927 15:06:06.485445 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet f585bcdadbcc4032aa484481cdf94b72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f585bcdadbcc4032aa484481cdf94b72 already in progress: creating tablet
W20260927 15:06:06.485759 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 54a07831078b48a59807f7da4a42bcec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54a07831078b48a59807f7da4a42bcec already in progress: creating tablet
I20260927 15:06:06.486102 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 0df4a23269244191bf1dcd69cb34d371 (table default.Table_190c56d51dc446aa8a208d631e35f3d2 [id=d80cbbb5881e42f0b5651563d6f60bb5]) successfully deleted
I20260927 15:06:06.489112 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.489915 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 10b19de22dd74d74bdf619c75fc17762 (DEFAULT_TABLE table=default.Table_edb92ee651224ae8ac03471012ebb44b [id=d4b50c4eac27403fb94efa8aa7ef901c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:06.490144 1376 leader_election.cc:341] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.490422 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10b19de22dd74d74bdf619c75fc17762. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:06.490654 1376 leader_election.cc:341] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:06.490895 1376 leader_election.cc:341] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.491741 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb6d2c9c3b24ad49366d52bdd7cff3c (DEFAULT_TABLE table=default.Table_417406b595a848f1a8eb064e1e51257f [id=531b726141db41159f1e1f177b330cc3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:06.492031 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 142297us
I20260927 15:06:06.492149 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb6d2c9c3b24ad49366d52bdd7cff3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.492599 912 master_service.cc:946] ReplaceTablet: received request to replace tablet a90039faff27436db7b50fa4c4643d3b from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:06.495078 2028 leader_election.cc:288] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:06.498355 1961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45416 (request call id 0) took 1215 ms. Trace:
I20260927 15:06:06.498631 1239 leader_election.cc:302] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:06.505375 1102 consensus_peers.cc:487] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:06.503094 1302 raft_consensus.cc:3037] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:06.510013 1102 consensus_peers.cc:487] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:06.510304 1274 tablet_service.cc:1467] Processing CreateTablet for tablet d8baa02df777404187611de3ae220e39 (DEFAULT_TABLE table=default.Table_4e3722eb6b6f4ea0ae4dae79367377fc [id=4ee4476e8a124df1a3fb54626a2d7f53]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:06.511482 1102 consensus_peers.cc:487] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:06.512347 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8baa02df777404187611de3ae220e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.512876 1552 tablet_bootstrap.cc:654] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:06.512880 2148 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260927 15:06:06.513368 1238 leader_election.cc:341] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9c9e4311049d47d3b2f1e117795624ef
I20260927 15:06:06.520572 1238 leader_election.cc:302] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:06.502266 1408 tablet_service.cc:1467] Processing CreateTablet for tablet d827f6a3a6834ecd86d8722b1f1e4444 (DEFAULT_TABLE table=default.Table_da4a80fa90b442bdb4fb9928235f6f05 [id=612b1b17cb3a43d5a13734758d317e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.530817 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c018f11de9842bc883409f8af35fb5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.532855 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8baa02df777404187611de3ae220e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.534678 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 8d533883e3344eca939cd67644895148 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:06.530298 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 6de2fca4b792491993fcf23ce6db61e0 (DEFAULT_TABLE table=default.Table_53f5b1728e4947fca524ecea11ae3d37 [id=fe47ea48cef44035b7d9df3be08eabb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.536861 2071 raft_consensus.cc:504] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.537626 2071 leader_election.cc:288] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:06.542395 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d827f6a3a6834ecd86d8722b1f1e4444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.548228 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fde632b187eb4180b343d7bddc7f0943" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:06.549178 1376 leader_election.cc:341] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.553004 905 master_service.cc:946] ReplaceTablet: received request to replace tablet 04007cd4bd214b88a4664e23daf4b790 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:06.557858 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6de2fca4b792491993fcf23ce6db61e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.571904 1556 tablet_bootstrap.cc:654] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:06.579799 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet d4f05da432f041378c5ab808536e6b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.581058 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 10b19de22dd74d74bdf619c75fc17762 (DEFAULT_TABLE table=default.Table_edb92ee651224ae8ac03471012ebb44b [id=d4b50c4eac27403fb94efa8aa7ef901c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.581455 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10b19de22dd74d74bdf619c75fc17762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.582846 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cba64a85ff14281a662bb41189a2c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:06.586179 899 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 078ba40ca56745b2a2b86402a1519011 (table default.Table_4e61792c99664faca894de841edc089d [id=f8a991083fb74bfc9d9969214ac7108f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 078ba40ca56745b2a2b86402a1519011 consensus state has no leader
I20260927 15:06:06.590687 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cba64a85ff14281a662bb41189a2c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.598784 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet ba14b7531bb647248572be10d2b43cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.602599 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.611075 2006 raft_consensus.cc:482] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:06.611243 2006 raft_consensus.cc:504] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.611912 2006 leader_election.cc:288] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:06.612838 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a231aff1a39485db36979208d871ab3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:06.613488 1102 leader_election.cc:341] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.615728 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 04007cd4bd214b88a4664e23daf4b790
I20260927 15:06:06.616231 905 catalog_manager.cc:6565] ReplaceTablet: tablet 04007cd4bd214b88a4664e23daf4b790 deleted and replaced by tablet 79c983d3119f4754a33a1ec3a84665c1
I20260927 15:06:06.619029 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 04007cd4bd214b88a4664e23daf4b790 with delete_type TABLET_DATA_DELETED (replaced by tablet 79c983d3119f4754a33a1ec3a84665c1) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.621445 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ebfd4efc9ff44240b03a8f680d418512"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.622040 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebfd4efc9ff44240b03a8f680d418512 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.625200 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8f4553657b21460ab92da2ff23dca5d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.625320 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_809751f8c81a413590d182426a142d1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.625710 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f4553657b21460ab92da2ff23dca5d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:06.625828 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_809751f8c81a413590d182426a142d1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:06.625993 1102 consensus_peers.cc:487] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:06.626363 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_38f43f60e5ff4f65804ded14f7d99410"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.626858 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9091bf3af8564f0fa93792507114d5b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.626945 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_df75a53e443d434aaa888fab1ad38e36" } modify_external_catalogs: true
I20260927 15:06:06.627152 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_df75a53e443d434aaa888fab1ad38e36" } modify_external_catalogs: true
W20260927 15:06:06.627278 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9091bf3af8564f0fa93792507114d5b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:06.626858 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38f43f60e5ff4f65804ded14f7d99410 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.628278 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2addc3d2ba2b42d2b9107764c473cf95" } new_table_name: "default.Table_e30ce3bcbfeb47af9835850576ade0d0" modify_external_catalogs: true
I20260927 15:06:06.629364 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4fb14661edfd40989eb155bc053dab72" } new_table_name: "default.Table_d2aaea940100473b8730bf5faebd2b15" modify_external_catalogs: true
I20260927 15:06:06.629588 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet ba14b7531bb647248572be10d2b43cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.632535 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8d533883e3344eca939cd67644895148
I20260927 15:06:06.632656 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 8034812bd8b44d97bc63b7d65b8f83d1 (DEFAULT_TABLE table=default.Table_0c13e1b918e8461fb684b657939d128c [id=36c94caa49714fd5919e5105143e130e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.632968 912 catalog_manager.cc:6565] ReplaceTablet: tablet 8d533883e3344eca939cd67644895148 deleted and replaced by tablet 534a74d9f8e648168b87e26fb73c8b3a
I20260927 15:06:06.633059 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8034812bd8b44d97bc63b7d65b8f83d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.637403 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d533883e3344eca939cd67644895148 with delete_type TABLET_DATA_DELETED (replaced by tablet 534a74d9f8e648168b87e26fb73c8b3a) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.637671 1143 tablet_service.cc:1467] Processing CreateTablet for tablet fca35566db71465b832f9b48c272b49f (DEFAULT_TABLE table=default.Table_6ad2d890db9e4a95b7b8f9e73b6580b3 [id=5ebbff7e02dd4208bb51d92494510642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.637923 1412 tablet_service.cc:1467] Processing CreateTablet for tablet fca35566db71465b832f9b48c272b49f (DEFAULT_TABLE table=default.Table_6ad2d890db9e4a95b7b8f9e73b6580b3 [id=5ebbff7e02dd4208bb51d92494510642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.638113 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca35566db71465b832f9b48c272b49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.641911 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d533883e3344eca939cd67644895148 with delete_type TABLET_DATA_DELETED (replaced by tablet 534a74d9f8e648168b87e26fb73c8b3a) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:06.642004 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af25950fd08043f18a6eaaf46ded4378 consensus state has no leader
I20260927 15:06:06.642059 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1ba163e0f6164d65b09da684ee4872e0
W20260927 15:06:06.642953 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 480e3d9b3d31443fad163542c6681110 consensus state has no leader
I20260927 15:06:06.643438 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba163e0f6164d65b09da684ee4872e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.644522 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba163e0f6164d65b09da684ee4872e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.647472 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 8034812bd8b44d97bc63b7d65b8f83d1 (DEFAULT_TABLE table=default.Table_0c13e1b918e8461fb684b657939d128c [id=36c94caa49714fd5919e5105143e130e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.648361 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet d4f05da432f041378c5ab808536e6b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.649042 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 1d9562d917b74db9aa4a9678b9d32841 (DEFAULT_TABLE table=default.Table_066bd6c1063544008f82fa386dd2e5a1 [id=b0d22ea6a09540ef82c6719ffcdfdf11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.649472 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d9562d917b74db9aa4a9678b9d32841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.658412 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 1d9562d917b74db9aa4a9678b9d32841 (DEFAULT_TABLE table=default.Table_066bd6c1063544008f82fa386dd2e5a1 [id=b0d22ea6a09540ef82c6719ffcdfdf11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.658860 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca35566db71465b832f9b48c272b49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.659839 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d9562d917b74db9aa4a9678b9d32841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.662272 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 3a47c42f9edd4e1ab761317b7b58e8df (DEFAULT_TABLE table=default.Table_0992c54eabeb45b19758c9660f2de1f7 [id=95a187aeda1f44e0bd3e8e70a0a3caec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.662698 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a47c42f9edd4e1ab761317b7b58e8df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.664217 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 04007cd4bd214b88a4664e23daf4b790 with delete_type TABLET_DATA_DELETED (replaced by tablet 79c983d3119f4754a33a1ec3a84665c1) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.666672 1130 tablet_service.cc:1467] Processing CreateTablet for tablet fb99a5570603497fbcc029a31f7f947f (DEFAULT_TABLE table=default.Table_f52a44b8e26c4239ad332cec0499eead [id=2de9b33e6d6a40b5b8fcd4244a03549a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.667059 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8034812bd8b44d97bc63b7d65b8f83d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.667380 1133 tablet_service.cc:1467] Processing CreateTablet for tablet edc07b00db3c42eeb7543fecaf515eab (DEFAULT_TABLE table=default.Table_85e4afa525a840fb88a84cc7cd8042a8 [id=9844f2789e0342d28f0d7c5c1905983d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:06.667994 1241 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s user 0.013s sys 0.054s
W20260927 15:06:06.668120 1241 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.501s user 0.013s sys 0.054s
I20260927 15:06:06.668165 1406 tablet_service.cc:1467] Processing CreateTablet for tablet edc07b00db3c42eeb7543fecaf515eab (DEFAULT_TABLE table=default.Table_85e4afa525a840fb88a84cc7cd8042a8 [id=9844f2789e0342d28f0d7c5c1905983d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.668503 1141 tablet_service.cc:1467] Processing CreateTablet for tablet a9a58b4d602b4f879fc56f5f1648f19c (DEFAULT_TABLE table=default.Table_53a07a501dad4901a14b534a8fecea27 [id=88572f756ab54b718c3caf4929135462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.670249 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edc07b00db3c42eeb7543fecaf515eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.672147 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 3a47c42f9edd4e1ab761317b7b58e8df (DEFAULT_TABLE table=default.Table_0992c54eabeb45b19758c9660f2de1f7 [id=95a187aeda1f44e0bd3e8e70a0a3caec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.672806 2141 raft_consensus.cc:2726] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:06.676280 1402 tablet_service.cc:1467] Processing CreateTablet for tablet a9a58b4d602b4f879fc56f5f1648f19c (DEFAULT_TABLE table=default.Table_53a07a501dad4901a14b534a8fecea27 [id=88572f756ab54b718c3caf4929135462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.682209 1561 tablet_bootstrap.cc:492] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:06.682433 1561 ts_tablet_manager.cc:1397] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.301s user 0.004s sys 0.000s
I20260927 15:06:06.683241 1561 raft_consensus.cc:348] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.683578 1561 raft_consensus.cc:374] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:06.683686 1561 raft_consensus.cc:729] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:06.683960 1561 consensus_queue.cc:260] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.684562 1561 ts_tablet_manager.cc:1428] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:06.685246 1561 tablet_bootstrap.cc:492] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:06.693197 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c62bcaf11f0645449faf533a55f5d15f" } new_table_name: "default.Table_e08ec6e011ab4bf586420eaf92cfe107" modify_external_catalogs: true
I20260927 15:06:06.694075 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_af5779149a514b809b9e3f46afc2adf8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.694564 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7632e621dc1f45af8d18583654bfd90b" } modify_external_catalogs: true
W20260927 15:06:06.694665 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af5779149a514b809b9e3f46afc2adf8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.694792 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7632e621dc1f45af8d18583654bfd90b" } modify_external_catalogs: true
I20260927 15:06:06.695979 2006 raft_consensus.cc:482] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:06.696141 2006 raft_consensus.cc:504] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.696453 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c83fd3da9f48466c93f466016033cd56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.696727 2006 leader_election.cc:288] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:06.696668 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1a919c358b5340f7a616321c89f236a4" } modify_external_catalogs: true
I20260927 15:06:06.696859 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1a919c358b5340f7a616321c89f236a4" } modify_external_catalogs: true
W20260927 15:06:06.696993 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c83fd3da9f48466c93f466016033cd56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.697463 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e9d03457dac43038b4e6fb120ff572c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:06.698012 1102 leader_election.cc:341] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.698150 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_24cb81a378f04185be135842bae6db54" } modify_external_catalogs: true
I20260927 15:06:06.698221 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_190c56d51dc446aa8a208d631e35f3d2" } new_table_name: "default.Table_30f44c4820b9415daf4edfe7ea689da3" modify_external_catalogs: true
I20260927 15:06:06.698325 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_24cb81a378f04185be135842bae6db54" } modify_external_catalogs: true
I20260927 15:06:06.698750 1562 pending_rounds.cc:62] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:06.698810 1562 pending_rounds.cc:68] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976326833356800 op_type: NO_OP noop_request { }
I20260927 15:06:06.698967 1562 raft_consensus.cc:2866] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:06.699074 1562 raft_consensus.cc:2258] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:06.699400 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4e746f160fe7481ea3947c59c33ed5ee" } modify_external_catalogs: true
I20260927 15:06:06.699558 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4e746f160fe7481ea3947c59c33ed5ee" } modify_external_catalogs: true
I20260927 15:06:06.699586 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5bc19744aafd42cdb0a1bb656853619b" } new_table_name: "default.Table_8a6f153903cc41eeae108d5aeca2aa61" modify_external_catalogs: true
I20260927 15:06:06.699676 1562 ts_tablet_manager.cc:1905] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:06.701048 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_10c51390989a4f3a829a9e22bcfc0ccf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.701519 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10c51390989a4f3a829a9e22bcfc0ccf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.705089 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3e14460ebed347b7be671cd31ed5951a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.705582 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e14460ebed347b7be671cd31ed5951a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.706593 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f1ad3b9d5f8244c99a01f5951007e1fd
I20260927 15:06:06.707237 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a5f82e24d3204c97a20b0b8db78e82d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.707664 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5f82e24d3204c97a20b0b8db78e82d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:06.710693 1102 consensus_peers.cc:487] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:06.711360 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f0a71cf0ee554b3eafca3f054cc16b28
W20260927 15:06:06.711297 1238 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 207894us
W20260927 15:06:06.711664 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3042c17580d54082971b761433a7dca9 consensus state has no leader
I20260927 15:06:06.712162 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e19cd7febe054432899739e21605406d
I20260927 15:06:06.713624 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet f0a71cf0ee554b3eafca3f054cc16b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.714001 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet e19cd7febe054432899739e21605406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.714865 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c5cd55de34d249bc8d3adcf4690f0414
I20260927 15:06:06.715198 2119 ts_tablet_manager.cc:1918] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:06.715623 2119 log.cc:1196] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/7d6d1cfb1a4d4c439e970d966af841b6
I20260927 15:06:06.716130 2119 ts_tablet_manager.cc:1939] T 7d6d1cfb1a4d4c439e970d966af841b6 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:06.716540 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 427) took 1062 ms. Trace:
W20260927 15:06:06.717604 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd8a53f3c95c4cb7bce21d23f79af28c consensus state has no leader
I20260927 15:06:06.721594 995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dbf522d70373412b87815d33c0f1f745" candidate_term: 2 candidate_status { last_received { term: 1 index: 576 } } ignore_live_leader: false dest_uuid: "2a122de3662f485f8f44b0a5e4b29862" is_pre_election: true
I20260927 15:06:06.725188 1561 tablet_bootstrap.cc:654] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:06.732216 1374 leader_election.cc:341] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:06.732461 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet c5cd55de34d249bc8d3adcf4690f0414 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:06.733237 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a47c42f9edd4e1ab761317b7b58e8df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.740275 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet c5cd55de34d249bc8d3adcf4690f0414 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.741570 907 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 377847d06b534883ba2b870ca3317fe0 (table default.Table_0021fd56477c4debbfe492c5673d41c2 [id=56574e770aa74f04a7bf24b7718e4960]). Expected version 2 got 1
I20260927 15:06:06.744464 1374 leader_election.cc:302] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:06.745348 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet f1ad3b9d5f8244c99a01f5951007e1fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.745712 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9a58b4d602b4f879fc56f5f1648f19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.745980 1405 tablet_service.cc:1467] Processing CreateTablet for tablet fb99a5570603497fbcc029a31f7f947f (DEFAULT_TABLE table=default.Table_f52a44b8e26c4239ad332cec0499eead [id=2de9b33e6d6a40b5b8fcd4244a03549a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.751318 2119 rpcz_store.cc:276] 0927 15:06:05.654415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.655297 (+ 882us) service_pool.cc:227] Handling call
0927 15:06:06.174990 (+519693us) ts_tablet_manager.cc:1145] Deleting tablet 7d6d1cfb1a4d4c439e970d966af841b6
0927 15:06:06.175004 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.615479 (+440475us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:06.715066 (+ 99587us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:06.716510 (+ 1444us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":518272}
I20260927 15:06:06.751478 2071 raft_consensus.cc:2726] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:06.751694 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet e19cd7febe054432899739e21605406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.751881 2119 tablet_replica.cc:330] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:06.752156 2119 raft_consensus.cc:2229] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:06.752408 2119 raft_consensus.cc:2258] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:06.753778 1913 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" instance_seqno: 1790521556108434) as {username='slave'} at 127.0.201.3:44303; Asking this server to re-register.
I20260927 15:06:06.754592 2119 ts_tablet_manager.cc:1905] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:06.733423 1552 tablet_bootstrap.cc:492] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:06.755940 1552 ts_tablet_manager.cc:1397] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.717s user 0.005s sys 0.009s
I20260927 15:06:06.757334 1552 raft_consensus.cc:348] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.746685 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 6de2fca4b792491993fcf23ce6db61e0 (DEFAULT_TABLE table=default.Table_53f5b1728e4947fca524ecea11ae3d37 [id=fe47ea48cef44035b7d9df3be08eabb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.757869 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6de2fca4b792491993fcf23ce6db61e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.752720 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet f0a71cf0ee554b3eafca3f054cc16b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.746098 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb6d2c9c3b24ad49366d52bdd7cff3c (DEFAULT_TABLE table=default.Table_417406b595a848f1a8eb064e1e51257f [id=531b726141db41159f1e1f177b330cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.764807 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb6d2c9c3b24ad49366d52bdd7cff3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.770391 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb99a5570603497fbcc029a31f7f947f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.770866 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb99a5570603497fbcc029a31f7f947f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.771474 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9a58b4d602b4f879fc56f5f1648f19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.772040 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edc07b00db3c42eeb7543fecaf515eab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:06.772801 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 256217us
I20260927 15:06:06.773754 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988ae3a67a4b436583cb475fbcf07b8f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:06.774104 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e066308fcdfc49ed926cd81963c5f1a7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:06.774274 1164 raft_consensus.cc:3037] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:06.774658 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fde632b187eb4180b343d7bddc7f0943" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:06.774906 1166 raft_consensus.cc:3037] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:06.777812 1166 raft_consensus.cc:2454] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:06.778165 1163 raft_consensus.cc:3037] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:06.781106 1164 raft_consensus.cc:2454] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:06.783788 1163 raft_consensus.cc:2454] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
W20260927 15:06:06.788623 1376 consensus_peers.cc:487] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:06.789865 1374 leader_election.cc:302] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:06.797739 1374 leader_election.cc:302] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:06.799283 1374 leader_election.cc:302] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:06.800712 2071 raft_consensus.cc:2781] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:06.800938 2071 raft_consensus.cc:686] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:06.804332 2071 consensus_queue.cc:237] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.808374 2028 raft_consensus.cc:2781] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:06.808568 2028 raft_consensus.cc:686] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:06.808899 2028 consensus_queue.cc:237] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.810084 2137 raft_consensus.cc:2781] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:06.810400 2154 consensus_queue.cc:1035] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260927 15:06:06.810916 1269 tablet_service.cc:1467] Processing CreateTablet for tablet d827f6a3a6834ecd86d8722b1f1e4444 (DEFAULT_TABLE table=default.Table_da4a80fa90b442bdb4fb9928235f6f05 [id=612b1b17cb3a43d5a13734758d317e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.811358 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d827f6a3a6834ecd86d8722b1f1e4444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.813382 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet ba14b7531bb647248572be10d2b43cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.813764 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cba64a85ff14281a662bb41189a2c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.814237 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 10b19de22dd74d74bdf619c75fc17762 (DEFAULT_TABLE table=default.Table_edb92ee651224ae8ac03471012ebb44b [id=d4b50c4eac27403fb94efa8aa7ef901c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.814580 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.814942 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 04007cd4bd214b88a4664e23daf4b790 with delete_type TABLET_DATA_DELETED (replaced by tablet 79c983d3119f4754a33a1ec3a84665c1) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.815369 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 8034812bd8b44d97bc63b7d65b8f83d1 (DEFAULT_TABLE table=default.Table_0c13e1b918e8461fb684b657939d128c [id=36c94caa49714fd5919e5105143e130e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.815692 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d533883e3344eca939cd67644895148 with delete_type TABLET_DATA_DELETED (replaced by tablet 534a74d9f8e648168b87e26fb73c8b3a) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.816205 1270 tablet_service.cc:1467] Processing CreateTablet for tablet fca35566db71465b832f9b48c272b49f (DEFAULT_TABLE table=default.Table_6ad2d890db9e4a95b7b8f9e73b6580b3 [id=5ebbff7e02dd4208bb51d92494510642]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.816537 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba163e0f6164d65b09da684ee4872e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.817037 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 1d9562d917b74db9aa4a9678b9d32841 (DEFAULT_TABLE table=default.Table_066bd6c1063544008f82fa386dd2e5a1 [id=b0d22ea6a09540ef82c6719ffcdfdf11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.830768 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 89783d26db9e49f0ae5171f929fcf1df (DEFAULT_TABLE table=default.Table_809751f8c81a413590d182426a142d1d [id=1d97fa8043884caca863cda21242e82e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.820122 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet d4f05da432f041378c5ab808536e6b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.832516 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d9562d917b74db9aa4a9678b9d32841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.835511 1559 ts_tablet_manager.cc:1918] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:06.835657 1559 log.cc:1196] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3a231aff1a39485db36979208d871ab3
I20260927 15:06:06.837917 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c5695d700a0a493787faac8cf1bd52e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.838465 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5695d700a0a493787faac8cf1bd52e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.838869 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8034812bd8b44d97bc63b7d65b8f83d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.845963 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_269c53f28aca4ac88279237446faf109"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.846181 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f8b73341b24f4b28841b59c55d6c05a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.846556 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_269c53f28aca4ac88279237446faf109 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:06.846702 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8b73341b24f4b28841b59c55d6c05a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.847021 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_abf58979f24a466485e0b343a6a3feac" } modify_external_catalogs: true
I20260927 15:06:06.847203 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_abf58979f24a466485e0b343a6a3feac" } modify_external_catalogs: true
I20260927 15:06:06.848377 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c17aba6177d54467b2120ce673c0dfb4" } new_table_name: "default.Table_ac7bff6e03d44dba9636e37f00fa658b" modify_external_catalogs: true
I20260927 15:06:06.849084 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_18591fe82c804016b1f5794d997374d5" } new_table_name: "default.Table_5c5b46d2dba044ef8c5bb41023e108ee" modify_external_catalogs: true
I20260927 15:06:06.849681 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c3fc9ebaaba64e83829700b3281b210d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.850138 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fca35566db71465b832f9b48c272b49f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:06.850193 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3fc9ebaaba64e83829700b3281b210d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.852846 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_54e2863baa68479a8d2a670386880094"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.853338 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54e2863baa68479a8d2a670386880094 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.854442 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10b19de22dd74d74bdf619c75fc17762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.859262 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7a9c96abcfd347a9881b99df093da490
W20260927 15:06:06.859935 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d167c390ed546e09f31f1e08988500c consensus state has no leader
I20260927 15:06:06.860536 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a9c96abcfd347a9881b99df093da490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:06.863070 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 610ff6563dc64e73b2b4d7c268468b21 consensus state has no leader
I20260927 15:06:06.872066 1559 ts_tablet_manager.cc:1939] T 3a231aff1a39485db36979208d871ab3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:06.872887 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 470) took 1067 ms. Trace:
I20260927 15:06:06.873018 1559 rpcz_store.cc:276] 0927 15:06:05.805503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.805645 (+ 142us) service_pool.cc:227] Handling call
0927 15:06:05.827809 (+ 22164us) ts_tablet_manager.cc:1145] Deleting tablet 3a231aff1a39485db36979208d871ab3
0927 15:06:05.827818 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.500974 (+673156us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:06.830780 (+329806us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:06.872847 (+ 42067us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20529,"tablet-delete.queue_time_us":20900}
I20260927 15:06:06.873481 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 472) took 1038 ms. Trace:
I20260927 15:06:06.873607 1559 rpcz_store.cc:276] 0927 15:06:05.835389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.835441 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:06.873332 (+1037891us) ts_tablet_manager.cc:1145] Deleting tablet 424b66c69254487f932894516d570204
0927 15:06:06.873342 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.873445 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1036358}
I20260927 15:06:06.873862 1559 tablet_replica.cc:330] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:06.874410 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89783d26db9e49f0ae5171f929fcf1df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:06.876163 901 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 133313us
I20260927 15:06:06.876394 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e9d03457dac43038b4e6fb120ff572c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:06.876621 1438 raft_consensus.cc:2454] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:06.878417 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 3a231aff1a39485db36979208d871ab3 (table default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f [id=403185df10bf4ed980e2a8ce8427a93f]) successfully deleted
W20260927 15:06:06.878677 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 424b66c69254487f932894516d570204 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 424b66c69254487f932894516d570204 already in progress: creating tablet
I20260927 15:06:06.880898 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:06.883076 924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dbf522d70373412b87815d33c0f1f745" candidate_term: 2 candidate_status { last_received { term: 1 index: 576 } } ignore_live_leader: false dest_uuid: "6b6a41e027f0448cafe3365f23103f92" is_pre_election: true
I20260927 15:06:06.824200 2170 tablet.cc:1722] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:06.825368 2094 raft_consensus.cc:2726] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:06.825536 1552 raft_consensus.cc:374] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:06.888926 1552 raft_consensus.cc:729] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:06.889271 1552 consensus_queue.cc:260] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.890870 1438 raft_consensus.cc:1261] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Refusing update from remote peer c4264874db964ff2830b7894c2b3d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:06:06.891145 1404 tablet_service.cc:1467] Processing CreateTablet for tablet e1770acc612f4924ba62ee20767a31c1 (DEFAULT_TABLE table=default.Table_38f43f60e5ff4f65804ded14f7d99410 [id=92c79dd7bd094ab98a3c7125fd6a335d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.892460 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1770acc612f4924ba62ee20767a31c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.900347 1486 heartbeater.cc:464] Registering TS with master...
I20260927 15:06:06.902344 1407 tablet_service.cc:1467] Processing CreateTablet for tablet e7051277b0324331a28168eb387c770c (DEFAULT_TABLE table=default.Table_8f4553657b21460ab92da2ff23dca5d8 [id=c4b481feebe54e15b1ff2f1a009cb8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.902784 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7051277b0324331a28168eb387c770c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.905659 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 534a74d9f8e648168b87e26fb73c8b3a (DEFAULT_TABLE table=default.Table_d072149ddba94cff935fb906dcf0524c [id=ba95aca9e7c449bd8fe939e896ab1ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.905998 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 534a74d9f8e648168b87e26fb73c8b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.907326 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 79c983d3119f4754a33a1ec3a84665c1 (DEFAULT_TABLE table=default.Table_1363eb0bffb8454a9bfbc067762dad9c [id=ff900aafe4f94663a9633fc0fbec0a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.907886 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79c983d3119f4754a33a1ec3a84665c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.908686 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 2e85b83758e44de4894d3101465bb47e (DEFAULT_TABLE table=default.Table_9091bf3af8564f0fa93792507114d5b9 [id=21edfba1cfde477fb8220339e91f27ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.910655 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_269c53f28aca4ac88279237446faf109" } modify_external_catalogs: true
I20260927 15:06:06.910898 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_269c53f28aca4ac88279237446faf109" } modify_external_catalogs: true
I20260927 15:06:06.911561 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0c18b4cd27df497a8722e0a3c4a8e8e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.912197 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c18b4cd27df497a8722e0a3c4a8e8e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.915511 1283 tablet_service.cc:1467] Processing CreateTablet for tablet edc07b00db3c42eeb7543fecaf515eab (DEFAULT_TABLE table=default.Table_85e4afa525a840fb88a84cc7cd8042a8 [id=9844f2789e0342d28f0d7c5c1905983d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.915902 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edc07b00db3c42eeb7543fecaf515eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.917120 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fdbd726355df419fae94cbf8fce53375" } modify_external_catalogs: true
I20260927 15:06:06.917307 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fdbd726355df419fae94cbf8fce53375" } modify_external_catalogs: true
I20260927 15:06:06.917456 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ddb5bec424b947abba941419a9136bdc" } new_table_name: "default.Table_a0619053a2d04afda155e55e08d6bc7e" modify_external_catalogs: true
I20260927 15:06:06.917609 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ee79d927d2a24080beb4354086ce00f6" } modify_external_catalogs: true
I20260927 15:06:06.917845 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ee79d927d2a24080beb4354086ce00f6" } modify_external_catalogs: true
I20260927 15:06:06.919055 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d80304854a5249a08e5c2098c97d7c1c" } modify_external_catalogs: true
I20260927 15:06:06.919016 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7343b42c802f450fa21fbd575b426e4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.919214 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d80304854a5249a08e5c2098c97d7c1c" } modify_external_catalogs: true
W20260927 15:06:06.919473 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7343b42c802f450fa21fbd575b426e4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.921545 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e85b83758e44de4894d3101465bb47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.921926 1270 tablet_service.cc:1467] Processing CreateTablet for tablet a9a58b4d602b4f879fc56f5f1648f19c (DEFAULT_TABLE table=default.Table_53a07a501dad4901a14b534a8fecea27 [id=88572f756ab54b718c3caf4929135462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.922308 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9a58b4d602b4f879fc56f5f1648f19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.922314 1409 tablet_service.cc:1467] Processing CreateTablet for tablet fd225f6127ed4c4ea4bbea41aeb0521f (DEFAULT_TABLE table=default.Table_ebfd4efc9ff44240b03a8f680d418512 [id=47b387e918fc4edabad6f65e8a146eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.922452 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c3fc9ebaaba64e83829700b3281b210d" } new_table_name: "default.Table_7d8a934f4d0446f898f867fac907a053" modify_external_catalogs: true
I20260927 15:06:06.922529 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_868afe47a2504c16883e32967e707061" } new_table_name: "default.Table_17a0aa0524f040f0a54e3eaded51d06f" modify_external_catalogs: true
I20260927 15:06:06.925547 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd225f6127ed4c4ea4bbea41aeb0521f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.927018 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet f1ad3b9d5f8244c99a01f5951007e1fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.927395 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 3a47c42f9edd4e1ab761317b7b58e8df (DEFAULT_TABLE table=default.Table_0992c54eabeb45b19758c9660f2de1f7 [id=95a187aeda1f44e0bd3e8e70a0a3caec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.927744 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a47c42f9edd4e1ab761317b7b58e8df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.931080 1281 tablet_service.cc:1467] Processing CreateTablet for tablet fb99a5570603497fbcc029a31f7f947f (DEFAULT_TABLE table=default.Table_f52a44b8e26c4239ad332cec0499eead [id=2de9b33e6d6a40b5b8fcd4244a03549a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.931500 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb99a5570603497fbcc029a31f7f947f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:06.932117 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df6d7670381b49bb927943b2ee920c84 consensus state has no leader
W20260927 15:06:06.932333 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d6523d56f344208abc30f0d82138998 consensus state has no leader
I20260927 15:06:06.932597 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9d4487cbbce24e60ae76ec0aca2760f4
W20260927 15:06:06.933672 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9e357fa70ef4e15ba46f5fc12026e5a has no consensus state
I20260927 15:06:06.936187 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d4487cbbce24e60ae76ec0aca2760f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.938213 1556 tablet_bootstrap.cc:492] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:06.938241 2137 raft_consensus.cc:686] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:06.938356 1556 ts_tablet_manager.cc:1397] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.976s user 0.005s sys 0.022s
I20260927 15:06:06.939350 1556 raft_consensus.cc:348] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.939577 1556 raft_consensus.cc:374] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:06.939661 1556 raft_consensus.cc:729] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:06.939872 1556 consensus_queue.cc:260] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.940441 1556 ts_tablet_manager.cc:1428] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:06.940707 1556 tablet_bootstrap.cc:492] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:06.941502 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 96ac92258c6044a891b3325b7aaf3b8f
I20260927 15:06:06.942454 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 96ac92258c6044a891b3325b7aaf3b8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:06.943029 2137 consensus_queue.cc:237] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:06.944006 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet f0a71cf0ee554b3eafca3f054cc16b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.944453 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet e19cd7febe054432899739e21605406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.944871 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet c5cd55de34d249bc8d3adcf4690f0414 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:06.945427 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 89783d26db9e49f0ae5171f929fcf1df (DEFAULT_TABLE table=default.Table_809751f8c81a413590d182426a142d1d [id=1d97fa8043884caca863cda21242e82e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.945811 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89783d26db9e49f0ae5171f929fcf1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.955538 1267 tablet_service.cc:1467] Processing CreateTablet for tablet e1770acc612f4924ba62ee20767a31c1 (DEFAULT_TABLE table=default.Table_38f43f60e5ff4f65804ded14f7d99410 [id=92c79dd7bd094ab98a3c7125fd6a335d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:06.957135 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1770acc612f4924ba62ee20767a31c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:06.967628 1559 raft_consensus.cc:2229] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:06.968151 1559 pending_rounds.cc:62] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:06.968235 1559 pending_rounds.cc:68] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976338212429824 op_type: NO_OP noop_request { }
I20260927 15:06:06.968350 1559 raft_consensus.cc:2866] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:06.968451 1559 raft_consensus.cc:2258] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:06.969064 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8a603f04bc4e47bc96a9c06f178536ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:06.969185 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_35eb658172474617ac4f5ea71f19747d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.969689 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a603f04bc4e47bc96a9c06f178536ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.971563 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b1562c61fb3447a9b59d1069cbebee7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:06.972005 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1562c61fb3447a9b59d1069cbebee7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:06.969698 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35eb658172474617ac4f5ea71f19747d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:06.974136 913 master_service.cc:946] ReplaceTablet: received request to replace tablet 8d533883e3344eca939cd67644895148 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:06.976503 1559 ts_tablet_manager.cc:1905] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:06.993630 1552 ts_tablet_manager.cc:1428] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.237s user 0.001s sys 0.001s
I20260927 15:06:06.994709 1552 tablet_bootstrap.cc:492] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:06.998385 1351 heartbeater.cc:347] Connected to a master server at 127.0.201.62:41167
I20260927 15:06:07.007272 1873 leader_election.cc:302] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbf522d70373412b87815d33c0f1f745; no voters: 2a122de3662f485f8f44b0a5e4b29862, 6b6a41e027f0448cafe3365f23103f92
I20260927 15:06:07.007692 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 7d6d1cfb1a4d4c439e970d966af841b6 (table default.Table_de263f6e08ac4eed8c0d53662d9a8b00 [id=1ff3964110d34f149e6c3c539a802ff3]) successfully deleted
I20260927 15:06:07.008118 1552 tablet_bootstrap.cc:654] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:07.008847 2181 tablet.cc:1722] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:07.011822 2183 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:07.012560 1559 ts_tablet_manager.cc:1918] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:07.012753 1559 log.cc:1196] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/e066308fcdfc49ed926cd81963c5f1a7
I20260927 15:06:07.013674 1559 ts_tablet_manager.cc:1939] T e066308fcdfc49ed926cd81963c5f1a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:07.013654 1913 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "4769a710b72a4b49b816725a5921e86e" instance_seqno: 1790521555627347) as {username='slave'} at 127.0.201.2:38189; Asking this server to re-register.
I20260927 15:06:07.014009 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 67cf4dae943e4092b2c490ad770e4a94 with delete_type TABLET_DATA_DELETED (replaced by tablet b6f6bdef4ddb4f9c9c0d1f933768cd14) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.014461 1282 tablet_service.cc:1467] Processing CreateTablet for tablet e7051277b0324331a28168eb387c770c (DEFAULT_TABLE table=default.Table_8f4553657b21460ab92da2ff23dca5d8 [id=c4b481feebe54e15b1ff2f1a009cb8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.014536 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 474) took 1173 ms. Trace:
I20260927 15:06:07.014638 1559 rpcz_store.cc:276] 0927 15:06:05.840733 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.840783 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:06.873795 (+1033012us) ts_tablet_manager.cc:1145] Deleting tablet e066308fcdfc49ed926cd81963c5f1a7
0927 15:06:06.873814 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.967970 (+ 94156us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x6150001f3c24. stack: 00007f26d729d66e 00007f26d729d430 00007f26d63245ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f26e27d904d 00007f26e3a7d5ec 00007f26e640c2e6 00007f26e643e404 00007f26e641f870 00007f26e641f5fd 00000000009edb7c 00007f26d72e3344 00007f26d72e691b 00007f26d72e6798
0927 15:06:06.987460 (+ 19490us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.012321 (+ 24861us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.014503 (+ 2182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":215165824,"tablet-delete.queue_time_us":1032798}
I20260927 15:06:07.014847 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7051277b0324331a28168eb387c770c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.015120 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet e066308fcdfc49ed926cd81963c5f1a7 (table default.Table_7258841dfdbd45b0a5745d0a4cbd5551 [id=6ed04e9f13a242f581a5c92cca97a25d]) successfully deleted
I20260927 15:06:07.014073 2179 tablet.cc:1722] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:07.019146 1559 tablet_replica.cc:330] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:07.019150 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 79c983d3119f4754a33a1ec3a84665c1 (DEFAULT_TABLE table=default.Table_1363eb0bffb8454a9bfbc067762dad9c [id=ff900aafe4f94663a9633fc0fbec0a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.019318 2137 raft_consensus.cc:482] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:07.019377 1559 raft_consensus.cc:2229] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:07.019536 1559 raft_consensus.cc:2258] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.019603 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79c983d3119f4754a33a1ec3a84665c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.019511 2137 raft_consensus.cc:504] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.020045 1559 ts_tablet_manager.cc:1905] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.020313 2137 leader_election.cc:288] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:07.025887 1923 ts_manager.cc:194] Registered new tserver with Master: fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:07.026976 1271 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d4487cbbce24e60ae76ec0aca2760f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.027212 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 96ac92258c6044a891b3325b7aaf3b8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.029162 2119 ts_tablet_manager.cc:1918] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:07.029301 2119 log.cc:1196] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/9c9e4311049d47d3b2f1e117795624ef
I20260927 15:06:07.029661 2119 ts_tablet_manager.cc:1939] T 9c9e4311049d47d3b2f1e117795624ef P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:07.029990 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 429) took 1345 ms. Trace:
I20260927 15:06:07.030143 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 2e85b83758e44de4894d3101465bb47e (DEFAULT_TABLE table=default.Table_9091bf3af8564f0fa93792507114d5b9 [id=21edfba1cfde477fb8220339e91f27ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.030506 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e85b83758e44de4894d3101465bb47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.034736 1559 ts_tablet_manager.cc:1918] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:07.035002 1559 log.cc:1196] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/42baac8b7d47433e826eb3bc1980acaa
I20260927 15:06:07.035132 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 534a74d9f8e648168b87e26fb73c8b3a (DEFAULT_TABLE table=default.Table_d072149ddba94cff935fb906dcf0524c [id=ba95aca9e7c449bd8fe939e896ab1ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.035445 1559 ts_tablet_manager.cc:1939] T 42baac8b7d47433e826eb3bc1980acaa P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:07.035487 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 534a74d9f8e648168b87e26fb73c8b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.037088 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 476) took 1196 ms. Trace:
I20260927 15:06:07.037380 1559 rpcz_store.cc:276] 0927 15:06:05.840980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.841030 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:07.019088 (+1178058us) ts_tablet_manager.cc:1145] Deleting tablet 42baac8b7d47433e826eb3bc1980acaa
0927 15:06:07.019097 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.030495 (+ 11398us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.034644 (+ 4149us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.037020 (+ 2376us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1177899}
I20260927 15:06:07.037858 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 42baac8b7d47433e826eb3bc1980acaa (table default.Table_e362bbc19fce4b2a842bd907b98ede40 [id=d3243f5a530645288cdf6befd30c31e3]) successfully deleted
I20260927 15:06:07.038235 1559 tablet_replica.cc:330] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:07.038472 1559 raft_consensus.cc:2229] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:07.038712 1559 pending_rounds.cc:62] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:07.038772 1559 pending_rounds.cc:68] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976337633300480 op_type: NO_OP noop_request { }
I20260927 15:06:07.038932 1559 raft_consensus.cc:2866] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:07.039052 1559 raft_consensus.cc:2258] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.039963 1351 heartbeater.cc:464] Registering TS with master...
I20260927 15:06:07.041220 2185 tablet.cc:1722] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:07.041402 1552 tablet_bootstrap.cc:492] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:07.041550 1552 ts_tablet_manager.cc:1397] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.002s
I20260927 15:06:07.041872 2170 tablet.cc:1722] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:07.042984 1552 raft_consensus.cc:348] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.043759 1552 raft_consensus.cc:374] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:07.043849 1552 raft_consensus.cc:729] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:07.044149 1923 ts_manager.cc:194] Registered new tserver with Master: 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:07.044196 1552 consensus_queue.cc:260] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.044860 1552 ts_tablet_manager.cc:1428] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:07.045321 1552 tablet_bootstrap.cc:492] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:07.048049 1552 tablet_bootstrap.cc:654] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:07.052932 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_279db08831174124bf691a8cad553e81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.053654 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_279db08831174124bf691a8cad553e81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.054921 912 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 08f28c023473434ba73b1142a041be97 (table default.Table_826c1efeddc74a17ad2db271286974ac [id=67762455acad44448ba24d18c2863816]). Expected version 3 got 0
I20260927 15:06:07.059963 911 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 08f28c023473434ba73b1142a041be97 (table default.Table_826c1efeddc74a17ad2db271286974ac [id=67762455acad44448ba24d18c2863816]). Expected version 3 got 0
I20260927 15:06:07.062551 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_edb92ee651224ae8ac03471012ebb44b" } new_table_name: "default.Table_c792c8cddcc548b387f79c4664d664a4" modify_external_catalogs: true
I20260927 15:06:07.064003 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b33719cf7165405caf26b84396bd5f7b" } modify_external_catalogs: true
I20260927 15:06:07.064224 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b33719cf7165405caf26b84396bd5f7b" } modify_external_catalogs: true
I20260927 15:06:07.065332 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c5c7a3c4978a4100b3e643bcbb8e6b70" } new_table_name: "default.Table_de460bc61353426699a8c19e69f38a36" modify_external_catalogs: true
I20260927 15:06:07.070087 911 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_0021fd56477c4debbfe492c5673d41c2 [id=56574e770aa74f04a7bf24b7718e4960] alter complete (version 2)
I20260927 15:06:07.070627 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0ef0f88b084c44adbaa8d752c24f67a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.071251 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ef0f88b084c44adbaa8d752c24f67a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.072609 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_49ac42f044d84fd5ad0acbf7fa401b33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.073125 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49ac42f044d84fd5ad0acbf7fa401b33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.073580 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8f620f33a9dc4d388caf59fd6edc6cc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.074003 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f620f33a9dc4d388caf59fd6edc6cc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.074393 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3cdaadf2a6d64643a97238fcba5134a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.074908 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cdaadf2a6d64643a97238fcba5134a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:07.076375 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10b19de22dd74d74bdf619c75fc17762 consensus state has no leader
W20260927 15:06:07.077039 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d05f7db323e40b780b050b560e1c846 consensus state has no leader
I20260927 15:06:07.079345 2094 raft_consensus.cc:482] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:07.081841 2094 raft_consensus.cc:504] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.082413 2094 leader_election.cc:288] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:07.083238 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f28c023473434ba73b1142a041be97" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:07.092053 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45b610025b1a4b68bdc34f870654f9d1" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:07.093461 1376 leader_election.cc:341] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.098876 1280 tablet_service.cc:1467] Processing CreateTablet for tablet fd225f6127ed4c4ea4bbea41aeb0521f (DEFAULT_TABLE table=default.Table_ebfd4efc9ff44240b03a8f680d418512 [id=47b387e918fc4edabad6f65e8a146eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.099472 912 master_service.cc:946] ReplaceTablet: received request to replace tablet c41cd38355e64590b43b2e1271c43e91 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:07.103060 1556 tablet_bootstrap.cc:654] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:07.116204 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd225f6127ed4c4ea4bbea41aeb0521f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.121739 1562 ts_tablet_manager.cc:1918] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:07.127691 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a3a8d1e9d1b54c209faf08c4ca2f04aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.128468 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3a8d1e9d1b54c209faf08c4ca2f04aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.134850 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a04a6074db084291834a75d52898cf4b" } modify_external_catalogs: true
I20260927 15:06:07.135082 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a04a6074db084291834a75d52898cf4b" } modify_external_catalogs: true
I20260927 15:06:07.136157 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d2aaea940100473b8730bf5faebd2b15" } new_table_name: "default.Table_cb686a947176423b897137ff82399455" modify_external_catalogs: true
I20260927 15:06:07.138309 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7accf34bdde24d1e9ddbc63f5b205640" } new_table_name: "default.Table_e5b4923d6799470bbe254277f66e23e5" modify_external_catalogs: true
I20260927 15:06:07.138844 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_13066a3685a54af8b406268b1bbbe003"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.139434 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13066a3685a54af8b406268b1bbbe003 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.140540 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2e6fedff929f4c0bbe9df08fc0314680" } new_table_name: "default.Table_3f87c14f83fd403a9ab71722e7e3bff9" modify_external_catalogs: true
I20260927 15:06:07.142758 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 5bc96d1626f24cfab49bf6a36e1da33e from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:07.113300 2173 consensus_queue.cc:1159] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
W20260927 15:06:07.148046 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 480e3d9b3d31443fad163542c6681110 consensus state has no leader
I20260927 15:06:07.148432 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cb426815b34f4e6c89470b4b3904b673" } modify_external_catalogs: true
I20260927 15:06:07.148620 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cb426815b34f4e6c89470b4b3904b673" } modify_external_catalogs: true
I20260927 15:06:07.149106 1559 ts_tablet_manager.cc:1905] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:07.154330 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 373b6e6c03614b78a8343c84095bd347 consensus state has no leader
W20260927 15:06:07.155267 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f199e9507a894fdabe2ccd2cef699fd8 consensus state has no leader
I20260927 15:06:07.167474 1559 ts_tablet_manager.cc:1918] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:07.167837 1559 log.cc:1196] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/fde632b187eb4180b343d7bddc7f0943
I20260927 15:06:07.170749 1559 ts_tablet_manager.cc:1939] T fde632b187eb4180b343d7bddc7f0943 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:07.172325 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 475) took 1330 ms. Trace:
I20260927 15:06:07.172528 1559 rpcz_store.cc:276] 0927 15:06:05.840837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.841380 (+ 543us) service_pool.cc:227] Handling call
0927 15:06:07.038136 (+1196756us) ts_tablet_manager.cc:1145] Deleting tablet fde632b187eb4180b343d7bddc7f0943
0927 15:06:07.038150 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.152642 (+114492us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.163053 (+ 10411us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.171540 (+ 8487us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1196557}
I20260927 15:06:07.173053 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet fde632b187eb4180b343d7bddc7f0943 (table default.Table_be15cdb2ae6a49e38da808ee4cafd27c [id=bb4c8603779d4998bbf639ff0f8b2ed9]) successfully deleted
I20260927 15:06:07.176056 1559 tablet_replica.cc:330] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:07.176357 1559 raft_consensus.cc:2229] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:07.176632 1559 raft_consensus.cc:2258] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.177575 1559 ts_tablet_manager.cc:1905] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.181444 1556 tablet_bootstrap.cc:492] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:07.181672 1556 ts_tablet_manager.cc:1397] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.241s user 0.008s sys 0.006s
I20260927 15:06:07.182664 1556 raft_consensus.cc:348] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.183048 1556 raft_consensus.cc:374] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:07.183187 1556 raft_consensus.cc:729] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:07.183530 1556 consensus_queue.cc:260] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.186543 913 master_service.cc:946] ReplaceTablet: received request to replace tablet af25950fd08043f18a6eaaf46ded4378 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:07.121978 1099 consensus_peers.cc:487] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9a7ed6e23e1479a86e2abcf6aa5b317. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:07.189821 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 297478us
W20260927 15:06:07.190222 1099 consensus_peers.cc:487] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63289edbdd734dd5a817df42d83e422e. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:07.190423 1099 consensus_peers.cc:487] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a46e15ea145b4eae8f94b664067b4f92. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:07.190685 1099 leader_election.cc:341] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3a231aff1a39485db36979208d871ab3
I20260927 15:06:07.190658 2070 consensus_queue.cc:1035] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:07.190809 1099 leader_election.cc:302] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:07.191129 2070 raft_consensus.cc:2726] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:07.191157 1099 leader_election.cc:302] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:07.191642 2070 raft_consensus.cc:2781] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:07.191756 2070 raft_consensus.cc:482] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:07.191861 2070 raft_consensus.cc:3037] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:07.192158 2142 consensus_queue.cc:1035] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:07.194777 2070 raft_consensus.cc:504] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.195808 2070 leader_election.cc:288] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:07.196643 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_19d971ae53cd42748c5f56cd7451bfc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.197288 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19d971ae53cd42748c5f56cd7451bfc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.123492 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet f1ad3b9d5f8244c99a01f5951007e1fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.200474 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4
I20260927 15:06:07.201445 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.201550 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:07.203460 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6041922ddbbd40f1a099875f5071c91d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:07.203904 1069 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4
W20260927 15:06:07.203984 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6041922ddbbd40f1a099875f5071c91d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.204340 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1584e270ee294e3f9079b464b830f50a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.204823 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1584e270ee294e3f9079b464b830f50a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.206188 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 177c5ac2c14a4f9baa85d46541181787 (DEFAULT_TABLE table=default.Table_54e2863baa68479a8d2a670386880094 [id=f4b761be6ae94cb092f262c9ceeb4201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.206559 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 177c5ac2c14a4f9baa85d46541181787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.206949 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.207641 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 177c5ac2c14a4f9baa85d46541181787 (DEFAULT_TABLE table=default.Table_54e2863baa68479a8d2a670386880094 [id=f4b761be6ae94cb092f262c9ceeb4201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.208642 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 2b18847655594043a3fcf2188d8d0b7e (DEFAULT_TABLE table=default.Table_c5695d700a0a493787faac8cf1bd52e0 [id=fa6aab7721eb41f5b10fab4d331d9515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.209069 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b18847655594043a3fcf2188d8d0b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.211288 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:07.211534 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 177c5ac2c14a4f9baa85d46541181787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.212167 1404 tablet_service.cc:1467] Processing CreateTablet for tablet c9e541ad12fd470986eb82b4855db498 (DEFAULT_TABLE table=default.Table_a5f82e24d3204c97a20b0b8db78e82d4 [id=e954de21a57c4eb5ba1aabdffab9c7d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.212340 1144 tablet_service.cc:1467] Processing CreateTablet for tablet e9e357fa70ef4e15ba46f5fc12026e5a (DEFAULT_TABLE table=default.Table_7d8a934f4d0446f898f867fac907a053 [id=89c47db91f0d4a349eacba400b3349a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.212563 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9e541ad12fd470986eb82b4855db498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.212683 1138 tablet_service.cc:1467] Processing CreateTablet for tablet c9e541ad12fd470986eb82b4855db498 (DEFAULT_TABLE table=default.Table_a5f82e24d3204c97a20b0b8db78e82d4 [id=e954de21a57c4eb5ba1aabdffab9c7d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.212760 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 467cda952ec4492f9206ee4847abc3bc (DEFAULT_TABLE table=default.Table_c83fd3da9f48466c93f466016033cd56 [id=a750028adf8f4eeca41d3063282104e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.213080 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 467cda952ec4492f9206ee4847abc3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.126399 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 89783d26db9e49f0ae5171f929fcf1df (DEFAULT_TABLE table=default.Table_809751f8c81a413590d182426a142d1d [id=1d97fa8043884caca863cda21242e82e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.133647 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08f28c023473434ba73b1142a041be97" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:07.213207 1127 tablet_service.cc:1467] Processing CreateTablet for tablet ddfb62d579704b30a3482b7f95be4922 (DEFAULT_TABLE table=default.Table_f8b73341b24f4b28841b59c55d6c05a9 [id=50b06ee533d948bda8df43b3cf85d4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.139137 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a9c96abcfd347a9881b99df093da490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.144074 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e9d03457dac43038b4e6fb120ff572c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.213665 1145 tablet_service.cc:1467] Processing CreateTablet for tablet b2b5f866646d4da9a0d0881a3bf6bd83 (DEFAULT_TABLE table=default.Table_af5779149a514b809b9e3f46afc2adf8 [id=97438236a4a04508921360e4d4e446b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.146353 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 79c983d3119f4754a33a1ec3a84665c1 (DEFAULT_TABLE table=default.Table_1363eb0bffb8454a9bfbc067762dad9c [id=ff900aafe4f94663a9633fc0fbec0a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.214432 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 (DEFAULT_TABLE table=default.Table_269c53f28aca4ac88279237446faf109 [id=ae45dddb7f2940e99b44b1acefde9799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.212661 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9e357fa70ef4e15ba46f5fc12026e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.215190 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89783d26db9e49f0ae5171f929fcf1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.215332 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 2b18847655594043a3fcf2188d8d0b7e (DEFAULT_TABLE table=default.Table_c5695d700a0a493787faac8cf1bd52e0 [id=fa6aab7721eb41f5b10fab4d331d9515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.215651 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b18847655594043a3fcf2188d8d0b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.218956 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79c983d3119f4754a33a1ec3a84665c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.219087 1419 tablet_service.cc:1467] Processing CreateTablet for tablet e9e357fa70ef4e15ba46f5fc12026e5a (DEFAULT_TABLE table=default.Table_7d8a934f4d0446f898f867fac907a053 [id=89c47db91f0d4a349eacba400b3349a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.219466 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9e357fa70ef4e15ba46f5fc12026e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.223079 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2b5f866646d4da9a0d0881a3bf6bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.223091 1407 tablet_service.cc:1467] Processing CreateTablet for tablet ddfb62d579704b30a3482b7f95be4922 (DEFAULT_TABLE table=default.Table_f8b73341b24f4b28841b59c55d6c05a9 [id=50b06ee533d948bda8df43b3cf85d4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.223416 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddfb62d579704b30a3482b7f95be4922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.225423 1562 log.cc:1196] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/7d1f23f91bce4df480dd9991659f2e81
I20260927 15:06:07.226344 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddfb62d579704b30a3482b7f95be4922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.231014 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9e541ad12fd470986eb82b4855db498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.232188 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet a04caae16db84d8ea9050b648c1ba354 (table default.Table_9e1c88622f89474285f6bdb98faffffb [id=32293fa2bff246dba3dfe47a3fcaf310]). Expected version 1 got 0
I20260927 15:06:07.232451 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]). Expected version 4 got 0
I20260927 15:06:07.232656 912 catalog_manager.cc:5495] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:07.233179 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 988ae3a67a4b436583cb475fbcf07b8f (table default.Table_fc15353bc7ae407b85aece886ce4db99 [id=19258732f721448fadcdb38690160dd4]). Expected version 2 got 0
I20260927 15:06:07.234988 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.240548 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 180c347e066f4d9a897825bad8a32d69 (DEFAULT_TABLE table=default.Table_10c51390989a4f3a829a9e22bcfc0ccf [id=9f66a66cb744485da60e11e4b4d3edd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.240962 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 180c347e066f4d9a897825bad8a32d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.240746 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 180c347e066f4d9a897825bad8a32d69 (DEFAULT_TABLE table=default.Table_10c51390989a4f3a829a9e22bcfc0ccf [id=9f66a66cb744485da60e11e4b4d3edd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.241628 1559 ts_tablet_manager.cc:1918] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:07.241745 1559 log.cc:1196] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/ad5af5df58824fe88d607a93216bd228
I20260927 15:06:07.241868 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 180c347e066f4d9a897825bad8a32d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.243125 1559 ts_tablet_manager.cc:1939] T ad5af5df58824fe88d607a93216bd228 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:07.244156 1417 tablet_service.cc:1467] Processing CreateTablet for tablet b2b5f866646d4da9a0d0881a3bf6bd83 (DEFAULT_TABLE table=default.Table_af5779149a514b809b9e3f46afc2adf8 [id=97438236a4a04508921360e4d4e446b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.244618 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 (DEFAULT_TABLE table=default.Table_269c53f28aca4ac88279237446faf109 [id=ae45dddb7f2940e99b44b1acefde9799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.245875 1403 tablet_service.cc:1467] Processing CreateTablet for tablet d15b7dfb83494d329ca75dd96a189c60 (DEFAULT_TABLE table=default.Table_3e14460ebed347b7be671cd31ed5951a [id=cb5f7c2ef0cb459c87788c20b4a1666c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.249993 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2b5f866646d4da9a0d0881a3bf6bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.251183 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d15b7dfb83494d329ca75dd96a189c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.253579 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.259150 1143 tablet_service.cc:1467] Processing CreateTablet for tablet d15b7dfb83494d329ca75dd96a189c60 (DEFAULT_TABLE table=default.Table_3e14460ebed347b7be671cd31ed5951a [id=cb5f7c2ef0cb459c87788c20b4a1666c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.259770 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d15b7dfb83494d329ca75dd96a189c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.260481 1556 ts_tablet_manager.cc:1428] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.079s user 0.002s sys 0.000s
I20260927 15:06:07.148010 1137 tablet_service.cc:1467] Processing CreateTablet for tablet e1770acc612f4924ba62ee20767a31c1 (DEFAULT_TABLE table=default.Table_38f43f60e5ff4f65804ded14f7d99410 [id=92c79dd7bd094ab98a3c7125fd6a335d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.148406 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 2e85b83758e44de4894d3101465bb47e (DEFAULT_TABLE table=default.Table_9091bf3af8564f0fa93792507114d5b9 [id=21edfba1cfde477fb8220339e91f27ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.269546 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e85b83758e44de4894d3101465bb47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.148573 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d4487cbbce24e60ae76ec0aca2760f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.148613 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 534a74d9f8e648168b87e26fb73c8b3a (DEFAULT_TABLE table=default.Table_d072149ddba94cff935fb906dcf0524c [id=ba95aca9e7c449bd8fe939e896ab1ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.148681 1142 tablet_service.cc:1467] Processing CreateTablet for tablet e7051277b0324331a28168eb387c770c (DEFAULT_TABLE table=default.Table_8f4553657b21460ab92da2ff23dca5d8 [id=c4b481feebe54e15b1ff2f1a009cb8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.148752 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 96ac92258c6044a891b3325b7aaf3b8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.147905 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45b610025b1a4b68bdc34f870654f9d1" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:07.161002 1128 tablet_service.cc:1467] Processing CreateTablet for tablet fd225f6127ed4c4ea4bbea41aeb0521f (DEFAULT_TABLE table=default.Table_ebfd4efc9ff44240b03a8f680d418512 [id=47b387e918fc4edabad6f65e8a146eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.168723 1561 tablet_bootstrap.cc:492] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:07.280692 1561 ts_tablet_manager.cc:1397] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.596s user 0.008s sys 0.025s
I20260927 15:06:07.282465 1561 raft_consensus.cc:348] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.282840 1561 raft_consensus.cc:374] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:07.282981 1561 raft_consensus.cc:729] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:07.283250 1561 consensus_queue.cc:260] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.284649 1561 ts_tablet_manager.cc:1428] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260927 15:06:07.288424 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 5bc96d1626f24cfab49bf6a36e1da33e
I20260927 15:06:07.288970 911 catalog_manager.cc:6565] ReplaceTablet: tablet 5bc96d1626f24cfab49bf6a36e1da33e deleted and replaced by tablet 8472966402af4053b8c883d0c4a7c2a3
I20260927 15:06:07.290283 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2afab8bf87bc45c899bcd5dfdad48d26
I20260927 15:06:07.290951 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 377847d06b534883ba2b870ca3317fe0 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:07.291452 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 90619b7804324c9589b53342e2f6d0e8
I20260927 15:06:07.292210 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8133a6b1d48149a9a063310debe2bddd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.293031 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8133a6b1d48149a9a063310debe2bddd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.294606 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet af25950fd08043f18a6eaaf46ded4378
I20260927 15:06:07.295127 913 catalog_manager.cc:6565] ReplaceTablet: tablet af25950fd08043f18a6eaaf46ded4378 deleted and replaced by tablet 571072536098420d8b5bdddc9aaa4161
I20260927 15:06:07.295464 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_702f8a99c52f4aa197c9a40e3cc7dfa4" } new_table_name: "default.Table_1edfa5a3ee694409bba96890df52a19e" modify_external_catalogs: true
I20260927 15:06:07.299229 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 454e637ec622424e81a8770c16bbc941
I20260927 15:06:07.303893 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet af25950fd08043f18a6eaaf46ded4378 with delete_type TABLET_DATA_DELETED (replaced by tablet 571072536098420d8b5bdddc9aaa4161) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:07.305634 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ace1274fa2e14536abd51af7dfe6f85f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.306317 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ace1274fa2e14536abd51af7dfe6f85f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.307963 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 473) took 1467 ms. Trace:
I20260927 15:06:07.308996 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 2afab8bf87bc45c899bcd5dfdad48d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.309608 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 90619b7804324c9589b53342e2f6d0e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.310272 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet af25950fd08043f18a6eaaf46ded4378 with delete_type TABLET_DATA_DELETED (replaced by tablet 571072536098420d8b5bdddc9aaa4161) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.310736 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 454e637ec622424e81a8770c16bbc941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.312034 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 2afab8bf87bc45c899bcd5dfdad48d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:07.312414 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bc96d1626f24cfab49bf6a36e1da33e with delete_type TABLET_DATA_DELETED (replaced by tablet 8472966402af4053b8c883d0c4a7c2a3) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.312865 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 90619b7804324c9589b53342e2f6d0e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:07.312994 1559 rpcz_store.cc:276] 0927 15:06:05.840592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.841459 (+ 867us) service_pool.cc:227] Handling call
0927 15:06:07.175954 (+1334495us) ts_tablet_manager.cc:1145] Deleting tablet ad5af5df58824fe88d607a93216bd228
0927 15:06:07.175979 (+ 25us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.191586 (+ 15607us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.240745 (+ 49159us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.307925 (+ 67180us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1331243}
I20260927 15:06:07.313220 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bc96d1626f24cfab49bf6a36e1da33e with delete_type TABLET_DATA_DELETED (replaced by tablet 8472966402af4053b8c883d0c4a7c2a3) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:07.313899 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet ad5af5df58824fe88d607a93216bd228 (table default.Table_86b086d55b34411782656982b6de6a74 [id=63f859bf91e142e3a4b9600a580b6b39]) successfully deleted
I20260927 15:06:07.314138 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 478) took 1470 ms. Trace:
I20260927 15:06:07.314324 1559 rpcz_store.cc:276] 0927 15:06:05.843341 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.844265 (+ 924us) service_pool.cc:227] Handling call
0927 15:06:07.313989 (+1469724us) ts_tablet_manager.cc:1145] Deleting tablet a97f72ddef5346c297d73589e926260c
0927 15:06:07.313999 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.314109 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1469487}
I20260927 15:06:07.313320 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 454e637ec622424e81a8770c16bbc941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:07.314548 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 467cda952ec4492f9206ee4847abc3bc (DEFAULT_TABLE table=default.Table_c83fd3da9f48466c93f466016033cd56 [id=a750028adf8f4eeca41d3063282104e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.315021 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 479) took 1468 ms. Trace:
W20260927 15:06:07.315033 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a97f72ddef5346c297d73589e926260c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a97f72ddef5346c297d73589e926260c already in progress: creating tablet
I20260927 15:06:07.030078 2119 rpcz_store.cc:276] 0927 15:06:05.684877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.686585 (+ 1708us) service_pool.cc:227] Handling call
0927 15:06:06.751817 (+1065232us) ts_tablet_manager.cc:1145] Deleting tablet 9c9e4311049d47d3b2f1e117795624ef
0927 15:06:06.751829 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.943821 (+191992us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.029060 (+ 85239us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.029938 (+ 878us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1064992}
I20260927 15:06:07.316164 2119 tablet_replica.cc:330] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:07.316363 2119 raft_consensus.cc:2229] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:07.316584 2119 raft_consensus.cc:2258] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.186055 2197 tablet.cc:1722] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:07.316824 1559 rpcz_store.cc:276] 0927 15:06:05.846960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.847013 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:07.314894 (+1467881us) ts_tablet_manager.cc:1145] Deleting tablet b44e2611d2bf40ae90c4fd857225e39e
0927 15:06:07.314904 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.314993 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1466066}
I20260927 15:06:07.317193 1556 tablet_bootstrap.cc:492] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:07.317485 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b44e2611d2bf40ae90c4fd857225e39e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b44e2611d2bf40ae90c4fd857225e39e already in progress: creating tablet
I20260927 15:06:07.318360 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a9c96abcfd347a9881b99df093da490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.319227 1556 tablet_bootstrap.cc:654] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:07.319593 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 477) took 1476 ms. Trace:
I20260927 15:06:07.325466 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 177c5ac2c14a4f9baa85d46541181787 (DEFAULT_TABLE table=default.Table_54e2863baa68479a8d2a670386880094 [id=f4b761be6ae94cb092f262c9ceeb4201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.325460 1559 rpcz_store.cc:276] 0927 15:06:05.843192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.844202 (+ 1010us) service_pool.cc:227] Handling call
0927 15:06:07.319435 (+1475233us) ts_tablet_manager.cc:1145] Deleting tablet b2d2501a9f764790818426665e7f0340
0927 15:06:07.319448 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.319547 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1468349}
W20260927 15:06:07.326053 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b2d2501a9f764790818426665e7f0340 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2d2501a9f764790818426665e7f0340 already in progress: creating tablet
I20260927 15:06:07.326630 1272 tablet_service.cc:1467] Processing CreateTablet for tablet d15b7dfb83494d329ca75dd96a189c60 (DEFAULT_TABLE table=default.Table_3e14460ebed347b7be671cd31ed5951a [id=cb5f7c2ef0cb459c87788c20b4a1666c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.326792 1559 tablet_replica.cc:330] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:07.327032 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d15b7dfb83494d329ca75dd96a189c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.327093 1559 raft_consensus.cc:2229] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:07.327291 1559 raft_consensus.cc:2258] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.328017 1559 ts_tablet_manager.cc:1905] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.328239 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 467cda952ec4492f9206ee4847abc3bc (DEFAULT_TABLE table=default.Table_c83fd3da9f48466c93f466016033cd56 [id=a750028adf8f4eeca41d3063282104e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.331465 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 467cda952ec4492f9206ee4847abc3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.334545 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 177c5ac2c14a4f9baa85d46541181787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.340848 1270 tablet_service.cc:1467] Processing CreateTablet for tablet b2b5f866646d4da9a0d0881a3bf6bd83 (DEFAULT_TABLE table=default.Table_af5779149a514b809b9e3f46afc2adf8 [id=97438236a4a04508921360e4d4e446b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.341214 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2b5f866646d4da9a0d0881a3bf6bd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.343197 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 (DEFAULT_TABLE table=default.Table_269c53f28aca4ac88279237446faf109 [id=ae45dddb7f2940e99b44b1acefde9799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.343596 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.347081 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 180c347e066f4d9a897825bad8a32d69 (DEFAULT_TABLE table=default.Table_10c51390989a4f3a829a9e22bcfc0ccf [id=9f66a66cb744485da60e11e4b4d3edd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.347380 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 180c347e066f4d9a897825bad8a32d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.351009 1271 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bc96d1626f24cfab49bf6a36e1da33e with delete_type TABLET_DATA_DELETED (replaced by tablet 8472966402af4053b8c883d0c4a7c2a3) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.351531 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet af25950fd08043f18a6eaaf46ded4378 with delete_type TABLET_DATA_DELETED (replaced by tablet 571072536098420d8b5bdddc9aaa4161) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.351560 1556 tablet_bootstrap.cc:492] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:07.351719 1556 ts_tablet_manager.cc:1397] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.000s
I20260927 15:06:07.351738 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 454e637ec622424e81a8770c16bbc941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.351938 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 90619b7804324c9589b53342e2f6d0e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.352254 1284 tablet_service.cc:1467] Processing CreateTablet for tablet e9e357fa70ef4e15ba46f5fc12026e5a (DEFAULT_TABLE table=default.Table_7d8a934f4d0446f898f867fac907a053 [id=89c47db91f0d4a349eacba400b3349a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.352551 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9e357fa70ef4e15ba46f5fc12026e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.352646 1556 raft_consensus.cc:348] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.352941 1556 raft_consensus.cc:374] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:07.353034 1556 raft_consensus.cc:729] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:07.353315 1556 consensus_queue.cc:260] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.354892 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 2afab8bf87bc45c899bcd5dfdad48d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.356101 1281 tablet_service.cc:1467] Processing CreateTablet for tablet ddfb62d579704b30a3482b7f95be4922 (DEFAULT_TABLE table=default.Table_f8b73341b24f4b28841b59c55d6c05a9 [id=50b06ee533d948bda8df43b3cf85d4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.356418 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddfb62d579704b30a3482b7f95be4922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.358714 1556 ts_tablet_manager.cc:1428] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260927 15:06:07.359091 1556 tablet_bootstrap.cc:492] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:07.365643 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_519a5f172cb0461ebf48deafd431751a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.366403 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_519a5f172cb0461ebf48deafd431751a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.366910 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dbed284830c64bdcb8e42eaa73a92b47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.367453 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbed284830c64bdcb8e42eaa73a92b47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.367909 1556 tablet_bootstrap.cc:654] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:07.367856 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c6a9f9c3ec2149f4a29f0ff6ed71e1b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:07.368649 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d6af061238d5449ba54326f29719fe5c" } new_table_name: "default.Table_7bfe6167028e4bde809aa45546ce3826" modify_external_catalogs: true
W20260927 15:06:07.368765 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6a9f9c3ec2149f4a29f0ff6ed71e1b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.369900 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c6a248ec4ee64d0a8d986fdc683d69ba
I20260927 15:06:07.369688 1559 ts_tablet_manager.cc:1918] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:07.370517 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_85f7e805a2b84ca3a600cfa46ebc660f" } new_table_name: "default.Table_600a9f9429c7432aa5574b114c0ab9f9" modify_external_catalogs: true
I20260927 15:06:07.370651 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0f11b40830cd4696a3e43054e33ed454" } new_table_name: "default.Table_0af436e324cb429c887fcf9fe3a23b45" modify_external_catalogs: true
I20260927 15:06:07.371006 1559 log.cc:1196] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/6e9d03457dac43038b4e6fb120ff572c
I20260927 15:06:07.371368 1559 ts_tablet_manager.cc:1939] T 6e9d03457dac43038b4e6fb120ff572c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:07.372020 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7b4d8af41aa04ef3bf742ff0312c3ba6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:07.372125 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 492) took 1332 ms. Trace:
I20260927 15:06:07.372256 1559 rpcz_store.cc:276] 0927 15:06:06.039497 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.039684 (+ 187us) service_pool.cc:227] Handling call
0927 15:06:07.326019 (+1286335us) ts_tablet_manager.cc:1145] Deleting tablet 6e9d03457dac43038b4e6fb120ff572c
0927 15:06:07.326032 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.341058 (+ 15026us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.369584 (+ 28526us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.372075 (+ 2491us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1236515}
W20260927 15:06:07.372493 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b4d8af41aa04ef3bf742ff0312c3ba6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.372813 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 493) took 1289 ms. Trace:
I20260927 15:06:07.372910 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 2b18847655594043a3fcf2188d8d0b7e (DEFAULT_TABLE table=default.Table_c5695d700a0a493787faac8cf1bd52e0 [id=fa6aab7721eb41f5b10fab4d331d9515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.372939 1559 rpcz_store.cc:276] 0927 15:06:06.083721 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.084707 (+ 986us) service_pool.cc:227] Handling call
0927 15:06:07.372641 (+1287934us) ts_tablet_manager.cc:1145] Deleting tablet e2ba3bdf50b14aec85a99742426e9298
0927 15:06:07.372654 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.372763 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1238996}
I20260927 15:06:07.373262 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b18847655594043a3fcf2188d8d0b7e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:07.375064 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75645963963e4091af0edfcbc794fb2d consensus state has no leader
I20260927 15:06:07.375085 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 501) took 1259 ms. Trace:
I20260927 15:06:07.375172 1559 rpcz_store.cc:276] 0927 15:06:06.115833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.145208 (+ 29375us) service_pool.cc:227] Handling call
0927 15:06:07.374933 (+1229725us) ts_tablet_manager.cc:1145] Deleting tablet cf2d3438867a45319645a7b6bee7022a
0927 15:06:07.374945 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.375036 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1229505}
I20260927 15:06:07.375460 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_09d8cf7dce6a4b2f80ff871b85bfff29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:07.375622 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 502) took 1259 ms. Trace:
W20260927 15:06:07.375876 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09d8cf7dce6a4b2f80ff871b85bfff29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.377362 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet c6a248ec4ee64d0a8d986fdc683d69ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.379024 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet c6a248ec4ee64d0a8d986fdc683d69ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.375713 1559 rpcz_store.cc:276] 0927 15:06:06.115976 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.145446 (+ 29470us) service_pool.cc:227] Handling call
0927 15:06:07.375472 (+1230026us) ts_tablet_manager.cc:1145] Deleting tablet 0f4cff4a06db44269defca578af289d8
0927 15:06:07.375482 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.375557 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1228128}
I20260927 15:06:07.381474 1559 tablet_replica.cc:330] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:07.381893 1559 raft_consensus.cc:2229] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:07.383358 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 9c9e4311049d47d3b2f1e117795624ef (table default.Table_195d86242b4c4d008065aee0ea319f60 [id=e70d41731a9442ea9dbe00db169e3b3b]) successfully deleted
I20260927 15:06:07.383564 2137 raft_consensus.cc:482] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:07.383702 2137 raft_consensus.cc:504] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.384357 2137 leader_election.cc:288] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:07.385202 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 6e9d03457dac43038b4e6fb120ff572c (table default.Table_fa178c2ce0e14306911368823822afc2 [id=55e2284e62fa45629d02de072260473c]) successfully deleted
W20260927 15:06:07.385455 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e2ba3bdf50b14aec85a99742426e9298 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2ba3bdf50b14aec85a99742426e9298 already in progress: creating tablet
I20260927 15:06:07.385601 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet fde632b187eb4180b343d7bddc7f0943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:07.385702 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet cf2d3438867a45319645a7b6bee7022a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf2d3438867a45319645a7b6bee7022a already in progress: creating tablet
I20260927 15:06:07.385828 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet c6a248ec4ee64d0a8d986fdc683d69ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:07.385900 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0f4cff4a06db44269defca578af289d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f4cff4a06db44269defca578af289d8 already in progress: creating tablet
I20260927 15:06:07.386044 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet e066308fcdfc49ed926cd81963c5f1a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:07.387307 1559 raft_consensus.cc:2258] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.387967 1559 ts_tablet_manager.cc:1905] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.390573 1269 tablet_service.cc:1467] Processing CreateTablet for tablet c9e541ad12fd470986eb82b4855db498 (DEFAULT_TABLE table=default.Table_a5f82e24d3204c97a20b0b8db78e82d4 [id=e954de21a57c4eb5ba1aabdffab9c7d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.391040 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9e541ad12fd470986eb82b4855db498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.393893 1562 ts_tablet_manager.cc:1939] T 7d1f23f91bce4df480dd9991659f2e81 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:07.398455 2198 tablet.cc:1722] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:07.403239 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 534a74d9f8e648168b87e26fb73c8b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.403285 2198 tablet.cc:1722] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 15:06:07.403966 1374 leader_election.cc:341] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.404104 1374 leader_election.cc:302] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:07.404326 2200 raft_consensus.cc:482] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:07.404353 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f585bcdadbcc4032aa484481cdf94b72" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:07.404613 2137 raft_consensus.cc:2726] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:07.404495 2200 raft_consensus.cc:504] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:07.405118 1374 leader_election.cc:341] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.405160 2200 leader_election.cc:288] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:07.407122 1559 ts_tablet_manager.cc:1918] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:07.407291 1559 log.cc:1196] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/89bd5b459caa42e7a9153d9273ad52c4
I20260927 15:06:07.407845 1559 ts_tablet_manager.cc:1939] T 89bd5b459caa42e7a9153d9273ad52c4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:07.408324 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 378) took 3804 ms. Trace:
I20260927 15:06:07.408556 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 505) took 1262 ms. Trace:
I20260927 15:06:07.408449 1562 rpcz_store.cc:276] 0927 15:06:03.603918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.604695 (+ 777us) service_pool.cc:227] Handling call
0927 15:06:06.415200 (+2810505us) ts_tablet_manager.cc:1145] Deleting tablet 7d1f23f91bce4df480dd9991659f2e81
0927 15:06:06.415213 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:06.809365 (+394152us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.121589 (+312224us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.407750 (+286161us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x618000005118. stack: 00007f344c23b66e 00007f344c23b430 00007f344b2c25ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f344c2310fd 00007f344c23216e 00007f345f18acfd 00007f345f108883 00007f345b3aa752 00007f345b3dc404 00007f345b3bd870 00007f345b3bd5fd 00000000009edb7c 00007f344c281344
0927 15:06:07.408257 (+ 507us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30714112,"tablet-delete.queue_time_us":2808384}
I20260927 15:06:07.408668 1559 rpcz_store.cc:276] 0927 15:06:06.145740 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.360708 (+214968us) service_pool.cc:227] Handling call
0927 15:06:07.381406 (+1020698us) ts_tablet_manager.cc:1145] Deleting tablet 89bd5b459caa42e7a9153d9273ad52c4
0927 15:06:07.381415 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.391471 (+ 10056us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.407001 (+ 15530us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.408519 (+ 1518us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1018444}
I20260927 15:06:07.409034 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 379) took 3805 ms. Trace:
I20260927 15:06:07.409077 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_28678b473eb34fc98fdfa5b51c8f9ecc [id=4686792aaf36414380f3f894a5635874]) successfully deleted
I20260927 15:06:07.409202 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 506) took 1262 ms. Trace:
I20260927 15:06:07.409133 1562 rpcz_store.cc:276] 0927 15:06:03.604013 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.604720 (+ 707us) service_pool.cc:227] Handling call
0927 15:06:07.408827 (+3804107us) ts_tablet_manager.cc:1145] Deleting tablet 8f4bd8182c9d48c7b6e6175ab98d405a
0927 15:06:07.408836 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.408980 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3800829}
I20260927 15:06:07.409330 1559 rpcz_store.cc:276] 0927 15:06:06.147217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.362987 (+215770us) service_pool.cc:227] Handling call
0927 15:06:07.409073 (+1046086us) ts_tablet_manager.cc:1145] Deleting tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85
0927 15:06:07.409083 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.409173 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1045889}
I20260927 15:06:07.409518 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 376) took 3805 ms. Trace:
I20260927 15:06:07.409619 1562 rpcz_store.cc:276] 0927 15:06:03.603759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.604646 (+ 887us) service_pool.cc:227] Handling call
0927 15:06:07.409380 (+3804734us) ts_tablet_manager.cc:1145] Deleting tablet 4ead753ba6664829b1262712f35e64f2
0927 15:06:07.409409 (+ 29us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.409468 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3800561}
W20260927 15:06:07.409802 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 already in progress: creating tablet
I20260927 15:06:07.409924 1562 tablet_replica.cc:330] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:07.409909 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 510) took 1078 ms. Trace:
I20260927 15:06:07.410106 1562 raft_consensus.cc:2229] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:07.410040 1559 rpcz_store.cc:276] 0927 15:06:06.331427 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.461330 (+129903us) service_pool.cc:227] Handling call
0927 15:06:07.409770 (+948440us) ts_tablet_manager.cc:1145] Deleting tablet 1c018f11de9842bc883409f8af35fb5f
0927 15:06:07.409779 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.409880 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":948225}
I20260927 15:06:07.410274 1562 raft_consensus.cc:2258] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:07.410513 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1c018f11de9842bc883409f8af35fb5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c018f11de9842bc883409f8af35fb5f already in progress: creating tablet
I20260927 15:06:07.410686 1559 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 508) took 1115 ms. Trace:
I20260927 15:06:07.410760 1562 ts_tablet_manager.cc:1905] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.410818 1559 rpcz_store.cc:276] 0927 15:06:06.295588 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.371171 (+ 75583us) service_pool.cc:227] Handling call
0927 15:06:07.410483 (+1039312us) ts_tablet_manager.cc:1145] Deleting tablet 434e9390f1fd4a3ebb65924c37b85bd4
0927 15:06:07.410538 (+ 55us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.410646 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":936764}
W20260927 15:06:07.411232 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 434e9390f1fd4a3ebb65924c37b85bd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 434e9390f1fd4a3ebb65924c37b85bd4 already in progress: creating tablet
I20260927 15:06:07.411779 1559 tablet_replica.cc:330] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:07.411820 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet d4f05da432f041378c5ab808536e6b6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4f05da432f041378c5ab808536e6b6f already in progress: creating tablet
W20260927 15:06:07.412045 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6cba64a85ff14281a662bb41189a2c5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cba64a85ff14281a662bb41189a2c5e already in progress: creating tablet
I20260927 15:06:07.412102 1559 raft_consensus.cc:2229] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:07.412530 1559 raft_consensus.cc:2258] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.413486 1559 ts_tablet_manager.cc:1905] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.415650 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 7d1f23f91bce4df480dd9991659f2e81 (table default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]) successfully deleted
W20260927 15:06:07.415879 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8f4bd8182c9d48c7b6e6175ab98d405a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f4bd8182c9d48c7b6e6175ab98d405a already in progress: creating tablet
W20260927 15:06:07.416078 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 4ead753ba6664829b1262712f35e64f2 because the tablet was not found. No further retry: Not found: Tablet not found: 4ead753ba6664829b1262712f35e64f2
I20260927 15:06:07.413136 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd225f6127ed4c4ea4bbea41aeb0521f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.418957 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7051277b0324331a28168eb387c770c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.421478 1559 ts_tablet_manager.cc:1918] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:07.421603 1559 log.cc:1196] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/ba14b7531bb647248572be10d2b43cf2
I20260927 15:06:07.422001 1559 ts_tablet_manager.cc:1939] T ba14b7531bb647248572be10d2b43cf2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:07.422879 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet ba14b7531bb647248572be10d2b43cf2 (table default.Table_bc0cef144e2c48f6883df97308937a76 [id=43c20c5b532545b5b66ad52dc5af5fc2]) successfully deleted
I20260927 15:06:07.423110 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1770acc612f4924ba62ee20767a31c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:07.423246 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aa58fa9a1384013ac1674bc7d53c3b1 already in progress: creating tablet
W20260927 15:06:07.423527 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8d533883e3344eca939cd67644895148 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d533883e3344eca939cd67644895148 already in progress: creating tablet
W20260927 15:06:07.423785 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1ba163e0f6164d65b09da684ee4872e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ba163e0f6164d65b09da684ee4872e0 already in progress: creating tablet
W20260927 15:06:07.424062 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 04007cd4bd214b88a4664e23daf4b790 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04007cd4bd214b88a4664e23daf4b790 already in progress: creating tablet
W20260927 15:06:07.424304 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c5cd55de34d249bc8d3adcf4690f0414 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5cd55de34d249bc8d3adcf4690f0414 already in progress: creating tablet
W20260927 15:06:07.424573 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f1ad3b9d5f8244c99a01f5951007e1fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1ad3b9d5f8244c99a01f5951007e1fd already in progress: creating tablet
W20260927 15:06:07.424857 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e19cd7febe054432899739e21605406d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e19cd7febe054432899739e21605406d already in progress: creating tablet
W20260927 15:06:07.425100 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f0a71cf0ee554b3eafca3f054cc16b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0a71cf0ee554b3eafca3f054cc16b28 already in progress: creating tablet
W20260927 15:06:07.425364 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7a9c96abcfd347a9881b99df093da490 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a9c96abcfd347a9881b99df093da490 already in progress: creating tablet
W20260927 15:06:07.425631 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9d4487cbbce24e60ae76ec0aca2760f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d4487cbbce24e60ae76ec0aca2760f4 already in progress: creating tablet
W20260927 15:06:07.425882 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 96ac92258c6044a891b3325b7aaf3b8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96ac92258c6044a891b3325b7aaf3b8f already in progress: creating tablet
W20260927 15:06:07.426179 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 already in progress: creating tablet
W20260927 15:06:07.426702 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 already in progress: creating tablet
W20260927 15:06:07.427078 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet af25950fd08043f18a6eaaf46ded4378 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af25950fd08043f18a6eaaf46ded4378 already in progress: creating tablet
W20260927 15:06:07.427290 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2afab8bf87bc45c899bcd5dfdad48d26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2afab8bf87bc45c899bcd5dfdad48d26 already in progress: creating tablet
W20260927 15:06:07.427531 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 90619b7804324c9589b53342e2f6d0e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90619b7804324c9589b53342e2f6d0e8 already in progress: creating tablet
W20260927 15:06:07.427732 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 5bc96d1626f24cfab49bf6a36e1da33e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bc96d1626f24cfab49bf6a36e1da33e already in progress: creating tablet
W20260927 15:06:07.427951 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 454e637ec622424e81a8770c16bbc941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 454e637ec622424e81a8770c16bbc941 already in progress: creating tablet
W20260927 15:06:07.428153 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fde632b187eb4180b343d7bddc7f0943 because the tablet was not found. No further retry: Not found: Tablet not found: fde632b187eb4180b343d7bddc7f0943
W20260927 15:06:07.428413 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c6a248ec4ee64d0a8d986fdc683d69ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6a248ec4ee64d0a8d986fdc683d69ba already in progress: creating tablet
W20260927 15:06:07.428651 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e066308fcdfc49ed926cd81963c5f1a7 because the tablet was not found. No further retry: Not found: Tablet not found: e066308fcdfc49ed926cd81963c5f1a7
I20260927 15:06:07.437788 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 467cda952ec4492f9206ee4847abc3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.443145 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.443868 1561 tablet_bootstrap.cc:492] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:07.445504 1561 tablet_bootstrap.cc:654] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:07.446434 2119 ts_tablet_manager.cc:1905] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.448689 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f585bcdadbcc4032aa484481cdf94b72" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:07.449373 1376 leader_election.cc:341] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.449523 1376 leader_election.cc:302] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:07.449963 2076 raft_consensus.cc:2726] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:07.450665 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e9d03457dac43038b4e6fb120ff572c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:07.452571 1102 consensus_peers.cc:487] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:07.452767 1102 consensus_peers.cc:487] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:07.452899 1102 leader_election.cc:341] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.459337 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0702d9501ac047938d02ef2521dbf0d5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:07.459944 1239 leader_election.cc:302] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:07.460588 1102 leader_election.cc:341] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.461011 2094 raft_consensus.cc:2726] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:07.466904 1552 tablet_bootstrap.cc:492] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:07.475534 2094 raft_consensus.cc:482] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:07.475813 2094 raft_consensus.cc:504] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.476390 2094 leader_election.cc:288] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:07.479154 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21651dc1231c4faf9053a465a1874092 consensus state has no leader
I20260927 15:06:07.479815 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7888b7559b574fa29792a622e564a3bf" } new_table_name: "default.Table_50a63eb480b7485eb5086db00570f5ef" modify_external_catalogs: true
I20260927 15:06:07.481189 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_85e4afa525a840fb88a84cc7cd8042a8" } modify_external_catalogs: true
I20260927 15:06:07.481652 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 42baac8b7d47433e826eb3bc1980acaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:07.481981 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05d525c1128e4042aa97ff786ffa7ba9 consensus state has no leader
I20260927 15:06:07.482105 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_85e4afa525a840fb88a84cc7cd8042a8" } modify_external_catalogs: true
I20260927 15:06:07.483227 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cf4dae943e4092b2c490ad770e4a94" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:07.483443 1164 raft_consensus.cc:2454] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:07.484011 1556 tablet_bootstrap.cc:492] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:07.484174 1556 ts_tablet_manager.cc:1397] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.125s user 0.032s sys 0.032s
I20260927 15:06:07.484292 1239 leader_election.cc:302] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:07.484506 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 377847d06b534883ba2b870ca3317fe0
I20260927 15:06:07.484932 914 catalog_manager.cc:6565] ReplaceTablet: tablet 377847d06b534883ba2b870ca3317fe0 deleted and replaced by tablet bcbaed2bd9224a0c867cb8804ce8478e
I20260927 15:06:07.484925 2094 raft_consensus.cc:2781] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:07.484879 1556 raft_consensus.cc:348] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.485025 2094 raft_consensus.cc:482] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:07.485117 1556 raft_consensus.cc:374] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:07.485186 1556 raft_consensus.cc:729] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:07.485369 2094 raft_consensus.cc:3037] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:07.485443 1556 consensus_queue.cc:260] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.485757 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 377847d06b534883ba2b870ca3317fe0 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbaed2bd9224a0c867cb8804ce8478e) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:07.485838 1238 leader_election.cc:341] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 67cf4dae943e4092b2c490ad770e4a94
I20260927 15:06:07.486038 1556 ts_tablet_manager.cc:1428] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:07.486160 1559 tablet_replica.cc:330] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:07.486346 1559 raft_consensus.cc:2229] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:07.486558 2076 raft_consensus.cc:482] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:07.486676 1559 raft_consensus.cc:2258] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.486723 2076 raft_consensus.cc:504] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.487411 2076 leader_election.cc:288] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:07.488369 1552 ts_tablet_manager.cc:1397] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.422s user 0.030s sys 0.037s
I20260927 15:06:07.489693 1559 ts_tablet_manager.cc:1905] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.491575 1562 ts_tablet_manager.cc:1918] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:07.491698 1562 log.cc:1196] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/30244d596d4d4090af7656027b48f22e
I20260927 15:06:07.492233 1562 ts_tablet_manager.cc:1939] T 30244d596d4d4090af7656027b48f22e P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:07.492965 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0702d9501ac047938d02ef2521dbf0d5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:07.493160 1164 raft_consensus.cc:2454] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:07.493572 1374 leader_election.cc:302] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:07.494285 2076 raft_consensus.cc:2781] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:07.494382 2076 raft_consensus.cc:482] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:07.494480 2076 raft_consensus.cc:3037] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:07.496707 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 consensus state has no leader
I20260927 15:06:07.497987 1559 ts_tablet_manager.cc:1918] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:07.498111 1559 log.cc:1196] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/377847d06b534883ba2b870ca3317fe0
I20260927 15:06:07.498762 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 377847d06b534883ba2b870ca3317fe0 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbaed2bd9224a0c867cb8804ce8478e) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:07.498885 2076 raft_consensus.cc:504] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.499104 1559 ts_tablet_manager.cc:1939] T 377847d06b534883ba2b870ca3317fe0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:07.499779 2076 leader_election.cc:288] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:07.500252 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 377847d06b534883ba2b870ca3317fe0 (table default.Table_0021fd56477c4debbfe492c5673d41c2 [id=56574e770aa74f04a7bf24b7718e4960]) successfully deleted
I20260927 15:06:07.500561 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0702d9501ac047938d02ef2521dbf0d5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:07.500726 1164 raft_consensus.cc:3037] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:07.504244 1556 tablet_bootstrap.cc:492] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:07.508678 1561 tablet_bootstrap.cc:492] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:07.508847 1561 ts_tablet_manager.cc:1397] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.065s user 0.001s sys 0.002s
I20260927 15:06:07.509085 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_600a9f9429c7432aa5574b114c0ab9f9" } modify_external_catalogs: true
I20260927 15:06:07.509191 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e30ce3bcbfeb47af9835850576ade0d0" } modify_external_catalogs: true
I20260927 15:06:07.509296 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_600a9f9429c7432aa5574b114c0ab9f9" } modify_external_catalogs: true
I20260927 15:06:07.509572 1561 raft_consensus.cc:348] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.509806 1561 raft_consensus.cc:374] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:07.509924 1561 raft_consensus.cc:729] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:07.510267 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 381) took 3850 ms. Trace:
I20260927 15:06:07.510154 1561 consensus_queue.cc:260] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.510812 1561 ts_tablet_manager.cc:1428] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:07.509338 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e30ce3bcbfeb47af9835850576ade0d0" } modify_external_catalogs: true
I20260927 15:06:07.512221 1556 tablet_bootstrap.cc:654] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:07.512650 1562 rpcz_store.cc:276] 0927 15:06:03.659363 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.659644 (+ 281us) service_pool.cc:227] Handling call
0927 15:06:07.409836 (+3750192us) ts_tablet_manager.cc:1145] Deleting tablet 30244d596d4d4090af7656027b48f22e
0927 15:06:07.409859 (+ 23us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.422640 (+ 12781us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.491440 (+ 68800us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.510227 (+ 18787us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3715292}
I20260927 15:06:07.513376 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 30244d596d4d4090af7656027b48f22e (table default.Table_46238c103f2247faa5ba7f68d8b744c4 [id=5577906b11a841d58884c42d471a4427]) successfully deleted
I20260927 15:06:07.513801 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 373) took 3910 ms. Trace:
I20260927 15:06:07.513911 1562 rpcz_store.cc:276] 0927 15:06:03.603464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:03.658190 (+ 54726us) service_pool.cc:227] Handling call
0927 15:06:07.513639 (+3855449us) ts_tablet_manager.cc:1145] Deleting tablet a19c9cc5859f49a58a35460e504b3f84
0927 15:06:07.513649 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.513756 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3705643}
W20260927 15:06:07.514145 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 047fe4ed761642ccbfecdf543900d064 consensus state has no leader
W20260927 15:06:07.514317 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet a19c9cc5859f49a58a35460e504b3f84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a19c9cc5859f49a58a35460e504b3f84 already in progress: creating tablet
I20260927 15:06:07.514631 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_53a07a501dad4901a14b534a8fecea27" } modify_external_catalogs: true
I20260927 15:06:07.514858 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_53a07a501dad4901a14b534a8fecea27" } modify_external_catalogs: true
I20260927 15:06:07.517145 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0702d9501ac047938d02ef2521dbf0d5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:07.520721 1376 leader_election.cc:341] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.521726 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 404) took 3336 ms. Trace:
I20260927 15:06:07.521924 1562 rpcz_store.cc:276] 0927 15:06:04.185151 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.188488 (+ 3337us) service_pool.cc:227] Handling call
0927 15:06:07.521564 (+3333076us) ts_tablet_manager.cc:1145] Deleting tablet 033e71f60c3e47fd9647db090d4d6cd5
0927 15:06:07.521590 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.521689 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3332763}
W20260927 15:06:07.522722 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 033e71f60c3e47fd9647db090d4d6cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033e71f60c3e47fd9647db090d4d6cd5 already in progress: creating tablet
I20260927 15:06:07.523422 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 403) took 3338 ms. Trace:
I20260927 15:06:07.523854 1562 rpcz_store.cc:276] 0927 15:06:04.184981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.206490 (+ 21509us) service_pool.cc:227] Handling call
0927 15:06:07.523165 (+3316675us) ts_tablet_manager.cc:1145] Deleting tablet 089b6b5ac39d49fea744240261a8010e
0927 15:06:07.523175 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.523385 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3316206}
W20260927 15:06:07.524471 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 089b6b5ac39d49fea744240261a8010e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 089b6b5ac39d49fea744240261a8010e already in progress: creating tablet
I20260927 15:06:06.498508 1961 rpcz_store.cc:276] 0927 15:06:05.283119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.283176 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:05.395876 (+112700us) raft_consensus.cc:1457] Updating replica for 550 ops
0927 15:06:05.431493 (+ 35617us) raft_consensus.cc:1520] Early marking committed up to index 0
0927 15:06:05.431503 (+ 10us) raft_consensus.cc:1525] Triggering prepare for 550 ops
0927 15:06:05.432191 (+ 688us) write_op.cc:270] Start()
0927 15:06:05.432260 (+ 69us) write_op.cc:276] Timestamp: P: 1790521556445303 usec, L: 0
0927 15:06:05.471115 (+ 38855us) write_op.cc:270] Start()
0927 15:06:05.471159 (+ 44us) write_op.cc:276] Timestamp: P: 1790521556455483 usec, L: 0
0927 15:06:05.471392 (+ 233us) write_op.cc:270] Start()
0927 15:06:05.471428 (+ 36us) write_op.cc:276] Timestamp: P: 1790521556456348 usec, L: 0
0927 15:06:05.471587 (+ 159us) write_op.cc:270] Start()
0927 15:06:05.471610 (+ 23us) write_op.cc:276] Timestamp: P: 1790521556473513 usec, L: 0
0927 15:06:05.471728 (+ 118us) write_op.cc:270] Start()
0927 15:06:05.471745 (+ 17us) write_op.cc:276] Timestamp: P: 1790521556485110 usec, L: 0
0927 15:06:05.471900 (+ 155us) write_op.cc:270] Start()
0927 15:06:05.471928 (+ 28us) write_op.cc:276] Timestamp: P: 1790521556499273 usec, L: 0
0927 15:06:05.472092 (+ 164us) write_op.cc:270] Start()
0927 15:06:05.472154 (+ 62us) write_op.cc:276] Timestamp: P: 1790521556503295 usec, L: 0
0927 15:06:05.472296 (+ 142us) write_op.cc:270] Start()
0927 15:06:05.472318 (+ 22us) write_op.cc:276] Timestamp: P: 1790521556514744 usec, L: 0
0927 15:06:05.472474 (+ 156us) write_op.cc:270] Start()
0927 15:06:05.472497 (+ 23us) write_op.cc:276] Timestamp: P: 1790521556519301 usec, L: 0
0927 15:06:05.472637 (+ 140us) write_op.cc:270] Start()
0927 15:06:05.472659 (+ 22us) write_op.cc:276] Timestamp: P: 1790521556527929 usec, L: 0
0927 15:06:05.472847 (+ 188us) write_op.cc:270] Start()
0927 15:06:05.472871 (+ 24us) write_op.cc:276] Timestamp: P: 1790521556547375 usec, L: 0
0927 15:06:05.473022 (+ 151us) write_op.cc:270] Start()
0927 15:06:05.473046 (+ 24us) write_op.cc:276] Timestamp: P: 1790521556561430 usec, L: 0
0927 15:06:05.473176 (+ 130us) write_op.cc:270] Start()
0927 15:06:05.473197 (+ 21us) write_op.cc:276] Timestamp: P: 1790521556562908 usec, L: 0
0927 15:06:05.473349 (+ 152us) write_op.cc:270] Start()
0927 15:06:05.473371 (+ 22us) write_op.cc:276] Timestamp: P: 1790521556564652 usec, L: 0
0927 15:06:05.473520 (+ 149us) write_op.cc:270] Start()
0927 15:06:05.473535 (+ 15us) write_op.cc:276] Timestamp: P: 1790521556565701 usec, L: 0
0927 15:06:05.473686 (+ 151us) write_op.cc:270] Start()
0927 15:06:05.473702 (+ 16us) write_op.cc:276] Timestamp: P: 1790521556566504 usec, L: 0
0927 15:06:05.473809 (+ 107us) write_op.cc:270] Start()
0927 15:06:05.473836 (+ 27us) write_op.cc:276] Timestamp: P: 1790521556620793 usec, L: 0
0927 15:06:05.473988 (+ 152us) write_op.cc:270] Start()
0927 15:06:05.474008 (+ 20us) write_op.cc:276] Timestamp: P: 1790521556622329 usec, L: 0
0927 15:06:05.474149 (+ 141us) write_op.cc:270] Start()
0927 15:06:05.474173 (+ 24us) write_op.cc:276] Timestamp: P: 1790521556623437 usec, L: 0
0927 15:06:05.474333 (+ 160us) write_op.cc:270] Start()
0927 15:06:05.474357 (+ 24us) write_op.cc:276] Timestamp: P: 1790521556632527 usec, L: 0
0927 15:06:05.474533 (+ 176us) write_op.cc:270] Start()
0927 15:06:05.474556 (+ 23us) write_op.cc:276] Timestamp: P: 1790521556634073 usec, L: 0
0927 15:06:05.474709 (+ 153us) write_op.cc:270] Start()
0927 15:06:05.474732 (+ 23us) write_op.cc:276] Timestamp: P: 1790521556634993 usec, L: 0
0927 15:06:05.488069 (+ 13337us) write_op.cc:270] Start()
0927 15:06:05.488102 (+ 33us) write_op.cc:276] Timestamp: P: 1790521556635543 usec, L: 0
0927 15:06:05.488247 (+ 145us) write_op.cc:270] Start()
0927 15:06:05.488268 (+ 21us) write_op.cc:276] Timestamp: P: 1790521556635996 usec, L: 0
0927 15:06:05.488450 (+ 182us) write_op.cc:270] Start()
0927 15:06:05.488503 (+ 53us) write_op.cc:276] Timestamp: P: 1790521556636520 usec, L: 0
0927 15:06:05.488661 (+ 158us) write_op.cc:270] Start()
0927 15:06:05.488685 (+ 24us) write_op.cc:276] Timestamp: P: 1790521556683382 usec, L: 0
0927 15:06:05.488784 (+ 99us) write_op.cc:270] Start()
0927 15:06:05.488799 (+ 15us) write_op.cc:276] Timestamp: P: 1790521556714067 usec, L: 0
0927 15:06:05.488900 (+ 101us) write_op.cc:270] Start()
0927 15:06:05.488920 (+ 20us) write_op.cc:276] Timestamp: P: 1790521556717008 usec, L: 0
0927 15:06:05.489023 (+ 103us) write_op.cc:270] Start()
0927 15:06:05.489045 (+ 22us) write_op.cc:276] Timestamp: P: 1790521556717928 usec, L: 0
0927 15:06:05.489182 (+ 137us) write_op.cc:270] Start()
0927 15:06:05.489203 (+ 21us) write_op.cc:276] Timestamp: P: 1790521556734091 usec, L: 0
0927 15:06:05.489332 (+ 129us) write_op.cc:270] Start()
0927 15:06:05.489346 (+ 14us) write_op.cc:276] Timestamp: P: 1790521556735469 usec, L: 0
0927 15:06:05.489437 (+ 91us) write_op.cc:270] Start()
0927 15:06:05.489451 (+ 14us) write_op.cc:276] Timestamp: P: 1790521556740852 usec, L: 0
0927 15:06:05.489620 (+ 169us) write_op.cc:270] Start()
0927 15:06:05.489636 (+ 16us) write_op.cc:276] Timestamp: P: 1790521556752871 usec, L: 0
0927 15:06:05.489732 (+ 96us) write_op.cc:270] Start()
0927 15:06:05.489745 (+ 13us) write_op.cc:276] Timestamp: P: 1790521556754870 usec, L: 0
0927 15:06:05.489838 (+ 93us) write_op.cc:270] Start()
0927 15:06:05.489859 (+ 21us) write_op.cc:276] Timestamp: P: 1790521556762603 usec, L: 0
0927 15:06:05.490011 (+ 152us) write_op.cc:270] Start()
0927 15:06:05.490030 (+ 19us) write_op.cc:276] Timestamp: P: 1790521556774556 usec, L: 0
0927 15:06:05.490144 (+ 114us) write_op.cc:270] Start()
0927 15:06:05.490172 (+ 28us) write_op.cc:276] Timestamp: P: 1790521556805443 usec, L: 0
0927 15:06:05.490284 (+ 112us) write_op.cc:270] Start()
0927 15:06:05.490302 (+ 18us) write_op.cc:276] Timestamp: P: 1790521556823514 usec, L: 0
0927 15:06:05.490404 (+ 102us) write_op.cc:270] Start()
0927 15:06:05.490420 (+ 16us) write_op.cc:276] Timestamp: P: 1790521556824299 usec, L: 0
0927 15:06:05.490542 (+ 122us) write_op.cc:270] Start()
0927 15:06:05.490561 (+ 19us) write_op.cc:276] Timestamp: P: 1790521556833124 usec, L: 0
0927 15:06:05.490682 (+ 121us) write_op.cc:270] Start()
0927 15:06:05.490698 (+ 16us) write_op.cc:276] Timestamp: P: 1790521556833813 usec, L: 0
0927 15:06:05.490806 (+ 108us) write_op.cc:270] Start()
0927 15:06:05.503410 (+ 12604us) write_op.cc:276] Timestamp: P: 1790521556848630 usec, L: 0
0927 15:06:05.503669 (+ 259us) write_op.cc:270] Start()
0927 15:06:05.503697 (+ 28us) write_op.cc:276] Timestamp: P: 1790521556855341 usec, L: 0
0927 15:06:05.503836 (+ 139us) write_op.cc:270] Start()
0927 15:06:05.503855 (+ 19us) write_op.cc:276] Timestamp: P: 1790521556856059 usec, L: 0
0927 15:06:05.503965 (+ 110us) write_op.cc:270] Start()
0927 15:06:05.503982 (+ 17us) write_op.cc:276] Timestamp: P: 1790521556866416 usec, L: 0
0927 15:06:05.504107 (+ 125us) write_op.cc:270] Start()
0927 15:06:05.504124 (+ 17us) write_op.cc:276] Timestamp: P: 1790521556867999 usec, L: 0
0927 15:06:05.504228 (+ 104us) write_op.cc:270] Start()
0927 15:06:05.504243 (+ 15us) write_op.cc:276] Timestamp: P: 1790521556877295 usec, L: 0
0927 15:06:05.504349 (+ 106us) write_op.cc:270] Start()
0927 15:06:05.504369 (+ 20us) write_op.cc:276] Timestamp: P: 1790521556886326 usec, L: 0
0927 15:06:05.512332 (+ 7963us) write_op.cc:270] Start()
0927 15:06:05.512364 (+ 32us) write_op.cc:276] Timestamp: P: 1790521556887456 usec, L: 0
0927 15:06:05.512533 (+ 169us) write_op.cc:270] Start()
0927 15:06:05.512555 (+ 22us) write_op.cc:276] Timestamp: P: 1790521556929695 usec, L: 0
0927 15:06:05.512762 (+ 207us) write_op.cc:270] Start()
0927 15:06:05.512783 (+ 21us) write_op.cc:276] Timestamp: P: 1790521556940131 usec, L: 0
0927 15:06:05.512924 (+ 141us) write_op.cc:270] Start()
0927 15:06:05.512942 (+ 18us) write_op.cc:276] Timestamp: P: 1790521556951870 usec, L: 0
0927 15:06:05.513045 (+ 103us) write_op.cc:270] Start()
0927 15:06:05.513062 (+ 17us) write_op.cc:276] Timestamp: P: 1790521556961460 usec, L: 0
0927 15:06:05.513182 (+ 120us) write_op.cc:270] Start()
0927 15:06:05.513198 (+ 16us) write_op.cc:276] Timestamp: P: 1790521556962151 usec, L: 0
0927 15:06:05.513329 (+ 131us) write_op.cc:270] Start()
0927 15:06:05.513347 (+ 18us) write_op.cc:276] Timestamp: P: 1790521556965999 usec, L: 0
0927 15:06:05.513451 (+ 104us) write_op.cc:270] Start()
0927 15:06:05.513481 (+ 30us) write_op.cc:276] Timestamp: P: 1790521556976013 usec, L: 0
0927 15:06:05.513624 (+ 143us) write_op.cc:270] Start()
0927 15:06:05.513641 (+ 17us) write_op.cc:276] Timestamp: P: 1790521556976641 usec, L: 0
0927 15:06:05.513758 (+ 117us) write_op.cc:270] Start()
0927 15:06:05.513778 (+ 20us) write_op.cc:276] Timestamp: P: 1790521556994417 usec, L: 0
0927 15:06:05.513891 (+ 113us) write_op.cc:270] Start()
0927 15:06:05.513909 (+ 18us) write_op.cc:276] Timestamp: P: 1790521556996652 usec, L: 0
0927 15:06:05.514034 (+ 125us) write_op.cc:270] Start()
0927 15:06:05.514085 (+ 51us) write_op.cc:276] Timestamp: P: 1790521557038749 usec, L: 0
0927 15:06:05.514201 (+ 116us) write_op.cc:270] Start()
0927 15:06:05.514219 (+ 18us) write_op.cc:276] Timestamp: P: 1790521557052616 usec, L: 0
0927 15:06:05.514330 (+ 111us) write_op.cc:270] Start()
0927 15:06:05.514348 (+ 18us) write_op.cc:276] Timestamp: P: 1790521557059764 usec, L: 0
0927 15:06:05.514478 (+ 130us) write_op.cc:270] Start()
0927 15:06:05.514503 (+ 25us) write_op.cc:276] Timestamp: P: 1790521557060779 usec, L: 0
0927 15:06:05.514629 (+ 126us) write_op.cc:270] Start()
0927 15:06:05.514646 (+ 17us) write_op.cc:276] Timestamp: P: 1790521557061556 usec, L: 0
0927 15:06:05.514787 (+ 141us) write_op.cc:270] Start()
0927 15:06:05.514804 (+ 17us) write_op.cc:276] Timestamp: P: 1790521557070320 usec, L: 0
0927 15:06:05.524130 (+ 9326us) write_op.cc:270] Start()
0927 15:06:05.524169 (+ 39us) write_op.cc:276] Timestamp: P: 1790521557072421 usec, L: 0
0927 15:06:05.524330 (+ 161us) write_op.cc:270] Start()
0927 15:06:05.524364 (+ 34us) write_op.cc:276] Timestamp: P: 1790521557078313 usec, L: 0
0927 15:06:05.524505 (+ 141us) write_op.cc:270] Start()
0927 15:06:05.524529 (+ 24us) write_op.cc:276] Timestamp: P: 1790521557133777 usec, L: 0
0927 15:06:05.524679 (+ 150us) write_op.cc:270] Start()
0927 15:06:05.524707 (+ 28us) write_op.cc:276] Timestamp: P: 1790521557134426 usec, L: 0
0927 15:06:05.524896 (+ 189us) write_op.cc:270] Start()
0927 15:06:05.524920 (+ 24us) write_op.cc:276] Timestamp: P: 1790521557135422 usec, L: 0
0927 15:06:05.525060 (+ 140us) write_op.cc:270] Start()
0927 15:06:05.525083 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557183756 usec, L: 0
0927 15:06:05.525199 (+ 116us) write_op.cc:270] Start()
0927 15:06:05.525218 (+ 19us) write_op.cc:276] Timestamp: P: 1790521557184370 usec, L: 0
0927 15:06:05.525352 (+ 134us) write_op.cc:270] Start()
0927 15:06:05.525380 (+ 28us) write_op.cc:276] Timestamp: P: 1790521557184855 usec, L: 0
0927 15:06:05.525568 (+ 188us) write_op.cc:270] Start()
0927 15:06:05.525593 (+ 25us) write_op.cc:276] Timestamp: P: 1790521557185362 usec, L: 0
0927 15:06:05.525739 (+ 146us) write_op.cc:270] Start()
0927 15:06:05.525761 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557199239 usec, L: 0
0927 15:06:05.525909 (+ 148us) write_op.cc:270] Start()
0927 15:06:05.525926 (+ 17us) write_op.cc:276] Timestamp: P: 1790521557199763 usec, L: 0
0927 15:06:05.526015 (+ 89us) write_op.cc:270] Start()
0927 15:06:05.526037 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557200287 usec, L: 0
0927 15:06:05.526175 (+ 138us) write_op.cc:270] Start()
0927 15:06:05.526198 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557309653 usec, L: 0
0927 15:06:05.526353 (+ 155us) write_op.cc:270] Start()
0927 15:06:05.526405 (+ 52us) write_op.cc:276] Timestamp: P: 1790521557314222 usec, L: 0
0927 15:06:05.526530 (+ 125us) write_op.cc:270] Start()
0927 15:06:05.526553 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557316440 usec, L: 0
0927 15:06:05.526691 (+ 138us) write_op.cc:270] Start()
0927 15:06:05.526712 (+ 21us) write_op.cc:276] Timestamp: P: 1790521557318516 usec, L: 0
0927 15:06:05.539114 (+ 12402us) write_op.cc:270] Start()
0927 15:06:05.539165 (+ 51us) write_op.cc:276] Timestamp: P: 1790521557322585 usec, L: 0
0927 15:06:05.539411 (+ 246us) write_op.cc:270] Start()
0927 15:06:05.539438 (+ 27us) write_op.cc:276] Timestamp: P: 1790521557325055 usec, L: 0
0927 15:06:05.539625 (+ 187us) write_op.cc:270] Start()
0927 15:06:05.539650 (+ 25us) write_op.cc:276] Timestamp: P: 1790521557327351 usec, L: 0
0927 15:06:05.539833 (+ 183us) write_op.cc:270] Start()
0927 15:06:05.539871 (+ 38us) write_op.cc:276] Timestamp: P: 1790521557331429 usec, L: 0
0927 15:06:05.540009 (+ 138us) write_op.cc:270] Start()
0927 15:06:05.540031 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557361334 usec, L: 0
0927 15:06:05.540126 (+ 95us) write_op.cc:270] Start()
0927 15:06:05.540144 (+ 18us) write_op.cc:276] Timestamp: P: 1790521557361969 usec, L: 0
0927 15:06:05.540290 (+ 146us) write_op.cc:270] Start()
0927 15:06:05.540313 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557370971 usec, L: 0
0927 15:06:05.540454 (+ 141us) write_op.cc:270] Start()
0927 15:06:05.540486 (+ 32us) write_op.cc:276] Timestamp: P: 1790521557394194 usec, L: 0
0927 15:06:05.540620 (+ 134us) write_op.cc:270] Start()
0927 15:06:05.540642 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557396022 usec, L: 0
0927 15:06:05.540777 (+ 135us) write_op.cc:270] Start()
0927 15:06:05.540798 (+ 21us) write_op.cc:276] Timestamp: P: 1790521557396761 usec, L: 0
0927 15:06:05.540957 (+ 159us) write_op.cc:270] Start()
0927 15:06:05.540973 (+ 16us) write_op.cc:276] Timestamp: P: 1790521557420634 usec, L: 0
0927 15:06:05.541111 (+ 138us) write_op.cc:270] Start()
0927 15:06:05.541133 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557435706 usec, L: 0
0927 15:06:05.541266 (+ 133us) write_op.cc:270] Start()
0927 15:06:05.541288 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557457231 usec, L: 0
0927 15:06:05.541422 (+ 134us) write_op.cc:270] Start()
0927 15:06:05.541443 (+ 21us) write_op.cc:276] Timestamp: P: 1790521557457881 usec, L: 0
0927 15:06:05.541629 (+ 186us) write_op.cc:270] Start()
0927 15:06:05.541655 (+ 26us) write_op.cc:276] Timestamp: P: 1790521557475358 usec, L: 0
0927 15:06:05.541808 (+ 153us) write_op.cc:270] Start()
0927 15:06:05.541830 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557505872 usec, L: 0
0927 15:06:05.541962 (+ 132us) write_op.cc:270] Start()
0927 15:06:05.541988 (+ 26us) write_op.cc:276] Timestamp: P: 1790521557525906 usec, L: 0
0927 15:06:05.542102 (+ 114us) write_op.cc:270] Start()
0927 15:06:05.542126 (+ 24us) write_op.cc:276] Timestamp: P: 1790521557526590 usec, L: 0
0927 15:06:05.542280 (+ 154us) write_op.cc:270] Start()
0927 15:06:05.542297 (+ 17us) write_op.cc:276] Timestamp: P: 1790521557527118 usec, L: 0
0927 15:06:05.542423 (+ 126us) write_op.cc:270] Start()
0927 15:06:05.542442 (+ 19us) write_op.cc:276] Timestamp: P: 1790521557527629 usec, L: 0
0927 15:06:05.542575 (+ 133us) write_op.cc:270] Start()
0927 15:06:05.542594 (+ 19us) write_op.cc:276] Timestamp: P: 1790521557538541 usec, L: 0
0927 15:06:05.542728 (+ 134us) write_op.cc:270] Start()
0927 15:06:05.542748 (+ 20us) write_op.cc:276] Timestamp: P: 1790521557555245 usec, L: 0
0927 15:06:05.551595 (+ 8847us) write_op.cc:270] Start()
0927 15:06:05.551625 (+ 30us) write_op.cc:276] Timestamp: P: 1790521557557773 usec, L: 0
0927 15:06:05.555243 (+ 3618us) write_op.cc:270] Start()
0927 15:06:05.555280 (+ 37us) write_op.cc:276] Timestamp: P: 1790521557560207 usec, L: 0
0927 15:06:05.555477 (+ 197us) write_op.cc:270] Start()
0927 15:06:05.555496 (+ 19us) write_op.cc:276] Timestamp: P: 1790521557565632 usec, L: 0
0927 15:06:05.555630 (+ 134us) write_op.cc:270] Start()
0927 15:06:05.555648 (+ 18us) write_op.cc:276] Timestamp: P: 1790521557566211 usec, L: 0
0927 15:06:05.555782 (+ 134us) write_op.cc:270] Start()
0927 15:06:05.555807 (+ 25us) write_op.cc:276] Timestamp: P: 1790521557566784 usec, L: 0
0927 15:06:05.555962 (+ 155us) write_op.cc:270] Start()
0927 15:06:05.555982 (+ 20us) write_op.cc:276] Timestamp: P: 1790521557567260 usec, L: 0
0927 15:06:05.556147 (+ 165us) write_op.cc:270] Start()
0927 15:06:05.556168 (+ 21us) write_op.cc:276] Timestamp: P: 1790521557585439 usec, L: 0
0927 15:06:05.556303 (+ 135us) write_op.cc:270] Start()
0927 15:06:05.556327 (+ 24us) write_op.cc:276] Timestamp: P: 1790521557587026 usec, L: 0
0927 15:06:05.556523 (+ 196us) write_op.cc:270] Start()
0927 15:06:05.556546 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557587749 usec, L: 0
0927 15:06:05.556679 (+ 133us) write_op.cc:270] Start()
0927 15:06:05.556703 (+ 24us) write_op.cc:276] Timestamp: P: 1790521557590225 usec, L: 0
0927 15:06:05.556832 (+ 129us) write_op.cc:270] Start()
0927 15:06:05.556850 (+ 18us) write_op.cc:276] Timestamp: P: 1790521557637550 usec, L: 0
0927 15:06:05.556978 (+ 128us) write_op.cc:270] Start()
0927 15:06:05.556998 (+ 20us) write_op.cc:276] Timestamp: P: 1790521557650977 usec, L: 0
0927 15:06:05.557151 (+ 153us) write_op.cc:270] Start()
0927 15:06:05.557170 (+ 19us) write_op.cc:276] Timestamp: P: 1790521557656212 usec, L: 0
0927 15:06:05.557301 (+ 131us) write_op.cc:270] Start()
0927 15:06:05.557321 (+ 20us) write_op.cc:276] Timestamp: P: 1790521557667950 usec, L: 0
0927 15:06:05.557499 (+ 178us) write_op.cc:270] Start()
0927 15:06:05.557522 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557677808 usec, L: 0
0927 15:06:05.557667 (+ 145us) write_op.cc:270] Start()
0927 15:06:05.557688 (+ 21us) write_op.cc:276] Timestamp: P: 1790521557699596 usec, L: 0
0927 15:06:05.557827 (+ 139us) write_op.cc:270] Start()
0927 15:06:05.557848 (+ 21us) write_op.cc:276] Timestamp: P: 1790521557731140 usec, L: 0
0927 15:06:05.557998 (+ 150us) write_op.cc:270] Start()
0927 15:06:05.558020 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557731968 usec, L: 0
0927 15:06:05.558162 (+ 142us) write_op.cc:270] Start()
0927 15:06:05.558183 (+ 21us) write_op.cc:276] Timestamp: P: 1790521557733558 usec, L: 0
0927 15:06:05.558307 (+ 124us) write_op.cc:270] Start()
0927 15:06:05.558327 (+ 20us) write_op.cc:276] Timestamp: P: 1790521557738396 usec, L: 0
0927 15:06:05.558500 (+ 173us) write_op.cc:270] Start()
0927 15:06:05.558525 (+ 25us) write_op.cc:276] Timestamp: P: 1790521557744893 usec, L: 0
0927 15:06:05.558686 (+ 161us) write_op.cc:270] Start()
0927 15:06:05.558710 (+ 24us) write_op.cc:276] Timestamp: P: 1790521557745568 usec, L: 0
0927 15:06:05.582071 (+ 23361us) write_op.cc:270] Start()
0927 15:06:05.582110 (+ 39us) write_op.cc:276] Timestamp: P: 1790521557758699 usec, L: 0
0927 15:06:05.582307 (+ 197us) write_op.cc:270] Start()
0927 15:06:05.582330 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557767149 usec, L: 0
0927 15:06:05.582545 (+ 215us) write_op.cc:270] Start()
0927 15:06:05.582565 (+ 20us) write_op.cc:276] Timestamp: P: 1790521557808080 usec, L: 0
0927 15:06:05.582736 (+ 171us) write_op.cc:270] Start()
0927 15:06:05.582758 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557808698 usec, L: 0
0927 15:06:05.584218 (+ 1460us) write_op.cc:270] Start()
0927 15:06:05.584253 (+ 35us) write_op.cc:276] Timestamp: P: 1790521557812299 usec, L: 0
0927 15:06:05.584419 (+ 166us) write_op.cc:270] Start()
0927 15:06:05.584492 (+ 73us) write_op.cc:276] Timestamp: P: 1790521557813590 usec, L: 0
0927 15:06:05.584650 (+ 158us) write_op.cc:270] Start()
0927 15:06:05.584678 (+ 28us) write_op.cc:276] Timestamp: P: 1790521557823044 usec, L: 0
0927 15:06:05.584831 (+ 153us) write_op.cc:270] Start()
0927 15:06:05.584855 (+ 24us) write_op.cc:276] Timestamp: P: 1790521557827367 usec, L: 0
0927 15:06:05.584998 (+ 143us) write_op.cc:270] Start()
0927 15:06:05.585021 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557840303 usec, L: 0
0927 15:06:05.585166 (+ 145us) write_op.cc:270] Start()
0927 15:06:05.585189 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557843841 usec, L: 0
0927 15:06:05.585328 (+ 139us) write_op.cc:270] Start()
0927 15:06:05.585350 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557847665 usec, L: 0
0927 15:06:05.585494 (+ 144us) write_op.cc:270] Start()
0927 15:06:05.585531 (+ 37us) write_op.cc:276] Timestamp: P: 1790521557874528 usec, L: 0
0927 15:06:05.585719 (+ 188us) write_op.cc:270] Start()
0927 15:06:05.585742 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557889447 usec, L: 0
0927 15:06:05.585892 (+ 150us) write_op.cc:270] Start()
0927 15:06:05.585915 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557910051 usec, L: 0
0927 15:06:05.586053 (+ 138us) write_op.cc:270] Start()
0927 15:06:05.586076 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557916236 usec, L: 0
0927 15:06:05.586215 (+ 139us) write_op.cc:270] Start()
0927 15:06:05.586237 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557916912 usec, L: 0
0927 15:06:05.586374 (+ 137us) write_op.cc:270] Start()
0927 15:06:05.586396 (+ 22us) write_op.cc:276] Timestamp: P: 1790521557922310 usec, L: 0
0927 15:06:05.586594 (+ 198us) write_op.cc:270] Start()
0927 15:06:05.586618 (+ 24us) write_op.cc:276] Timestamp: P: 1790521557934143 usec, L: 0
0927 15:06:05.586758 (+ 140us) write_op.cc:270] Start()
0927 15:06:05.586781 (+ 23us) write_op.cc:276] Timestamp: P: 1790521557944830 usec, L: 0
0927 15:06:05.598230 (+ 11449us) write_op.cc:270] Start()
0927 15:06:05.598261 (+ 31us) write_op.cc:276] Timestamp: P: 1790521557947990 usec, L: 0
0927 15:06:05.598448 (+ 187us) write_op.cc:270] Start()
0927 15:06:05.598484 (+ 36us) write_op.cc:276] Timestamp: P: 1790521557949293 usec, L: 0
0927 15:06:05.598629 (+ 145us) write_op.cc:270] Start()
0927 15:06:05.598650 (+ 21us) write_op.cc:276] Timestamp: P: 1790521557975964 usec, L: 0
0927 15:06:05.598772 (+ 122us) write_op.cc:270] Start()
0927 15:06:05.598790 (+ 18us) write_op.cc:276] Timestamp: P: 1790521557983473 usec, L: 0
0927 15:06:05.598944 (+ 154us) write_op.cc:270] Start()
0927 15:06:05.598965 (+ 21us) write_op.cc:276] Timestamp: P: 1790521557984000 usec, L: 0
0927 15:06:05.599105 (+ 140us) write_op.cc:270] Start()
0927 15:06:05.599125 (+ 20us) write_op.cc:276] Timestamp: P: 1790521557984551 usec, L: 0
0927 15:06:05.599277 (+ 152us) write_op.cc:270] Start()
0927 15:06:05.599296 (+ 19us) write_op.cc:276] Timestamp: P: 1790521558017986 usec, L: 0
0927 15:06:05.599427 (+ 131us) write_op.cc:270] Start()
0927 15:06:05.599445 (+ 18us) write_op.cc:276] Timestamp: P: 1790521558018565 usec, L: 0
0927 15:06:05.599573 (+ 128us) write_op.cc:270] Start()
0927 15:06:05.599592 (+ 19us) write_op.cc:276] Timestamp: P: 1790521558019481 usec, L: 0
0927 15:06:05.599714 (+ 122us) write_op.cc:270] Start()
0927 15:06:05.599731 (+ 17us) write_op.cc:276] Timestamp: P: 1790521558055804 usec, L: 0
0927 15:06:05.599899 (+ 168us) write_op.cc:270] Start()
0927 15:06:05.599920 (+ 21us) write_op.cc:276] Timestamp: P: 1790521558060252 usec, L: 0
0927 15:06:05.600070 (+ 150us) write_op.cc:270] Start()
0927 15:06:05.600091 (+ 21us) write_op.cc:276] Timestamp: P: 1790521558073787 usec, L: 0
0927 15:06:05.600218 (+ 127us) write_op.cc:270] Start()
0927 15:06:05.600241 (+ 23us) write_op.cc:276] Timestamp: P: 1790521558075814 usec, L: 0
0927 15:06:05.600347 (+ 106us) write_op.cc:270] Start()
0927 15:06:05.600387 (+ 40us) write_op.cc:276] Timestamp: P: 1790521558076660 usec, L: 0
0927 15:06:05.600516 (+ 129us) write_op.cc:270] Start()
0927 15:06:05.600533 (+ 17us) write_op.cc:276] Timestamp: P: 1790521558077395 usec, L: 0
0927 15:06:05.600687 (+ 154us) write_op.cc:270] Start()
0927 15:06:05.600709 (+ 22us) write_op.cc:276] Timestamp: P: 1790521558090729 usec, L: 0
0927 15:06:05.600831 (+ 122us) write_op.cc:270] Start()
0927 15:06:05.600848 (+ 17us) write_op.cc:276] Timestamp: P: 1790521558100371 usec, L: 0
0927 15:06:05.600949 (+ 101us) write_op.cc:270] Start()
0927 15:06:05.600965 (+ 16us) write_op.cc:276] Timestamp: P: 1790521558100945 usec, L: 0
0927 15:06:05.601072 (+ 107us) write_op.cc:270] Start()
0927 15:06:05.601093 (+ 21us) write_op.cc:276] Timestamp: P: 1790521558107758 usec, L: 0
0927 15:06:05.601211 (+ 118us) write_op.cc:270] Start()
0927 15:06:05.601228 (+ 17us) write_op.cc:276] Timestamp: P: 1790521558159930 usec, L: 0
0927 15:06:05.601344 (+ 116us) write_op.cc:270] Start()
0927 15:06:05.601362 (+ 18us) write_op.cc:276] Timestamp: P: 1790521558192049 usec, L: 0
0927 15:06:05.601481 (+ 119us) write_op.cc:270] Start()
0927 15:06:05.601502 (+ 21us) write_op.cc:276] Timestamp: P: 1790521558197184 usec, L: 0
0927 15:06:05.601652 (+ 150us) write_op.cc:270] Start()
0927 15:06:05.601713 (+ 61us) write_op.cc:276] Timestamp: P: 1790521558201216 usec, L: 0
0927 15:06:05.601872 (+ 159us) write_op.cc:270] Start()
0927 15:06:05.601891 (+ 19us) write_op.cc:276] Timestamp: P: 1790521558376672 usec, L: 0
0927 15:06:05.601998 (+ 107us) write_op.cc:270] Start()
0927 15:06:05.602015 (+ 17us) write_op.cc:276] Timestamp: P: 1790521558392743 usec, L: 0
0927 15:06:05.602136 (+ 121us) write_op.cc:270] Start()
0927 15:06:05.602166 (+ 30us) write_op.cc:276] Timestamp: P: 1790521558416869 usec, L: 0
0927 15:06:05.602301 (+ 135us) write_op.cc:270] Start()
0927 15:06:05.602324 (+ 23us) write_op.cc:276] Timestamp: P: 1790521558441089 usec, L: 0
0927 15:06:05.602484 (+ 160us) write_op.cc:270] Start()
0927 15:06:05.602504 (+ 20us) write_op.cc:276] Timestamp: P: 1790521558458372 usec, L: 0
0927 15:06:05.602631 (+ 127us) write_op.cc:270] Start()
0927 15:06:05.602652 (+ 21us) write_op.cc:276] Timestamp: P: 1790521558460230 usec, L: 0
0927 15:06:05.602770 (+ 118us) write_op.cc:270] Start()
0927 15:06:05.602788 (+ 18us) write_op.cc:276] Timestamp: P: 1790521558463973 usec, L: 0
0927 15:06:05.619085 (+ 16297us) write_op.cc:270] Start()
0927 15:06:05.619113 (+ 28us) write_op.cc:276] Timestamp: P: 1790521558467474 usec, L: 0
0927 15:06:05.619260 (+ 147us) write_op.cc:270] Start()
0927 15:06:05.619276 (+ 16us) write_op.cc:276] Timestamp: P: 1790521558494797 usec, L: 0
0927 15:06:05.619388 (+ 112us) write_op.cc:270] Start()
0927 15:06:05.619402 (+ 14us) write_op.cc:276] Timestamp: P: 1790521558506646 usec, L: 0
0927 15:06:05.619532 (+ 130us) write_op.cc:270] Start()
0927 15:06:05.619548 (+ 16us) write_op.cc:276] Timestamp: P: 1790521558511535 usec, L: 0
0927 15:06:05.619642 (+ 94us) write_op.cc:270] Start()
0927 15:06:05.619656 (+ 14us) write_op.cc:276] Timestamp: P: 1790521558512886 usec, L: 0
0927 15:06:05.619762 (+ 106us) write_op.cc:270] Start()
0927 15:06:05.619777 (+ 15us) write_op.cc:276] Timestamp: P: 1790521558527489 usec, L: 0
0927 15:06:05.619878 (+ 101us) write_op.cc:270] Start()
0927 15:06:05.619892 (+ 14us) write_op.cc:276] Timestamp: P: 1790521558609243 usec, L: 0
0927 15:06:05.619975 (+ 83us) write_op.cc:270] Start()
0927 15:06:05.619990 (+ 15us) write_op.cc:276] Timestamp: P: 1790521558619122 usec, L: 0
0927 15:06:05.620090 (+ 100us) write_op.cc:270] Start()
0927 15:06:05.620104 (+ 14us) write_op.cc:276] Timestamp: P: 1790521558659898 usec, L: 0
0927 15:06:05.620203 (+ 99us) write_op.cc:270] Start()
0927 15:06:05.620217 (+ 14us) write_op.cc:276] Timestamp: P: 1790521558660532 usec, L: 0
0927 15:06:05.620311 (+ 94us) write_op.cc:270] Start()
0927 15:06:05.620326 (+ 15us) write_op.cc:276] Timestamp: P: 1790521558667859 usec, L: 0
0927 15:06:05.620415 (+ 89us) write_op.cc:270] Start()
0927 15:06:05.620430 (+ 15us) write_op.cc:276] Timestamp: P: 1790521558671725 usec, L: 0
0927 15:06:05.620538 (+ 108us) write_op.cc:270] Start()
0927 15:06:05.620555 (+ 17us) write_op.cc:276] Timestamp: P: 1790521558672960 usec, L: 0
0927 15:06:05.620670 (+ 115us) write_op.cc:270] Start()
0927 15:06:05.620685 (+ 15us) write_op.cc:276] Timestamp: P: 1790521558674713 usec, L: 0
0927 15:06:05.620787 (+ 102us) write_op.cc:270] Start()
0927 15:06:05.620811 (+ 24us) write_op.cc:276] Timestamp: P: 1790521558676938 usec, L: 0
0927 15:06:05.620938 (+ 127us) write_op.cc:270] Start()
0927 15:06:05.620955 (+ 17us) write_op.cc:276] Timestamp: P: 1790521558680958 usec, L: 0
0927 15:06:05.621078 (+ 123us) write_op.cc:270] Start()
0927 15:06:05.621096 (+ 18us) write_op.cc:276] Timestamp: P: 1790521558714006 usec, L: 0
0927 15:06:05.621218 (+ 122us) write_op.cc:270] Start()
0927 15:06:05.621237 (+ 19us) write_op.cc:276] Timestamp: P: 1790521558723444 usec, L: 0
0927 15:06:05.621378 (+ 141us) write_op.cc:270] Start()
0927 15:06:05.621396 (+ 18us) write_op.cc:276] Timestamp: P: 1790521558727218 usec, L: 0
0927 15:06:05.621534 (+ 138us) write_op.cc:270] Start()
0927 15:06:05.621556 (+ 22us) write_op.cc:276] Timestamp: P: 1790521558731109 usec, L: 0
0927 15:06:05.621668 (+ 112us) write_op.cc:270] Start()
0927 15:06:05.621683 (+ 15us) write_op.cc:276] Timestamp: P: 1790521558737173 usec, L: 0
0927 15:06:05.621809 (+ 126us) write_op.cc:270] Start()
0927 15:06:05.621826 (+ 17us) write_op.cc:276] Timestamp: P: 1790521558739644 usec, L: 0
0927 15:06:05.643214 (+ 21388us) write_op.cc:270] Start()
0927 15:06:05.643249 (+ 35us) write_op.cc:276] Timestamp: P: 17905215
I20260927 15:06:07.525138 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 405) took 3254 ms. Trace:
I20260927 15:06:07.527704 1562 rpcz_store.cc:276] 0927 15:06:04.270239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.270310 (+ 71us) service_pool.cc:227] Handling call
0927 15:06:07.525012 (+3254702us) ts_tablet_manager.cc:1145] Deleting tablet 9576d1a36d7547bf81faabe9c362e3cb
0927 15:06:07.525021 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.525108 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3194053}
W20260927 15:06:07.528184 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9576d1a36d7547bf81faabe9c362e3cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9576d1a36d7547bf81faabe9c362e3cb already in progress: creating tablet
I20260927 15:06:07.529577 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 406) took 3198 ms. Trace:
I20260927 15:06:07.529744 1562 rpcz_store.cc:276] 0927 15:06:04.330520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.330618 (+ 98us) service_pool.cc:227] Handling call
0927 15:06:07.528494 (+3197876us) ts_tablet_manager.cc:1145] Deleting tablet ac64eacc7d924940aacc8779b5bfeae7
0927 15:06:07.528503 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.528598 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3180516}
W20260927 15:06:07.530211 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ac64eacc7d924940aacc8779b5bfeae7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac64eacc7d924940aacc8779b5bfeae7 already in progress: creating tablet
I20260927 15:06:07.530596 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 408) took 3173 ms. Trace:
I20260927 15:06:07.546614 2068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:06:07.548583 2068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: This master's current role is: LEADER
I20260927 15:06:07.556495 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0702d9501ac047938d02ef2521dbf0d5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:07.557417 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:07.563217 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 377847d06b534883ba2b870ca3317fe0 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbaed2bd9224a0c867cb8804ce8478e) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:07.565057 1376 leader_election.cc:341] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.567863 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1e91076e42b04629abc3a91b3b7ecd50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.568614 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e91076e42b04629abc3a91b3b7ecd50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.577476 2094 raft_consensus.cc:504] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.579378 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67cf4dae943e4092b2c490ad770e4a94" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:07.579597 1163 raft_consensus.cc:3037] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:07.580386 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_017e45d4e58a4ee7963c291a4aa901c7" } modify_external_catalogs: true
I20260927 15:06:07.580305 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2996ce3719d74bc9814dedbb61678d95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:07.580572 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_017e45d4e58a4ee7963c291a4aa901c7" } modify_external_catalogs: true
I20260927 15:06:07.580628 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_acd9f14d4fb34ccca7258cac39ea7602"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.580952 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2996ce3719d74bc9814dedbb61678d95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:07.581149 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acd9f14d4fb34ccca7258cac39ea7602 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:07.581197 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_523e2ef14fe8419c80231f7d636c8d6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:07.581676 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_523e2ef14fe8419c80231f7d636c8d6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:07.595212 1238 leader_election.cc:341] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 67cf4dae943e4092b2c490ad770e4a94
I20260927 15:06:07.598042 1552 raft_consensus.cc:348] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.598405 1552 raft_consensus.cc:374] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:07.600498 1552 raft_consensus.cc:729] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:07.600777 1552 consensus_queue.cc:260] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.602626 2094 leader_election.cc:288] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:07.610708 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 75645963963e4091af0edfcbc794fb2d consensus state has no leader
I20260927 15:06:07.612313 2119 ts_tablet_manager.cc:1918] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:07.612510 2119 log.cc:1196] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/0e6e3600cbf741419bc7b93eec42eb13
I20260927 15:06:07.633138 2119 ts_tablet_manager.cc:1939] T 0e6e3600cbf741419bc7b93eec42eb13 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:07.633821 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 430) took 1943 ms. Trace:
I20260927 15:06:07.636193 2119 rpcz_store.cc:276] 0927 15:06:05.690681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.692522 (+ 1841us) service_pool.cc:227] Handling call
0927 15:06:07.316068 (+1623546us) ts_tablet_manager.cc:1145] Deleting tablet 0e6e3600cbf741419bc7b93eec42eb13
0927 15:06:07.316081 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.485081 (+169000us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.610327 (+125246us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.633781 (+ 23454us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1623251}
I20260927 15:06:07.637498 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 0e6e3600cbf741419bc7b93eec42eb13 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]) successfully deleted
I20260927 15:06:07.638782 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 437) took 1865 ms. Trace:
I20260927 15:06:07.648808 2119 rpcz_store.cc:276] 0927 15:06:05.772970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.790927 (+ 17957us) service_pool.cc:227] Handling call
0927 15:06:07.638590 (+1847663us) ts_tablet_manager.cc:1145] Deleting tablet 45b610025b1a4b68bdc34f870654f9d1
0927 15:06:07.638605 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.638739 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1847456}
I20260927 15:06:07.653689 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 442) took 1819 ms. Trace:
I20260927 15:06:07.659422 2119 rpcz_store.cc:276] 0927 15:06:05.834662 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.836487 (+ 1825us) service_pool.cc:227] Handling call
0927 15:06:07.653473 (+1816986us) ts_tablet_manager.cc:1145] Deleting tablet 424b66c69254487f932894516d570204
0927 15:06:07.653489 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.653651 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1816673}
W20260927 15:06:07.662881 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 424b66c69254487f932894516d570204 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 424b66c69254487f932894516d570204 already in progress: creating tablet
I20260927 15:06:07.663444 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 445) took 1817 ms. Trace:
I20260927 15:06:07.663648 2119 rpcz_store.cc:276] 0927 15:06:05.845704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.845756 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:07.663254 (+1817498us) ts_tablet_manager.cc:1145] Deleting tablet b44e2611d2bf40ae90c4fd857225e39e
0927 15:06:07.663269 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.663398 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1817223}
W20260927 15:06:07.664631 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b44e2611d2bf40ae90c4fd857225e39e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b44e2611d2bf40ae90c4fd857225e39e already in progress: creating tablet
I20260927 15:06:07.665258 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 444) took 1819 ms. Trace:
I20260927 15:06:07.666201 2119 rpcz_store.cc:276] 0927 15:06:05.845548 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.846448 (+ 900us) service_pool.cc:227] Handling call
0927 15:06:07.665095 (+1818647us) ts_tablet_manager.cc:1145] Deleting tablet a97f72ddef5346c297d73589e926260c
0927 15:06:07.665108 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.665220 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1795721}
I20260927 15:06:07.687270 2197 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:07.696828 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0702d9501ac047938d02ef2521dbf0d5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:07.697165 1436 raft_consensus.cc:2379] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4264874db964ff2830b7894c2b3d61c in current term 1: Already voted for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in this term.
W20260927 15:06:07.697395 1099 leader_election.cc:341] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6e9d03457dac43038b4e6fb120ff572c
I20260927 15:06:07.697554 1099 leader_election.cc:302] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:07.697882 2199 raft_consensus.cc:2726] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260927 15:06:07.699311 1099 consensus_peers.cc:487] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad5af5df58824fe88d607a93216bd228. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:07.699522 1099 leader_election.cc:302] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:07.709970 1561 tablet_bootstrap.cc:492] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:07.711717 1561 tablet_bootstrap.cc:654] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:07.532894 1562 rpcz_store.cc:276] 0927 15:06:04.357049 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.357179 (+ 130us) service_pool.cc:227] Handling call
0927 15:06:07.530472 (+3173293us) ts_tablet_manager.cc:1145] Deleting tablet d463a481cb8c4243961e9b0d2b11822c
0927 15:06:07.530481 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.530560 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3173111}
I20260927 15:06:07.713068 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 407) took 3356 ms. Trace:
I20260927 15:06:07.713192 1562 rpcz_store.cc:276] 0927 15:06:04.356875 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.357429 (+ 554us) service_pool.cc:227] Handling call
0927 15:06:07.712910 (+3355481us) ts_tablet_manager.cc:1145] Deleting tablet fd1f51cb124d4d20a9d6024e6eb6810f
0927 15:06:07.712920 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.713022 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3348510}
I20260927 15:06:07.713486 1562 tablet_replica.cc:330] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:07.713721 1562 raft_consensus.cc:2229] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:07.714028 1562 raft_consensus.cc:2258] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.714570 1562 ts_tablet_manager.cc:1905] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.714690 1163 raft_consensus.cc:2454] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
W20260927 15:06:07.719336 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet fd1f51cb124d4d20a9d6024e6eb6810f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd1f51cb124d4d20a9d6024e6eb6810f already in progress: creating tablet
I20260927 15:06:07.721700 1164 raft_consensus.cc:2454] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:07.726651 2006 raft_consensus.cc:2726] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:07.726739 1374 leader_election.cc:302] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:07.727049 2216 tablet.cc:1722] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:07.727213 2076 raft_consensus.cc:2781] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:07.727370 2076 raft_consensus.cc:686] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:07.727608 2076 consensus_queue.cc:237] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.733758 2216 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:07.722316 1562 ts_tablet_manager.cc:1918] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:07.746615 1562 log.cc:1196] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/67ad68a0adad407a92b2335f43e67227
I20260927 15:06:07.747135 1562 ts_tablet_manager.cc:1939] T 67ad68a0adad407a92b2335f43e67227 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:07.748181 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 409) took 3353 ms. Trace:
I20260927 15:06:07.748319 1562 rpcz_store.cc:276] 0927 15:06:04.394551 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.394769 (+ 218us) service_pool.cc:227] Handling call
0927 15:06:07.713423 (+3318654us) ts_tablet_manager.cc:1145] Deleting tablet 67ad68a0adad407a92b2335f43e67227
0927 15:06:07.713437 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.718311 (+ 4874us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.722201 (+ 3890us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.748119 (+ 25918us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3289175}
I20260927 15:06:07.748914 1562 tablet_replica.cc:330] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:07.748867 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 67ad68a0adad407a92b2335f43e67227 (table default.Table_f775f6645d8543308d977cc3519302b7 [id=55619382de684277879287b56f6bce02]) successfully deleted
I20260927 15:06:07.749190 1562 raft_consensus.cc:2229] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:07.749575 1562 pending_rounds.cc:62] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:07.749675 1562 pending_rounds.cc:68] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976331735371776 op_type: NO_OP noop_request { }
I20260927 15:06:07.701908 1301 raft_consensus.cc:3037] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:07.719444 1239 leader_election.cc:302] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:07.750819 1562 raft_consensus.cc:2866] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:07.750991 1562 raft_consensus.cc:2258] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.751469 1561 tablet_bootstrap.cc:492] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
W20260927 15:06:07.751396 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a97f72ddef5346c297d73589e926260c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a97f72ddef5346c297d73589e926260c already in progress: creating tablet
I20260927 15:06:07.751588 1562 ts_tablet_manager.cc:1905] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.774649 2094 raft_consensus.cc:2781] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:07.775434 2137 raft_consensus.cc:482] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:07.775645 2137 raft_consensus.cc:504] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.776019 2094 raft_consensus.cc:686] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:07.776300 2137 leader_election.cc:288] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:07.776381 2094 consensus_queue.cc:237] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.777205 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c313ab6848428d8237557392669f6f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:07.777776 1376 leader_election.cc:341] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.782883 1561 ts_tablet_manager.cc:1397] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.248s user 0.000s sys 0.014s
I20260927 15:06:07.784147 1562 ts_tablet_manager.cc:1918] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:07.784307 1561 raft_consensus.cc:348] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.784510 1561 raft_consensus.cc:374] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:07.785473 1561 raft_consensus.cc:729] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:07.785409 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 443) took 1940 ms. Trace:
I20260927 15:06:07.785688 1561 consensus_queue.cc:260] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.786180 1562 log.cc:1196] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/63289edbdd734dd5a817df42d83e422e
I20260927 15:06:07.786705 1562 ts_tablet_manager.cc:1939] T 63289edbdd734dd5a817df42d83e422e P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:07.786132 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c313ab6848428d8237557392669f6f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:07.789387 1164 raft_consensus.cc:2454] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:07.789388 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 411) took 3320 ms. Trace:
I20260927 15:06:07.789873 1374 leader_election.cc:302] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:07.790280 2137 raft_consensus.cc:2781] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:07.790390 2137 raft_consensus.cc:482] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:07.790480 2137 raft_consensus.cc:3037] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:07.793304 2137 raft_consensus.cc:504] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.794368 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c313ab6848428d8237557392669f6f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:07.794930 1376 leader_election.cc:341] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:07.795419 2137 leader_election.cc:288] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:07.795647 1561 ts_tablet_manager.cc:1428] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260927 15:06:07.796229 1561 tablet_bootstrap.cc:492] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:07.795837 1562 rpcz_store.cc:276] 0927 15:06:04.467003 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.467213 (+ 210us) service_pool.cc:227] Handling call
0927 15:06:07.748822 (+3281609us) ts_tablet_manager.cc:1145] Deleting tablet 63289edbdd734dd5a817df42d83e422e
0927 15:06:07.748836 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.757282 (+ 8446us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.783953 (+ 26671us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.787566 (+ 3613us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5888,"tablet-delete.queue_time_us":3281369}
I20260927 15:06:07.796895 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 63289edbdd734dd5a817df42d83e422e (table default.Table_b093eeae2295436bb418ac8610a19dd0 [id=9680ba832c914d98b077951ac46dc2b6]) successfully deleted
I20260927 15:06:07.798794 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c313ab6848428d8237557392669f6f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:07.799157 1164 raft_consensus.cc:3037] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:07.803736 1164 raft_consensus.cc:2454] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:07.806340 1561 tablet_bootstrap.cc:654] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:07.806859 1374 leader_election.cc:302] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:07.806895 2119 rpcz_store.cc:276] 0927 15:06:05.842335 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.845319 (+ 2984us) service_pool.cc:227] Handling call
0927 15:06:07.751745 (+1906426us) ts_tablet_manager.cc:1145] Deleting tablet b2d2501a9f764790818426665e7f0340
0927 15:06:07.751762 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.782683 (+ 30921us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1873171}
I20260927 15:06:07.807266 2137 raft_consensus.cc:2781] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:07.801532 1562 tablet_replica.cc:330] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:06:07.807835 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b2d2501a9f764790818426665e7f0340 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2d2501a9f764790818426665e7f0340 already in progress: creating tablet
I20260927 15:06:07.807974 1562 raft_consensus.cc:2229] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:07.808209 1562 raft_consensus.cc:2258] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.808557 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 458) took 1854 ms. Trace:
I20260927 15:06:07.808871 1562 ts_tablet_manager.cc:1905] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.808760 2119 rpcz_store.cc:276] 0927 15:06:06.001389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.003329 (+ 1940us) service_pool.cc:227] Handling call
0927 15:06:07.808346 (+1805017us) ts_tablet_manager.cc:1145] Deleting tablet e2ba3bdf50b14aec85a99742426e9298
0927 15:06:07.808364 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.808509 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1769475}
W20260927 15:06:07.809424 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e2ba3bdf50b14aec85a99742426e9298 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2ba3bdf50b14aec85a99742426e9298 already in progress: creating tablet
I20260927 15:06:07.815425 1562 ts_tablet_manager.cc:1918] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:07.820587 1562 log.cc:1196] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/07b63e63f7cd4075bcf10a463ce16e05
I20260927 15:06:07.821267 1562 ts_tablet_manager.cc:1939] T 07b63e63f7cd4075bcf10a463ce16e05 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:07.822713 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 412) took 3355 ms. Trace:
I20260927 15:06:07.823868 1562 rpcz_store.cc:276] 0927 15:06:04.467126 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.467484 (+ 358us) service_pool.cc:227] Handling call
0927 15:06:07.796717 (+3329233us) ts_tablet_manager.cc:1145] Deleting tablet 07b63e63f7cd4075bcf10a463ce16e05
0927 15:06:07.796726 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.812342 (+ 15616us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.815316 (+ 2974us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.822676 (+ 7360us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3329048}
I20260927 15:06:07.824786 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 07b63e63f7cd4075bcf10a463ce16e05 (table default.Table_f1c5c1132cab4343b25f94cd31941336 [id=36810bbe6edd4d769f3f5da76c71e6e2]) successfully deleted
I20260927 15:06:07.824900 1562 tablet_replica.cc:330] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:07.825413 1562 raft_consensus.cc:2229] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:07.825888 1562 raft_consensus.cc:2258] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.826638 1562 ts_tablet_manager.cc:1905] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.827351 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 467) took 1762 ms. Trace:
I20260927 15:06:07.827909 2119 rpcz_store.cc:276] 0927 15:06:06.064928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.159506 (+ 94578us) service_pool.cc:227] Handling call
0927 15:06:07.827162 (+1667656us) ts_tablet_manager.cc:1145] Deleting tablet cf2d3438867a45319645a7b6bee7022a
0927 15:06:07.827177 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.827305 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1616542}
W20260927 15:06:07.828611 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet cf2d3438867a45319645a7b6bee7022a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf2d3438867a45319645a7b6bee7022a already in progress: creating tablet
I20260927 15:06:07.857659 1552 ts_tablet_manager.cc:1428] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.369s user 0.003s sys 0.008s
I20260927 15:06:07.858170 1552 tablet_bootstrap.cc:492] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:07.860919 1552 tablet_bootstrap.cc:654] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:07.862187 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.60:46799, user_credentials={real_user=slave}} blocked reactor thread for 324660us
I20260927 15:06:07.862922 1562 ts_tablet_manager.cc:1918] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:07.864267 1562 log.cc:1196] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/67cf4dae943e4092b2c490ad770e4a94
I20260927 15:06:07.864960 1562 ts_tablet_manager.cc:1939] T 67cf4dae943e4092b2c490ad770e4a94 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:07.865937 1164 raft_consensus.cc:1261] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Refusing update from remote peer fabb59e74b7d48fa9be047d7f4c4cc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260927 15:06:07.867542 1376 consensus_peers.cc:487] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:07.867579 2223 consensus_queue.cc:1035] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:07.868155 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 410) took 3401 ms. Trace:
I20260927 15:06:07.876554 2215 tablet.cc:1722] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:07.883472 2216 tablet.cc:1722] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:07.884996 1562 rpcz_store.cc:276] 0927 15:06:04.466816 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.469061 (+ 2245us) service_pool.cc:227] Handling call
0927 15:06:07.824831 (+3355770us) ts_tablet_manager.cc:1145] Deleting tablet 67cf4dae943e4092b2c490ad770e4a94
0927 15:06:07.824845 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.855905 (+ 31060us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.862774 (+ 6869us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.868095 (+ 5321us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3355561}
I20260927 15:06:07.884682 2198 tablet.cc:1722] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:07.889628 2197 tablet.cc:1722] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:07.895546 2197 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:60504 (request call id 514) took 1407 ms. Trace:
I20260927 15:06:07.895802 2197 rpcz_store.cc:276] 0927 15:06:06.488426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.593081 (+104655us) service_pool.cc:227] Handling call
0927 15:06:07.895507 (+1302426us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:06.708520 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0927 15:06:06.708624 (+ 104us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 15:06:06.708632 (+ 8us) alter_schema_op.cc:65] Acquired schema lock
0927 15:06:06.708637 (+ 5us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0927 15:06:06.708669 (+ 32us) alter_schema_op.cc:126] START. Timestamp: 1790521566708627
0927 15:06:06.708671 (+ 2us) op_driver.cc:331] REPLICATION: starting
0927 15:06:06.709022 (+ 351us) log.cc:842] Serialized 173 byte log entry
0927 15:06:07.889434 (+1180412us) op_driver.cc:444] REPLICATION: finished
0927 15:06:07.889555 (+ 121us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0927 15:06:07.891252 (+ 1697us) log.cc:842] Serialized 5 byte log entry
0927 15:06:07.895145 (+ 3893us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:07.895422 (+ 277us) log.cc:842] Serialized 14 byte log entry
0927 15:06:07.895455 (+ 33us) alter_schema_op.cc:71] Released schema lock
0927 15:06:07.895462 (+ 7us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":63,"prepare.queue_time_us":115101,"prepare.run_cpu_time_us":486,"prepare.run_wall_time_us":2382,"raft.queue_time_us":63,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":267,"replication_time_us":1180732,"thread_start_us":120763,"threads_started":1}]]}
I20260927 15:06:07.901135 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 419) took 3406 ms. Trace:
I20260927 15:06:07.901324 1562 rpcz_store.cc:276] 0927 15:06:04.495028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.495102 (+ 74us) service_pool.cc:227] Handling call
0927 15:06:07.900973 (+3405871us) ts_tablet_manager.cc:1145] Deleting tablet 566aa5caa012443ea63fcb7389c8b7c0
0927 15:06:07.900983 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.901079 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3402172}
I20260927 15:06:07.901921 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 417) took 3408 ms. Trace:
I20260927 15:06:07.902071 1562 rpcz_store.cc:276] 0927 15:06:04.493528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.493650 (+ 122us) service_pool.cc:227] Handling call
0927 15:06:07.901759 (+3408109us) ts_tablet_manager.cc:1145] Deleting tablet 219639c0184f4888984fa04a1f84bd83
0927 15:06:07.901769 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.901868 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3402812}
I20260927 15:06:07.906210 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 67cf4dae943e4092b2c490ad770e4a94 (table default.Table_6f254b1d0eb949238df41c88797697e5 [id=9ac1472258a24d01892257dd9c9874a8]) successfully deleted
W20260927 15:06:07.912058 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 566aa5caa012443ea63fcb7389c8b7c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 566aa5caa012443ea63fcb7389c8b7c0 already in progress: creating tablet
W20260927 15:06:07.912382 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 219639c0184f4888984fa04a1f84bd83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 219639c0184f4888984fa04a1f84bd83 already in progress: creating tablet
I20260927 15:06:07.916296 914 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 571072536098420d8b5bdddc9aaa4161
I20260927 15:06:07.919699 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 0ac2df48cabc467195f4986238519fb2 (DEFAULT_TABLE table=default.Table_8f620f33a9dc4d388caf59fd6edc6cc4 [id=9a6757ecfe864da7a72798efb131a53f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.920301 1134 tablet_service.cc:1467] Processing CreateTablet for tablet f9a1d9c742204cd3b7c0e0bd3c1d7e69 (DEFAULT_TABLE table=default.Table_a3a8d1e9d1b54c209faf08c4ca2f04aa [id=274ee048b1dc4ed2bf1b21503f3b0b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.920431 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet a260c9d3b8fb4316864e6f986559bef1 (table default.Table_b592f94f43ea4ffe8068db6aed19c5ef [id=61c39607ad5b482c80883c0e60f0da9c]). Expected version 1 got 0
I20260927 15:06:07.920694 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:07.921931 1417 tablet_service.cc:1467] Processing CreateTablet for tablet f9a1d9c742204cd3b7c0e0bd3c1d7e69 (DEFAULT_TABLE table=default.Table_a3a8d1e9d1b54c209faf08c4ca2f04aa [id=274ee048b1dc4ed2bf1b21503f3b0b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.922315 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9a1d9c742204cd3b7c0e0bd3c1d7e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.932180 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 916663fe0c6c46b1b3415e165d60187f (DEFAULT_TABLE table=default.Table_3cdaadf2a6d64643a97238fcba5134a3 [id=4c967042986d437f97f8da4a7284629e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.932524 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 0ac2df48cabc467195f4986238519fb2 (DEFAULT_TABLE table=default.Table_8f620f33a9dc4d388caf59fd6edc6cc4 [id=9a6757ecfe864da7a72798efb131a53f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.932626 1128 tablet_service.cc:1467] Processing CreateTablet for tablet e33a8d5908004ab88d4c53b21be4fb42 (DEFAULT_TABLE table=default.Table_49ac42f044d84fd5ad0acbf7fa401b33 [id=135687fe0d804ff088b40131eba73981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.932876 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ac2df48cabc467195f4986238519fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.932992 1143 tablet_service.cc:1467] Processing CreateTablet for tablet bda4bc28542d4b5e9cb1b432e5cf54d7 (DEFAULT_TABLE table=default.Table_279db08831174124bf691a8cad553e81 [id=5de6f33b4fa24254a432ee069ed91324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.933367 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 538a0577d6ce4898828aa0d1ea2a1c85 (DEFAULT_TABLE table=default.Table_b1562c61fb3447a9b59d1069cbebee7d [id=b1e03d1323e44dd2a0b3690a501d9838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.933784 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 36499416277548098a7acbbabb2d300a (DEFAULT_TABLE table=default.Table_35eb658172474617ac4f5ea71f19747d [id=55e92546fe1e41ef898509985d26154c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.934139 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 7b43f13e66b0415e8dea802d52626d04 (DEFAULT_TABLE table=default.Table_8a603f04bc4e47bc96a9c06f178536ff [id=d705ff389e60442b87dbd12722a5ed39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.934525 1146 tablet_service.cc:1467] Processing CreateTablet for tablet e1950cd7a2dc48a3ac03a7dc61f7e546 (DEFAULT_TABLE table=default.Table_7343b42c802f450fa21fbd575b426e4a [id=4a183100ff174e4a8f024b44e091ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.934881 1127 tablet_service.cc:1467] Processing CreateTablet for tablet fb33cdf8e6424c8eae54a792096c13b7 (DEFAULT_TABLE table=default.Table_0ef0f88b084c44adbaa8d752c24f67a0 [id=53ba68db870b42b5ac5cab91a97fe3cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.935271 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 49ed368c4c784802beba044514deb777 (DEFAULT_TABLE table=default.Table_0c18b4cd27df497a8722e0a3c4a8e8e4 [id=ab19321a0a8b4c9e804c782e885f366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.935784 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 421) took 3415 ms. Trace:
I20260927 15:06:07.935847 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 916663fe0c6c46b1b3415e165d60187f (DEFAULT_TABLE table=default.Table_3cdaadf2a6d64643a97238fcba5134a3 [id=4c967042986d437f97f8da4a7284629e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.936055 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ac2df48cabc467195f4986238519fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.935945 1562 rpcz_store.cc:276] 0927 15:06:04.520136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.520195 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:07.902491 (+3382296us) ts_tablet_manager.cc:1145] Deleting tablet ea3220df595848258d0f53fa941b2beb
0927 15:06:07.935368 (+ 32877us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:07.935699 (+ 331us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3382015}
I20260927 15:06:07.936239 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916663fe0c6c46b1b3415e165d60187f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.936355 1562 tablet_replica.cc:330] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:07.936575 1562 raft_consensus.cc:2229] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:07.937075 1562 pending_rounds.cc:62] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:07.937145 1562 pending_rounds.cc:68] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976332159369216 op_type: NO_OP noop_request { }
I20260927 15:06:07.939150 2208 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b6a41e027f0448cafe3365f23103f92)
W20260927 15:06:07.942035 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ea3220df595848258d0f53fa941b2beb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea3220df595848258d0f53fa941b2beb already in progress: creating tablet
I20260927 15:06:07.943575 1407 tablet_service.cc:1467] Processing CreateTablet for tablet e33a8d5908004ab88d4c53b21be4fb42 (DEFAULT_TABLE table=default.Table_49ac42f044d84fd5ad0acbf7fa401b33 [id=135687fe0d804ff088b40131eba73981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.939332 2208 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:06:07.944154 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e33a8d5908004ab88d4c53b21be4fb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.947443 1401 tablet_service.cc:1467] Processing CreateTablet for tablet bda4bc28542d4b5e9cb1b432e5cf54d7 (DEFAULT_TABLE table=default.Table_279db08831174124bf691a8cad553e81 [id=5de6f33b4fa24254a432ee069ed91324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.947755 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bda4bc28542d4b5e9cb1b432e5cf54d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.953558 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 538a0577d6ce4898828aa0d1ea2a1c85 (DEFAULT_TABLE table=default.Table_b1562c61fb3447a9b59d1069cbebee7d [id=b1e03d1323e44dd2a0b3690a501d9838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.953931 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538a0577d6ce4898828aa0d1ea2a1c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.956856 924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dbf522d70373412b87815d33c0f1f745" candidate_term: 2 candidate_status { last_received { term: 1 index: 758 } } ignore_live_leader: false dest_uuid: "6b6a41e027f0448cafe3365f23103f92" is_pre_election: true
I20260927 15:06:07.957454 993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dbf522d70373412b87815d33c0f1f745" candidate_term: 2 candidate_status { last_received { term: 1 index: 758 } } ignore_live_leader: false dest_uuid: "2a122de3662f485f8f44b0a5e4b29862" is_pre_election: true
I20260927 15:06:07.957598 2208 leader_election.cc:288] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b6a41e027f0448cafe3365f23103f92 (127.0.201.61:43763), 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799)
I20260927 15:06:07.958019 1858 leader_election.cc:302] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbf522d70373412b87815d33c0f1f745; no voters: 2a122de3662f485f8f44b0a5e4b29862, 6b6a41e027f0448cafe3365f23103f92
I20260927 15:06:07.958407 2208 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:07.879252 2119 tablet_replica.cc:330] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:07.928153 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 0ac2df48cabc467195f4986238519fb2 (DEFAULT_TABLE table=default.Table_8f620f33a9dc4d388caf59fd6edc6cc4 [id=9a6757ecfe864da7a72798efb131a53f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.928555 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 916663fe0c6c46b1b3415e165d60187f (DEFAULT_TABLE table=default.Table_3cdaadf2a6d64643a97238fcba5134a3 [id=4c967042986d437f97f8da4a7284629e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.929050 1280 tablet_service.cc:1467] Processing CreateTablet for tablet f9a1d9c742204cd3b7c0e0bd3c1d7e69 (DEFAULT_TABLE table=default.Table_a3a8d1e9d1b54c209faf08c4ca2f04aa [id=274ee048b1dc4ed2bf1b21503f3b0b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.932403 1274 tablet_service.cc:1467] Processing CreateTablet for tablet e33a8d5908004ab88d4c53b21be4fb42 (DEFAULT_TABLE table=default.Table_49ac42f044d84fd5ad0acbf7fa401b33 [id=135687fe0d804ff088b40131eba73981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.933003 1282 tablet_service.cc:1467] Processing CreateTablet for tablet bda4bc28542d4b5e9cb1b432e5cf54d7 (DEFAULT_TABLE table=default.Table_279db08831174124bf691a8cad553e81 [id=5de6f33b4fa24254a432ee069ed91324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.934572 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 538a0577d6ce4898828aa0d1ea2a1c85 (DEFAULT_TABLE table=default.Table_b1562c61fb3447a9b59d1069cbebee7d [id=b1e03d1323e44dd2a0b3690a501d9838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.934931 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 36499416277548098a7acbbabb2d300a (DEFAULT_TABLE table=default.Table_35eb658172474617ac4f5ea71f19747d [id=55e92546fe1e41ef898509985d26154c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.960384 2119 raft_consensus.cc:2229] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:07.935256 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 7b43f13e66b0415e8dea802d52626d04 (DEFAULT_TABLE table=default.Table_8a603f04bc4e47bc96a9c06f178536ff [id=d705ff389e60442b87dbd12722a5ed39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.935611 1272 tablet_service.cc:1467] Processing CreateTablet for tablet e1950cd7a2dc48a3ac03a7dc61f7e546 (DEFAULT_TABLE table=default.Table_7343b42c802f450fa21fbd575b426e4a [id=4a183100ff174e4a8f024b44e091ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.935981 1266 tablet_service.cc:1467] Processing CreateTablet for tablet fb33cdf8e6424c8eae54a792096c13b7 (DEFAULT_TABLE table=default.Table_0ef0f88b084c44adbaa8d752c24f67a0 [id=53ba68db870b42b5ac5cab91a97fe3cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.936331 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 49ed368c4c784802beba044514deb777 (DEFAULT_TABLE table=default.Table_0c18b4cd27df497a8722e0a3c4a8e8e4 [id=ab19321a0a8b4c9e804c782e885f366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.936656 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 903af8c6380948ff9bbb9f84ca0eadeb (DEFAULT_TABLE table=default.Table_13066a3685a54af8b406268b1bbbe003 [id=59ce95c20cca4d86a32fb6e4d56bbbd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.960981 2119 raft_consensus.cc:2258] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:07.962050 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ac2df48cabc467195f4986238519fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.963622 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916663fe0c6c46b1b3415e165d60187f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.963967 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 7b43f13e66b0415e8dea802d52626d04 (DEFAULT_TABLE table=default.Table_8a603f04bc4e47bc96a9c06f178536ff [id=d705ff389e60442b87dbd12722a5ed39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.964344 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b43f13e66b0415e8dea802d52626d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.965792 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9a1d9c742204cd3b7c0e0bd3c1d7e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.967383 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e33a8d5908004ab88d4c53b21be4fb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.968967 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bda4bc28542d4b5e9cb1b432e5cf54d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.970345 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538a0577d6ce4898828aa0d1ea2a1c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.970902 1405 tablet_service.cc:1467] Processing CreateTablet for tablet fb33cdf8e6424c8eae54a792096c13b7 (DEFAULT_TABLE table=default.Table_0ef0f88b084c44adbaa8d752c24f67a0 [id=53ba68db870b42b5ac5cab91a97fe3cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.971091 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36499416277548098a7acbbabb2d300a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.971253 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb33cdf8e6424c8eae54a792096c13b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.971261 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb33cdf8e6424c8eae54a792096c13b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.972522 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49ed368c4c784802beba044514deb777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.974294 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 903af8c6380948ff9bbb9f84ca0eadeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.975214 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1950cd7a2dc48a3ac03a7dc61f7e546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.976804 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b43f13e66b0415e8dea802d52626d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.977906 1418 tablet_service.cc:1467] Processing CreateTablet for tablet e1950cd7a2dc48a3ac03a7dc61f7e546 (DEFAULT_TABLE table=default.Table_7343b42c802f450fa21fbd575b426e4a [id=4a183100ff174e4a8f024b44e091ec85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.978353 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1950cd7a2dc48a3ac03a7dc61f7e546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.978557 2137 raft_consensus.cc:686] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:07.978976 2137 consensus_queue.cc:237] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.980865 1303 raft_consensus.cc:3037] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:07.981756 2119 ts_tablet_manager.cc:1905] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:07.987977 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 903af8c6380948ff9bbb9f84ca0eadeb (DEFAULT_TABLE table=default.Table_13066a3685a54af8b406268b1bbbe003 [id=59ce95c20cca4d86a32fb6e4d56bbbd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.988333 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 903af8c6380948ff9bbb9f84ca0eadeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.941296 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bda4bc28542d4b5e9cb1b432e5cf54d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.988866 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9a1d9c742204cd3b7c0e0bd3c1d7e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.942878 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 903af8c6380948ff9bbb9f84ca0eadeb (DEFAULT_TABLE table=default.Table_13066a3685a54af8b406268b1bbbe003 [id=59ce95c20cca4d86a32fb6e4d56bbbd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.989387 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 903af8c6380948ff9bbb9f84ca0eadeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.993126 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e33a8d5908004ab88d4c53b21be4fb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.993799 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538a0577d6ce4898828aa0d1ea2a1c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.958997 2006 raft_consensus.cc:482] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:07.994992 2006 raft_consensus.cc:504] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:07.995393 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 49ed368c4c784802beba044514deb777 (DEFAULT_TABLE table=default.Table_0c18b4cd27df497a8722e0a3c4a8e8e4 [id=ab19321a0a8b4c9e804c782e885f366b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:07.995774 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49ed368c4c784802beba044514deb777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:07.999171 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36499416277548098a7acbbabb2d300a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.001951 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f585bcdadbcc4032aa484481cdf94b72" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:08.002198 1438 raft_consensus.cc:2454] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:08.002266 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f585bcdadbcc4032aa484481cdf94b72" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:07.937388 1562 raft_consensus.cc:2866] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:08.007519 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb33cdf8e6424c8eae54a792096c13b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.010385 1556 tablet_bootstrap.cc:492] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.010622 1556 ts_tablet_manager.cc:1397] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.506s user 0.090s sys 0.185s
I20260927 15:06:08.011452 1556 raft_consensus.cc:348] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:08.013242 1102 leader_election.cc:341] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.013386 1556 raft_consensus.cc:374] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.013491 1556 raft_consensus.cc:729] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.014029 1556 consensus_queue.cc:260] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.014237 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b43f13e66b0415e8dea802d52626d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.015053 1556 ts_tablet_manager.cc:1428] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260927 15:06:08.017169 1556 tablet_bootstrap.cc:492] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:08.017252 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916663fe0c6c46b1b3415e165d60187f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.020071 2006 leader_election.cc:288] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:08.020984 1099 leader_election.cc:302] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:08.022004 1556 tablet_bootstrap.cc:654] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.022596 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49ed368c4c784802beba044514deb777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.027168 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1950cd7a2dc48a3ac03a7dc61f7e546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.028113 914 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_9e1c88622f89474285f6bdb98faffffb [id=32293fa2bff246dba3dfe47a3fcaf310] alter complete (version 1)
I20260927 15:06:08.030149 2006 raft_consensus.cc:2781] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:08.030251 2006 raft_consensus.cc:482] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:08.030362 2006 raft_consensus.cc:3037] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:08.031067 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 05d525c1128e4042aa97ff786ffa7ba9
I20260927 15:06:08.031738 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 05d525c1128e4042aa97ff786ffa7ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.032426 1562 raft_consensus.cc:2258] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.035406 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_90b9ccd25c694abe98e24e0b37bb75af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.035975 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90b9ccd25c694abe98e24e0b37bb75af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.036084 2142 raft_consensus.cc:482] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.036230 2142 raft_consensus.cc:504] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.036868 2142 leader_election.cc:288] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:08.037479 1562 ts_tablet_manager.cc:1905] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.037501 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8f620f33a9dc4d388caf59fd6edc6cc4" } new_table_name: "default.Table_992c531b10424b57a812f821b5bd99bf" modify_external_catalogs: true
W20260927 15:06:08.039081 1099 leader_election.cc:341] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 42baac8b7d47433e826eb3bc1980acaa
I20260927 15:06:08.039577 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_996a8c79612d4f8f81e6849eb51715b9" } new_table_name: "default.Table_69e7da33db594b0494d614660c3525f8" modify_external_catalogs: true
I20260927 15:06:08.040603 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7b626dee65d244319052156e5e5fe7bc" } new_table_name: "default.Table_7c6727a8c35146bab41c30a0ef2ddd04" modify_external_catalogs: true
I20260927 15:06:08.040970 2006 raft_consensus.cc:504] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.041832 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6abf703ded884d0aa2706e13cf2df6a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.042294 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6abf703ded884d0aa2706e13cf2df6a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.043610 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4c0f3b014a07445b9a7e9bca831bce19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.044050 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c0f3b014a07445b9a7e9bca831bce19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.022569 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 36499416277548098a7acbbabb2d300a (DEFAULT_TABLE table=default.Table_35eb658172474617ac4f5ea71f19747d [id=55e92546fe1e41ef898509985d26154c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.058275 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36499416277548098a7acbbabb2d300a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.049012 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 377847d06b534883ba2b870ca3317fe0 with delete_type TABLET_DATA_DELETED (replaced by tablet bcbaed2bd9224a0c867cb8804ce8478e) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.049525 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet f585bcdadbcc4032aa484481cdf94b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.050084 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 45b610025b1a4b68bdc34f870654f9d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 96ac92258c6044a891b3325b7aaf3b8f) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.050256 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet ba14b7531bb647248572be10d2b43cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.050875 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 05d525c1128e4042aa97ff786ffa7ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.067131 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f585bcdadbcc4032aa484481cdf94b72" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:08.067348 1438 raft_consensus.cc:3037] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:08.068199 2006 leader_election.cc:288] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:08.075268 1438 raft_consensus.cc:2454] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:08.075788 1099 leader_election.cc:302] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:08.076193 2006 raft_consensus.cc:2781] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:08.076509 2006 raft_consensus.cc:686] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:08.076819 2006 consensus_queue.cc:237] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.077659 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3fff31ceb379400bbfa4586c749e6d6e
I20260927 15:06:08.078294 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a9a58b4d602b4f879fc56f5f1648f19c
I20260927 15:06:08.079559 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet a9a58b4d602b4f879fc56f5f1648f19c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.081269 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fff31ceb379400bbfa4586c749e6d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.082485 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fff31ceb379400bbfa4586c749e6d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.083241 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet a9a58b4d602b4f879fc56f5f1648f19c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.097000 2215 tablet.cc:1722] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:08.097582 2198 tablet.cc:1722] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:08.097944 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet edc07b00db3c42eeb7543fecaf515eab
I20260927 15:06:08.098717 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet edc07b00db3c42eeb7543fecaf515eab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:08.100883 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0ac2df48cabc467195f4986238519fb2 consensus state has no leader
I20260927 15:06:08.103895 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet edc07b00db3c42eeb7543fecaf515eab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.113869 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 05d525c1128e4042aa97ff786ffa7ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.120996 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f585bcdadbcc4032aa484481cdf94b72" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:08.122054 1102 leader_election.cc:341] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.125675 1562 ts_tablet_manager.cc:1918] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:08.125931 1562 log.cc:1196] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/a46e15ea145b4eae8f94b664067b4f92
W20260927 15:06:08.127604 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ef93a120f00423d91664ce4eaf03803 consensus state has no leader
W20260927 15:06:08.128360 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9c032a06c0b497fa21a3553375978ca consensus state has no leader
I20260927 15:06:08.128665 908 master_service.cc:946] ReplaceTablet: received request to replace tablet a9a58b4d602b4f879fc56f5f1648f19c from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:08.125262 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42baac8b7d47433e826eb3bc1980acaa" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:08.131166 1562 ts_tablet_manager.cc:1939] T a46e15ea145b4eae8f94b664067b4f92 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:08.131855 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 4714d536373a4bf2a4be9ebeaebe77c1 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:08.132628 2221 raft_consensus.cc:482] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.132830 2221 raft_consensus.cc:504] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.133320 1561 tablet_bootstrap.cc:492] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:08.133483 1561 ts_tablet_manager.cc:1397] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.337s user 0.010s sys 0.026s
I20260927 15:06:08.133627 2221 leader_election.cc:288] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:08.134102 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd901034653b47dbba7912d5338bc3bb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:08.134308 1561 raft_consensus.cc:348] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.134560 1561 raft_consensus.cc:374] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.134636 1561 raft_consensus.cc:729] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:06:08.134681 1374 leader_election.cc:341] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.134894 1561 consensus_queue.cc:260] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.135413 1561 ts_tablet_manager.cc:1428] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:08.135700 1561 tablet_bootstrap.cc:492] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:08.136205 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_8a6f153903cc41eeae108d5aeca2aa61 [id=c4ddc66927a94fd2abc8e44012cf69f7] alter complete (version 2)
I20260927 15:06:08.140232 1561 tablet_bootstrap.cc:654] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.141010 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_30959463ca2946d29587919310f2556e" } modify_external_catalogs: true
I20260927 15:06:08.141256 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_30959463ca2946d29587919310f2556e" } modify_external_catalogs: true
I20260927 15:06:08.141462 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5c0d2507a5ac46f1874f45430d2693cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.142122 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c0d2507a5ac46f1874f45430d2693cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.143797 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4a1df0232ef7431f9f29870cfd637429"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.144335 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a1df0232ef7431f9f29870cfd637429 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.145521 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ad68a0adad407a92b2335f43e67227 with delete_type TABLET_DATA_DELETED (replaced by tablet 20278f979638419db92105e55310f605) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.145601 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_10c51390989a4f3a829a9e22bcfc0ccf" } new_table_name: "default.Table_828cbafda2b74f2f8efdcf10df5e23c5" modify_external_catalogs: true
I20260927 15:06:08.147838 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_72e3aea6fa834175b98e58759d6d28cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.148505 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72e3aea6fa834175b98e58759d6d28cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.149745 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_430e7778dcb44f198d75c01d39fba60b" } new_table_name: "default.Table_9776e17214ae47b3a9c9721ad570dc28" modify_external_catalogs: true
I20260927 15:06:08.156914 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 423) took 3636 ms. Trace:
I20260927 15:06:08.157125 1562 rpcz_store.cc:276] 0927 15:06:04.520442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.520487 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:07.936272 (+3415785us) ts_tablet_manager.cc:1145] Deleting tablet a46e15ea145b4eae8f94b664067b4f92
0927 15:06:07.936282 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.120119 (+183837us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.125550 (+ 5431us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.156412 (+ 30862us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3415579}
I20260927 15:06:08.157800 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet a46e15ea145b4eae8f94b664067b4f92 (table default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20 [id=3fea2c5530204bb9ada53551032065b7]) successfully deleted
I20260927 15:06:08.158320 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 422) took 3638 ms. Trace:
I20260927 15:06:08.158496 1562 rpcz_store.cc:276] 0927 15:06:04.520290 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.520528 (+ 238us) service_pool.cc:227] Handling call
0927 15:06:08.158149 (+3637621us) ts_tablet_manager.cc:1145] Deleting tablet 2268d824f5324cd1b81879e2fe4fd027
0927 15:06:08.158162 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.158266 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3637388}
W20260927 15:06:08.159019 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 2268d824f5324cd1b81879e2fe4fd027 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2268d824f5324cd1b81879e2fe4fd027 already in progress: creating tablet
I20260927 15:06:08.159510 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 424) took 3634 ms. Trace:
I20260927 15:06:08.159674 1562 rpcz_store.cc:276] 0927 15:06:04.524656 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.526954 (+ 2298us) service_pool.cc:227] Handling call
0927 15:06:08.159349 (+3632395us) ts_tablet_manager.cc:1145] Deleting tablet 9ae003f1ca76472cbaa8b577b66fe84c
0927 15:06:08.159359 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.159448 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3632204}
W20260927 15:06:08.160108 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9ae003f1ca76472cbaa8b577b66fe84c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ae003f1ca76472cbaa8b577b66fe84c already in progress: creating tablet
I20260927 15:06:08.162489 1552 tablet_bootstrap.cc:492] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:08.163399 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fff31ceb379400bbfa4586c749e6d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:08.165503 1102 leader_election.cc:341] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.165673 1102 leader_election.cc:302] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:08.166183 2006 raft_consensus.cc:2726] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:08.168089 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 180c347e066f4d9a897825bad8a32d69 consensus state has no leader
W20260927 15:06:08.168867 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50d786631fc849789164e83efaca333d consensus state has no leader
I20260927 15:06:08.174127 1552 ts_tablet_manager.cc:1397] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.305s user 0.005s sys 0.000s
I20260927 15:06:08.175087 1552 raft_consensus.cc:348] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.176424 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 727652500d9a47b68b7a0d0dcf583822 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:08.177493 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet a9a58b4d602b4f879fc56f5f1648f19c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.181560 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet edc07b00db3c42eeb7543fecaf515eab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.186805 1552 raft_consensus.cc:374] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.191953 1552 raft_consensus.cc:729] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.193372 1561 tablet_bootstrap.cc:492] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:08.192500 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd901034653b47dbba7912d5338bc3bb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:08.193692 1561 ts_tablet_manager.cc:1397] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.058s user 0.007s sys 0.002s
W20260927 15:06:08.194018 1376 leader_election.cc:341] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.194211 1376 leader_election.cc:302] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:08.194623 2221 raft_consensus.cc:2726] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:08.194546 1552 consensus_queue.cc:260] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.195461 1552 ts_tablet_manager.cc:1428] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260927 15:06:08.196201 1552 tablet_bootstrap.cc:492] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:08.198093 1561 raft_consensus.cc:348] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.198355 1561 raft_consensus.cc:374] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.198405 1552 tablet_bootstrap.cc:654] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.198447 1561 raft_consensus.cc:729] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.198701 1561 consensus_queue.cc:260] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.199309 1561 ts_tablet_manager.cc:1428] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:08.199604 1561 tablet_bootstrap.cc:492] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:08.201400 1562 tablet_replica.cc:330] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:08.201680 1562 raft_consensus.cc:2229] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:08.201915 1562 raft_consensus.cc:2258] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.202646 1562 ts_tablet_manager.cc:1905] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.205715 2233 tablet_replica.cc:330] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:08.205668 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 377847d06b534883ba2b870ca3317fe0 because the tablet was not found. No further retry: Not found: Tablet not found: 377847d06b534883ba2b870ca3317fe0
I20260927 15:06:08.205978 2233 raft_consensus.cc:2229] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:08.206180 2233 raft_consensus.cc:2258] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.206789 2233 ts_tablet_manager.cc:1905] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.210000 2119 ts_tablet_manager.cc:1918] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:08.210999 2119 log.cc:1196] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/89bd5b459caa42e7a9153d9273ad52c4
I20260927 15:06:08.211704 2119 ts_tablet_manager.cc:1939] T 89bd5b459caa42e7a9153d9273ad52c4 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:08.212517 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 469) took 2138 ms. Trace:
I20260927 15:06:08.212651 2119 rpcz_store.cc:276] 0927 15:06:06.073337 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.210640 (+137303us) service_pool.cc:227] Handling call
0927 15:06:07.879153 (+1668513us) ts_tablet_manager.cc:1145] Deleting tablet 89bd5b459caa42e7a9153d9273ad52c4
0927 15:06:07.879174 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.178545 (+299371us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.208088 (+ 29543us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.212090 (+ 4002us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1668316}
I20260927 15:06:08.213442 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_28678b473eb34fc98fdfa5b51c8f9ecc [id=4686792aaf36414380f3f894a5635874]) successfully deleted
I20260927 15:06:08.213831 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 470) took 2127 ms. Trace:
I20260927 15:06:08.213979 2119 rpcz_store.cc:276] 0927 15:06:06.085227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.210875 (+125648us) service_pool.cc:227] Handling call
0927 15:06:08.212981 (+2002106us) ts_tablet_manager.cc:1145] Deleting tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85
0927 15:06:08.212994 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.213105 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2001867}
I20260927 15:06:08.214397 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 466) took 2149 ms. Trace:
I20260927 15:06:08.214488 2119 rpcz_store.cc:276] 0927 15:06:06.064682 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.156001 (+ 91319us) service_pool.cc:227] Handling call
0927 15:06:08.214238 (+2058237us) ts_tablet_manager.cc:1145] Deleting tablet 0f4cff4a06db44269defca578af289d8
0927 15:06:08.214246 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.214339 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2001469}
I20260927 15:06:08.214807 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 472) took 1933 ms. Trace:
I20260927 15:06:08.214944 2119 rpcz_store.cc:276] 0927 15:06:06.281111 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.281176 (+ 65us) service_pool.cc:227] Handling call
0927 15:06:08.214674 (+1933498us) ts_tablet_manager.cc:1145] Deleting tablet 434e9390f1fd4a3ebb65924c37b85bd4
0927 15:06:08.214683 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.214760 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1925993}
I20260927 15:06:08.215289 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 474) took 1712 ms. Trace:
I20260927 15:06:08.215380 2119 rpcz_store.cc:276] 0927 15:06:06.503264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.503405 (+ 141us) service_pool.cc:227] Handling call
0927 15:06:08.215155 (+1711750us) ts_tablet_manager.cc:1145] Deleting tablet 1c018f11de9842bc883409f8af35fb5f
0927 15:06:08.215164 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.215243 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1684136}
I20260927 15:06:08.216109 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 479) took 1402 ms. Trace:
I20260927 15:06:08.216187 2119 rpcz_store.cc:276] 0927 15:06:06.813209 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.813299 (+ 90us) service_pool.cc:227] Handling call
0927 15:06:08.215983 (+1402684us) ts_tablet_manager.cc:1145] Deleting tablet ba14b7531bb647248572be10d2b43cf2
0927 15:06:08.215991 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.216059 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1386402}
I20260927 15:06:08.216581 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 480) took 1402 ms. Trace:
W20260927 15:06:08.217594 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 already in progress: creating tablet
W20260927 15:06:08.217895 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0f4cff4a06db44269defca578af289d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f4cff4a06db44269defca578af289d8 already in progress: creating tablet
W20260927 15:06:08.218181 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 434e9390f1fd4a3ebb65924c37b85bd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 434e9390f1fd4a3ebb65924c37b85bd4 already in progress: creating tablet
W20260927 15:06:08.218449 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1c018f11de9842bc883409f8af35fb5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c018f11de9842bc883409f8af35fb5f already in progress: creating tablet
W20260927 15:06:08.218683 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ba14b7531bb647248572be10d2b43cf2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba14b7531bb647248572be10d2b43cf2 already in progress: creating tablet
I20260927 15:06:08.216682 2119 rpcz_store.cc:276] 0927 15:06:06.813645 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.813694 (+ 49us) service_pool.cc:227] Handling call
0927 15:06:08.216431 (+1402737us) ts_tablet_manager.cc:1145] Deleting tablet 6cba64a85ff14281a662bb41189a2c5e
0927 15:06:08.216443 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.216519 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1386742}
W20260927 15:06:08.220466 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6cba64a85ff14281a662bb41189a2c5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cba64a85ff14281a662bb41189a2c5e already in progress: creating tablet
I20260927 15:06:08.224571 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 482) took 1406 ms. Trace:
I20260927 15:06:08.224699 2119 rpcz_store.cc:276] 0927 15:06:06.814482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.814530 (+ 48us) service_pool.cc:227] Handling call
0927 15:06:08.219846 (+1405316us) ts_tablet_manager.cc:1145] Deleting tablet 5aa58fa9a1384013ac1674bc7d53c3b1
0927 15:06:08.219859 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.220775 (+ 916us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1389864}
W20260927 15:06:08.225270 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aa58fa9a1384013ac1674bc7d53c3b1 already in progress: creating tablet
I20260927 15:06:08.225975 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9a00bed1fa194766ad89ee518de9875c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:08.227527 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9184c4ea97b249cba034421e1d7945c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:08.228262 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ed2c95d0f8d841ec973b4eb82dc4555d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:08.229638 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b5af446327ee4e9e8a927bd0ac84a8ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:08.231056 1556 tablet_bootstrap.cc:492] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.231220 1556 ts_tablet_manager.cc:1397] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.214s user 0.009s sys 0.008s
I20260927 15:06:08.233361 1556 raft_consensus.cc:348] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.235215 1556 raft_consensus.cc:374] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.235288 1556 raft_consensus.cc:729] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.235528 1556 consensus_queue.cc:260] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.238116 1556 ts_tablet_manager.cc:1428] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
W20260927 15:06:08.240289 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5af446327ee4e9e8a927bd0ac84a8ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.240646 1556 tablet_bootstrap.cc:492] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:08.246943 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed2c95d0f8d841ec973b4eb82dc4555d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:08.248642 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9184c4ea97b249cba034421e1d7945c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.243526 1556 tablet_bootstrap.cc:654] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:08.254963 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a00bed1fa194766ad89ee518de9875c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.262219 1561 tablet_bootstrap.cc:654] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.270285 2242 tablet.cc:1722] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:08.274232 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 483) took 1412 ms. Trace:
I20260927 15:06:08.280311 2119 rpcz_store.cc:276] 0927 15:06:06.814770 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.814816 (+ 46us) service_pool.cc:227] Handling call
0927 15:06:08.224934 (+1410118us) ts_tablet_manager.cc:1145] Deleting tablet 04007cd4bd214b88a4664e23daf4b790
0927 15:06:08.224944 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.226792 (+ 1848us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1394882}
I20260927 15:06:08.282075 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 485) took 1466 ms. Trace:
I20260927 15:06:08.282222 2119 rpcz_store.cc:276] 0927 15:06:06.815590 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.815635 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:08.281243 (+1465608us) ts_tablet_manager.cc:1145] Deleting tablet 8d533883e3344eca939cd67644895148
0927 15:06:08.281260 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.282011 (+ 751us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1450898}
I20260927 15:06:08.282665 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 487) took 1466 ms. Trace:
I20260927 15:06:08.282784 2119 rpcz_store.cc:276] 0927 15:06:06.816438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.816483 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:08.282501 (+1466018us) ts_tablet_manager.cc:1145] Deleting tablet 1ba163e0f6164d65b09da684ee4872e0
0927 15:06:08.282515 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.282609 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1451880}
I20260927 15:06:08.283221 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 478) took 1470 ms. Trace:
I20260927 15:06:08.283316 2119 rpcz_store.cc:276] 0927 15:06:06.813089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.820047 (+ 6958us) service_pool.cc:227] Handling call
0927 15:06:08.283073 (+1463026us) ts_tablet_manager.cc:1145] Deleting tablet d4f05da432f041378c5ab808536e6b6f
0927 15:06:08.283085 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.283170 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1451088}
I20260927 15:06:08.283705 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 493) took 1368 ms. Trace:
I20260927 15:06:08.283799 2119 rpcz_store.cc:276] 0927 15:06:06.914997 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.926878 (+ 11881us) service_pool.cc:227] Handling call
0927 15:06:08.283553 (+1356675us) ts_tablet_manager.cc:1145] Deleting tablet f1ad3b9d5f8244c99a01f5951007e1fd
0927 15:06:08.283563 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.283654 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1356408}
I20260927 15:06:08.284215 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 494) took 1369 ms. Trace:
I20260927 15:06:08.284322 2119 rpcz_store.cc:276] 0927 15:06:06.915098 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.943913 (+ 28815us) service_pool.cc:227] Handling call
0927 15:06:08.284054 (+1340141us) ts_tablet_manager.cc:1145] Deleting tablet f0a71cf0ee554b3eafca3f054cc16b28
0927 15:06:08.284065 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.284162 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1339924}
I20260927 15:06:08.301242 1562 ts_tablet_manager.cc:1918] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:08.305446 1562 log.cc:1196] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/e066308fcdfc49ed926cd81963c5f1a7
I20260927 15:06:08.284715 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 495) took 1340 ms. Trace:
I20260927 15:06:08.308511 1562 ts_tablet_manager.cc:1939] T e066308fcdfc49ed926cd81963c5f1a7 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:08.306517 1561 tablet_bootstrap.cc:492] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:08.308838 1561 ts_tablet_manager.cc:1397] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.109s user 0.004s sys 0.000s
I20260927 15:06:08.309712 1561 raft_consensus.cc:348] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.311774 1561 raft_consensus.cc:374] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.312352 1561 raft_consensus.cc:729] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.312711 1561 consensus_queue.cc:260] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.310663 909 catalog_manager.cc:5495] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:08.312960 2247 tablet.cc:1722] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:08.313236 909 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:08.319658 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec (DEFAULT_TABLE table=default.Table_7b4d8af41aa04ef3bf742ff0312c3ba6 [id=e500425c1ba34f03a503890ca79efc5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.320283 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.321740 1561 ts_tablet_manager.cc:1428] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260927 15:06:08.323249 1142 tablet_service.cc:1467] Processing CreateTablet for tablet ca9bb98aab8c4ec087412248cd28a86f (DEFAULT_TABLE table=default.Table_dbed284830c64bdcb8e42eaa73a92b47 [id=0583a53ab1de432b962b68f26217d574]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.323746 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca9bb98aab8c4ec087412248cd28a86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.325366 1561 tablet_bootstrap.cc:492] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:08.327286 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 514ce66d5afd46a7b9cc460776973b06 (DEFAULT_TABLE table=default.Table_1584e270ee294e3f9079b464b830f50a [id=d8f467e2348a4b518222e0394beaff2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.327826 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514ce66d5afd46a7b9cc460776973b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.329871 2233 ts_tablet_manager.cc:1918] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:08.330080 2233 log.cc:1196] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/f585bcdadbcc4032aa484481cdf94b72
I20260927 15:06:08.330613 2233 ts_tablet_manager.cc:1939] T f585bcdadbcc4032aa484481cdf94b72 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:08.332492 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec (DEFAULT_TABLE table=default.Table_7b4d8af41aa04ef3bf742ff0312c3ba6 [id=e500425c1ba34f03a503890ca79efc5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.332763 1401 tablet_service.cc:1467] Processing CreateTablet for tablet ca9bb98aab8c4ec087412248cd28a86f (DEFAULT_TABLE table=default.Table_dbed284830c64bdcb8e42eaa73a92b47 [id=0583a53ab1de432b962b68f26217d574]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.332955 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.333228 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca9bb98aab8c4ec087412248cd28a86f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:08.333428 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 04007cd4bd214b88a4664e23daf4b790 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04007cd4bd214b88a4664e23daf4b790 already in progress: creating tablet
I20260927 15:06:08.333637 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 514ce66d5afd46a7b9cc460776973b06 (DEFAULT_TABLE table=default.Table_1584e270ee294e3f9079b464b830f50a [id=d8f467e2348a4b518222e0394beaff2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.334444 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514ce66d5afd46a7b9cc460776973b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.334806 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 5ff1948ac4f6465f8fd806c8c401ac77 (DEFAULT_TABLE table=default.Table_19d971ae53cd42748c5f56cd7451bfc6 [id=73d714308c89481facd0973712cc7c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.335196 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ff1948ac4f6465f8fd806c8c401ac77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.342437 1129 tablet_service.cc:1467] Processing CreateTablet for tablet d25d98b148a94de4bba78a6969e81430 (DEFAULT_TABLE table=default.Table_8133a6b1d48149a9a063310debe2bddd [id=c89da8013ecf48438d9186818a3d2b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.342932 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d25d98b148a94de4bba78a6969e81430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.347638 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 434) took 3634 ms. Trace:
I20260927 15:06:08.347856 1562 rpcz_store.cc:276] 0927 15:06:04.713222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.714594 (+ 1372us) service_pool.cc:227] Handling call
0927 15:06:08.201294 (+3486700us) ts_tablet_manager.cc:1145] Deleting tablet e066308fcdfc49ed926cd81963c5f1a7
0927 15:06:08.201309 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.274680 (+ 73371us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.301094 (+ 26414us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.347601 (+ 46507us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3484476}
I20260927 15:06:08.348122 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_fc15353bc7ae407b85aece886ce4db99 [id=19258732f721448fadcdb38690160dd4] alter complete (version 2)
I20260927 15:06:08.348474 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 440) took 3600 ms. Trace:
I20260927 15:06:08.348604 1562 rpcz_store.cc:276] 0927 15:06:04.748454 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.748575 (+ 121us) service_pool.cc:227] Handling call
0927 15:06:08.348308 (+3599733us) ts_tablet_manager.cc:1145] Deleting tablet 8fc1fc04814147d8843aa734fd1794da
0927 15:06:08.348328 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.348441 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3574131}
I20260927 15:06:08.348973 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 446) took 3516 ms. Trace:
I20260927 15:06:08.349087 1562 rpcz_store.cc:276] 0927 15:06:04.832440 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.833422 (+ 982us) service_pool.cc:227] Handling call
0927 15:06:08.348834 (+3515412us) ts_tablet_manager.cc:1145] Deleting tablet 66b54ee47e424aacb7f53fd95b0ce889
0927 15:06:08.348843 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.348934 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3515128}
I20260927 15:06:08.349404 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 447) took 3516 ms. Trace:
I20260927 15:06:08.349557 1562 rpcz_store.cc:276] 0927 15:06:04.832591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.833918 (+ 1327us) service_pool.cc:227] Handling call
0927 15:06:08.349292 (+3515374us) ts_tablet_manager.cc:1145] Deleting tablet efa42545da374ca989199433ce1284c3
0927 15:06:08.349301 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.349375 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3515078}
I20260927 15:06:08.350055 1562 tablet_replica.cc:330] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:08.350543 1562 raft_consensus.cc:2229] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:08.351189 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet f585bcdadbcc4032aa484481cdf94b72 (table default.Table_9e37ca2b041a439aa503560c17e5b391 [id=79aefc953f4e419f87376e3ffb2e7a1e]) successfully deleted
I20260927 15:06:08.351989 1561 tablet_bootstrap.cc:654] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.352447 1405 tablet_service.cc:1467] Processing CreateTablet for tablet d25d98b148a94de4bba78a6969e81430 (DEFAULT_TABLE table=default.Table_8133a6b1d48149a9a063310debe2bddd [id=c89da8013ecf48438d9186818a3d2b5e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:08.352799 901 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 51772.8us
I20260927 15:06:08.352964 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d25d98b148a94de4bba78a6969e81430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.354040 905 master_service.cc:946] ReplaceTablet: received request to replace tablet 568ba79ea795403cba76fb6632efd7e2 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:08.355114 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 5ff1948ac4f6465f8fd806c8c401ac77 (DEFAULT_TABLE table=default.Table_19d971ae53cd42748c5f56cd7451bfc6 [id=73d714308c89481facd0973712cc7c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.355551 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ff1948ac4f6465f8fd806c8c401ac77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.359719 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 8472966402af4053b8c883d0c4a7c2a3 (DEFAULT_TABLE table=default.Table_3cc6cd481b6a4ca798cf1c63e940902d [id=471cdcbca51d482c94f354f83446d0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.366532 2223 raft_consensus.cc:482] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.366762 2223 raft_consensus.cc:504] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.367504 2223 leader_election.cc:288] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:08.368598 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54a07831078b48a59807f7da4a42bcec" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:08.369195 1374 leader_election.cc:341] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:08.369647 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8d533883e3344eca939cd67644895148 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d533883e3344eca939cd67644895148 already in progress: creating tablet
I20260927 15:06:08.370504 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8472d420763f4fd59e6814326d75b8d7" } modify_external_catalogs: true
I20260927 15:06:08.370800 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8472d420763f4fd59e6814326d75b8d7" } modify_external_catalogs: true
W20260927 15:06:08.373934 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1ba163e0f6164d65b09da684ee4872e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ba163e0f6164d65b09da684ee4872e0 already in progress: creating tablet
W20260927 15:06:08.374269 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet d4f05da432f041378c5ab808536e6b6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4f05da432f041378c5ab808536e6b6f already in progress: creating tablet
I20260927 15:06:08.375396 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 8472966402af4053b8c883d0c4a7c2a3 (DEFAULT_TABLE table=default.Table_3cc6cd481b6a4ca798cf1c63e940902d [id=471cdcbca51d482c94f354f83446d0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.375872 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8472966402af4053b8c883d0c4a7c2a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:08.382968 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f1ad3b9d5f8244c99a01f5951007e1fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1ad3b9d5f8244c99a01f5951007e1fd already in progress: creating tablet
W20260927 15:06:08.383427 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f0a71cf0ee554b3eafca3f054cc16b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0a71cf0ee554b3eafca3f054cc16b28 already in progress: creating tablet
I20260927 15:06:08.384814 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8472966402af4053b8c883d0c4a7c2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.384702 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_49ac42f044d84fd5ad0acbf7fa401b33" } modify_external_catalogs: true
I20260927 15:06:08.384976 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_49ac42f044d84fd5ad0acbf7fa401b33" } modify_external_catalogs: true
I20260927 15:06:08.387346 2233 tablet_replica.cc:330] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:08.387632 2233 raft_consensus.cc:2229] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:08.387835 2233 raft_consensus.cc:2258] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.388293 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet e066308fcdfc49ed926cd81963c5f1a7 (table default.Table_7258841dfdbd45b0a5745d0a4cbd5551 [id=6ed04e9f13a242f581a5c92cca97a25d]) successfully deleted
W20260927 15:06:08.388641 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8fc1fc04814147d8843aa734fd1794da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fc1fc04814147d8843aa734fd1794da already in progress: creating tablet
W20260927 15:06:08.389178 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 66b54ee47e424aacb7f53fd95b0ce889 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66b54ee47e424aacb7f53fd95b0ce889 already in progress: creating tablet
W20260927 15:06:08.389601 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet efa42545da374ca989199433ce1284c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efa42545da374ca989199433ce1284c3 already in progress: creating tablet
I20260927 15:06:08.390232 2233 ts_tablet_manager.cc:1905] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.390362 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b3d8c342ab564cf8a14311ab99ac9615" } modify_external_catalogs: true
I20260927 15:06:08.396870 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 0679cdd90b974c8c82cdb0eced264bbd (DEFAULT_TABLE table=default.Table_ace1274fa2e14536abd51af7dfe6f85f [id=ae22dd6e49a2487d89194ce2397f6e00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.397359 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0679cdd90b974c8c82cdb0eced264bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.403483 1562 raft_consensus.cc:2258] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.403293 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b3d8c342ab564cf8a14311ab99ac9615" } modify_external_catalogs: true
I20260927 15:06:08.404194 1562 ts_tablet_manager.cc:1905] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.418612 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1c5c0d205937415ab0214a5bdbd939c1
I20260927 15:06:08.423175 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2c48b816d5304111b8219dab75d9045e" } modify_external_catalogs: true
I20260927 15:06:08.423488 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2c48b816d5304111b8219dab75d9045e" } modify_external_catalogs: true
I20260927 15:06:08.425063 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 08f28c023473434ba73b1142a041be97 (table default.Table_826c1efeddc74a17ad2db271286974ac [id=67762455acad44448ba24d18c2863816]). Expected version 3 got 0
I20260927 15:06:08.425415 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]). Expected version 4 got 0
I20260927 15:06:08.426251 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 0679cdd90b974c8c82cdb0eced264bbd (DEFAULT_TABLE table=default.Table_ace1274fa2e14536abd51af7dfe6f85f [id=ae22dd6e49a2487d89194ce2397f6e00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.427444 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0679cdd90b974c8c82cdb0eced264bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.427690 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 5e32b9870eea4319b84145b46333ec98 (DEFAULT_TABLE table=default.Table_6041922ddbbd40f1a099875f5071c91d [id=0dd3ca350cf448899cce6dd1971fac6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.435006 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 727652500d9a47b68b7a0d0dcf583822
I20260927 15:06:08.435494 912 catalog_manager.cc:6565] ReplaceTablet: tablet 727652500d9a47b68b7a0d0dcf583822 deleted and replaced by tablet decee14b5d7a4aef9989051dcaeb5a7b
I20260927 15:06:08.436013 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 4714d536373a4bf2a4be9ebeaebe77c1
I20260927 15:06:08.435890 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f684293c235f49e08bb4eaae59e2fe77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:08.436249 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5] alter complete (version 4)
I20260927 15:06:08.436360 914 catalog_manager.cc:6565] ReplaceTablet: tablet 4714d536373a4bf2a4be9ebeaebe77c1 deleted and replaced by tablet f0e0d5f68e5b4bccb59ca2c31efdc60f
W20260927 15:06:08.436501 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f684293c235f49e08bb4eaae59e2fe77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.436662 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3cdaadf2a6d64643a97238fcba5134a3" } new_table_name: "default.Table_4637b56a65aa49339cb6d9e0785b7583" modify_external_catalogs: true
I20260927 15:06:08.437585 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e32b9870eea4319b84145b46333ec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.437883 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 75537edf83a040cba4da502c726bf456
I20260927 15:06:08.438495 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_519a5f172cb0461ebf48deafd431751a" } new_table_name: "default.Table_34e69f03f4ae4aa58a9bffd06b168d85" modify_external_catalogs: true
I20260927 15:06:08.439777 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e33a8d5908004ab88d4c53b21be4fb42
I20260927 15:06:08.440428 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3e14460ebed347b7be671cd31ed5951a" } new_table_name: "default.Table_621c68a85e5943a8907d419f99272e72" modify_external_catalogs: true
I20260927 15:06:08.442180 1418 tablet_service.cc:1467] Processing CreateTablet for tablet d2856a29a2594e279b399c7da1921236 (DEFAULT_TABLE table=default.Table_519a5f172cb0461ebf48deafd431751a [id=ab18b7b258ce4be686fac858f450cbcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.442624 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2856a29a2594e279b399c7da1921236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.443115 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 568ba79ea795403cba76fb6632efd7e2
I20260927 15:06:08.443532 905 catalog_manager.cc:6565] ReplaceTablet: tablet 568ba79ea795403cba76fb6632efd7e2 deleted and replaced by tablet 925d256cb28f496889ad7b3c6b1f6f10
I20260927 15:06:08.443827 1407 tablet_service.cc:1467] Processing CreateTablet for tablet a4a48e08f69a4727924d006dc19b6ed1 (DEFAULT_TABLE table=default.Table_09d8cf7dce6a4b2f80ff871b85bfff29 [id=0ee607f872604f4db1f1841a10228300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.444294 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c5c0d205937415ab0214a5bdbd939c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.444519 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 95c8178680ea4b6b8794150188320ea9 (DEFAULT_TABLE table=default.Table_c6a9f9c3ec2149f4a29f0ff6ed71e1b6 [id=f4d5c8e51e544a12b3c1e0d8ebb41254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.444572 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c82ee61d4bf4403eb10b6ec67e0a455e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.445259 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c82ee61d4bf4403eb10b6ec67e0a455e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.447523 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c8178680ea4b6b8794150188320ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.448654 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a48e08f69a4727924d006dc19b6ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.455919 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54a07831078b48a59807f7da4a42bcec" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:08.456694 1376 leader_election.cc:341] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.456843 1376 leader_election.cc:302] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:08.457536 1266 tablet_service.cc:1467] Processing CreateTablet for tablet ca9bb98aab8c4ec087412248cd28a86f (DEFAULT_TABLE table=default.Table_dbed284830c64bdcb8e42eaa73a92b47 [id=0583a53ab1de432b962b68f26217d574]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.458022 2223 raft_consensus.cc:2726] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:08.458499 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec (DEFAULT_TABLE table=default.Table_7b4d8af41aa04ef3bf742ff0312c3ba6 [id=e500425c1ba34f03a503890ca79efc5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.459494 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 514ce66d5afd46a7b9cc460776973b06 (DEFAULT_TABLE table=default.Table_1584e270ee294e3f9079b464b830f50a [id=d8f467e2348a4b518222e0394beaff2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.460654 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca9bb98aab8c4ec087412248cd28a86f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.461454 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 5ff1948ac4f6465f8fd806c8c401ac77 (DEFAULT_TABLE table=default.Table_19d971ae53cd42748c5f56cd7451bfc6 [id=73d714308c89481facd0973712cc7c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.462612 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 8472966402af4053b8c883d0c4a7c2a3 (DEFAULT_TABLE table=default.Table_3cc6cd481b6a4ca798cf1c63e940902d [id=471cdcbca51d482c94f354f83446d0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.463162 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 0679cdd90b974c8c82cdb0eced264bbd (DEFAULT_TABLE table=default.Table_ace1274fa2e14536abd51af7dfe6f85f [id=ae22dd6e49a2487d89194ce2397f6e00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.463788 1282 tablet_service.cc:1467] Processing CreateTablet for tablet d25d98b148a94de4bba78a6969e81430 (DEFAULT_TABLE table=default.Table_8133a6b1d48149a9a063310debe2bddd [id=c89da8013ecf48438d9186818a3d2b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.464200 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.463182 2119 rpcz_store.cc:276] 0927 15:06:06.944315 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.944373 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:08.284558 (+1340185us) ts_tablet_manager.cc:1145] Deleting tablet e19cd7febe054432899739e21605406d
0927 15:06:08.284570 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.284654 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1339995}
I20260927 15:06:08.467424 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 496) took 1521 ms. Trace:
I20260927 15:06:08.467549 2119 rpcz_store.cc:276] 0927 15:06:06.944755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.944799 (+ 44us) service_pool.cc:227] Handling call
0927 15:06:08.465924 (+1521125us) ts_tablet_manager.cc:1145] Deleting tablet c5cd55de34d249bc8d3adcf4690f0414
0927 15:06:08.465939 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.466030 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1520952}
I20260927 15:06:08.468010 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 5e32b9870eea4319b84145b46333ec98 (DEFAULT_TABLE table=default.Table_6041922ddbbd40f1a099875f5071c91d [id=0dd3ca350cf448899cce6dd1971fac6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.468385 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0679cdd90b974c8c82cdb0eced264bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.472009 1284 tablet_service.cc:1467] Processing CreateTablet for tablet bcbaed2bd9224a0c867cb8804ce8478e (DEFAULT_TABLE table=default.Table_0021fd56477c4debbfe492c5673d41c2 [id=56574e770aa74f04a7bf24b7718e4960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.472420 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e32b9870eea4319b84145b46333ec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.472366 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 727652500d9a47b68b7a0d0dcf583822 with delete_type TABLET_DATA_DELETED (replaced by tablet decee14b5d7a4aef9989051dcaeb5a7b) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.473371 1283 tablet_service.cc:1467] Processing CreateTablet for tablet d2856a29a2594e279b399c7da1921236 (DEFAULT_TABLE table=default.Table_519a5f172cb0461ebf48deafd431751a [id=ab18b7b258ce4be686fac858f450cbcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.473493 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d25d98b148a94de4bba78a6969e81430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.473731 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2856a29a2594e279b399c7da1921236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.474647 1272 tablet_service.cc:1467] Processing CreateTablet for tablet a4a48e08f69a4727924d006dc19b6ed1 (DEFAULT_TABLE table=default.Table_09d8cf7dce6a4b2f80ff871b85bfff29 [id=0ee607f872604f4db1f1841a10228300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.475831 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 95c8178680ea4b6b8794150188320ea9 (DEFAULT_TABLE table=default.Table_c6a9f9c3ec2149f4a29f0ff6ed71e1b6 [id=f4d5c8e51e544a12b3c1e0d8ebb41254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.476151 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c5c0d205937415ab0214a5bdbd939c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.475803 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 4714d536373a4bf2a4be9ebeaebe77c1 with delete_type TABLET_DATA_DELETED (replaced by tablet f0e0d5f68e5b4bccb59ca2c31efdc60f) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.476378 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 75537edf83a040cba4da502c726bf456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.478559 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ff1948ac4f6465f8fd806c8c401ac77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:08.480046 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e19cd7febe054432899739e21605406d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e19cd7febe054432899739e21605406d already in progress: creating tablet
I20260927 15:06:08.480507 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 568ba79ea795403cba76fb6632efd7e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 925d256cb28f496889ad7b3c6b1f6f10) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:08.480773 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c5cd55de34d249bc8d3adcf4690f0414 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5cd55de34d249bc8d3adcf4690f0414 already in progress: creating tablet
I20260927 15:06:08.481014 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet e33a8d5908004ab88d4c53b21be4fb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.482591 2233 ts_tablet_manager.cc:1918] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:08.486747 2233 log.cc:1196] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/45b610025b1a4b68bdc34f870654f9d1
I20260927 15:06:08.492223 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c8178680ea4b6b8794150188320ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.492481 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8472966402af4053b8c883d0c4a7c2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.493211 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcbaed2bd9224a0c867cb8804ce8478e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.495211 2233 ts_tablet_manager.cc:1939] T 45b610025b1a4b68bdc34f870654f9d1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:08.496215 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 727652500d9a47b68b7a0d0dcf583822 with delete_type TABLET_DATA_DELETED (replaced by tablet decee14b5d7a4aef9989051dcaeb5a7b) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.496830 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 4714d536373a4bf2a4be9ebeaebe77c1 with delete_type TABLET_DATA_DELETED (replaced by tablet f0e0d5f68e5b4bccb59ca2c31efdc60f) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.414556 1145 tablet_service.cc:1467] Processing CreateTablet for tablet a4a48e08f69a4727924d006dc19b6ed1 (DEFAULT_TABLE table=default.Table_09d8cf7dce6a4b2f80ff871b85bfff29 [id=0ee607f872604f4db1f1841a10228300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.497394 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 75537edf83a040cba4da502c726bf456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.497782 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a48e08f69a4727924d006dc19b6ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.497655 2119 tablet_replica.cc:330] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:08.498901 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet e33a8d5908004ab88d4c53b21be4fb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.414598 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 5e32b9870eea4319b84145b46333ec98 (DEFAULT_TABLE table=default.Table_6041922ddbbd40f1a099875f5071c91d [id=0dd3ca350cf448899cce6dd1971fac6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.502128 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e32b9870eea4319b84145b46333ec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.502159 1556 tablet_bootstrap.cc:492] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.502308 1556 ts_tablet_manager.cc:1397] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.262s user 0.037s sys 0.087s
I20260927 15:06:08.503085 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 568ba79ea795403cba76fb6632efd7e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 925d256cb28f496889ad7b3c6b1f6f10) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.503247 1556 raft_consensus.cc:348] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.503597 1556 raft_consensus.cc:374] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.503749 1556 raft_consensus.cc:729] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.504102 1556 consensus_queue.cc:260] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.504901 1556 ts_tablet_manager.cc:1428] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:08.415432 1127 tablet_service.cc:1467] Processing CreateTablet for tablet d2856a29a2594e279b399c7da1921236 (DEFAULT_TABLE table=default.Table_519a5f172cb0461ebf48deafd431751a [id=ab18b7b258ce4be686fac858f450cbcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.470535 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet e33a8d5908004ab88d4c53b21be4fb42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.466982 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 727652500d9a47b68b7a0d0dcf583822 with delete_type TABLET_DATA_DELETED (replaced by tablet decee14b5d7a4aef9989051dcaeb5a7b) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.506038 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2856a29a2594e279b399c7da1921236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.415006 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 95c8178680ea4b6b8794150188320ea9 (DEFAULT_TABLE table=default.Table_c6a9f9c3ec2149f4a29f0ff6ed71e1b6 [id=f4d5c8e51e544a12b3c1e0d8ebb41254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.506273 1556 tablet_bootstrap.cc:492] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:08.506486 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c8178680ea4b6b8794150188320ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.507874 1556 tablet_bootstrap.cc:654] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.425158 1561 tablet_bootstrap.cc:492] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:08.415681 1143 tablet_service.cc:1467] Processing CreateTablet for tablet bcbaed2bd9224a0c867cb8804ce8478e (DEFAULT_TABLE table=default.Table_0021fd56477c4debbfe492c5673d41c2 [id=56574e770aa74f04a7bf24b7718e4960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.509660 1561 ts_tablet_manager.cc:1397] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.184s user 0.002s sys 0.002s
I20260927 15:06:08.509773 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcbaed2bd9224a0c867cb8804ce8478e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.509760 1405 tablet_service.cc:1467] Processing CreateTablet for tablet bcbaed2bd9224a0c867cb8804ce8478e (DEFAULT_TABLE table=default.Table_0021fd56477c4debbfe492c5673d41c2 [id=56574e770aa74f04a7bf24b7718e4960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.510166 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcbaed2bd9224a0c867cb8804ce8478e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.490236 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c5c0d205937415ab0214a5bdbd939c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.510989 1561 raft_consensus.cc:348] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.511248 1561 raft_consensus.cc:374] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.511489 1561 raft_consensus.cc:729] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.511747 1561 consensus_queue.cc:260] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.410813 1562 ts_tablet_manager.cc:1918] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:08.517122 1556 tablet_bootstrap.cc:492] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.517376 1556 ts_tablet_manager.cc:1397] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260927 15:06:08.502143 2006 raft_consensus.cc:482] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.518404 1562 log.cc:1196] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/3a231aff1a39485db36979208d871ab3
I20260927 15:06:08.519047 2142 raft_consensus.cc:482] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.519368 1556 raft_consensus.cc:348] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.519704 1556 raft_consensus.cc:374] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.519835 1556 raft_consensus.cc:729] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.520191 1556 consensus_queue.cc:260] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.524080 1556 ts_tablet_manager.cc:1428] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 15:06:08.524529 1556 tablet_bootstrap.cc:492] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:08.526479 1556 tablet_bootstrap.cc:654] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.528085 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514ce66d5afd46a7b9cc460776973b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.553301 1556 tablet_bootstrap.cc:492] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.553721 1556 ts_tablet_manager.cc:1397] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.018s
I20260927 15:06:08.555305 1556 raft_consensus.cc:348] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.555799 1556 raft_consensus.cc:374] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.556038 1556 raft_consensus.cc:729] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.556571 1556 consensus_queue.cc:260] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.560055 1556 ts_tablet_manager.cc:1428] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260927 15:06:08.560653 1556 tablet_bootstrap.cc:492] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:08.566630 1556 tablet_bootstrap.cc:654] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.569918 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a48e08f69a4727924d006dc19b6ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.577745 1556 tablet_bootstrap.cc:492] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.578058 1556 ts_tablet_manager.cc:1397] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.004s
I20260927 15:06:08.579025 1556 raft_consensus.cc:348] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.598217 1556 raft_consensus.cc:374] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.598364 1556 raft_consensus.cc:729] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.598598 2119 raft_consensus.cc:2229] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:08.598968 2119 pending_rounds.cc:62] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:08.599042 2119 pending_rounds.cc:68] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976341615575040 op_type: NO_OP noop_request { }
I20260927 15:06:08.599200 2119 raft_consensus.cc:2866] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:08.599299 2119 raft_consensus.cc:2258] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.599155 1556 consensus_queue.cc:260] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.599757 1556 ts_tablet_manager.cc:1428] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260927 15:06:08.600121 1556 tablet_bootstrap.cc:492] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:08.601809 1556 tablet_bootstrap.cc:654] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.614120 2119 ts_tablet_manager.cc:1905] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.620272 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 568ba79ea795403cba76fb6632efd7e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 925d256cb28f496889ad7b3c6b1f6f10) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.626189 2006 raft_consensus.cc:504] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.629043 2223 consensus_queue.cc:1035] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:08.630570 1556 tablet_bootstrap.cc:492] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.630786 1556 ts_tablet_manager.cc:1397] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.007s
I20260927 15:06:08.631680 1556 raft_consensus.cc:348] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.631980 1556 raft_consensus.cc:374] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.632110 1556 raft_consensus.cc:729] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.632411 1556 consensus_queue.cc:260] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.524145 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_21609103889c418684f1607150049aba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:08.636799 1556 ts_tablet_manager.cc:1428] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260927 15:06:08.644243 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21609103889c418684f1607150049aba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.646574 1552 tablet_bootstrap.cc:492] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:08.646857 1552 ts_tablet_manager.cc:1397] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.451s user 0.008s sys 0.000s
I20260927 15:06:08.647747 1552 raft_consensus.cc:348] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.648046 1552 raft_consensus.cc:374] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.648185 1552 raft_consensus.cc:729] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.648458 1552 consensus_queue.cc:260] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.650221 1552 ts_tablet_manager.cc:1428] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:08.650564 1552 tablet_bootstrap.cc:492] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:08.652354 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 21651dc1231c4faf9053a465a1874092 (table default.Table_7bfe6167028e4bde809aa45546ce3826 [id=d1f70a989c3645b29c4da5fad4934a5d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 21651dc1231c4faf9053a465a1874092 consensus state has no leader
I20260927 15:06:08.653259 1552 tablet_bootstrap.cc:654] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.656104 1556 tablet_bootstrap.cc:492] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:08.635811 898 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 108850us
I20260927 15:06:08.658588 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 45b610025b1a4b68bdc34f870654f9d1 (table default.Table_fdbd726355df419fae94cbf8fce53375 [id=f6284e29d38143b38fc421ab5c09538c]) successfully deleted
W20260927 15:06:08.659010 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ba14b7531bb647248572be10d2b43cf2 because the tablet was not found. No further retry: Not found: Tablet not found: ba14b7531bb647248572be10d2b43cf2
W20260927 15:06:08.659299 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 05d525c1128e4042aa97ff786ffa7ba9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05d525c1128e4042aa97ff786ffa7ba9 already in progress: creating tablet
I20260927 15:06:08.659626 1556 tablet_bootstrap.cc:654] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:08.659621 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3fff31ceb379400bbfa4586c749e6d6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fff31ceb379400bbfa4586c749e6d6e already in progress: creating tablet
W20260927 15:06:08.659951 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a9a58b4d602b4f879fc56f5f1648f19c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9a58b4d602b4f879fc56f5f1648f19c already in progress: creating tablet
W20260927 15:06:08.660250 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet edc07b00db3c42eeb7543fecaf515eab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edc07b00db3c42eeb7543fecaf515eab already in progress: creating tablet
W20260927 15:06:08.660524 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1c5c0d205937415ab0214a5bdbd939c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c5c0d205937415ab0214a5bdbd939c1 already in progress: creating tablet
W20260927 15:06:08.660815 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 727652500d9a47b68b7a0d0dcf583822 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 727652500d9a47b68b7a0d0dcf583822 already in progress: creating tablet
W20260927 15:06:08.661098 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 4714d536373a4bf2a4be9ebeaebe77c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4714d536373a4bf2a4be9ebeaebe77c1 already in progress: creating tablet
W20260927 15:06:08.661372 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 75537edf83a040cba4da502c726bf456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75537edf83a040cba4da502c726bf456 already in progress: creating tablet
W20260927 15:06:08.661700 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e33a8d5908004ab88d4c53b21be4fb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e33a8d5908004ab88d4c53b21be4fb42 already in progress: creating tablet
I20260927 15:06:08.661759 1556 tablet_bootstrap.cc:492] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.661926 1556 ts_tablet_manager.cc:1397] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260927 15:06:08.662714 1556 raft_consensus.cc:348] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.663017 1556 raft_consensus.cc:374] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.663106 1556 raft_consensus.cc:729] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.663357 1556 consensus_queue.cc:260] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:08.669188 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 568ba79ea795403cba76fb6632efd7e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 568ba79ea795403cba76fb6632efd7e2 already in progress: creating tablet
I20260927 15:06:08.670403 1556 ts_tablet_manager.cc:1428] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 15:06:08.672119 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_2acab08ececa48aab9e6139d3e031e59 [id=672533238895472b9bfb06706e4b41bb] alter complete (version 1)
I20260927 15:06:08.673213 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 278205071701447e8ee7457b2ee84be4
I20260927 15:06:08.676086 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_88c0cf4bc1f74871ba507e8bd8ca7cbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:08.676381 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 12f6403cde734c1394aabfc92c093290
I20260927 15:06:08.677269 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ed2c95d0f8d841ec973b4eb82dc4555d" } new_table_name: "default.Table_e8c0580cbbae4664910245b65d51b219" modify_external_catalogs: true
W20260927 15:06:08.678177 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88c0cf4bc1f74871ba507e8bd8ca7cbc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.682749 1562 ts_tablet_manager.cc:1939] T 3a231aff1a39485db36979208d871ab3 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:08.683279 1561 ts_tablet_manager.cc:1428] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 15:06:08.683915 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6eed08273244d28fd15785a09059f9 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a07831078b48a59807f7da4a42bcec) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.684196 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 12f6403cde734c1394aabfc92c093290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.690553 2142 raft_consensus.cc:504] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.691784 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45b610025b1a4b68bdc34f870654f9d1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:08.694005 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 12f6403cde734c1394aabfc92c093290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.694334 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 278205071701447e8ee7457b2ee84be4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.695816 2223 raft_consensus.cc:482] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.696089 2223 raft_consensus.cc:504] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.696782 2223 leader_election.cc:288] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:08.697506 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 916663fe0c6c46b1b3415e165d60187f consensus state has no leader
I20260927 15:06:08.697448 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b375902081c54cdb84fdb075eec6baf7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:08.697988 1376 leader_election.cc:341] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.698060 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2d1d3aacd61a41a3a18e1952d14a4314"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.698649 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d1d3aacd61a41a3a18e1952d14a4314 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:08.699141 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2856a29a2594e279b399c7da1921236 consensus state has no leader
I20260927 15:06:08.699520 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ac11c36acdcb479bb7b7430d8bec6a9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.700414 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d15b7dfb83494d329ca75dd96a189c60 consensus state has no leader
W20260927 15:06:08.700574 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac11c36acdcb479bb7b7430d8bec6a9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.700739 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ceb6674fa07f4d06a23e13778cc087d5" } new_table_name: "default.Table_18fc1dad83b24245966b3502992719e8" modify_external_catalogs: true
I20260927 15:06:08.702301 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_17d2558045b04f62a6d6b7952926e8b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.702888 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17d2558045b04f62a6d6b7952926e8b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.703541 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_40807a5ed0df43dd89c4d4a10827bb9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.704010 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40807a5ed0df43dd89c4d4a10827bb9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.706058 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a5001fbf122c4ec18fe48ad0196e5b42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.706684 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5001fbf122c4ec18fe48ad0196e5b42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.709632 1561 tablet_bootstrap.cc:492] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:08.709990 2006 leader_election.cc:288] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:08.710403 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 12f6403cde734c1394aabfc92c093290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12f6403cde734c1394aabfc92c093290 already in progress: creating tablet
W20260927 15:06:08.710665 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 278205071701447e8ee7457b2ee84be4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 278205071701447e8ee7457b2ee84be4 already in progress: creating tablet
W20260927 15:06:08.711167 1102 leader_election.cc:341] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.711843 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afab8bf87bc45c899bcd5dfdad48d26" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:08.712535 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 75537edf83a040cba4da502c726bf456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.714104 2142 leader_election.cc:288] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:08.720762 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet f1d7a98ffc4745ac8eeb93012b55d417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:08.721402 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 728c495d176c4577835a38f8193493eb has no consensus state
I20260927 15:06:08.721741 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_b592f94f43ea4ffe8068db6aed19c5ef [id=61c39607ad5b482c80883c0e60f0da9c] alter complete (version 1)
I20260927 15:06:08.721920 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f0c6627b22b6461fb4eb75c255a8fbac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:08.722330 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 449) took 3752 ms. Trace:
I20260927 15:06:08.722460 1562 rpcz_store.cc:276] 0927 15:06:04.943092 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.944845 (+ 1753us) service_pool.cc:227] Handling call
0927 15:06:08.349991 (+3405146us) ts_tablet_manager.cc:1145] Deleting tablet 3a231aff1a39485db36979208d871ab3
0927 15:06:08.350000 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.407354 (+ 57354us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.410685 (+ 3331us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.694965 (+284280us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3357421}
I20260927 15:06:08.723309 1562 tablet_replica.cc:330] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:08.723470 2006 raft_consensus.cc:482] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.723634 2006 raft_consensus.cc:504] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.724277 2006 leader_election.cc:288] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:08.725090 1102 leader_election.cc:341] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.726078 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c313ab6848428d8237557392669f6f with delete_type TABLET_DATA_DELETED (replaced by tablet 568ba79ea795403cba76fb6632efd7e2) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.728592 2233 tablet_replica.cc:330] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:08.728828 2233 raft_consensus.cc:2229] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:08.729110 2233 pending_rounds.cc:62] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:08.729171 2233 pending_rounds.cc:68] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976342449180672 op_type: NO_OP noop_request { }
I20260927 15:06:08.729343 2233 raft_consensus.cc:2866] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:08.729447 2233 raft_consensus.cc:2258] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.729704 1561 tablet_bootstrap.cc:654] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.729615 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_281eba53292f402cb45d978e48f00c4e" } modify_external_catalogs: true
I20260927 15:06:08.729841 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e54284c6f69f46a58add5dfc7c9bec4a" } modify_external_catalogs: true
I20260927 15:06:08.730166 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet cd901034653b47dbba7912d5338bc3bb with delete_type TABLET_DATA_DELETED (replaced by tablet 0d4ca19b492c4df1b31c78f1629c50b5) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:08.730342 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0c6627b22b6461fb4eb75c255a8fbac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.730808 2233 ts_tablet_manager.cc:1905] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.730923 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 54f5c4b7c7a045bea1a79bc67a913f65 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:08.733265 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec3d823781234015aa8a48421a23bbd2 consensus state has no leader
I20260927 15:06:08.733554 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_281eba53292f402cb45d978e48f00c4e" } modify_external_catalogs: true
I20260927 15:06:08.732842 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e301f5a5aea64583a20cf58c548d0934" } modify_external_catalogs: true
I20260927 15:06:08.734233 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e301f5a5aea64583a20cf58c548d0934" } modify_external_catalogs: true
I20260927 15:06:08.734716 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e54284c6f69f46a58add5dfc7c9bec4a" } modify_external_catalogs: true
I20260927 15:06:08.735584 1556 tablet_bootstrap.cc:492] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:08.736325 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b375902081c54cdb84fdb075eec6baf7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:08.737226 1374 leader_election.cc:341] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.737396 1374 leader_election.cc:302] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:08.737804 2223 raft_consensus.cc:2726] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:08.737928 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebb4e007cefa4f18bdaa461b43c5c810" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:08.738616 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 4714d536373a4bf2a4be9ebeaebe77c1 with delete_type TABLET_DATA_DELETED (replaced by tablet f0e0d5f68e5b4bccb59ca2c31efdc60f) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.738981 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 278205071701447e8ee7457b2ee84be4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:08.739037 1102 leader_election.cc:341] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.739271 2233 ts_tablet_manager.cc:1918] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:08.739476 2233 log.cc:1196] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/65c313ab6848428d8237557392669f6f
I20260927 15:06:08.739926 1556 tablet_bootstrap.cc:654] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.740116 2233 ts_tablet_manager.cc:1939] T 65c313ab6848428d8237557392669f6f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:08.740159 1552 tablet_bootstrap.cc:492] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:08.740793 1552 ts_tablet_manager.cc:1397] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.090s user 0.004s sys 0.000s
I20260927 15:06:08.741777 2233 tablet_replica.cc:330] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:08.741621 1552 raft_consensus.cc:348] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.741966 1552 raft_consensus.cc:374] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.742089 1552 raft_consensus.cc:729] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.742443 1552 consensus_queue.cc:260] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.742645 2233 raft_consensus.cc:2229] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:08.742863 2233 raft_consensus.cc:2258] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.743389 2233 ts_tablet_manager.cc:1905] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.746850 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 3a231aff1a39485db36979208d871ab3 (table default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f [id=403185df10bf4ed980e2a8ce8427a93f]) successfully deleted
I20260927 15:06:08.747509 1562 raft_consensus.cc:2229] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:08.747910 1562 pending_rounds.cc:62] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:08.747987 1562 pending_rounds.cc:68] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976332166844416 op_type: NO_OP noop_request { }
I20260927 15:06:08.748235 1562 raft_consensus.cc:2866] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:08.748353 1562 raft_consensus.cc:2258] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.749056 1562 ts_tablet_manager.cc:1905] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.749595 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 278205071701447e8ee7457b2ee84be4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.749758 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet ab08d04c11dd44299ee5f9a911d581c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.751343 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afab8bf87bc45c899bcd5dfdad48d26" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:08.751708 1438 raft_consensus.cc:2454] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:08.751904 2119 ts_tablet_manager.cc:1918] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:08.752079 2119 log.cc:1196] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/67cf4dae943e4092b2c490ad770e4a94
I20260927 15:06:08.752377 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebb4e007cefa4f18bdaa461b43c5c810" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:08.752538 2119 ts_tablet_manager.cc:1939] T 67cf4dae943e4092b2c490ad770e4a94 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:08.752610 1438 raft_consensus.cc:2454] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:08.756347 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 65c313ab6848428d8237557392669f6f (table default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]) successfully deleted
I20260927 15:06:08.757205 804 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu pid 951
I20260927 15:06:08.759563 1552 ts_tablet_manager.cc:1428] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260927 15:06:08.761462 2233 ts_tablet_manager.cc:1918] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:08.763159 2233 log.cc:1196] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/cd901034653b47dbba7912d5338bc3bb
I20260927 15:06:08.764551 2199 raft_consensus.cc:482] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:08.764777 1099 leader_election.cc:341] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 45b610025b1a4b68bdc34f870654f9d1
I20260927 15:06:08.765542 2233 ts_tablet_manager.cc:1939] T cd901034653b47dbba7912d5338bc3bb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:08.765687 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 12f6403cde734c1394aabfc92c093290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.767501 1552 tablet_bootstrap.cc:492] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:08.774927 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet cd901034653b47dbba7912d5338bc3bb (table default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]) successfully deleted
I20260927 15:06:08.777266 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c313ab6848428d8237557392669f6f with delete_type TABLET_DATA_DELETED (replaced by tablet 568ba79ea795403cba76fb6632efd7e2) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.777621 1099 leader_election.cc:302] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:08.777974 2253 raft_consensus.cc:2726] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:08.778169 1552 tablet_bootstrap.cc:654] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.778446 1099 leader_election.cc:302] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:08.778723 2253 raft_consensus.cc:2781] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:08.778894 2253 raft_consensus.cc:482] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:08.779031 2253 raft_consensus.cc:3037] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:08.780715 906 master_service.cc:946] ReplaceTablet: received request to replace tablet 7a9c96abcfd347a9881b99df093da490 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:08.782488 2253 raft_consensus.cc:504] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.783650 2253 leader_election.cc:288] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:08.783663 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afab8bf87bc45c899bcd5dfdad48d26" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:08.784080 1099 leader_election.cc:302] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:08.784410 1102 leader_election.cc:341] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.784598 2255 raft_consensus.cc:2781] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:08.784694 2255 raft_consensus.cc:482] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:08.784798 2255 raft_consensus.cc:3037] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:08.786304 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afab8bf87bc45c899bcd5dfdad48d26" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:08.786551 1438 raft_consensus.cc:3037] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:08.790205 1438 raft_consensus.cc:2454] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:08.792017 1015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260927 15:06:08.801252 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 501) took 1788 ms. Trace:
I20260927 15:06:08.801437 2119 rpcz_store.cc:276] 0927 15:06:07.012883 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.013906 (+ 1023us) service_pool.cc:227] Handling call
0927 15:06:08.467792 (+1453886us) ts_tablet_manager.cc:1145] Deleting tablet 67cf4dae943e4092b2c490ad770e4a94
0927 15:06:08.467804 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.617526 (+149722us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.751762 (+134236us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.800999 (+ 49237us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1453650}
I20260927 15:06:08.802027 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 67cf4dae943e4092b2c490ad770e4a94 (table default.Table_6f254b1d0eb949238df41c88797697e5 [id=9ac1472258a24d01892257dd9c9874a8]) successfully deleted
I20260927 15:06:08.802659 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 506) took 1789 ms. Trace:
I20260927 15:06:08.802870 2119 rpcz_store.cc:276] 0927 15:06:07.013349 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.026882 (+ 13533us) service_pool.cc:227] Handling call
0927 15:06:08.802405 (+1775523us) ts_tablet_manager.cc:1145] Deleting tablet 9d4487cbbce24e60ae76ec0aca2760f4
0927 15:06:08.802420 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.802533 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1775295}
W20260927 15:06:08.803406 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9d4487cbbce24e60ae76ec0aca2760f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d4487cbbce24e60ae76ec0aca2760f4 already in progress: creating tablet
I20260927 15:06:08.809717 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 507) took 1796 ms. Trace:
I20260927 15:06:08.809867 2119 rpcz_store.cc:276] 0927 15:06:07.013433 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.027148 (+ 13715us) service_pool.cc:227] Handling call
0927 15:06:08.804599 (+1777451us) ts_tablet_manager.cc:1145] Deleting tablet 96ac92258c6044a891b3325b7aaf3b8f
0927 15:06:08.804618 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.809625 (+ 5007us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1777284}
W20260927 15:06:08.810662 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 96ac92258c6044a891b3325b7aaf3b8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96ac92258c6044a891b3325b7aaf3b8f already in progress: creating tablet
I20260927 15:06:08.813022 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 499) took 1815 ms. Trace:
I20260927 15:06:08.813261 2119 rpcz_store.cc:276] 0927 15:06:06.997437 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.159264 (+161827us) service_pool.cc:227] Handling call
0927 15:06:08.812729 (+1653465us) ts_tablet_manager.cc:1145] Deleting tablet 7a9c96abcfd347a9881b99df093da490
0927 15:06:08.812746 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.812950 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1494191}
W20260927 15:06:08.814035 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7a9c96abcfd347a9881b99df093da490 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a9c96abcfd347a9881b99df093da490 already in progress: creating tablet
I20260927 15:06:08.814674 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 520) took 1474 ms. Trace:
I20260927 15:06:08.815277 2119 rpcz_store.cc:276] 0927 15:06:07.340071 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.350890 (+ 10819us) service_pool.cc:227] Handling call
0927 15:06:08.814436 (+1463546us) ts_tablet_manager.cc:1145] Deleting tablet 5bc96d1626f24cfab49bf6a36e1da33e
0927 15:06:08.814451 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.814613 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1463305}
W20260927 15:06:08.815933 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 5bc96d1626f24cfab49bf6a36e1da33e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bc96d1626f24cfab49bf6a36e1da33e already in progress: creating tablet
I20260927 15:06:08.819031 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 523) took 1478 ms. Trace:
I20260927 15:06:08.819202 2119 rpcz_store.cc:276] 0927 15:06:07.340330 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.351444 (+ 11114us) service_pool.cc:227] Handling call
0927 15:06:08.818851 (+1467407us) ts_tablet_manager.cc:1145] Deleting tablet af25950fd08043f18a6eaaf46ded4378
0927 15:06:08.818863 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.818966 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1467191}
I20260927 15:06:08.803094 2199 raft_consensus.cc:504] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.820163 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 524) took 1479 ms. Trace:
I20260927 15:06:08.820264 2119 rpcz_store.cc:276] 0927 15:06:07.340434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.351668 (+ 11234us) service_pool.cc:227] Handling call
0927 15:06:08.819991 (+1468323us) ts_tablet_manager.cc:1145] Deleting tablet 454e637ec622424e81a8770c16bbc941
0927 15:06:08.820002 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.820101 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1468144}
I20260927 15:06:08.820302 2199 leader_election.cc:288] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:08.820703 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 454e637ec622424e81a8770c16bbc941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 454e637ec622424e81a8770c16bbc941 already in progress: creating tablet
I20260927 15:06:08.821147 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 522) took 1480 ms. Trace:
I20260927 15:06:08.821580 2119 rpcz_store.cc:276] 0927 15:06:07.340242 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.351385 (+ 11143us) service_pool.cc:227] Handling call
0927 15:06:08.820979 (+1469594us) ts_tablet_manager.cc:1145] Deleting tablet 90619b7804324c9589b53342e2f6d0e8
0927 15:06:08.820992 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.821094 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1468935}
W20260927 15:06:08.822019 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 90619b7804324c9589b53342e2f6d0e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90619b7804324c9589b53342e2f6d0e8 already in progress: creating tablet
I20260927 15:06:08.823243 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "109f9088371e4f008b2b5f993f2b4c3b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:08.824115 1562 ts_tablet_manager.cc:1918] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:08.824437 1562 log.cc:1196] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/e9a7ed6e23e1479a86e2abcf6aa5b317
I20260927 15:06:08.824860 1562 ts_tablet_manager.cc:1939] T e9a7ed6e23e1479a86e2abcf6aa5b317 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:08.825824 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 450) took 3828 ms. Trace:
I20260927 15:06:08.825992 1562 rpcz_store.cc:276] 0927 15:06:04.997511 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:04.997922 (+ 411us) service_pool.cc:227] Handling call
0927 15:06:08.723206 (+3725284us) ts_tablet_manager.cc:1145] Deleting tablet e9a7ed6e23e1479a86e2abcf6aa5b317
0927 15:06:08.723218 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.770721 (+ 47503us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.818257 (+ 47536us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.825761 (+ 7504us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23909,"tablet-delete.queue_time_us":3718240}
I20260927 15:06:08.826437 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet e9a7ed6e23e1479a86e2abcf6aa5b317 (table default.Table_bbb9f9f890a54220b1065de77e571c1e [id=da0dd555186044f2ac3825b4fbeb645a]) successfully deleted
I20260927 15:06:08.827678 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 521) took 1487 ms. Trace:
I20260927 15:06:08.827817 2119 rpcz_store.cc:276] 0927 15:06:07.340155 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.351162 (+ 11007us) service_pool.cc:227] Handling call
0927 15:06:08.827488 (+1476326us) ts_tablet_manager.cc:1145] Deleting tablet 2afab8bf87bc45c899bcd5dfdad48d26
0927 15:06:08.827505 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.827612 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1472475}
W20260927 15:06:08.828006 1102 leader_election.cc:341] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:08.828367 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2afab8bf87bc45c899bcd5dfdad48d26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2afab8bf87bc45c899bcd5dfdad48d26 already in progress: creating tablet
I20260927 15:06:08.828595 1561 tablet_bootstrap.cc:492] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:08.828821 1561 ts_tablet_manager.cc:1397] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.139s user 0.008s sys 0.005s
I20260927 15:06:08.829206 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 525) took 1452 ms. Trace:
I20260927 15:06:08.822151 2255 raft_consensus.cc:504] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.830344 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet f585bcdadbcc4032aa484481cdf94b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.830546 1552 tablet_bootstrap.cc:492] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:08.829835 2119 rpcz_store.cc:276] 0927 15:06:07.377184 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.377241 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:08.829048 (+1451807us) ts_tablet_manager.cc:1145] Deleting tablet c6a248ec4ee64d0a8d986fdc683d69ba
0927 15:06:08.829059 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.829150 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1451553}
I20260927 15:06:08.830650 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 456) took 3241 ms. Trace:
I20260927 15:06:08.830868 1552 ts_tablet_manager.cc:1397] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.008s
W20260927 15:06:08.831084 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c6a248ec4ee64d0a8d986fdc683d69ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6a248ec4ee64d0a8d986fdc683d69ba already in progress: creating tablet
I20260927 15:06:08.831060 1561 raft_consensus.cc:348] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.831676 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 508) took 1515 ms. Trace:
I20260927 15:06:08.831954 1561 raft_consensus.cc:374] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.832057 1561 raft_consensus.cc:729] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.830783 1562 rpcz_store.cc:276] 0927 15:06:05.589633 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.589690 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:08.826695 (+3237005us) ts_tablet_manager.cc:1145] Deleting tablet 289bea546c8a41bf97edfdc9a453a024
0927 15:06:08.826709 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.830585 (+ 3876us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3199464}
I20260927 15:06:08.831700 1552 raft_consensus.cc:348] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:08.833143 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 289bea546c8a41bf97edfdc9a453a024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 289bea546c8a41bf97edfdc9a453a024 already in progress: creating tablet
I20260927 15:06:08.833225 1552 raft_consensus.cc:374] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.833425 1552 raft_consensus.cc:729] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.833357 2119 rpcz_store.cc:276] 0927 15:06:07.315742 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.316769 (+ 1027us) service_pool.cc:227] Handling call
0927 15:06:08.831482 (+1514713us) ts_tablet_manager.cc:1145] Deleting tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4
0927 15:06:08.831492 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.831607 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1388179}
I20260927 15:06:08.834283 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 509) took 1515 ms. Trace:
I20260927 15:06:08.834375 2119 rpcz_store.cc:276] 0927 15:06:07.318714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.500616 (+181902us) service_pool.cc:227] Handling call
0927 15:06:08.834121 (+1333505us) ts_tablet_manager.cc:1145] Deleting tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4
0927 15:06:08.834130 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.834229 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1273237}
W20260927 15:06:08.834676 1376 consensus_peers.cc:487] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:08.835035 2119 tablet_replica.cc:330] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:08.833741 1552 consensus_queue.cc:260] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.835228 2119 raft_consensus.cc:2229] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:08.835667 1552 ts_tablet_manager.cc:1428] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:08.839509 1561 consensus_queue.cc:260] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.840171 1561 ts_tablet_manager.cc:1428] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 15:06:08.840323 1552 tablet_bootstrap.cc:492] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:08.840528 2119 raft_consensus.cc:2258] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.841136 2119 ts_tablet_manager.cc:1905] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.841784 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebb4e007cefa4f18bdaa461b43c5c810" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:08.842049 2255 leader_election.cc:288] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:08.842335 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 457) took 3252 ms. Trace:
W20260927 15:06:08.842449 1102 leader_election.cc:341] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.842453 1562 rpcz_store.cc:276] 0927 15:06:05.589762 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.589813 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:08.833164 (+3243351us) ts_tablet_manager.cc:1145] Deleting tablet 58d6bdc1ac004d889aac36db65afbbbe
0927 15:06:08.841878 (+ 8714us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.842281 (+ 403us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3205881}
I20260927 15:06:08.843044 1561 tablet_bootstrap.cc:492] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:08.843207 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 455) took 3254 ms. Trace:
I20260927 15:06:08.843300 1562 rpcz_store.cc:276] 0927 15:06:05.589089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.590054 (+ 965us) service_pool.cc:227] Handling call
0927 15:06:08.843036 (+3252982us) ts_tablet_manager.cc:1145] Deleting tablet 5c0d51b50b414721a255fdde2fe1732f
0927 15:06:08.843047 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.843149 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3215713}
I20260927 15:06:08.843655 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 454) took 3254 ms. Trace:
I20260927 15:06:08.843750 1562 rpcz_store.cc:276] 0927 15:06:05.588940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.598094 (+ 9154us) service_pool.cc:227] Handling call
0927 15:06:08.843511 (+3245417us) ts_tablet_manager.cc:1145] Deleting tablet 541147938d864cd9ad7208d96533b0f4
0927 15:06:08.843537 (+ 26us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.843605 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3176364}
I20260927 15:06:08.844023 1562 tablet_replica.cc:330] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:08.844213 1562 raft_consensus.cc:2229] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:08.844566 1562 raft_consensus.cc:2258] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.844800 1561 tablet_bootstrap.cc:654] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.845113 1562 ts_tablet_manager.cc:1905] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.850296 1099 leader_election.cc:302] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:08.850674 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 already in progress: creating tablet
W20260927 15:06:08.850876 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 58d6bdc1ac004d889aac36db65afbbbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d6bdc1ac004d889aac36db65afbbbe already in progress: creating tablet
W20260927 15:06:08.851549 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 5c0d51b50b414721a255fdde2fe1732f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c0d51b50b414721a255fdde2fe1732f already in progress: creating tablet
W20260927 15:06:08.851794 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 541147938d864cd9ad7208d96533b0f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 541147938d864cd9ad7208d96533b0f4 already in progress: creating tablet
W20260927 15:06:08.852756 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 already in progress: creating tablet
I20260927 15:06:08.861671 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 30244d596d4d4090af7656027b48f22e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.862664 2255 raft_consensus.cc:2781] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:08.863142 2255 raft_consensus.cc:686] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:08.863463 2255 consensus_queue.cc:237] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:08.864992 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 70838.5us
I20260927 15:06:08.866788 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebb4e007cefa4f18bdaa461b43c5c810" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:08.866902 1562 ts_tablet_manager.cc:1918] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:08.867045 1562 log.cc:1196] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/0e6e3600cbf741419bc7b93eec42eb13
I20260927 15:06:08.867058 1438 raft_consensus.cc:3037] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:08.869761 2094 raft_consensus.cc:482] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.869809 1438 raft_consensus.cc:2454] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:08.869944 2094 raft_consensus.cc:504] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.870651 2094 leader_election.cc:288] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:08.871538 1562 ts_tablet_manager.cc:1939] T 0e6e3600cbf741419bc7b93eec42eb13 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:08.872483 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 459) took 3185 ms. Trace:
I20260927 15:06:08.872610 1562 rpcz_store.cc:276] 0927 15:06:05.686686 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.691263 (+ 4577us) service_pool.cc:227] Handling call
0927 15:06:08.843947 (+3152684us) ts_tablet_manager.cc:1145] Deleting tablet 0e6e3600cbf741419bc7b93eec42eb13
0927 15:06:08.843955 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.849070 (+ 5115us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.866735 (+ 17665us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.872438 (+ 5703us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3152265}
W20260927 15:06:08.872958 1239 leader_election.cc:341] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 6d6eed08273244d28fd15785a09059f9
W20260927 15:06:08.873833 1238 leader_election.cc:341] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6d6eed08273244d28fd15785a09059f9
I20260927 15:06:08.873962 1238 leader_election.cc:302] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:08.874329 2094 raft_consensus.cc:2726] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:08.875469 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 0e6e3600cbf741419bc7b93eec42eb13 (table default.Table_eab3b8f9831948c8a78c4484d3911e0c [id=1b6050475cc24e249f2c525e95dda59a]) successfully deleted
W20260927 15:06:08.875490 1099 leader_election.cc:341] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 109f9088371e4f008b2b5f993f2b4c3b
I20260927 15:06:08.875995 1099 leader_election.cc:302] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:08.876441 2199 raft_consensus.cc:2726] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:08.876569 1099 leader_election.cc:302] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:08.876808 2199 raft_consensus.cc:2781] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:08.876959 2199 raft_consensus.cc:686] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:08.877194 2199 consensus_queue.cc:237] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.878651 906 master_service.cc:946] ReplaceTablet: received request to replace tablet f585bcdadbcc4032aa484481cdf94b72 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:08.884523 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6bf0172924f44feb8a2467e2ad14781b" } modify_external_catalogs: true
I20260927 15:06:08.884786 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6bf0172924f44feb8a2467e2ad14781b" } modify_external_catalogs: true
I20260927 15:06:08.887153 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet ebb4e007cefa4f18bdaa461b43c5c810 (table default.Table_299a7e2d3b174b50b6f535e3971c1f35 [id=49e5a0fcbe0d48aa993446d112ed5d2b]). Expected version 2 got 0
I20260927 15:06:08.887989 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet ebb4e007cefa4f18bdaa461b43c5c810 (table default.Table_299a7e2d3b174b50b6f535e3971c1f35 [id=49e5a0fcbe0d48aa993446d112ed5d2b]). Expected version 2 got 0
I20260927 15:06:08.888195 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:08.888988 1552 tablet_bootstrap.cc:654] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.889220 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 49f6f839939042838a24e234a21eacb6 (DEFAULT_TABLE table=default.Table_b5af446327ee4e9e8a927bd0ac84a8ba [id=ec29f8e79ec14f15adf3fdb07ef2c864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.889724 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49f6f839939042838a24e234a21eacb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.890616 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e6e3600cbf741419bc7b93eec42eb13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.891665 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a07831078b48a59807f7da4a42bcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.891800 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 454e637ec622424e81a8770c16bbc941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.892005 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 16884c7343be436aa312ec0af40f5e33 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cc8bd2079f84da39e13113e6699bf5e) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.892102 2233 tablet_replica.cc:330] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:08.892409 2233 raft_consensus.cc:2229] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:08.892584 2233 raft_consensus.cc:2258] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.893167 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet b375902081c54cdb84fdb075eec6baf7 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f4cff4a06db44269defca578af289d8) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.893217 2233 ts_tablet_manager.cc:1905] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.893272 1561 tablet_bootstrap.cc:492] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:08.893410 1561 ts_tablet_manager.cc:1397] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.004s
I20260927 15:06:08.894399 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f75fed3fee5b474c89a743876719cbfb" } modify_external_catalogs: true
I20260927 15:06:08.894632 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f75fed3fee5b474c89a743876719cbfb" } modify_external_catalogs: true
I20260927 15:06:08.892063 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 2afab8bf87bc45c899bcd5dfdad48d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.895354 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1b045b82515540e8813f9250726479e5
I20260927 15:06:08.896592 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b045b82515540e8813f9250726479e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.897789 1556 tablet_bootstrap.cc:492] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.897935 1556 ts_tablet_manager.cc:1397] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.162s user 0.010s sys 0.009s
I20260927 15:06:08.898316 1561 raft_consensus.cc:348] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.898532 1561 raft_consensus.cc:374] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.898612 1561 raft_consensus.cc:729] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.898640 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:08.898787 1556 raft_consensus.cc:348] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.899075 1556 raft_consensus.cc:374] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.899205 1556 raft_consensus.cc:729] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.899942 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b045b82515540e8813f9250726479e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.901567 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b045b82515540e8813f9250726479e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.902174 1561 consensus_queue.cc:260] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.901149 1556 consensus_queue.cc:260] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.904732 1561 ts_tablet_manager.cc:1428] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 15:06:08.905049 1561 tablet_bootstrap.cc:492] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:08.905611 2223 raft_consensus.cc:482] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.905758 2223 raft_consensus.cc:504] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.906436 2223 leader_election.cc:288] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:08.906649 1561 tablet_bootstrap.cc:654] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.907030 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454e637ec622424e81a8770c16bbc941" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:08.907024 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454e637ec622424e81a8770c16bbc941" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:08.907614 1376 leader_election.cc:341] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.908416 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 9598ac8a916f4bf5b1cf9995a8149c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.909462 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 53ddb28f419d42afbaddf36966fa1509
I20260927 15:06:08.909917 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_36ee5821ff0c4c76b28ba32d1fa76b25" } new_table_name: "default.Table_60ea7e4921ff40728d6a8b84c9b494c8" modify_external_catalogs: true
I20260927 15:06:08.910382 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 53ddb28f419d42afbaddf36966fa1509 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.910413 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 34348cffe35b46728e77df7dede29682
I20260927 15:06:08.911146 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f271c76b5f2447239d3d014fbde4e8b2
I20260927 15:06:08.911695 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 34348cffe35b46728e77df7dede29682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.910706 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4e3722eb6b6f4ea0ae4dae79367377fc" } new_table_name: "default.Table_a9272e6bb1f14a3b9e7d4a3dd4a881fb" modify_external_catalogs: true
I20260927 15:06:08.912439 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_db7331205e7f4b2f8b1e833b7ee59616"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:08.912570 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6f254b1d0eb949238df41c88797697e5" } new_table_name: "default.Table_bf61e56b4709425c99c5a22da57ddba9" modify_external_catalogs: true
W20260927 15:06:08.913043 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db7331205e7f4b2f8b1e833b7ee59616 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.913431 1556 ts_tablet_manager.cc:1428] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260927 15:06:08.913844 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 54f5c4b7c7a045bea1a79bc67a913f65
I20260927 15:06:08.914225 909 catalog_manager.cc:6565] ReplaceTablet: tablet 54f5c4b7c7a045bea1a79bc67a913f65 deleted and replaced by tablet fd6a824a5a504c92992ceec1cd3eb2e7
I20260927 15:06:08.915544 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 34348cffe35b46728e77df7dede29682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.915833 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet f271c76b5f2447239d3d014fbde4e8b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.916050 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 54f5c4b7c7a045bea1a79bc67a913f65 with delete_type TABLET_DATA_DELETED (replaced by tablet fd6a824a5a504c92992ceec1cd3eb2e7) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.916260 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 53ddb28f419d42afbaddf36966fa1509 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:08.917220 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 54f5c4b7c7a045bea1a79bc67a913f65 with delete_type TABLET_DATA_DELETED (replaced by tablet fd6a824a5a504c92992ceec1cd3eb2e7) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.917443 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet f271c76b5f2447239d3d014fbde4e8b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.917824 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_05a4f0b59b034d37ad273d442100793d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.918457 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05a4f0b59b034d37ad273d442100793d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.918340 1556 tablet_bootstrap.cc:492] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:08.920295 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 34348cffe35b46728e77df7dede29682 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.920563 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 54f5c4b7c7a045bea1a79bc67a913f65 with delete_type TABLET_DATA_DELETED (replaced by tablet fd6a824a5a504c92992ceec1cd3eb2e7) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.920845 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet f271c76b5f2447239d3d014fbde4e8b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.920899 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 53ddb28f419d42afbaddf36966fa1509 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.920992 1164 raft_consensus.cc:2454] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:08.920833 1562 tablet_replica.cc:330] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:08.921456 1374 leader_election.cc:302] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:08.921756 1562 raft_consensus.cc:2229] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:08.921864 2223 raft_consensus.cc:2781] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:08.921937 1562 raft_consensus.cc:2258] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.922005 2223 raft_consensus.cc:482] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:08.922096 2223 raft_consensus.cc:3037] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:08.922509 1562 ts_tablet_manager.cc:1905] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.925496 1556 tablet_bootstrap.cc:654] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:08.927393 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_72b3658396124482993401cff12bf063"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.928057 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72b3658396124482993401cff12bf063 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.929018 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b74ce51718e7413bb6e6657e638c8d49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.929556 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b74ce51718e7413bb6e6657e638c8d49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.930356 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_af5779149a514b809b9e3f46afc2adf8" } new_table_name: "default.Table_0b53e259ee1c4a8e976aaf01c97b0b33" modify_external_catalogs: true
W20260927 15:06:08.930763 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6f6bdef4ddb4f9c9c0d1f933768cd14 consensus state has no leader
I20260927 15:06:08.931169 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_63c6bb3ab2a94fbd978bfb8ad64439ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.931608 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63c6bb3ab2a94fbd978bfb8ad64439ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:08.933199 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80a8563c77484a1ebbbe7dab9a652aeb consensus state has no leader
I20260927 15:06:08.933713 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1d221f14ad57462e95017b9068eb8714
I20260927 15:06:08.934782 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d221f14ad57462e95017b9068eb8714 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:08.935271 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8baa02df777404187611de3ae220e39 consensus state has no leader
I20260927 15:06:08.936632 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d221f14ad57462e95017b9068eb8714 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:08.937994 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d221f14ad57462e95017b9068eb8714 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:08.938448 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_957e53d26f194ff3aae5a94f8ef7558e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.938994 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_957e53d26f194ff3aae5a94f8ef7558e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.940119 2223 raft_consensus.cc:504] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.941293 2223 leader_election.cc:288] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:08.941511 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454e637ec622424e81a8770c16bbc941" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:08.941717 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454e637ec622424e81a8770c16bbc941" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:08.941962 1164 raft_consensus.cc:3037] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:08.942126 1376 leader_election.cc:341] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:08.945569 1164 raft_consensus.cc:2454] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:08.946142 1374 leader_election.cc:302] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:08.946625 2223 raft_consensus.cc:2781] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:08.946899 2223 raft_consensus.cc:686] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:08.947178 2223 consensus_queue.cc:237] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.948571 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 49f6f839939042838a24e234a21eacb6 (DEFAULT_TABLE table=default.Table_b5af446327ee4e9e8a927bd0ac84a8ba [id=ec29f8e79ec14f15adf3fdb07ef2c864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.948994 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49f6f839939042838a24e234a21eacb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.950412 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 073b995a22304b0aaf8cfd61ffd5722a (DEFAULT_TABLE table=default.Table_4a1df0232ef7431f9f29870cfd637429 [id=f5e837e340de4ac781aac01b4ba8992e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.950908 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 073b995a22304b0aaf8cfd61ffd5722a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.951815 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 073b995a22304b0aaf8cfd61ffd5722a (DEFAULT_TABLE table=default.Table_4a1df0232ef7431f9f29870cfd637429 [id=f5e837e340de4ac781aac01b4ba8992e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.952248 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 073b995a22304b0aaf8cfd61ffd5722a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.960016 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ea141cf06d87453b9f5a4a68d8bfc5e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.960697 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea141cf06d87453b9f5a4a68d8bfc5e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.961436 1279 tablet_service.cc:1467] Processing CreateTablet for tablet b5e418f9ce5e41128b17f01e9e909ecb (DEFAULT_TABLE table=default.Table_2996ce3719d74bc9814dedbb61678d95 [id=1da3843000a143a2973a17783064996b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.961864 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e418f9ce5e41128b17f01e9e909ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.963117 1270 tablet_service.cc:1467] Processing CreateTablet for tablet af01c554377f414c9efe3451a5aa08fd (DEFAULT_TABLE table=default.Table_4c0f3b014a07445b9a7e9bca831bce19 [id=f071ddb03ea542cb9bb8bde4150bc72c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.963451 1556 tablet_bootstrap.cc:492] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:08.963541 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af01c554377f414c9efe3451a5aa08fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.963629 2233 ts_tablet_manager.cc:1918] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:08.963788 2233 log.cc:1196] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/54a07831078b48a59807f7da4a42bcec
I20260927 15:06:08.964165 2233 ts_tablet_manager.cc:1939] T 54a07831078b48a59807f7da4a42bcec P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:08.966161 2266 raft_consensus.cc:482] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:08.966326 2266 raft_consensus.cc:504] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.966526 2119 ts_tablet_manager.cc:1918] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:08.966662 2119 log.cc:1196] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/377847d06b534883ba2b870ca3317fe0
I20260927 15:06:08.967041 2266 leader_election.cc:288] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:08.967140 2119 ts_tablet_manager.cc:1939] T 377847d06b534883ba2b870ca3317fe0 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:08.967427 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 728c495d176c4577835a38f8193493eb (DEFAULT_TABLE table=default.Table_e8c0580cbbae4664910245b65d51b219 [id=b9dc470a14f7496cafb943476be9d740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.974349 2233 tablet_replica.cc:330] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:08.975134 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_677f83923ad647b08ba28a091be71775" } new_table_name: "default.Table_ec7d1d16936a48d3a1b9f06bde8060da" modify_external_catalogs: true
I20260927 15:06:08.975257 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e94758535baf48a9ba2a7e5fe62c32a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.975816 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e94758535baf48a9ba2a7e5fe62c32a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.976655 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6406a4cb5c1b4f18b8d482f820949cad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.977200 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6406a4cb5c1b4f18b8d482f820949cad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.978662 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_802f770c469d4f3daa131645340e456c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:08.979288 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_802f770c469d4f3daa131645340e456c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:08.980680 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca21f240d8d4252b9cf0355c69f7166 (DEFAULT_TABLE table=default.Table_1e91076e42b04629abc3a91b3b7ecd50 [id=fc8d2acf7d3d4b3cb3e20319e336a49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.981026 1407 tablet_service.cc:1467] Processing CreateTablet for tablet b5e418f9ce5e41128b17f01e9e909ecb (DEFAULT_TABLE table=default.Table_2996ce3719d74bc9814dedbb61678d95 [id=1da3843000a143a2973a17783064996b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.981185 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca21f240d8d4252b9cf0355c69f7166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.981460 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e418f9ce5e41128b17f01e9e909ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.981776 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 728c495d176c4577835a38f8193493eb (DEFAULT_TABLE table=default.Table_e8c0580cbbae4664910245b65d51b219 [id=b9dc470a14f7496cafb943476be9d740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.982133 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728c495d176c4577835a38f8193493eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.967917 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728c495d176c4577835a38f8193493eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.967497 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 526) took 1460 ms. Trace:
I20260927 15:06:08.985376 2119 rpcz_store.cc:276] 0927 15:06:07.507148 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.520053 (+ 12905us) service_pool.cc:227] Handling call
0927 15:06:08.834955 (+1314902us) ts_tablet_manager.cc:1145] Deleting tablet 377847d06b534883ba2b870ca3317fe0
0927 15:06:08.834963 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:08.879626 (+ 44663us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.966403 (+ 86777us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:08.967464 (+ 1061us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1271559}
I20260927 15:06:08.985838 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 377847d06b534883ba2b870ca3317fe0 (table default.Table_0021fd56477c4debbfe492c5673d41c2 [id=56574e770aa74f04a7bf24b7718e4960]) successfully deleted
I20260927 15:06:08.987151 1408 tablet_service.cc:1467] Processing CreateTablet for tablet af01c554377f414c9efe3451a5aa08fd (DEFAULT_TABLE table=default.Table_4c0f3b014a07445b9a7e9bca831bce19 [id=f071ddb03ea542cb9bb8bde4150bc72c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.987182 1403 tablet_service.cc:1467] Processing CreateTablet for tablet decee14b5d7a4aef9989051dcaeb5a7b (DEFAULT_TABLE table=default.Table_34d1f85060084bebb54e57402ea08b5d [id=645add1330bd41618f53f3c008b48200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.987911 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af01c554377f414c9efe3451a5aa08fd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:08.988415 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 05d525c1128e4042aa97ff786ffa7ba9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05d525c1128e4042aa97ff786ffa7ba9 already in progress: creating tablet
W20260927 15:06:08.989113 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3fff31ceb379400bbfa4586c749e6d6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fff31ceb379400bbfa4586c749e6d6e already in progress: creating tablet
I20260927 15:06:08.990890 2233 raft_consensus.cc:2229] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:08.991014 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decee14b5d7a4aef9989051dcaeb5a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.991295 2233 pending_rounds.cc:62] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:08.991252 1274 tablet_service.cc:1467] Processing CreateTablet for tablet c5de1bf320ca4043b31154380710ad79 (DEFAULT_TABLE table=default.Table_6abf703ded884d0aa2706e13cf2df6a9 [id=73965de1ec104c129287f555399a2643]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.991369 2233 pending_rounds.cc:68] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976346410606592 op_type: NO_OP noop_request { }
I20260927 15:06:08.991549 2233 raft_consensus.cc:2866] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:08.991644 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5de1bf320ca4043b31154380710ad79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.991672 2233 raft_consensus.cc:2258] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:08.963627 1556 ts_tablet_manager.cc:1397] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.001s
W20260927 15:06:08.993572 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a9a58b4d602b4f879fc56f5f1648f19c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9a58b4d602b4f879fc56f5f1648f19c already in progress: creating tablet
W20260927 15:06:08.994421 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet edc07b00db3c42eeb7543fecaf515eab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edc07b00db3c42eeb7543fecaf515eab already in progress: creating tablet
I20260927 15:06:08.995551 1267 tablet_service.cc:1467] Processing CreateTablet for tablet b19ddd29d7214931ad797497a0178544 (DEFAULT_TABLE table=default.Table_9184c4ea97b249cba034421e1d7945c9 [id=565cb0f0a17745d686acc36a11e969bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.995536 1556 raft_consensus.cc:348] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:08.995757 1556 raft_consensus.cc:374] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:08.995819 1556 raft_consensus.cc:729] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:08.995949 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b19ddd29d7214931ad797497a0178544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.996031 1556 consensus_queue.cc:260] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:08.996318 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 727652500d9a47b68b7a0d0dcf583822 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 727652500d9a47b68b7a0d0dcf583822 already in progress: creating tablet
I20260927 15:06:08.996722 2233 ts_tablet_manager.cc:1905] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:08.997947 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1c5c0d205937415ab0214a5bdbd939c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c5c0d205937415ab0214a5bdbd939c1 already in progress: creating tablet
I20260927 15:06:08.999226 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 2a31738c476c459280e837ff109fd84f (DEFAULT_TABLE table=default.Table_90b9ccd25c694abe98e24e0b37bb75af [id=142e26fc3c2b4e07bc223687073c7daa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:08.999354 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 4714d536373a4bf2a4be9ebeaebe77c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4714d536373a4bf2a4be9ebeaebe77c1 already in progress: creating tablet
I20260927 15:06:08.999652 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a31738c476c459280e837ff109fd84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.001549 1556 ts_tablet_manager.cc:1428] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20260927 15:06:09.002403 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 75537edf83a040cba4da502c726bf456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75537edf83a040cba4da502c726bf456 already in progress: creating tablet
I20260927 15:06:08.967145 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca21f240d8d4252b9cf0355c69f7166 (DEFAULT_TABLE table=default.Table_1e91076e42b04629abc3a91b3b7ecd50 [id=fc8d2acf7d3d4b3cb3e20319e336a49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.003474 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca21f240d8d4252b9cf0355c69f7166. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:09.003504 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 568ba79ea795403cba76fb6632efd7e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 568ba79ea795403cba76fb6632efd7e2 already in progress: creating tablet
I20260927 15:06:09.003767 1556 tablet_bootstrap.cc:492] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:09.005861 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e33a8d5908004ab88d4c53b21be4fb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e33a8d5908004ab88d4c53b21be4fb42 already in progress: creating tablet
I20260927 15:06:09.007175 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 925d256cb28f496889ad7b3c6b1f6f10 (DEFAULT_TABLE table=default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.007588 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 925d256cb28f496889ad7b3c6b1f6f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.008191 2119 tablet_replica.cc:330] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:09.008416 2119 raft_consensus.cc:2229] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:09.008591 2119 raft_consensus.cc:2258] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.010237 1556 tablet_bootstrap.cc:654] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.010649 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 9d8fd588fe344e819f13aadb33e26153 (DEFAULT_TABLE table=default.Table_acd9f14d4fb34ccca7258cac39ea7602 [id=2aa406a8c3bf4a93acd2b94a31d2e1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.011091 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d8fd588fe344e819f13aadb33e26153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.969318 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9598ac8a916f4bf5b1cf9995a8149c70" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:09.015202 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9598ac8a916f4bf5b1cf9995a8149c70" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:08.972744 1278 tablet_service.cc:1467] Processing CreateTablet for tablet decee14b5d7a4aef9989051dcaeb5a7b (DEFAULT_TABLE table=default.Table_34d1f85060084bebb54e57402ea08b5d [id=645add1330bd41618f53f3c008b48200]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:09.015743 1374 leader_election.cc:341] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.016000 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decee14b5d7a4aef9989051dcaeb5a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.016077 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 073b995a22304b0aaf8cfd61ffd5722a (DEFAULT_TABLE table=default.Table_4a1df0232ef7431f9f29870cfd637429 [id=f5e837e340de4ac781aac01b4ba8992e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.017345 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 073b995a22304b0aaf8cfd61ffd5722a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.018731 1130 tablet_service.cc:1467] Processing CreateTablet for tablet ce1c286eea664e2a8ad6ebdf31bd4050 (DEFAULT_TABLE table=default.Table_5c0d2507a5ac46f1874f45430d2693cb [id=4ae6aafbd90c4f94b377094d4790d922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.972981 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 9f07d07b63834b368930d34956e7d6df (DEFAULT_TABLE table=default.Table_523e2ef14fe8419c80231f7d636c8d6b [id=fe1f935eec2040a38d1299ac1e0b24b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.019106 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce1c286eea664e2a8ad6ebdf31bd4050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.019258 2119 ts_tablet_manager.cc:1905] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:08.973220 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 1d6afacbd3e04806862929e82e4bdeac (DEFAULT_TABLE table=default.Table_9a00bed1fa194766ad89ee518de9875c [id=c8ba057990ab44d2bd211fefc6df6e59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.984404 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 7c7f6acc32d3491c9aaa62db9bf4ab0f (DEFAULT_TABLE table=default.Table_72e3aea6fa834175b98e58759d6d28cb [id=9ff0c83997554b3ca450dba52d09c1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.019632 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 49f6f839939042838a24e234a21eacb6 (DEFAULT_TABLE table=default.Table_b5af446327ee4e9e8a927bd0ac84a8ba [id=ec29f8e79ec14f15adf3fdb07ef2c864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.019968 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49f6f839939042838a24e234a21eacb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.019254 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f07d07b63834b368930d34956e7d6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.020711 1268 tablet_service.cc:1467] Processing CreateTablet for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f (DEFAULT_TABLE table=default.Table_b94ff6d2011948078b03af17b4d95fae [id=8af79e2564b34d66be63893f6a90bd04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.021085 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.021509 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 728c495d176c4577835a38f8193493eb (DEFAULT_TABLE table=default.Table_e8c0580cbbae4664910245b65d51b219 [id=b9dc470a14f7496cafb943476be9d740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.022389 1127 tablet_service.cc:1467] Processing CreateTablet for tablet af01c554377f414c9efe3451a5aa08fd (DEFAULT_TABLE table=default.Table_4c0f3b014a07445b9a7e9bca831bce19 [id=f071ddb03ea542cb9bb8bde4150bc72c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.022660 1145 tablet_service.cc:1467] Processing CreateTablet for tablet b5e418f9ce5e41128b17f01e9e909ecb (DEFAULT_TABLE table=default.Table_2996ce3719d74bc9814dedbb61678d95 [id=1da3843000a143a2973a17783064996b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.022969 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c7f6acc32d3491c9aaa62db9bf4ab0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.025532 2233 ts_tablet_manager.cc:1918] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:09.025671 2233 log.cc:1196] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/454e637ec622424e81a8770c16bbc941
I20260927 15:06:09.026028 2233 ts_tablet_manager.cc:1939] T 454e637ec622424e81a8770c16bbc941 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:09.026942 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d6afacbd3e04806862929e82e4bdeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.026925 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 5ca21f240d8d4252b9cf0355c69f7166 (DEFAULT_TABLE table=default.Table_1e91076e42b04629abc3a91b3b7ecd50 [id=fc8d2acf7d3d4b3cb3e20319e336a49f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.027400 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 728c495d176c4577835a38f8193493eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:08.968271 1266 tablet_service.cc:1467] Processing CreateTablet for tablet ce1c286eea664e2a8ad6ebdf31bd4050 (DEFAULT_TABLE table=default.Table_5c0d2507a5ac46f1874f45430d2693cb [id=4ae6aafbd90c4f94b377094d4790d922]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:09.029093 1376 leader_election.cc:341] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.029250 1376 leader_election.cc:302] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:09.029500 2223 raft_consensus.cc:2726] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:09.030292 1131 tablet_service.cc:1467] Processing CreateTablet for tablet decee14b5d7a4aef9989051dcaeb5a7b (DEFAULT_TABLE table=default.Table_34d1f85060084bebb54e57402ea08b5d [id=645add1330bd41618f53f3c008b48200]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.030716 1556 tablet_bootstrap.cc:492] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:09.030905 1556 ts_tablet_manager.cc:1397] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260927 15:06:09.031648 1556 raft_consensus.cc:348] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.031885 1556 raft_consensus.cc:374] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.031984 1556 raft_consensus.cc:729] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.032229 1556 consensus_queue.cc:260] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.032471 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5e418f9ce5e41128b17f01e9e909ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.032814 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decee14b5d7a4aef9989051dcaeb5a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.032992 1556 ts_tablet_manager.cc:1428] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:09.033309 1556 tablet_bootstrap.cc:492] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:09.033381 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ca21f240d8d4252b9cf0355c69f7166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.035364 1556 tablet_bootstrap.cc:654] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.036556 2233 tablet_replica.cc:330] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:09.036772 2233 raft_consensus.cc:2229] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:09.036964 2233 raft_consensus.cc:2258] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.037496 2233 ts_tablet_manager.cc:1905] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:09.039234 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 9f07d07b63834b368930d34956e7d6df (DEFAULT_TABLE table=default.Table_523e2ef14fe8419c80231f7d636c8d6b [id=fe1f935eec2040a38d1299ac1e0b24b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.039603 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f07d07b63834b368930d34956e7d6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.041088 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af01c554377f414c9efe3451a5aa08fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.050988 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 1d6afacbd3e04806862929e82e4bdeac (DEFAULT_TABLE table=default.Table_9a00bed1fa194766ad89ee518de9875c [id=c8ba057990ab44d2bd211fefc6df6e59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.051640 2094 raft_consensus.cc:482] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.051678 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 9f07d07b63834b368930d34956e7d6df (DEFAULT_TABLE table=default.Table_523e2ef14fe8419c80231f7d636c8d6b [id=fe1f935eec2040a38d1299ac1e0b24b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:08.978756 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 54a07831078b48a59807f7da4a42bcec (table default.Table_c8f0a331bf1f4f7c969299f5f0c4d5a6 [id=aa16f23914de4c7db1e460bb1c743a4d]) successfully deleted
W20260927 15:06:09.052829 898 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 74064.9us
I20260927 15:06:09.052857 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 7c7f6acc32d3491c9aaa62db9bf4ab0f (DEFAULT_TABLE table=default.Table_72e3aea6fa834175b98e58759d6d28cb [id=9ff0c83997554b3ca450dba52d09c1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.054739 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d6afacbd3e04806862929e82e4bdeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.056829 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 454e637ec622424e81a8770c16bbc941 (table default.Table_d80304854a5249a08e5c2098c97d7c1c [id=a1de063eacb94c21b5009200a7517a33]) successfully deleted
W20260927 15:06:09.059749 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2b5f866646d4da9a0d0881a3bf6bd83 consensus state has no leader
I20260927 15:06:09.059769 1133 tablet_service.cc:1467] Processing CreateTablet for tablet c5de1bf320ca4043b31154380710ad79 (DEFAULT_TABLE table=default.Table_6abf703ded884d0aa2706e13cf2df6a9 [id=73965de1ec104c129287f555399a2643]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.060107 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c7f6acc32d3491c9aaa62db9bf4ab0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.066854 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5de1bf320ca4043b31154380710ad79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.068965 2094 raft_consensus.cc:504] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.070801 1129 tablet_service.cc:1467] Processing CreateTablet for tablet b19ddd29d7214931ad797497a0178544 (DEFAULT_TABLE table=default.Table_9184c4ea97b249cba034421e1d7945c9 [id=565cb0f0a17745d686acc36a11e969bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.070873 2094 leader_election.cc:288] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:09.071025 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce1c286eea664e2a8ad6ebdf31bd4050. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:09.072491 1239 leader_election.cc:341] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: f1d7a98ffc4745ac8eeb93012b55d417
I20260927 15:06:09.073207 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 2a31738c476c459280e837ff109fd84f (DEFAULT_TABLE table=default.Table_90b9ccd25c694abe98e24e0b37bb75af [id=142e26fc3c2b4e07bc223687073c7daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.077702 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 9d8fd588fe344e819f13aadb33e26153 (DEFAULT_TABLE table=default.Table_acd9f14d4fb34ccca7258cac39ea7602 [id=2aa406a8c3bf4a93acd2b94a31d2e1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.078059 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 925d256cb28f496889ad7b3c6b1f6f10 (DEFAULT_TABLE table=default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.080580 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f07d07b63834b368930d34956e7d6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.081853 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a31738c476c459280e837ff109fd84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.087236 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d8fd588fe344e819f13aadb33e26153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.088393 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 925d256cb28f496889ad7b3c6b1f6f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.089515 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b19ddd29d7214931ad797497a0178544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.091864 1138 tablet_service.cc:1467] Processing CreateTablet for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f (DEFAULT_TABLE table=default.Table_b94ff6d2011948078b03af17b4d95fae [id=8af79e2564b34d66be63893f6a90bd04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.092234 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:09.102551 1238 leader_election.cc:341] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: f1d7a98ffc4745ac8eeb93012b55d417
I20260927 15:06:09.102722 1238 leader_election.cc:302] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:09.105549 2233 ts_tablet_manager.cc:1918] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:09.105713 2233 log.cc:1196] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/16884c7343be436aa312ec0af40f5e33
I20260927 15:06:09.106106 2233 ts_tablet_manager.cc:1939] T 16884c7343be436aa312ec0af40f5e33 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:09.107036 2233 tablet_replica.cc:330] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:09.107251 2233 raft_consensus.cc:2229] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:09.107404 2233 raft_consensus.cc:2258] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.107904 2233 ts_tablet_manager.cc:1905] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:09.115427 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cf1a116400854111ad696b9bbc4fc97d" } modify_external_catalogs: true
I20260927 15:06:09.115664 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cf1a116400854111ad696b9bbc4fc97d" } modify_external_catalogs: true
I20260927 15:06:09.116788 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b63a429933e047478bdd814d02fa6d5a" } modify_external_catalogs: true
I20260927 15:06:09.116940 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b63a429933e047478bdd814d02fa6d5a" } modify_external_catalogs: true
I20260927 15:06:09.119261 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 7c7f6acc32d3491c9aaa62db9bf4ab0f (DEFAULT_TABLE table=default.Table_72e3aea6fa834175b98e58759d6d28cb [id=9ff0c83997554b3ca450dba52d09c1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.120218 2094 raft_consensus.cc:2726] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:09.120210 1419 tablet_service.cc:1467] Processing CreateTablet for tablet b19ddd29d7214931ad797497a0178544 (DEFAULT_TABLE table=default.Table_9184c4ea97b249cba034421e1d7945c9 [id=565cb0f0a17745d686acc36a11e969bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.121536 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 2a31738c476c459280e837ff109fd84f (DEFAULT_TABLE table=default.Table_90b9ccd25c694abe98e24e0b37bb75af [id=142e26fc3c2b4e07bc223687073c7daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.121840 2094 raft_consensus.cc:482] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.122366 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9184c4ea97b249cba034421e1d7945c9" } modify_external_catalogs: true
I20260927 15:06:09.122385 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 925d256cb28f496889ad7b3c6b1f6f10 (DEFAULT_TABLE table=default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.123944 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 925d256cb28f496889ad7b3c6b1f6f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.124143 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9184c4ea97b249cba034421e1d7945c9" } modify_external_catalogs: true
I20260927 15:06:09.126063 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_806abc9f7da043179a751515c37b1170" } modify_external_catalogs: true
I20260927 15:06:09.126374 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a31738c476c459280e837ff109fd84f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.126941 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 48e7eac8753f425d90302360d228ee54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.127308 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 9d8fd588fe344e819f13aadb33e26153 (DEFAULT_TABLE table=default.Table_acd9f14d4fb34ccca7258cac39ea7602 [id=2aa406a8c3bf4a93acd2b94a31d2e1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.127637 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d8fd588fe344e819f13aadb33e26153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.127261 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_806abc9f7da043179a751515c37b1170" } modify_external_catalogs: true
I20260927 15:06:09.129498 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 16884c7343be436aa312ec0af40f5e33 (table default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388]) successfully deleted
I20260927 15:06:09.129769 2119 ts_tablet_manager.cc:1918] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:09.130491 2119 log.cc:1196] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/6d6eed08273244d28fd15785a09059f9
I20260927 15:06:09.125435 2094 raft_consensus.cc:504] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.132004 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9ab7a25d863f493e81a9717e0f3693a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.132541 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ab7a25d863f493e81a9717e0f3693a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:09.136162 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 929425d7dab14084acef649e54a9b32b consensus state has no leader
I20260927 15:06:09.136549 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8a603f04bc4e47bc96a9c06f178536ff" } new_table_name: "default.Table_468a71b950534b7aa36adbcda42fca55" modify_external_catalogs: true
I20260927 15:06:09.139509 2094 leader_election.cc:288] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:09.140039 2119 ts_tablet_manager.cc:1939] T 6d6eed08273244d28fd15785a09059f9 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:09.140931 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6041922ddbbd40f1a099875f5071c91d" } new_table_name: "default.Table_26e580c47f6447e49e838ec66db70015" modify_external_catalogs: true
I20260927 15:06:09.143822 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9091bf3af8564f0fa93792507114d5b9" } new_table_name: "default.Table_ec248855083540d8a7656d2a1ac39508" modify_external_catalogs: true
W20260927 15:06:09.144647 1238 leader_election.cc:341] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 30244d596d4d4090af7656027b48f22e
I20260927 15:06:09.145440 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_50468591e06d4c9bb7eec72646b0e846" } modify_external_catalogs: true
I20260927 15:06:09.145625 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_50468591e06d4c9bb7eec72646b0e846" } modify_external_catalogs: true
W20260927 15:06:09.145932 1239 leader_election.cc:341] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 30244d596d4d4090af7656027b48f22e
I20260927 15:06:09.146317 1239 leader_election.cc:302] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:09.146660 2094 raft_consensus.cc:2726] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:09.147300 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 6d6eed08273244d28fd15785a09059f9 (table default.Table_c8f0a331bf1f4f7c969299f5f0c4d5a6 [id=aa16f23914de4c7db1e460bb1c743a4d]) successfully deleted
W20260927 15:06:09.147553 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 12f6403cde734c1394aabfc92c093290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12f6403cde734c1394aabfc92c093290 already in progress: creating tablet
I20260927 15:06:09.148628 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 1d6afacbd3e04806862929e82e4bdeac (DEFAULT_TABLE table=default.Table_9a00bed1fa194766ad89ee518de9875c [id=c8ba057990ab44d2bd211fefc6df6e59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.149694 2119 tablet_replica.cc:330] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:09.149902 2119 raft_consensus.cc:2229] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:09.150846 2119 raft_consensus.cc:2258] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.151818 2119 ts_tablet_manager.cc:1905] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:09.158247 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6f179aab784ae4822356e63332532f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.158881 1406 tablet_service.cc:1467] Processing CreateTablet for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f (DEFAULT_TABLE table=default.Table_b94ff6d2011948078b03af17b4d95fae [id=8af79e2564b34d66be63893f6a90bd04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.161070 1401 tablet_service.cc:1467] Processing CreateTablet for tablet c5de1bf320ca4043b31154380710ad79 (DEFAULT_TABLE table=default.Table_6abf703ded884d0aa2706e13cf2df6a9 [id=73965de1ec104c129287f555399a2643]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.161876 1556 tablet_bootstrap.cc:492] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:09.162204 2223 raft_consensus.cc:482] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.162328 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c7f6acc32d3491c9aaa62db9bf4ab0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.163218 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b19ddd29d7214931ad797497a0178544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.164095 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.165023 1556 ts_tablet_manager.cc:1397] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.129s user 0.017s sys 0.010s
I20260927 15:06:09.165784 1556 raft_consensus.cc:348] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.166030 1556 raft_consensus.cc:374] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.166091 1556 raft_consensus.cc:729] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.166297 1556 consensus_queue.cc:260] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:09.167071 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b43f13e66b0415e8dea802d52626d04 consensus state has no leader
I20260927 15:06:09.167491 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5de1bf320ca4043b31154380710ad79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.167497 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0795a9d7633f474d985758dabdc8c31a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.168116 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0795a9d7633f474d985758dabdc8c31a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.171156 1556 ts_tablet_manager.cc:1428] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:06:09.171460 1556 tablet_bootstrap.cc:492] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:09.173022 1556 tablet_bootstrap.cc:654] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:09.175565 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e32b9870eea4319b84145b46333ec98 consensus state has no leader
W20260927 15:06:09.177101 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e85b83758e44de4894d3101465bb47e consensus state has no leader
I20260927 15:06:09.183001 2223 raft_consensus.cc:504] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.183585 2223 leader_election.cc:288] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:09.184700 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6f6bdef4ddb4f9c9c0d1f933768cd14" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:09.185146 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6f6bdef4ddb4f9c9c0d1f933768cd14" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:09.185720 1376 leader_election.cc:341] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.186167 1164 raft_consensus.cc:2454] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:09.186601 1374 leader_election.cc:302] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:09.187233 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 048719b6bb41462e99ae942c52b2fcdd (DEFAULT_TABLE table=default.Table_40807a5ed0df43dd89c4d4a10827bb9b [id=af826da6faae4dc892a97ca367f902e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.187326 2223 raft_consensus.cc:2781] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:09.187454 2223 raft_consensus.cc:482] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:09.187541 2223 raft_consensus.cc:3037] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:09.188417 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048719b6bb41462e99ae942c52b2fcdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.190598 2223 raft_consensus.cc:504] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.187235 1275 tablet_service.cc:1467] Processing CreateTablet for tablet d9a3105b7cca4ac18b2c29c8b9dcda64 (DEFAULT_TABLE table=default.Table_2d1d3aacd61a41a3a18e1952d14a4314 [id=da01e8f647e447f79774f42e635188ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.191881 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 7dccaee87f314cbaa98d66e0bb885a8b (DEFAULT_TABLE table=default.Table_a5001fbf122c4ec18fe48ad0196e5b42 [id=bac9543f575d4b5182fb9b795ef53f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.191974 2223 leader_election.cc:288] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:09.192288 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dccaee87f314cbaa98d66e0bb885a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.193135 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6f6bdef4ddb4f9c9c0d1f933768cd14" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:09.193607 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6f6bdef4ddb4f9c9c0d1f933768cd14" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:09.195024 1376 leader_election.cc:341] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.196743 1276 tablet_service.cc:1467] Processing CreateTablet for tablet a18edad951474e9c87bd86ae1232055a (DEFAULT_TABLE table=default.Table_17d2558045b04f62a6d6b7952926e8b2 [id=847ee9ff6b41486c9a915672ebb47c6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.197108 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18edad951474e9c87bd86ae1232055a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.197127 1164 raft_consensus.cc:3037] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:09.194877 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 59cb392e91634113859027d5101620cb (DEFAULT_TABLE table=default.Table_88c0cf4bc1f74871ba507e8bd8ca7cbc [id=ecf2540e76024287a634bfc1a4744efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.197747 1281 tablet_service.cc:1467] Processing CreateTablet for tablet ac384537014a4a48952d12a447e56266 (DEFAULT_TABLE table=default.Table_b74ce51718e7413bb6e6657e638c8d49 [id=82e5e574d95f442fa4cbf560ebb7a101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.198100 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac384537014a4a48952d12a447e56266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.198103 1143 tablet_service.cc:1467] Processing CreateTablet for tablet d9a3105b7cca4ac18b2c29c8b9dcda64 (DEFAULT_TABLE table=default.Table_2d1d3aacd61a41a3a18e1952d14a4314 [id=da01e8f647e447f79774f42e635188ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.198362 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 048719b6bb41462e99ae942c52b2fcdd (DEFAULT_TABLE table=default.Table_40807a5ed0df43dd89c4d4a10827bb9b [id=af826da6faae4dc892a97ca367f902e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.198614 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59cb392e91634113859027d5101620cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.199914 1273 tablet_service.cc:1467] Processing CreateTablet for tablet b4fe2cf8b9954f398f559864b26277ca (DEFAULT_TABLE table=default.Table_f0c6627b22b6461fb4eb75c255a8fbac [id=24b6bddbbfeb45388777cc2d42699ed1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:09.201648 1102 consensus_peers.cc:487] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:09.201824 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 59cb392e91634113859027d5101620cb (DEFAULT_TABLE table=default.Table_88c0cf4bc1f74871ba507e8bd8ca7cbc [id=ecf2540e76024287a634bfc1a4744efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.202068 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 (DEFAULT_TABLE table=default.Table_db7331205e7f4b2f8b1e833b7ee59616 [id=ba1ffb0266b44449b98ef6a40e83ed46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.202191 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 7dccaee87f314cbaa98d66e0bb885a8b (DEFAULT_TABLE table=default.Table_a5001fbf122c4ec18fe48ad0196e5b42 [id=bac9543f575d4b5182fb9b795ef53f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.204809 912 catalog_manager.cc:5495] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:09.205302 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet ebb4e007cefa4f18bdaa461b43c5c810 (table default.Table_299a7e2d3b174b50b6f535e3971c1f35 [id=49e5a0fcbe0d48aa993446d112ed5d2b]). Expected version 2 got 0
I20260927 15:06:09.205585 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:09.207059 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d6afacbd3e04806862929e82e4bdeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.207474 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048719b6bb41462e99ae942c52b2fcdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.209656 1164 raft_consensus.cc:2454] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:09.209614 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 7dccaee87f314cbaa98d66e0bb885a8b (DEFAULT_TABLE table=default.Table_a5001fbf122c4ec18fe48ad0196e5b42 [id=bac9543f575d4b5182fb9b795ef53f3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.210073 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dccaee87f314cbaa98d66e0bb885a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.210114 1374 leader_election.cc:302] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:09.211138 1412 tablet_service.cc:1467] Processing CreateTablet for tablet a18edad951474e9c87bd86ae1232055a (DEFAULT_TABLE table=default.Table_17d2558045b04f62a6d6b7952926e8b2 [id=847ee9ff6b41486c9a915672ebb47c6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.211301 2223 raft_consensus.cc:2781] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:09.211490 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18edad951474e9c87bd86ae1232055a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.212984 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 83d8ff4f407245e881c2ffed3a4727bd (DEFAULT_TABLE table=default.Table_21609103889c418684f1607150049aba [id=f2f86a72b10c4a42a650ecad3894ce86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.214335 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 9011dcb105cd4d4f89921a300d18bab8 (DEFAULT_TABLE table=default.Table_c82ee61d4bf4403eb10b6ec67e0a455e [id=1fe788f293ea40a496eed535f3d20691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.215121 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 048719b6bb41462e99ae942c52b2fcdd (DEFAULT_TABLE table=default.Table_40807a5ed0df43dd89c4d4a10827bb9b [id=af826da6faae4dc892a97ca367f902e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.215469 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048719b6bb41462e99ae942c52b2fcdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.214723 1135 tablet_service.cc:1467] Processing CreateTablet for tablet e67cf0526f3c45718312508b306d7089 (DEFAULT_TABLE table=default.Table_05a4f0b59b034d37ad273d442100793d [id=423dc15d1ad845aa954c03ef105f4f4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.216308 1146 tablet_service.cc:1467] Processing CreateTablet for tablet ac384537014a4a48952d12a447e56266 (DEFAULT_TABLE table=default.Table_b74ce51718e7413bb6e6657e638c8d49 [id=82e5e574d95f442fa4cbf560ebb7a101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.216874 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a3105b7cca4ac18b2c29c8b9dcda64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.218549 1418 tablet_service.cc:1467] Processing CreateTablet for tablet ce1c286eea664e2a8ad6ebdf31bd4050 (DEFAULT_TABLE table=default.Table_5c0d2507a5ac46f1874f45430d2693cb [id=4ae6aafbd90c4f94b377094d4790d922]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.219102 1416 tablet_service.cc:1467] Processing CreateTablet for tablet d9a3105b7cca4ac18b2c29c8b9dcda64 (DEFAULT_TABLE table=default.Table_2d1d3aacd61a41a3a18e1952d14a4314 [id=da01e8f647e447f79774f42e635188ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.219637 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 59cb392e91634113859027d5101620cb (DEFAULT_TABLE table=default.Table_88c0cf4bc1f74871ba507e8bd8ca7cbc [id=ecf2540e76024287a634bfc1a4744efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.220377 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 66b419a684074a03876e3d9e86da80ae (DEFAULT_TABLE table=default.Table_f684293c235f49e08bb4eaae59e2fe77 [id=cd860a246e174921b6ea65f407372fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.220855 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7816e099094d13887650fc223097c7 with delete_type TABLET_DATA_DELETED (replaced by tablet c90e5c66d8564f68b401b3e4280499a7) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.221328 1410 tablet_service.cc:1467] Processing CreateTablet for tablet fd6a824a5a504c92992ceec1cd3eb2e7 (DEFAULT_TABLE table=default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.222216 1413 tablet_service.cc:1467] Processing CreateTablet for tablet e67cf0526f3c45718312508b306d7089 (DEFAULT_TABLE table=default.Table_05a4f0b59b034d37ad273d442100793d [id=423dc15d1ad845aa954c03ef105f4f4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.223142 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 (DEFAULT_TABLE table=default.Table_db7331205e7f4b2f8b1e833b7ee59616 [id=ba1ffb0266b44449b98ef6a40e83ed46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.223548 1420 tablet_service.cc:1467] Processing CreateTablet for tablet b4fe2cf8b9954f398f559864b26277ca (DEFAULT_TABLE table=default.Table_f0c6627b22b6461fb4eb75c255a8fbac [id=24b6bddbbfeb45388777cc2d42699ed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.225790 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce1c286eea664e2a8ad6ebdf31bd4050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.227977 2266 raft_consensus.cc:482] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.228219 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a3105b7cca4ac18b2c29c8b9dcda64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.228130 2266 raft_consensus.cc:504] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.229002 2266 leader_election.cc:288] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:09.232312 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59cb392e91634113859027d5101620cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.235661 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4fe2cf8b9954f398f559864b26277ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.236155 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e67cf0526f3c45718312508b306d7089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.238947 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66b419a684074a03876e3d9e86da80ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.238979 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9a3105b7cca4ac18b2c29c8b9dcda64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.241888 1552 tablet_bootstrap.cc:492] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:09.243008 2266 raft_consensus.cc:482] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.243075 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.243160 2266 raft_consensus.cc:504] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.243811 2266 leader_election.cc:288] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:09.245980 1270 tablet_service.cc:1467] Processing CreateTablet for tablet e67cf0526f3c45718312508b306d7089 (DEFAULT_TABLE table=default.Table_05a4f0b59b034d37ad273d442100793d [id=423dc15d1ad845aa954c03ef105f4f4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.248180 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd6a824a5a504c92992ceec1cd3eb2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.248697 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4fe2cf8b9954f398f559864b26277ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.247821 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7816e099094d13887650fc223097c7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:09.250020 1376 leader_election.cc:341] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.250346 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 66b419a684074a03876e3d9e86da80ae (DEFAULT_TABLE table=default.Table_f684293c235f49e08bb4eaae59e2fe77 [id=cd860a246e174921b6ea65f407372fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.261302 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 60d90561a3544e70b11f3f5a9bde39d2 (DEFAULT_TABLE table=default.Table_ac11c36acdcb479bb7b7430d8bec6a9e [id=97b3dc4a6e844dadbd1c0a5b33041a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.261377 1408 tablet_service.cc:1467] Processing CreateTablet for tablet ac384537014a4a48952d12a447e56266 (DEFAULT_TABLE table=default.Table_b74ce51718e7413bb6e6657e638c8d49 [id=82e5e574d95f442fa4cbf560ebb7a101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.261831 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac384537014a4a48952d12a447e56266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.264864 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d8e4a9d0dbcb49878bf7891e8e712915" } new_table_name: "default.Table_ca8c876717e746a68e817e519f5790d1" modify_external_catalogs: true
I20260927 15:06:09.265421 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3ead517549924f16a90ea7b24b577ad0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.266089 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ead517549924f16a90ea7b24b577ad0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.277678 2223 raft_consensus.cc:686] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:09.293362 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 66b419a684074a03876e3d9e86da80ae (DEFAULT_TABLE table=default.Table_f684293c235f49e08bb4eaae59e2fe77 [id=cd860a246e174921b6ea65f407372fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.284648 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 9011dcb105cd4d4f89921a300d18bab8 (DEFAULT_TABLE table=default.Table_c82ee61d4bf4403eb10b6ec67e0a455e [id=1fe788f293ea40a496eed535f3d20691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.295786 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9011dcb105cd4d4f89921a300d18bab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.286983 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 83d8ff4f407245e881c2ffed3a4727bd (DEFAULT_TABLE table=default.Table_21609103889c418684f1607150049aba [id=f2f86a72b10c4a42a650ecad3894ce86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.297581 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83d8ff4f407245e881c2ffed3a4727bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.290562 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 60d90561a3544e70b11f3f5a9bde39d2 (DEFAULT_TABLE table=default.Table_ac11c36acdcb479bb7b7430d8bec6a9e [id=97b3dc4a6e844dadbd1c0a5b33041a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.299892 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60d90561a3544e70b11f3f5a9bde39d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.289153 2223 consensus_queue.cc:237] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.303509 1278 tablet_service.cc:1467] Processing CreateTablet for tablet fd6a824a5a504c92992ceec1cd3eb2e7 (DEFAULT_TABLE table=default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.305745 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 9011dcb105cd4d4f89921a300d18bab8 (DEFAULT_TABLE table=default.Table_c82ee61d4bf4403eb10b6ec67e0a455e [id=1fe788f293ea40a496eed535f3d20691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.307353 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6f179aab784ae4822356e63332532f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:09.308400 1376 leader_election.cc:341] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.278280 2233 ts_tablet_manager.cc:1918] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:09.313489 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 (DEFAULT_TABLE table=default.Table_db7331205e7f4b2f8b1e833b7ee59616 [id=ba1ffb0266b44449b98ef6a40e83ed46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.313673 1134 tablet_service.cc:1467] Processing CreateTablet for tablet a18edad951474e9c87bd86ae1232055a (DEFAULT_TABLE table=default.Table_17d2558045b04f62a6d6b7952926e8b2 [id=847ee9ff6b41486c9a915672ebb47c6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.316303 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6f179aab784ae4822356e63332532f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:09.316980 1145 tablet_service.cc:1467] Processing CreateTablet for tablet b4fe2cf8b9954f398f559864b26277ca (DEFAULT_TABLE table=default.Table_f0c6627b22b6461fb4eb75c255a8fbac [id=24b6bddbbfeb45388777cc2d42699ed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.317500 1561 tablet_bootstrap.cc:492] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:09.318049 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83d8ff4f407245e881c2ffed3a4727bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.318331 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4fe2cf8b9954f398f559864b26277ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:09.318781 1099 consensus_peers.cc:487] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f585bcdadbcc4032aa484481cdf94b72. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:09.318962 1132 tablet_service.cc:1467] Processing CreateTablet for tablet fd6a824a5a504c92992ceec1cd3eb2e7 (DEFAULT_TABLE table=default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:09.319964 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 66987.2us
I20260927 15:06:09.320700 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dccaee87f314cbaa98d66e0bb885a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.319743 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 60d90561a3544e70b11f3f5a9bde39d2 (DEFAULT_TABLE table=default.Table_ac11c36acdcb479bb7b7430d8bec6a9e [id=97b3dc4a6e844dadbd1c0a5b33041a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.323547 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7816e099094d13887650fc223097c7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:09.324198 1561 ts_tablet_manager.cc:1397] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.413s user 0.003s sys 0.010s
I20260927 15:06:09.325181 1561 raft_consensus.cc:348] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.325516 1561 raft_consensus.cc:374] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.325642 1561 raft_consensus.cc:729] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.325991 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 83d8ff4f407245e881c2ffed3a4727bd (DEFAULT_TABLE table=default.Table_21609103889c418684f1607150049aba [id=f2f86a72b10c4a42a650ecad3894ce86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.326292 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60d90561a3544e70b11f3f5a9bde39d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.326403 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59cb392e91634113859027d5101620cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.332059 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.325996 1561 consensus_queue.cc:260] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.335404 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac384537014a4a48952d12a447e56266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.336771 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83d8ff4f407245e881c2ffed3a4727bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.336796 2119 ts_tablet_manager.cc:1918] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:09.338171 1561 ts_tablet_manager.cc:1428] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260927 15:06:09.339704 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.342420 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e67cf0526f3c45718312508b306d7089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.343578 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66b419a684074a03876e3d9e86da80ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.346175 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd6a824a5a504c92992ceec1cd3eb2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.347227 2119 log.cc:1196] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/f1d7a98ffc4745ac8eeb93012b55d417
I20260927 15:06:09.350908 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60d90561a3544e70b11f3f5a9bde39d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.356882 2119 ts_tablet_manager.cc:1939] T f1d7a98ffc4745ac8eeb93012b55d417 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:09.358481 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet f1d7a98ffc4745ac8eeb93012b55d417 (table default.Table_af607bdf84604e1d89e4b679360ed558 [id=5928f9637b7c4e569baf987137d28383]) successfully deleted
W20260927 15:06:09.359294 1374 leader_election.cc:341] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.359521 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9011dcb105cd4d4f89921a300d18bab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.360440 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9011dcb105cd4d4f89921a300d18bab8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:09.361704 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 278205071701447e8ee7457b2ee84be4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 278205071701447e8ee7457b2ee84be4 already in progress: creating tablet
I20260927 15:06:09.362413 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e67cf0526f3c45718312508b306d7089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.363615 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_46dca94ff3b742a4824f603969067b1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:09.363857 1561 tablet_bootstrap.cc:492] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:09.364319 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46dca94ff3b742a4824f603969067b1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.368896 2119 tablet_replica.cc:330] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:09.369575 2119 raft_consensus.cc:2229] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:09.369808 2119 raft_consensus.cc:2258] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.373992 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b19ddd29d7214931ad797497a0178544
I20260927 15:06:09.375445 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet b19ddd29d7214931ad797497a0178544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.377241 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dfc10f0ce8074b3c83e6388a718d8e4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.377766 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfc10f0ce8074b3c83e6388a718d8e4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.382066 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a8659865bf644458b3b5a78eae36a524
I20260927 15:06:09.382148 2233 log.cc:1196] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/b375902081c54cdb84fdb075eec6baf7
I20260927 15:06:09.383634 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a0ae944503394570920bd86171112fe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.384249 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0ae944503394570920bd86171112fe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.384539 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet cd901034653b47dbba7912d5338bc3bb with delete_type TABLET_DATA_DELETED (replaced by tablet 0d4ca19b492c4df1b31c78f1629c50b5) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.384889 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet a8659865bf644458b3b5a78eae36a524 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.385814 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f86725bd5d5247faa0dff164857629d3
I20260927 15:06:09.386439 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5e1d680b47b249bab5ff802cf85872ed" } new_table_name: "default.Table_ec640fa361004c6b9085d7a973b5970f" modify_external_catalogs: true
I20260927 15:06:09.386955 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_31dca477abed4b759a1ba843dc46238a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.387547 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31dca477abed4b759a1ba843dc46238a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.387956 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 81e0be77dff645f795237ffe779ed684
I20260927 15:06:09.388327 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet f86725bd5d5247faa0dff164857629d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.388618 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_efcf68a067bf4d34bae3e0859d6f1a38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:09.388999 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 81e0be77dff645f795237ffe779ed684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:09.389142 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efcf68a067bf4d34bae3e0859d6f1a38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.389120 1552 ts_tablet_manager.cc:1397] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.402s user 0.012s sys 0.007s
I20260927 15:06:09.389400 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66b419a684074a03876e3d9e86da80ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.390467 1374 leader_election.cc:302] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:09.393589 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 81f65ad693894e7c8b575cd8e1942c14
I20260927 15:06:09.396028 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b06cc424b97d4014bafbcffe9807c8d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.396627 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b06cc424b97d4014bafbcffe9807c8d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.401571 1556 tablet_bootstrap.cc:492] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:09.406034 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_354a1c885d164986846d086d406d5d40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.406642 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_354a1c885d164986846d086d406d5d40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.414177 908 master_service.cc:946] ReplaceTablet: received request to replace tablet bc20a62bbd484c4e9e25cf1c15e1dde0 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:09.415505 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_38f43f60e5ff4f65804ded14f7d99410" } new_table_name: "default.Table_8341b16295ad4e1891741ae8dd63bf3a" modify_external_catalogs: true
I20260927 15:06:09.418784 2281 raft_consensus.cc:2726] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:09.419970 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_68916c1b40d644d9846b0a85f7a075ce" } new_table_name: "default.Table_fb1ec2ad14a54339a8ded2628758b6ce" modify_external_catalogs: true
I20260927 15:06:09.420454 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b5af446327ee4e9e8a927bd0ac84a8ba" } new_table_name: "default.Table_4e10fab03983407786ee13b92602fb52" modify_external_catalogs: true
I20260927 15:06:09.430636 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_762b6b45a11f476c9aee7e80c706ee9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:09.431166 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 0d6523d56f344208abc30f0d82138998 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:09.431257 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_762b6b45a11f476c9aee7e80c706ee9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.436259 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f65ad693894e7c8b575cd8e1942c14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.441774 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet b19ddd29d7214931ad797497a0178544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.442046 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd6a824a5a504c92992ceec1cd3eb2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.442097 1556 ts_tablet_manager.cc:1397] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.230s user 0.004s sys 0.008s
I20260927 15:06:09.442340 2233 ts_tablet_manager.cc:1939] T b375902081c54cdb84fdb075eec6baf7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:09.443272 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f65ad693894e7c8b575cd8e1942c14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.443511 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7816e099094d13887650fc223097c7 with delete_type TABLET_DATA_DELETED (replaced by tablet c90e5c66d8564f68b401b3e4280499a7) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.445230 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet b375902081c54cdb84fdb075eec6baf7 (table default.Table_1b1639fc47724907a79f94e34f6b9469 [id=8be5c577dcb3490d883bede28c6b73ea]) successfully deleted
W20260927 15:06:09.445976 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 77680.4us
W20260927 15:06:09.446559 1374 leader_election.cc:341] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.446723 1374 leader_election.cc:302] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:09.447113 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet f86725bd5d5247faa0dff164857629d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.447599 2281 raft_consensus.cc:2726] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:09.447800 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet a8659865bf644458b3b5a78eae36a524 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.447976 2233 tablet_replica.cc:330] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:09.448182 2233 raft_consensus.cc:2229] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:09.448355 2233 raft_consensus.cc:2258] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.448940 2233 ts_tablet_manager.cc:1905] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:09.450265 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 81e0be77dff645f795237ffe779ed684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.459815 2119 ts_tablet_manager.cc:1905] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:09.461261 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet b19ddd29d7214931ad797497a0178544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.465818 1552 raft_consensus.cc:348] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.468911 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet a8659865bf644458b3b5a78eae36a524 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.470566 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 81e0be77dff645f795237ffe779ed684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.472153 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f65ad693894e7c8b575cd8e1942c14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.474628 1561 tablet_bootstrap.cc:654] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.480136 1556 raft_consensus.cc:348] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.480376 1556 raft_consensus.cc:374] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.480468 1556 raft_consensus.cc:729] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.480667 1556 consensus_queue.cc:260] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.481235 1556 ts_tablet_manager.cc:1428] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
I20260927 15:06:09.481518 1556 tablet_bootstrap.cc:492] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:09.483315 1556 tablet_bootstrap.cc:654] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.487910 1552 raft_consensus.cc:374] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:09.490192 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 99d4707e599840b3bdc2ab13c348ea80 consensus state has no leader
W20260927 15:06:09.491534 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b14f02426df4839b98f012042d8ee9b consensus state has no leader
I20260927 15:06:09.494722 1552 raft_consensus.cc:729] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:09.504376 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1770acc612f4924ba62ee20767a31c1 consensus state has no leader
W20260927 15:06:09.505470 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49f6f839939042838a24e234a21eacb6 consensus state has no leader
W20260927 15:06:09.506278 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 921db5dbe31a4d0381bdd823cb497424 consensus state has no leader
I20260927 15:06:09.507202 1562 ts_tablet_manager.cc:1918] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:09.507508 1562 log.cc:1196] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/45b610025b1a4b68bdc34f870654f9d1
I20260927 15:06:09.509219 1552 consensus_queue.cc:260] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.523798 1552 ts_tablet_manager.cc:1428] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.135s user 0.000s sys 0.003s
I20260927 15:06:09.526600 1552 tablet_bootstrap.cc:492] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:09.536638 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d454d65afa94aac9b34c253adfa4b0c with delete_type TABLET_DATA_DELETED (replaced by tablet 171ba98418b34aa283b7a7b243678fa9) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.543215 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet f86725bd5d5247faa0dff164857629d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.547289 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a18edad951474e9c87bd86ae1232055a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.577009 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f8b73341b24f4b28841b59c55d6c05a9" } modify_external_catalogs: true
I20260927 15:06:09.578243 2223 raft_consensus.cc:482] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.577749 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f8b73341b24f4b28841b59c55d6c05a9" } modify_external_catalogs: true
I20260927 15:06:09.578472 2223 raft_consensus.cc:504] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.579141 2223 leader_election.cc:288] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:09.579393 910 master_service.cc:946] ReplaceTablet: received request to replace tablet bda4bc28542d4b5e9cb1b432e5cf54d7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:09.579613 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb0ab983a444d26b903a0cec64f15f0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:09.580183 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb0ab983a444d26b903a0cec64f15f0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:09.580256 1376 leader_election.cc:341] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:09.580955 1374 leader_election.cc:341] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.581099 1374 leader_election.cc:302] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:09.581612 2223 raft_consensus.cc:2726] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:09.585419 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8596eafa3f184547be9ba74b2f833afe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.586030 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8596eafa3f184547be9ba74b2f833afe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.587433 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81fc47a80ea6475cacc27b37367105f4" } modify_external_catalogs: true
I20260927 15:06:09.587625 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81fc47a80ea6475cacc27b37367105f4" } modify_external_catalogs: true
I20260927 15:06:09.588886 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fac248ae4718435c9ec9d479beaaeae4" } modify_external_catalogs: true
I20260927 15:06:09.589111 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fac248ae4718435c9ec9d479beaaeae4" } modify_external_catalogs: true
I20260927 15:06:09.589679 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0992c54eabeb45b19758c9660f2de1f7" } modify_external_catalogs: true
I20260927 15:06:09.589902 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0992c54eabeb45b19758c9660f2de1f7" } modify_external_catalogs: true
W20260927 15:06:09.591642 1514 log.cc:924] Time spent T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260927 15:06:09.596629 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5c5b46d2dba044ef8c5bb41023e108ee" } modify_external_catalogs: true
I20260927 15:06:09.596846 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5c5b46d2dba044ef8c5bb41023e108ee" } modify_external_catalogs: true
W20260927 15:06:09.596879 2135 log.cc:924] Time spent T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
I20260927 15:06:09.597711 1562 ts_tablet_manager.cc:1939] T 45b610025b1a4b68bdc34f870654f9d1 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:09.606321 1561 tablet_bootstrap.cc:492] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:09.606527 1561 ts_tablet_manager.cc:1397] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.267s user 0.010s sys 0.002s
I20260927 15:06:09.607685 1561 raft_consensus.cc:348] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.608059 1561 raft_consensus.cc:374] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.608176 1561 raft_consensus.cc:729] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.608435 1561 consensus_queue.cc:260] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.609683 1556 tablet_bootstrap.cc:492] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:09.609889 1556 ts_tablet_manager.cc:1397] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.128s user 0.003s sys 0.004s
I20260927 15:06:09.611275 1556 raft_consensus.cc:348] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.611546 1556 raft_consensus.cc:374] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.611640 1556 raft_consensus.cc:729] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.612026 1556 consensus_queue.cc:260] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.617624 1556 ts_tablet_manager.cc:1428] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.008s user 0.000s sys 0.004s
I20260927 15:06:09.617882 1552 tablet_bootstrap.cc:654] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.618031 1556 tablet_bootstrap.cc:492] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:09.624621 1561 ts_tablet_manager.cc:1428] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260927 15:06:09.625136 1561 tablet_bootstrap.cc:492] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:09.627111 1561 tablet_bootstrap.cc:654] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.632529 906 catalog_manager.cc:5495] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:09.633111 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14 (table default.Table_bf61e56b4709425c99c5a22da57ddba9 [id=9ac1472258a24d01892257dd9c9874a8]). Expected version 1 got 0
I20260927 15:06:09.634197 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 31b8ad6c423443c7b1ef95dba6273af5 (DEFAULT_TABLE table=default.Table_6406a4cb5c1b4f18b8d482f820949cad [id=04c40e33d9494795a12c40b7b0879b66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.634773 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 8eeb4f55d0c6431cb1cff629cced4562 (DEFAULT_TABLE table=default.Table_ea141cf06d87453b9f5a4a68d8bfc5e8 [id=8f7b3486c25f48c6be265721aa844799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.635296 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2a9378aa46462b97906be25df8d90f (DEFAULT_TABLE table=default.Table_72b3658396124482993401cff12bf063 [id=47c0ab6196c84904a78a1fa4e2669843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.635499 1556 tablet_bootstrap.cc:654] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.635551 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 31b8ad6c423443c7b1ef95dba6273af5 (DEFAULT_TABLE table=default.Table_6406a4cb5c1b4f18b8d482f820949cad [id=04c40e33d9494795a12c40b7b0879b66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.635739 1283 tablet_service.cc:1467] Processing CreateTablet for tablet c683222276154ebd8855982393c4b782 (DEFAULT_TABLE table=default.Table_9ab7a25d863f493e81a9717e0f3693a0 [id=753754c20f5c483f9eb7566fe7c1568e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.636122 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2a9378aa46462b97906be25df8d90f (DEFAULT_TABLE table=default.Table_72b3658396124482993401cff12bf063 [id=47c0ab6196c84904a78a1fa4e2669843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.636698 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 8eeb4f55d0c6431cb1cff629cced4562 (DEFAULT_TABLE table=default.Table_ea141cf06d87453b9f5a4a68d8bfc5e8 [id=8f7b3486c25f48c6be265721aa844799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.637048 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 4fc6b5ac75b2436a96fd5fb00d575a99 (DEFAULT_TABLE table=default.Table_957e53d26f194ff3aae5a94f8ef7558e [id=9a4179f71c094e8694bb30f4016e6b5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.637157 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 4fc6b5ac75b2436a96fd5fb00d575a99 (DEFAULT_TABLE table=default.Table_957e53d26f194ff3aae5a94f8ef7558e [id=9a4179f71c094e8694bb30f4016e6b5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.637456 1279 tablet_service.cc:1467] Processing CreateTablet for tablet a6852cc3f94a40779799beb772b3d34d (DEFAULT_TABLE table=default.Table_63c6bb3ab2a94fbd978bfb8ad64439ef [id=4fbf95d52d864e4d8e7849c39f4484de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.637579 1401 tablet_service.cc:1467] Processing CreateTablet for tablet a6852cc3f94a40779799beb772b3d34d (DEFAULT_TABLE table=default.Table_63c6bb3ab2a94fbd978bfb8ad64439ef [id=4fbf95d52d864e4d8e7849c39f4484de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.638733 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 1d25749db81f4631bbc1e5581bcc666e (DEFAULT_TABLE table=default.Table_802f770c469d4f3daa131645340e456c [id=61c52ff0e4cc4ca986967f5c87aade48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.639063 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 1d25749db81f4631bbc1e5581bcc666e (DEFAULT_TABLE table=default.Table_802f770c469d4f3daa131645340e456c [id=61c52ff0e4cc4ca986967f5c87aade48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.639370 1413 tablet_service.cc:1467] Processing CreateTablet for tablet c7455fb85a5140f29b2eee890c2f3d70 (DEFAULT_TABLE table=default.Table_e94758535baf48a9ba2a7e5fe62c32a3 [id=4738bce62798442c83dccf0582a30e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.639384 1282 tablet_service.cc:1467] Processing CreateTablet for tablet c7455fb85a5140f29b2eee890c2f3d70 (DEFAULT_TABLE table=default.Table_e94758535baf48a9ba2a7e5fe62c32a3 [id=4738bce62798442c83dccf0582a30e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.642796 1402 tablet_service.cc:1467] Processing CreateTablet for tablet c683222276154ebd8855982393c4b782 (DEFAULT_TABLE table=default.Table_9ab7a25d863f493e81a9717e0f3693a0 [id=753754c20f5c483f9eb7566fe7c1568e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.643419 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 466) took 3876 ms. Trace:
I20260927 15:06:09.643560 1562 rpcz_store.cc:276] 0927 15:06:05.767399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.774886 (+ 7487us) service_pool.cc:227] Handling call
0927 15:06:08.920744 (+3145858us) ts_tablet_manager.cc:1145] Deleting tablet 45b610025b1a4b68bdc34f870654f9d1
0927 15:06:08.920757 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:09.125686 (+204929us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:09.392108 (+266422us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:09.643359 (+251251us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3145664}
I20260927 15:06:09.644073 1562 tablet_replica.cc:330] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:09.644326 1562 raft_consensus.cc:2229] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:09.644622 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d891902bcffb4a3f922e337a2a8700f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.645224 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d891902bcffb4a3f922e337a2a8700f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.645610 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_374aa939b215469a9f9e7a9aaacbd512"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.646099 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_374aa939b215469a9f9e7a9aaacbd512 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.644512 1562 raft_consensus.cc:2258] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.649657 1562 ts_tablet_manager.cc:1905] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:09.659361 1146 tablet_service.cc:1467] Processing CreateTablet for tablet c683222276154ebd8855982393c4b782 (DEFAULT_TABLE table=default.Table_9ab7a25d863f493e81a9717e0f3693a0 [id=753754c20f5c483f9eb7566fe7c1568e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.660679 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 31b8ad6c423443c7b1ef95dba6273af5 (DEFAULT_TABLE table=default.Table_6406a4cb5c1b4f18b8d482f820949cad [id=04c40e33d9494795a12c40b7b0879b66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.661741 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bda4bc28542d4b5e9cb1b432e5cf54d7
I20260927 15:06:09.661935 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2a9378aa46462b97906be25df8d90f (DEFAULT_TABLE table=default.Table_72b3658396124482993401cff12bf063 [id=47c0ab6196c84904a78a1fa4e2669843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.662017 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0d6523d56f344208abc30f0d82138998
I20260927 15:06:09.662215 910 catalog_manager.cc:6565] ReplaceTablet: tablet bda4bc28542d4b5e9cb1b432e5cf54d7 deleted and replaced by tablet 997c93bdf78b49709130d97a8d96a5a5
I20260927 15:06:09.662425 911 catalog_manager.cc:6565] ReplaceTablet: tablet 0d6523d56f344208abc30f0d82138998 deleted and replaced by tablet e40561ea6c2d4c6b856b3f123e337f64
I20260927 15:06:09.662603 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 8eeb4f55d0c6431cb1cff629cced4562 (DEFAULT_TABLE table=default.Table_ea141cf06d87453b9f5a4a68d8bfc5e8 [id=8f7b3486c25f48c6be265721aa844799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.662876 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7793a5b390d94f01a929468eb8c47e80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:09.663226 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 4fc6b5ac75b2436a96fd5fb00d575a99 (DEFAULT_TABLE table=default.Table_957e53d26f194ff3aae5a94f8ef7558e [id=9a4179f71c094e8694bb30f4016e6b5d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:09.663483 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7793a5b390d94f01a929468eb8c47e80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.663863 1130 tablet_service.cc:1467] Processing CreateTablet for tablet a6852cc3f94a40779799beb772b3d34d (DEFAULT_TABLE table=default.Table_63c6bb3ab2a94fbd978bfb8ad64439ef [id=4fbf95d52d864e4d8e7849c39f4484de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.664621 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_89ea2bd565d14ef38215685627826f0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:09.664762 1143 tablet_service.cc:1467] Processing CreateTablet for tablet c7455fb85a5140f29b2eee890c2f3d70 (DEFAULT_TABLE table=default.Table_e94758535baf48a9ba2a7e5fe62c32a3 [id=4738bce62798442c83dccf0582a30e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.665097 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3a47c42f9edd4e1ab761317b7b58e8df
W20260927 15:06:09.665179 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89ea2bd565d14ef38215685627826f0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.665349 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 1d25749db81f4631bbc1e5581bcc666e (DEFAULT_TABLE table=default.Table_802f770c469d4f3daa131645340e456c [id=61c52ff0e4cc4ca986967f5c87aade48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.665800 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet b375902081c54cdb84fdb075eec6baf7 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f4cff4a06db44269defca578af289d8) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.665812 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_912bad2648f24770970d14968ca68a96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.666278 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_912bad2648f24770970d14968ca68a96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.667070 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 610ff6563dc64e73b2b4d7c268468b21
W20260927 15:06:09.667615 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 921db5dbe31a4d0381bdd823cb497424 (table default.Table_fb1ec2ad14a54339a8ded2628758b6ce [id=b11f83d1010940d5bbd03efa06497202], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 921db5dbe31a4d0381bdd823cb497424 consensus state has no leader
I20260927 15:06:09.668550 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 01b7e017ead242849585679873a69b43
I20260927 15:06:09.670722 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet bda4bc28542d4b5e9cb1b432e5cf54d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 997c93bdf78b49709130d97a8d96a5a5) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.671047 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d6523d56f344208abc30f0d82138998 with delete_type TABLET_DATA_DELETED (replaced by tablet e40561ea6c2d4c6b856b3f123e337f64) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.671275 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a47c42f9edd4e1ab761317b7b58e8df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.671458 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 610ff6563dc64e73b2b4d7c268468b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.671630 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b7e017ead242849585679873a69b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.672494 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b9a97e3e6a5749feb4dd5f835d9c01ac
I20260927 15:06:09.675966 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet bda4bc28542d4b5e9cb1b432e5cf54d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 997c93bdf78b49709130d97a8d96a5a5) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.676568 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet b9a97e3e6a5749feb4dd5f835d9c01ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.677879 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d6523d56f344208abc30f0d82138998 with delete_type TABLET_DATA_DELETED (replaced by tablet e40561ea6c2d4c6b856b3f123e337f64) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.677987 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ddfb62d579704b30a3482b7f95be4922
I20260927 15:06:09.678447 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a47c42f9edd4e1ab761317b7b58e8df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.678959 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 610ff6563dc64e73b2b4d7c268468b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.679364 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b7e017ead242849585679873a69b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.679620 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet bda4bc28542d4b5e9cb1b432e5cf54d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 997c93bdf78b49709130d97a8d96a5a5) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.679759 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet b9a97e3e6a5749feb4dd5f835d9c01ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.679950 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a47c42f9edd4e1ab761317b7b58e8df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.680153 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 610ff6563dc64e73b2b4d7c268468b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.680223 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet ddfb62d579704b30a3482b7f95be4922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.680317 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d6523d56f344208abc30f0d82138998 with delete_type TABLET_DATA_DELETED (replaced by tablet e40561ea6c2d4c6b856b3f123e337f64) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.680349 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb0ab983a444d26b903a0cec64f15f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ae003f1ca76472cbaa8b577b66fe84c) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.680599 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet ddfb62d579704b30a3482b7f95be4922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.681087 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet b9a97e3e6a5749feb4dd5f835d9c01ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.681926 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet ddfb62d579704b30a3482b7f95be4922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.682158 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b7e017ead242849585679873a69b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.686015 1561 tablet_bootstrap.cc:492] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:09.686309 1561 ts_tablet_manager.cc:1397] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.004s
I20260927 15:06:09.688230 1561 raft_consensus.cc:348] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.691166 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7010193aed1b4921aeea88b83565050e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.689805 1102 consensus_peers.cc:487] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:09.691694 1436 raft_consensus.cc:1261] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Refusing update from remote peer c4264874db964ff2830b7894c2b3d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260927 15:06:09.692327 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7010193aed1b4921aeea88b83565050e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:09.694224 1099 consensus_peers.cc:487] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:09.694695 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_26486391140d4bc0922b79f92fbd5dce" } new_table_name: "default.Table_0ec92996e56b40ccb42f05e74a483762" modify_external_catalogs: true
I20260927 15:06:09.694844 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_93ff0be74d8c494e902ce0f7d5b74150" } new_table_name: "default.Table_9d80b52d671c4ba582ca662849267880" modify_external_catalogs: true
I20260927 15:06:09.696612 1556 tablet_bootstrap.cc:492] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:09.697525 2233 ts_tablet_manager.cc:1918] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:09.697654 2233 log.cc:1196] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/2afab8bf87bc45c899bcd5dfdad48d26
I20260927 15:06:09.696748 1556 ts_tablet_manager.cc:1397] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.004s
I20260927 15:06:09.697996 2233 ts_tablet_manager.cc:1939] T 2afab8bf87bc45c899bcd5dfdad48d26 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:09.698843 1556 raft_consensus.cc:348] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.699056 1556 raft_consensus.cc:374] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.699108 1556 raft_consensus.cc:729] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.699167 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c683222276154ebd8855982393c4b782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.699317 1556 consensus_queue.cc:260] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.699551 1561 raft_consensus.cc:374] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.699653 1561 raft_consensus.cc:729] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.699820 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b8ad6c423443c7b1ef95dba6273af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.700011 1561 consensus_queue.cc:260] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.700314 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2a9378aa46462b97906be25df8d90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.700786 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eeb4f55d0c6431cb1cff629cced4562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.701231 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fc6b5ac75b2436a96fd5fb00d575a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.701673 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6852cc3f94a40779799beb772b3d34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.702090 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7455fb85a5140f29b2eee890c2f3d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.702500 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d25749db81f4631bbc1e5581bcc666e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.706130 1556 ts_tablet_manager.cc:1428] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 15:06:09.707106 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b8ad6c423443c7b1ef95dba6273af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.707348 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8a6f153903cc41eeae108d5aeca2aa61" } new_table_name: "default.Table_d10e6eb8078c475abd696473005670a3" modify_external_catalogs: true
I20260927 15:06:09.707669 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d25749db81f4631bbc1e5581bcc666e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.708094 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fc6b5ac75b2436a96fd5fb00d575a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.708418 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7455fb85a5140f29b2eee890c2f3d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.708791 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2a9378aa46462b97906be25df8d90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.709295 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eeb4f55d0c6431cb1cff629cced4562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.709671 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6852cc3f94a40779799beb772b3d34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.709550 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_de460bc61353426699a8c19e69f38a36" } new_table_name: "default.Table_2a3783599083430997da0fb4ef464c56" modify_external_catalogs: true
I20260927 15:06:09.709648 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_46dca94ff3b742a4824f603969067b1f" } new_table_name: "default.Table_e71b1a0c323c48e09d9f20338ddd3f80" modify_external_catalogs: true
I20260927 15:06:09.710632 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c683222276154ebd8855982393c4b782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.711985 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet c49913b1763c4a7b9413a801aff93b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.713150 1556 tablet_bootstrap.cc:492] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:09.714391 2288 raft_consensus.cc:482] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.714582 2288 raft_consensus.cc:504] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.715375 2288 leader_election.cc:288] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:09.715658 2288 consensus_queue.cc:1035] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:09.716143 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd901034653b47dbba7912d5338bc3bb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:09.717181 1102 leader_election.cc:341] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.719067 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8eeb4f55d0c6431cb1cff629cced4562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.720112 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6852cc3f94a40779799beb772b3d34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.720333 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2a9378aa46462b97906be25df8d90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.721519 2233 tablet_replica.cc:330] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:09.721726 2233 raft_consensus.cc:2229] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:09.721872 2233 raft_consensus.cc:2258] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.723016 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 2afab8bf87bc45c899bcd5dfdad48d26 (table default.Table_a04a6074db084291834a75d52898cf4b [id=15103ee5ddc04d809af8930de02a7d24]) successfully deleted
I20260927 15:06:09.731814 2288 raft_consensus.cc:482] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.732132 2288 raft_consensus.cc:504] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.733515 2288 leader_election.cc:288] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:09.734771 1556 tablet_bootstrap.cc:654] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.739037 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7816e099094d13887650fc223097c7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:09.739305 1433 raft_consensus.cc:2454] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:09.739391 2233 ts_tablet_manager.cc:1905] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:09.739763 1099 leader_election.cc:302] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:09.741010 2289 raft_consensus.cc:2781] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:09.741225 2289 raft_consensus.cc:482] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:09.741422 2289 raft_consensus.cc:3037] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:09.743500 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2116f8e5cf2142249d0b5f3fdbf0b209"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.744144 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2116f8e5cf2142249d0b5f3fdbf0b209 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.746258 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f5fc14b511cb4c4ba6a023f692f00c9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.748153 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5fc14b511cb4c4ba6a023f692f00c9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:09.752437 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f5c8e8865a34f01addbb505cf777a0d consensus state has no leader
W20260927 15:06:09.756666 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4470df4cd407401ab03b6f62452c0dc7 consensus state has no leader
W20260927 15:06:09.757894 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d05f7db323e40b780b050b560e1c846 consensus state has no leader
W20260927 15:06:09.767303 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f34ce3980286489c87fdde92fb045607 has no consensus state
W20260927 15:06:09.772541 804 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu pid 951: Timed out: CheckLeaks RPC to 127.0.201.60:46799 timed out after 1.000s (SENT)
I20260927 15:06:09.772739 804 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu with pid 951
I20260927 15:06:09.776651 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 643ec85d098444d6b082fe4038c50c4d from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:09.782627 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 9598ac8a916f4bf5b1cf9995a8149c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.782953 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b8ad6c423443c7b1ef95dba6273af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.783278 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c683222276154ebd8855982393c4b782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.784364 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d25749db81f4631bbc1e5581bcc666e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.786649 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7816e099094d13887650fc223097c7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:09.740792 1099 leader_election.cc:341] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: cd901034653b47dbba7912d5338bc3bb
W20260927 15:06:09.789143 1102 leader_election.cc:341] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.793620 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7455fb85a5140f29b2eee890c2f3d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.794452 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fc6b5ac75b2436a96fd5fb00d575a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.802440 2289 raft_consensus.cc:504] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.803166 2233 ts_tablet_manager.cc:1918] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:09.803330 2233 log.cc:1196] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/1b045b82515540e8813f9250726479e5
I20260927 15:06:09.803987 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7816e099094d13887650fc223097c7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:09.804757 2233 ts_tablet_manager.cc:1939] T 1b045b82515540e8813f9250726479e5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:09.813004 1556 tablet_bootstrap.cc:492] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:09.813160 1556 ts_tablet_manager.cc:1397] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.100s user 0.002s sys 0.010s
I20260927 15:06:09.813979 1556 raft_consensus.cc:348] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.814209 1556 raft_consensus.cc:374] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.814260 1556 raft_consensus.cc:729] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.814473 1556 consensus_queue.cc:260] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.815007 2289 leader_election.cc:288] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:09.815259 1102 leader_election.cc:341] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.816560 1552 tablet_bootstrap.cc:492] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:09.816735 1552 ts_tablet_manager.cc:1397] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.292s user 0.005s sys 0.006s
I20260927 15:06:09.817548 1552 raft_consensus.cc:348] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.817792 1552 raft_consensus.cc:374] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.817878 1552 raft_consensus.cc:729] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.818077 1552 consensus_queue.cc:260] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.818610 1552 ts_tablet_manager.cc:1428] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:09.818969 1552 tablet_bootstrap.cc:492] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:09.823311 908 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet ebb4e007cefa4f18bdaa461b43c5c810 (table default.Table_299a7e2d3b174b50b6f535e3971c1f35 [id=49e5a0fcbe0d48aa993446d112ed5d2b]). Expected version 2 got 0
I20260927 15:06:09.825918 1562 ts_tablet_manager.cc:1918] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:09.829372 1562 log.cc:1196] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/109f9088371e4f008b2b5f993f2b4c3b
I20260927 15:06:09.830116 1562 ts_tablet_manager.cc:1939] T 109f9088371e4f008b2b5f993f2b4c3b P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:09.836042 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e690924686a146e18b23b31b4da1470e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.836668 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e690924686a146e18b23b31b4da1470e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.841697 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 643ec85d098444d6b082fe4038c50c4d
I20260927 15:06:09.842170 910 catalog_manager.cc:6565] ReplaceTablet: tablet 643ec85d098444d6b082fe4038c50c4d deleted and replaced by tablet 9a695b4fd5294f32a6644154487c1486
I20260927 15:06:09.843016 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 643ec85d098444d6b082fe4038c50c4d with delete_type TABLET_DATA_DELETED (replaced by tablet 9a695b4fd5294f32a6644154487c1486) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.849153 2279 raft_consensus.cc:482] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.849611 2279 raft_consensus.cc:504] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.850481 1556 ts_tablet_manager.cc:1428] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.037s user 0.000s sys 0.002s
I20260927 15:06:09.854254 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet c41cd38355e64590b43b2e1271c43e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.838992 1099 leader_election.cc:302] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:09.844278 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 643ec85d098444d6b082fe4038c50c4d with delete_type TABLET_DATA_DELETED (replaced by tablet 9a695b4fd5294f32a6644154487c1486) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:09.855412 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 114635us
I20260927 15:06:09.855587 2223 raft_consensus.cc:482] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.855724 2223 raft_consensus.cc:504] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.856493 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 18b5d17e6f8145b88d5f78e6f7b8361d (DEFAULT_TABLE table=default.Table_354a1c885d164986846d086d406d5d40 [id=f5877b8eb3cf4495b9ca4ad949e5c388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.856616 2223 leader_election.cc:288] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:09.857127 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e855555999f4452ba1cabab6862b3c47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:09.857650 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18b5d17e6f8145b88d5f78e6f7b8361d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:09.857975 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e855555999f4452ba1cabab6862b3c47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.858861 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 643ec85d098444d6b082fe4038c50c4d with delete_type TABLET_DATA_DELETED (replaced by tablet 9a695b4fd5294f32a6644154487c1486) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.859941 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48e7eac8753f425d90302360d228ee54" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:09.861431 1376 leader_election.cc:341] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.863420 2233 tablet_replica.cc:330] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:09.863646 2233 raft_consensus.cc:2229] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:09.863858 2233 raft_consensus.cc:2258] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.864476 2233 ts_tablet_manager.cc:1905] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:09.855697 2290 raft_consensus.cc:2726] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:09.857311 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48e7eac8753f425d90302360d228ee54" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:09.864823 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 0df4a23269244191bf1dcd69cb34d371 with delete_type TABLET_DATA_DELETED (replaced by tablet 3042c17580d54082971b761433a7dca9) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:09.865314 1374 leader_election.cc:341] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:09.865453 1374 leader_election.cc:302] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:09.865661 2223 raft_consensus.cc:2726] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:09.867141 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 1b045b82515540e8813f9250726479e5 (table default.Table_e301f5a5aea64583a20cf58c548d0934 [id=0268289149d14fd5abd1abecf14a43bb]) successfully deleted
I20260927 15:06:09.868307 1552 tablet_bootstrap.cc:654] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.869234 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 9cd4941f342d41f6a0b4d9c1c42a983d (DEFAULT_TABLE table=default.Table_dfc10f0ce8074b3c83e6388a718d8e4f [id=2fcdc78b6a6846f18bc78e6363bc21bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.869711 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cd4941f342d41f6a0b4d9c1c42a983d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.870782 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 18b5d17e6f8145b88d5f78e6f7b8361d (DEFAULT_TABLE table=default.Table_354a1c885d164986846d086d406d5d40 [id=f5877b8eb3cf4495b9ca4ad949e5c388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.871241 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18b5d17e6f8145b88d5f78e6f7b8361d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.872227 1556 tablet_bootstrap.cc:492] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:09.873749 1556 tablet_bootstrap.cc:654] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.881474 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 18b5d17e6f8145b88d5f78e6f7b8361d (DEFAULT_TABLE table=default.Table_354a1c885d164986846d086d406d5d40 [id=f5877b8eb3cf4495b9ca4ad949e5c388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.882128 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18b5d17e6f8145b88d5f78e6f7b8361d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.882499 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 9cd4941f342d41f6a0b4d9c1c42a983d (DEFAULT_TABLE table=default.Table_dfc10f0ce8074b3c83e6388a718d8e4f [id=2fcdc78b6a6846f18bc78e6363bc21bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.883071 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 9cd4941f342d41f6a0b4d9c1c42a983d (DEFAULT_TABLE table=default.Table_dfc10f0ce8074b3c83e6388a718d8e4f [id=2fcdc78b6a6846f18bc78e6363bc21bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.883514 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cd4941f342d41f6a0b4d9c1c42a983d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.883885 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e09fcea174c647adb26c6caeacda55a6" } modify_external_catalogs: true
I20260927 15:06:09.884373 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5c0d2507a5ac46f1874f45430d2693cb" } modify_external_catalogs: true
I20260927 15:06:09.884560 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_331e24eda68d4fcab4e75f6cc79a555e" } modify_external_catalogs: true
I20260927 15:06:09.884680 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_331e24eda68d4fcab4e75f6cc79a555e" } modify_external_catalogs: true
I20260927 15:06:09.886165 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f775f6645d8543308d977cc3519302b7" } modify_external_catalogs: true
I20260927 15:06:09.886392 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f775f6645d8543308d977cc3519302b7" } modify_external_catalogs: true
I20260927 15:06:09.887225 1404 tablet_service.cc:1467] Processing CreateTablet for tablet e5d924a79fa2493795abda6ffbbd11b5 (DEFAULT_TABLE table=default.Table_a0ae944503394570920bd86171112fe7 [id=a39aa407137b4ede8bb6039f38da81d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.887503 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5c0d2507a5ac46f1874f45430d2693cb" } modify_external_catalogs: true
I20260927 15:06:09.887660 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5d924a79fa2493795abda6ffbbd11b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.888072 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b21edeb66a3d44688131b1bbb44d7dab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.888659 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b21edeb66a3d44688131b1bbb44d7dab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.887916 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e09fcea174c647adb26c6caeacda55a6" } modify_external_catalogs: true
I20260927 15:06:09.891119 2279 leader_election.cc:288] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:09.891119 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 1d83cf0b359b45299f5cdebdc7dee7d4 (DEFAULT_TABLE table=default.Table_31dca477abed4b759a1ba843dc46238a [id=a54ebda9c6f1429caf8d43bb9232bb63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.891312 2279 raft_consensus.cc:482] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:09.891727 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d83cf0b359b45299f5cdebdc7dee7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.891676 2279 raft_consensus.cc:504] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.892441 2279 leader_election.cc:288] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:09.892896 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 1d83cf0b359b45299f5cdebdc7dee7d4 (DEFAULT_TABLE table=default.Table_31dca477abed4b759a1ba843dc46238a [id=a54ebda9c6f1429caf8d43bb9232bb63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.894657 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1b5c4193626947399ca6e784e8e68b27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:09.894944 1284 tablet_service.cc:1467] Processing CreateTablet for tablet e5d924a79fa2493795abda6ffbbd11b5 (DEFAULT_TABLE table=default.Table_a0ae944503394570920bd86171112fe7 [id=a39aa407137b4ede8bb6039f38da81d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.895150 1417 tablet_service.cc:1467] Processing CreateTablet for tablet f34ce3980286489c87fdde92fb045607 (DEFAULT_TABLE table=default.Table_e71b1a0c323c48e09d9f20338ddd3f80 [id=5981ef3c84fe4ddf84bb9c6150cb0787]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:09.895316 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b5c4193626947399ca6e784e8e68b27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.895627 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 15f5345ef904475cbc880c400ea41a26 (DEFAULT_TABLE table=default.Table_efcf68a067bf4d34bae3e0859d6f1a38 [id=17cba467ac6a4282b4397b997d4fa6c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.896116 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 237b6fd8d0ce4576ae84a1fb51dc500d (DEFAULT_TABLE table=default.Table_3ead517549924f16a90ea7b24b577ad0 [id=9f7315df6092401993b757ba891ecf94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.897642 2289 raft_consensus.cc:482] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:09.897825 2289 raft_consensus.cc:504] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.898504 2289 leader_election.cc:288] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:09.899296 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7816e099094d13887650fc223097c7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:09.899493 1437 raft_consensus.cc:3037] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:09.899374 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f745fe0a2f4e460a911af99e6c157b85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.899950 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f745fe0a2f4e460a911af99e6c157b85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.901095 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8596eafa3f184547be9ba74b2f833afe" } modify_external_catalogs: true
I20260927 15:06:09.901309 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8596eafa3f184547be9ba74b2f833afe" } modify_external_catalogs: true
I20260927 15:06:09.901332 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 237b6fd8d0ce4576ae84a1fb51dc500d (DEFAULT_TABLE table=default.Table_3ead517549924f16a90ea7b24b577ad0 [id=9f7315df6092401993b757ba891ecf94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.901770 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 237b6fd8d0ce4576ae84a1fb51dc500d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.904085 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f4624ee1f1074d14a78879480f51ac28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.904811 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4624ee1f1074d14a78879480f51ac28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.907212 1128 tablet_service.cc:1467] Processing CreateTablet for tablet ffbab94f00ec444b983a61c77544d123 (DEFAULT_TABLE table=default.Table_b06cc424b97d4014bafbcffe9807c8d6 [id=318d4180f96e494ea8806d559164db4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.907693 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffbab94f00ec444b983a61c77544d123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.908531 1418 tablet_service.cc:1467] Processing CreateTablet for tablet ffbab94f00ec444b983a61c77544d123 (DEFAULT_TABLE table=default.Table_b06cc424b97d4014bafbcffe9807c8d6 [id=318d4180f96e494ea8806d559164db4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.911054 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cd4941f342d41f6a0b4d9c1c42a983d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.913616 1437 raft_consensus.cc:2454] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:09.914247 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f34ce3980286489c87fdde92fb045607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.914453 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffbab94f00ec444b983a61c77544d123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.914654 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 237b6fd8d0ce4576ae84a1fb51dc500d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.915211 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f5345ef904475cbc880c400ea41a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.917554 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d83cf0b359b45299f5cdebdc7dee7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.922412 1135 tablet_service.cc:1467] Processing CreateTablet for tablet e5d924a79fa2493795abda6ffbbd11b5 (DEFAULT_TABLE table=default.Table_a0ae944503394570920bd86171112fe7 [id=a39aa407137b4ede8bb6039f38da81d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.922917 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5d924a79fa2493795abda6ffbbd11b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.923110 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 237b6fd8d0ce4576ae84a1fb51dc500d (DEFAULT_TABLE table=default.Table_3ead517549924f16a90ea7b24b577ad0 [id=9f7315df6092401993b757ba891ecf94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.923962 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 15f5345ef904475cbc880c400ea41a26 (DEFAULT_TABLE table=default.Table_efcf68a067bf4d34bae3e0859d6f1a38 [id=17cba467ac6a4282b4397b997d4fa6c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.924753 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 15f5345ef904475cbc880c400ea41a26 (DEFAULT_TABLE table=default.Table_efcf68a067bf4d34bae3e0859d6f1a38 [id=17cba467ac6a4282b4397b997d4fa6c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.925028 1556 tablet_bootstrap.cc:492] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:09.923678 1270 tablet_service.cc:1467] Processing CreateTablet for tablet f34ce3980286489c87fdde92fb045607 (DEFAULT_TABLE table=default.Table_e71b1a0c323c48e09d9f20338ddd3f80 [id=5981ef3c84fe4ddf84bb9c6150cb0787]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.925312 1556 ts_tablet_manager.cc:1397] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.053s user 0.000s sys 0.004s
I20260927 15:06:09.927255 1556 raft_consensus.cc:348] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.927675 1556 raft_consensus.cc:374] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:09.928140 1556 raft_consensus.cc:729] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:09.931183 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5d924a79fa2493795abda6ffbbd11b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.931605 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f5345ef904475cbc880c400ea41a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.930939 1556 consensus_queue.cc:260] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.933151 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ce1c286eea664e2a8ad6ebdf31bd4050
I20260927 15:06:09.934096 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 20278f979638419db92105e55310f605
I20260927 15:06:09.934525 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 5e9b07ea3ec9457399e2b765580d06e7
I20260927 15:06:09.935225 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 27c3283a40f14eb4868767799cfdf7bd
I20260927 15:06:09.936203 1276 tablet_service.cc:1467] Processing CreateTablet for tablet ffbab94f00ec444b983a61c77544d123 (DEFAULT_TABLE table=default.Table_b06cc424b97d4014bafbcffe9807c8d6 [id=318d4180f96e494ea8806d559164db4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.936561 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet ce1c286eea664e2a8ad6ebdf31bd4050 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.936575 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15f5345ef904475cbc880c400ea41a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.936633 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 27c3283a40f14eb4868767799cfdf7bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.936796 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 20278f979638419db92105e55310f605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.936991 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:09.937076 1556 ts_tablet_manager.cc:1428] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260927 15:06:09.937354 1556 tablet_bootstrap.cc:492] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:09.938386 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f34ce3980286489c87fdde92fb045607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.939110 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 9d4302735caf431f86ba256fb52f50a5 (DEFAULT_TABLE table=default.Table_0795a9d7633f474d985758dabdc8c31a [id=2e6ce3f9b221417fbda240eff8ca3de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.939215 1556 tablet_bootstrap.cc:654] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:09.939837 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 237b6fd8d0ce4576ae84a1fb51dc500d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.939826 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.940740 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 27c3283a40f14eb4868767799cfdf7bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.941177 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 20278f979638419db92105e55310f605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.941212 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 9d4302735caf431f86ba256fb52f50a5 (DEFAULT_TABLE table=default.Table_0795a9d7633f474d985758dabdc8c31a [id=2e6ce3f9b221417fbda240eff8ca3de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.941450 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet ce1c286eea664e2a8ad6ebdf31bd4050 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:09.941624 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d4302735caf431f86ba256fb52f50a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.942094 1561 ts_tablet_manager.cc:1428] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.256s user 0.002s sys 0.000s
I20260927 15:06:09.942054 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 72f87499645e4f55bc3d6edeba50eb64 (DEFAULT_TABLE table=default.Table_762b6b45a11f476c9aee7e80c706ee9d [id=fc3a145c7ad04f54a7473d290d669aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.942437 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72f87499645e4f55bc3d6edeba50eb64. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:09.945154 1238 leader_election.cc:341] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 0df4a23269244191bf1dcd69cb34d371
W20260927 15:06:09.946257 1238 leader_election.cc:341] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3d454d65afa94aac9b34c253adfa4b0c
I20260927 15:06:09.925532 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 1d83cf0b359b45299f5cdebdc7dee7d4 (DEFAULT_TABLE table=default.Table_31dca477abed4b759a1ba843dc46238a [id=a54ebda9c6f1429caf8d43bb9232bb63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.947536 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d83cf0b359b45299f5cdebdc7dee7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.947654 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7e960dd56c394b6f9171078af38cee79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:09.948665 1130 tablet_service.cc:1467] Processing CreateTablet for tablet f34ce3980286489c87fdde92fb045607 (DEFAULT_TABLE table=default.Table_e71b1a0c323c48e09d9f20338ddd3f80 [id=5981ef3c84fe4ddf84bb9c6150cb0787]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:09.948755 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e960dd56c394b6f9171078af38cee79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.949083 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f34ce3980286489c87fdde92fb045607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.951045 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 20278f979638419db92105e55310f605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.951560 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.951937 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 27c3283a40f14eb4868767799cfdf7bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.952613 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 72f87499645e4f55bc3d6edeba50eb64 (DEFAULT_TABLE table=default.Table_762b6b45a11f476c9aee7e80c706ee9d [id=fc3a145c7ad04f54a7473d290d669aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.956858 1099 leader_election.cc:302] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:09.957276 2290 raft_consensus.cc:2781] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:09.957434 2290 raft_consensus.cc:686] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:09.957690 2290 consensus_queue.cc:237] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:09.959830 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 72f87499645e4f55bc3d6edeba50eb64 (DEFAULT_TABLE table=default.Table_762b6b45a11f476c9aee7e80c706ee9d [id=fc3a145c7ad04f54a7473d290d669aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.960513 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72f87499645e4f55bc3d6edeba50eb64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:09.963687 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_294f26f04be64c4f8564c20e515fabb9" } new_table_name: "default.Table_9a6330b2000f4bb5a7817b924f99ad53" modify_external_catalogs: true
I20260927 15:06:09.965364 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d891902bcffb4a3f922e337a2a8700f8" } new_table_name: "default.Table_ac3e364e9065400eaa5e5f1b928fa4ee" modify_external_catalogs: true
I20260927 15:06:09.965591 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_374aa939b215469a9f9e7a9aaacbd512" } new_table_name: "default.Table_81a2ca7b51dd46eda17b8ea2776e4b23" modify_external_catalogs: true
I20260927 15:06:09.966049 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f0f5be0b569d486990e60f9bdf68958b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:09.966282 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ecb61742b1f74785ba7bc23a44e91dd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.966722 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0f5be0b569d486990e60f9bdf68958b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:09.966858 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecb61742b1f74785ba7bc23a44e91dd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.965719 1561 tablet_bootstrap.cc:492] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:09.967931 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2ada29db8b78455c9c8897f8027d3804"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:09.968461 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ada29db8b78455c9c8897f8027d3804 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:09.970747 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 471) took 4160 ms. Trace:
I20260927 15:06:09.971221 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet ce1c286eea664e2a8ad6ebdf31bd4050 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:09.973369 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f52a44b8e26c4239ad332cec0499eead" } new_table_name: "default.Table_6d2594aac47f4cdd9a608744f1fc2575" modify_external_catalogs: true
I20260927 15:06:09.977902 1562 rpcz_store.cc:276] 0927 15:06:05.809993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.810769 (+ 776us) service_pool.cc:227] Handling call
0927 15:06:09.643884 (+3833115us) ts_tablet_manager.cc:1145] Deleting tablet 109f9088371e4f008b2b5f993f2b4c3b
0927 15:06:09.643897 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:09.698386 (+ 54489us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:09.825738 (+127352us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:09.970703 (+144965us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3822817}
I20260927 15:06:09.978714 1562 tablet_replica.cc:330] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:09.979130 1562 raft_consensus.cc:2229] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:09.979600 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 109f9088371e4f008b2b5f993f2b4c3b (table default.Table_5e5da599fcef4b94ac03384faad9c44a [id=807446b6eab74770aa64683a5cf590a9]) successfully deleted
I20260927 15:06:09.979699 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 9d4302735caf431f86ba256fb52f50a5 (DEFAULT_TABLE table=default.Table_0795a9d7633f474d985758dabdc8c31a [id=2e6ce3f9b221417fbda240eff8ca3de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:09.982913 1562 pending_rounds.cc:62] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:09.983901 1562 pending_rounds.cc:68] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976335681024000 op_type: NO_OP noop_request { }
I20260927 15:06:09.987922 1562 raft_consensus.cc:2866] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:09.988909 1562 raft_consensus.cc:2258] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:09.990186 1562 ts_tablet_manager.cc:1905] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:09.993193 1239 leader_election.cc:341] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 3d454d65afa94aac9b34c253adfa4b0c
W20260927 15:06:09.991849 1102 leader_election.cc:341] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Not found: Tablet not found: 89bd5b459caa42e7a9153d9273ad52c4
I20260927 15:06:09.994616 1239 leader_election.cc:302] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:09.995934 2299 raft_consensus.cc:2726] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:09.998432 2303 tablet.cc:1722] T ebb4e007cefa4f18bdaa461b43c5c810 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:10.009618 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_17a0aa0524f040f0a54e3eaded51d06f" } new_table_name: "default.Table_c10827cf92b44050bf8d4dc379b26be3" modify_external_catalogs: true
I20260927 15:06:10.016700 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d4302735caf431f86ba256fb52f50a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.019120 908 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet ab0fae09c9084ef2b0a7468f311aa08b
I20260927 15:06:10.020867 908 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet ebb4e007cefa4f18bdaa461b43c5c810 (table default.Table_299a7e2d3b174b50b6f535e3971c1f35 [id=49e5a0fcbe0d48aa993446d112ed5d2b]). Expected version 2 got 0
I20260927 15:06:10.032856 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 7f0d667472ee4f1481c213e03403461e from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:10.033653 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 76787.8us
I20260927 15:06:10.033705 2233 ts_tablet_manager.cc:1918] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:10.033834 2233 log.cc:1196] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/9598ac8a916f4bf5b1cf9995a8149c70
W20260927 15:06:10.034126 1099 leader_election.cc:341] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 89bd5b459caa42e7a9153d9273ad52c4
I20260927 15:06:10.034423 1099 leader_election.cc:302] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:10.034734 2289 raft_consensus.cc:2726] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:10.038107 2233 ts_tablet_manager.cc:1939] T 9598ac8a916f4bf5b1cf9995a8149c70 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:10.039683 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba9f24239ae14eaf80b96a711596b00a has no consensus state
W20260927 15:06:10.040670 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79a3125723034cb48bc1a05fc4abbb82 consensus state has no leader
W20260927 15:06:10.041761 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72862763900249b8a7079fde891d8021 has no consensus state
I20260927 15:06:10.043213 908 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet dd2687f65780481c86a9942960ce7be1 (table default.Table_0c4d630a1b634322b0d6ffdf591dfc97 [id=a56919bbdc0146839e84fcc1224c6b8f]). Expected version 1 got 0
I20260927 15:06:10.046932 1561 tablet_bootstrap.cc:654] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:10.047820 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb99a5570603497fbcc029a31f7f947f consensus state has no leader
I20260927 15:06:10.058386 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_53dbfc415ede4dc69abb5bd5ede1f297"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:10.059247 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53dbfc415ede4dc69abb5bd5ede1f297 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:10.059223 1239 leader_election.cc:341] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 0df4a23269244191bf1dcd69cb34d371
W20260927 15:06:10.060565 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df6d7670381b49bb927943b2ee920c84 consensus state has no leader
I20260927 15:06:10.077709 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffbab94f00ec444b983a61c77544d123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.078626 2306 tablet.cc:1722] T ebb4e007cefa4f18bdaa461b43c5c810 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:10.081202 2119 ts_tablet_manager.cc:1918] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:10.081911 2119 log.cc:1196] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/ab08d04c11dd44299ee5f9a911d581c3
I20260927 15:06:10.082438 2119 ts_tablet_manager.cc:1939] T ab08d04c11dd44299ee5f9a911d581c3 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:10.090919 1556 tablet_bootstrap.cc:492] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.091104 1556 ts_tablet_manager.cc:1397] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.154s user 0.006s sys 0.000s
I20260927 15:06:10.091336 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72f87499645e4f55bc3d6edeba50eb64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.092794 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d4302735caf431f86ba256fb52f50a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.093904 2310 tablet.cc:1722] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:10.094444 1164 raft_consensus.cc:1261] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Refusing update from remote peer fabb59e74b7d48fa9be047d7f4c4cc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:06:10.095043 2223 consensus_queue.cc:1035] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:06:10.096338 1376 consensus_peers.cc:487] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:10.097414 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 565) took 1346 ms. Trace:
I20260927 15:06:10.097527 2119 rpcz_store.cc:276] 0927 15:06:08.749629 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.749685 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:09.361005 (+611320us) ts_tablet_manager.cc:1145] Deleting tablet ab08d04c11dd44299ee5f9a911d581c3
0927 15:06:09.361063 (+ 58us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:09.719689 (+358626us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.059475 (+339786us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.095978 (+ 36503us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":610981}
I20260927 15:06:10.098213 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet ab08d04c11dd44299ee5f9a911d581c3 (table default.Table_f1b5de8ecfe842e69ba40febba9c6ee1 [id=7f171341d8ee4ed68a7d8a4fc3e7ecb0]) successfully deleted
I20260927 15:06:10.099444 2119 tablet_replica.cc:330] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:10.099709 2119 raft_consensus.cc:2229] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:10.101573 2119 raft_consensus.cc:2258] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:10.102295 2119 ts_tablet_manager.cc:1905] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:10.110170 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_101d63978331408d8eaeb799e410ebe9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:10.110670 2303 tablet.cc:1722] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260927 15:06:10.110778 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_101d63978331408d8eaeb799e410ebe9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:10.115545 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 6c195d8161e24a2bb02b98c89aaa8d24 (DEFAULT_TABLE table=default.Table_f745fe0a2f4e460a911af99e6c157b85 [id=1de3237ad3f748a68b1197e3ceaf8e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.116647 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 4128146e2fcf4ed7ba213fa6d19fe7f5 (DEFAULT_TABLE table=default.Table_7010193aed1b4921aeea88b83565050e [id=46ff4c9ecbcb465c9831fb0f64e39e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.117131 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 6c195d8161e24a2bb02b98c89aaa8d24 (DEFAULT_TABLE table=default.Table_f745fe0a2f4e460a911af99e6c157b85 [id=1de3237ad3f748a68b1197e3ceaf8e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.118054 1131 tablet_service.cc:1467] Processing CreateTablet for tablet bc2974e11cf1446895607b4ccec16386 (DEFAULT_TABLE table=default.Table_2116f8e5cf2142249d0b5f3fdbf0b209 [id=11cd0d61632e4283881bb765e553b2d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.119396 1142 tablet_service.cc:1467] Processing CreateTablet for tablet b6697c852d114b7391717c7a36749127 (DEFAULT_TABLE table=default.Table_912bad2648f24770970d14968ca68a96 [id=0cf4e401820a40c58d658299d2213b30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.119529 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 1c37ef29622a4f9ebc2439c001ba8610 (DEFAULT_TABLE table=default.Table_89ea2bd565d14ef38215685627826f0f [id=e324d643c95c41018c97621a9838bb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.119588 1407 tablet_service.cc:1467] Processing CreateTablet for tablet b6697c852d114b7391717c7a36749127 (DEFAULT_TABLE table=default.Table_912bad2648f24770970d14968ca68a96 [id=0cf4e401820a40c58d658299d2213b30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.119959 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 3050246c0a094c90b0810afcf812aaf4 (DEFAULT_TABLE table=default.Table_7793a5b390d94f01a929468eb8c47e80 [id=92a3a6d5069045ee8df1ac8085c18029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.120510 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 3050246c0a094c90b0810afcf812aaf4 (DEFAULT_TABLE table=default.Table_7793a5b390d94f01a929468eb8c47e80 [id=92a3a6d5069045ee8df1ac8085c18029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.121543 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 72862763900249b8a7079fde891d8021 (DEFAULT_TABLE table=default.Table_ac3e364e9065400eaa5e5f1b928fa4ee [id=1c4d3e0f59ec48bb8777224b7a8afdfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.121691 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 0617b596022e48e7a2913762ae39251e (DEFAULT_TABLE table=default.Table_1b5c4193626947399ca6e784e8e68b27 [id=89d20c28c90644d19ccbd3b0b8a3f730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.121675 1556 raft_consensus.cc:348] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.121883 1556 raft_consensus.cc:374] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.121949 1556 raft_consensus.cc:729] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.122058 1128 tablet_service.cc:1467] Processing CreateTablet for tablet ba9f24239ae14eaf80b96a711596b00a (DEFAULT_TABLE table=default.Table_81a2ca7b51dd46eda17b8ea2776e4b23 [id=338876edde9a4ef3b33b34eb2eac50ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.122817 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 0ddca178f38e46b28fc1b5ed6416b990 (DEFAULT_TABLE table=default.Table_f5fc14b511cb4c4ba6a023f692f00c9f [id=505e0f5de6b846e88d4a3773336b6a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.122974 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 9a695b4fd5294f32a6644154487c1486 (DEFAULT_TABLE table=default.Table_188aafdea09e48319c0cdf8b390d1e3f [id=54147d46ad094905902131da9b76f02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.123806 1136 tablet_service.cc:1467] Processing CreateTablet for tablet d0b3fe3365f642e1b7b5836388ed7940 (DEFAULT_TABLE table=default.Table_e855555999f4452ba1cabab6862b3c47 [id=c254715a5e59474aae1cdb2b97327c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.124912 1139 tablet_service.cc:1467] Processing CreateTablet for tablet e40561ea6c2d4c6b856b3f123e337f64 (DEFAULT_TABLE table=default.Table_a0619053a2d04afda155e55e08d6bc7e [id=a6a404910b2247fa9cdca76d4e9a183d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.124876 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 08a66f1770dc45daaac458f3db9df7cc (DEFAULT_TABLE table=default.Table_e690924686a146e18b23b31b4da1470e [id=ecfae1a1395743d385da5fedb53f5434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.125725 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 90aa4663989b40b9825b72ce216fa8d0 (DEFAULT_TABLE table=default.Table_b21edeb66a3d44688131b1bbb44d7dab [id=dcad572d166f492a9486c7cee1df3563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.125941 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 4128146e2fcf4ed7ba213fa6d19fe7f5 (DEFAULT_TABLE table=default.Table_7010193aed1b4921aeea88b83565050e [id=46ff4c9ecbcb465c9831fb0f64e39e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.125983 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 997c93bdf78b49709130d97a8d96a5a5 (DEFAULT_TABLE table=default.Table_279db08831174124bf691a8cad553e81 [id=5de6f33b4fa24254a432ee069ed91324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.129240 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 622) took 1221 ms. Trace:
I20260927 15:06:10.129412 2233 rpcz_store.cc:276] 0927 15:06:08.908031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.908305 (+ 274us) service_pool.cc:227] Handling call
0927 15:06:09.863373 (+955068us) ts_tablet_manager.cc:1145] Deleting tablet 9598ac8a916f4bf5b1cf9995a8149c70
0927 15:06:09.863384 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.001187 (+137803us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.006727 (+ 5540us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.129211 (+122484us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":954824}
I20260927 15:06:10.129961 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 623) took 1219 ms. Trace:
I20260927 15:06:10.130048 2233 rpcz_store.cc:276] 0927 15:06:08.910247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.910298 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:10.129802 (+1219504us) ts_tablet_manager.cc:1145] Deleting tablet 53ddb28f419d42afbaddf36966fa1509
0927 15:06:10.129818 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.129942 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1219286}
I20260927 15:06:10.130429 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 624) took 1219 ms. Trace:
I20260927 15:06:10.131320 1274 tablet_service.cc:1467] Processing CreateTablet for tablet b6697c852d114b7391717c7a36749127 (DEFAULT_TABLE table=default.Table_912bad2648f24770970d14968ca68a96 [id=0cf4e401820a40c58d658299d2213b30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.131785 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6697c852d114b7391717c7a36749127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.133620 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 9598ac8a916f4bf5b1cf9995a8149c70 (table default.Table_3c3f771ede53431eac4f72641bf34c64 [id=11eb50b78bd74a098a861d227a4e2662]) successfully deleted
I20260927 15:06:10.133678 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 72862763900249b8a7079fde891d8021 (DEFAULT_TABLE table=default.Table_ac3e364e9065400eaa5e5f1b928fa4ee [id=1c4d3e0f59ec48bb8777224b7a8afdfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.133936 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 4128146e2fcf4ed7ba213fa6d19fe7f5 (DEFAULT_TABLE table=default.Table_7010193aed1b4921aeea88b83565050e [id=46ff4c9ecbcb465c9831fb0f64e39e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.134068 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 0ddca178f38e46b28fc1b5ed6416b990 (DEFAULT_TABLE table=default.Table_f5fc14b511cb4c4ba6a023f692f00c9f [id=505e0f5de6b846e88d4a3773336b6a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.134200 1417 tablet_service.cc:1467] Processing CreateTablet for tablet ba9f24239ae14eaf80b96a711596b00a (DEFAULT_TABLE table=default.Table_81a2ca7b51dd46eda17b8ea2776e4b23 [id=338876edde9a4ef3b33b34eb2eac50ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.134562 1405 tablet_service.cc:1467] Processing CreateTablet for tablet d0b3fe3365f642e1b7b5836388ed7940 (DEFAULT_TABLE table=default.Table_e855555999f4452ba1cabab6862b3c47 [id=c254715a5e59474aae1cdb2b97327c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.134663 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 0617b596022e48e7a2913762ae39251e (DEFAULT_TABLE table=default.Table_1b5c4193626947399ca6e784e8e68b27 [id=89d20c28c90644d19ccbd3b0b8a3f730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.134770 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 9a695b4fd5294f32a6644154487c1486 (DEFAULT_TABLE table=default.Table_188aafdea09e48319c0cdf8b390d1e3f [id=54147d46ad094905902131da9b76f02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.134955 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 08a66f1770dc45daaac458f3db9df7cc (DEFAULT_TABLE table=default.Table_e690924686a146e18b23b31b4da1470e [id=ecfae1a1395743d385da5fedb53f5434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.135181 1414 tablet_service.cc:1467] Processing CreateTablet for tablet e40561ea6c2d4c6b856b3f123e337f64 (DEFAULT_TABLE table=default.Table_a0619053a2d04afda155e55e08d6bc7e [id=a6a404910b2247fa9cdca76d4e9a183d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.135362 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4128146e2fcf4ed7ba213fa6d19fe7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.135314 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 90aa4663989b40b9825b72ce216fa8d0 (DEFAULT_TABLE table=default.Table_b21edeb66a3d44688131b1bbb44d7dab [id=dcad572d166f492a9486c7cee1df3563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.135690 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 997c93bdf78b49709130d97a8d96a5a5 (DEFAULT_TABLE table=default.Table_279db08831174124bf691a8cad553e81 [id=5de6f33b4fa24254a432ee069ed91324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.135702 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 1c37ef29622a4f9ebc2439c001ba8610 (DEFAULT_TABLE table=default.Table_89ea2bd565d14ef38215685627826f0f [id=e324d643c95c41018c97621a9838bb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.136158 1418 tablet_service.cc:1467] Processing CreateTablet for tablet bc2974e11cf1446895607b4ccec16386 (DEFAULT_TABLE table=default.Table_2116f8e5cf2142249d0b5f3fdbf0b209 [id=11cd0d61632e4283881bb765e553b2d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.130507 2233 rpcz_store.cc:276] 0927 15:06:08.911440 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.911602 (+ 162us) service_pool.cc:227] Handling call
0927 15:06:10.130296 (+1218694us) ts_tablet_manager.cc:1145] Deleting tablet 34348cffe35b46728e77df7dede29682
0927 15:06:10.130307 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.130415 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1218495}
I20260927 15:06:10.136842 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 626) took 1219 ms. Trace:
W20260927 15:06:10.137006 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 53ddb28f419d42afbaddf36966fa1509 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53ddb28f419d42afbaddf36966fa1509 already in progress: creating tablet
I20260927 15:06:10.136943 2233 rpcz_store.cc:276] 0927 15:06:08.917076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.917129 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:10.136720 (+1219591us) ts_tablet_manager.cc:1145] Deleting tablet 54f5c4b7c7a045bea1a79bc67a913f65
0927 15:06:10.136729 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.136827 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1219382}
I20260927 15:06:10.137271 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 625) took 1220 ms. Trace:
I20260927 15:06:10.137356 2233 rpcz_store.cc:276] 0927 15:06:08.916940 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.917369 (+ 429us) service_pool.cc:227] Handling call
0927 15:06:10.137169 (+1219800us) ts_tablet_manager.cc:1145] Deleting tablet f271c76b5f2447239d3d014fbde4e8b2
0927 15:06:10.137178 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.137256 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1219630}
I20260927 15:06:10.137483 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 6c195d8161e24a2bb02b98c89aaa8d24 (DEFAULT_TABLE table=default.Table_f745fe0a2f4e460a911af99e6c157b85 [id=1de3237ad3f748a68b1197e3ceaf8e5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.137634 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 627) took 1202 ms. Trace:
I20260927 15:06:10.137693 2233 rpcz_store.cc:276] 0927 15:06:08.935446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.935510 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:10.137544 (+1202034us) ts_tablet_manager.cc:1145] Deleting tablet 1d221f14ad57462e95017b9068eb8714
0927 15:06:10.137552 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.137621 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1199374}
I20260927 15:06:10.137907 2233 tablet_replica.cc:330] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:10.138068 2233 raft_consensus.cc:2229] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:10.138206 2233 raft_consensus.cc:2258] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:10.138520 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 1c37ef29622a4f9ebc2439c001ba8610 (DEFAULT_TABLE table=default.Table_89ea2bd565d14ef38215685627826f0f [id=e324d643c95c41018c97621a9838bb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.138722 2233 ts_tablet_manager.cc:1905] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:10.139031 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 72862763900249b8a7079fde891d8021 (DEFAULT_TABLE table=default.Table_ac3e364e9065400eaa5e5f1b928fa4ee [id=1c4d3e0f59ec48bb8777224b7a8afdfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.139196 1556 consensus_queue.cc:260] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.139344 1273 tablet_service.cc:1467] Processing CreateTablet for tablet bc2974e11cf1446895607b4ccec16386 (DEFAULT_TABLE table=default.Table_2116f8e5cf2142249d0b5f3fdbf0b209 [id=11cd0d61632e4283881bb765e553b2d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.139914 1556 ts_tablet_manager.cc:1428] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20260927 15:06:10.140015 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 3050246c0a094c90b0810afcf812aaf4 (DEFAULT_TABLE table=default.Table_7793a5b390d94f01a929468eb8c47e80 [id=92a3a6d5069045ee8df1ac8085c18029]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.143924 1556 tablet_bootstrap.cc:492] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:10.145859 1556 tablet_bootstrap.cc:654] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.152050 1282 tablet_service.cc:1467] Processing CreateTablet for tablet ba9f24239ae14eaf80b96a711596b00a (DEFAULT_TABLE table=default.Table_81a2ca7b51dd46eda17b8ea2776e4b23 [id=338876edde9a4ef3b33b34eb2eac50ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.152484 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c37ef29622a4f9ebc2439c001ba8610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.154740 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba9f24239ae14eaf80b96a711596b00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.156947 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 0617b596022e48e7a2913762ae39251e (DEFAULT_TABLE table=default.Table_1b5c4193626947399ca6e784e8e68b27 [id=89d20c28c90644d19ccbd3b0b8a3f730]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.158108 2286 raft_consensus.cc:482] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:10.158344 2286 raft_consensus.cc:504] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.159370 2286 leader_election.cc:288] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:10.160889 1099 leader_election.cc:341] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ba14b7531bb647248572be10d2b43cf2
I20260927 15:06:10.162577 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3050246c0a094c90b0810afcf812aaf4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:10.162799 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 34348cffe35b46728e77df7dede29682 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34348cffe35b46728e77df7dede29682 already in progress: creating tablet
W20260927 15:06:10.164059 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 54f5c4b7c7a045bea1a79bc67a913f65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54f5c4b7c7a045bea1a79bc67a913f65 already in progress: creating tablet
W20260927 15:06:10.164877 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f271c76b5f2447239d3d014fbde4e8b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f271c76b5f2447239d3d014fbde4e8b2 already in progress: creating tablet
W20260927 15:06:10.165527 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1d221f14ad57462e95017b9068eb8714 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d221f14ad57462e95017b9068eb8714 already in progress: creating tablet
I20260927 15:06:10.167982 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 0ddca178f38e46b28fc1b5ed6416b990 (DEFAULT_TABLE table=default.Table_f5fc14b511cb4c4ba6a023f692f00c9f [id=505e0f5de6b846e88d4a3773336b6a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.169740 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4637b56a65aa49339cb6d9e0785b7583" } modify_external_catalogs: true
I20260927 15:06:10.170020 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4637b56a65aa49339cb6d9e0785b7583" } modify_external_catalogs: true
I20260927 15:06:10.174043 2286 raft_consensus.cc:482] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:10.174309 2286 raft_consensus.cc:504] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.175194 2286 leader_election.cc:288] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:10.176674 1099 leader_election.cc:341] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 377847d06b534883ba2b870ca3317fe0
I20260927 15:06:10.179250 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7f0d667472ee4f1481c213e03403461e
I20260927 15:06:10.179494 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 9a695b4fd5294f32a6644154487c1486 (DEFAULT_TABLE table=default.Table_188aafdea09e48319c0cdf8b390d1e3f [id=54147d46ad094905902131da9b76f02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.179700 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_299a7e2d3b174b50b6f535e3971c1f35 [id=49e5a0fcbe0d48aa993446d112ed5d2b] alter complete (version 2)
I20260927 15:06:10.179951 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0617b596022e48e7a2913762ae39251e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.181769 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bb7abc219f5145b8b5530fbc0aa97af1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:10.181901 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0d667472ee4f1481c213e03403461e with delete_type TABLET_DATA_DELETED (replaced by tablet 0a64059ef2234ad6adbdfd8d3576f2a6) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:10.182436 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb7abc219f5145b8b5530fbc0aa97af1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:10.183262 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a695b4fd5294f32a6644154487c1486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.179771 911 catalog_manager.cc:6565] ReplaceTablet: tablet 7f0d667472ee4f1481c213e03403461e deleted and replaced by tablet 0a64059ef2234ad6adbdfd8d3576f2a6
I20260927 15:06:10.186281 2286 raft_consensus.cc:482] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:10.186486 2286 raft_consensus.cc:504] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.187237 2286 leader_election.cc:288] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:10.187294 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ddca178f38e46b28fc1b5ed6416b990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.188385 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 0aec677006ab4407bd7ae4c0078d6b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 66b54ee47e424aacb7f53fd95b0ce889) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:10.188427 1099 leader_election.cc:341] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b375902081c54cdb84fdb075eec6baf7
I20260927 15:06:10.188643 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72862763900249b8a7079fde891d8021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.191639 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 916663fe0c6c46b1b3415e165d60187f
I20260927 15:06:10.193456 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 916663fe0c6c46b1b3415e165d60187f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:10.194782 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d443f4fb7bc84bf3a8d190ef7ac8a570" } modify_external_catalogs: true
I20260927 15:06:10.195196 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d443f4fb7bc84bf3a8d190ef7ac8a570" } modify_external_catalogs: true
I20260927 15:06:10.195521 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e7068df5611442f19ba70e32b3b81cb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:10.196240 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7068df5611442f19ba70e32b3b81cb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:10.196631 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1584e270ee294e3f9079b464b830f50a" } modify_external_catalogs: true
I20260927 15:06:10.196815 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1584e270ee294e3f9079b464b830f50a" } modify_external_catalogs: true
I20260927 15:06:10.196983 1281 tablet_service.cc:1467] Processing CreateTablet for tablet d0b3fe3365f642e1b7b5836388ed7940 (DEFAULT_TABLE table=default.Table_e855555999f4452ba1cabab6862b3c47 [id=c254715a5e59474aae1cdb2b97327c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.197909 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_30f44c4820b9415daf4edfe7ea689da3" } modify_external_catalogs: true
I20260927 15:06:10.198132 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_30f44c4820b9415daf4edfe7ea689da3" } modify_external_catalogs: true
I20260927 15:06:10.198139 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3dc5ac5b1bbc4b76a78514b41ed76b79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:10.198735 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dc5ac5b1bbc4b76a78514b41ed76b79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:10.200412 1373 connection.cc:535] client connection to 127.0.201.60:46799 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 15:06:10.201293 1099 connection.cc:535] client connection to 127.0.201.60:46799 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260927 15:06:10.202963 898 connection.cc:535] client connection to 127.0.201.60:46799 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 15:06:10.203238 880 master_runner.cc:186] Error getting master registration for 127.0.201.60:46799: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107),
I20260927 15:06:10.203404 880 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260927 15:06:10.203630 898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
I20260927 15:06:10.206633 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc2974e11cf1446895607b4ccec16386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.207027 1562 ts_tablet_manager.cc:1918] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:10.207185 1562 log.cc:1196] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/ad5af5df58824fe88d607a93216bd228
I20260927 15:06:10.207647 1562 ts_tablet_manager.cc:1939] T ad5af5df58824fe88d607a93216bd228 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:10.209501 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c195d8161e24a2bb02b98c89aaa8d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.211148 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a695b4fd5294f32a6644154487c1486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.211719 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc2974e11cf1446895607b4ccec16386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.211941 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba9f24239ae14eaf80b96a711596b00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.212368 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0617b596022e48e7a2913762ae39251e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.212729 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e40561ea6c2d4c6b856b3f123e337f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.213053 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c37ef29622a4f9ebc2439c001ba8610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.213408 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72862763900249b8a7079fde891d8021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.213590 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4128146e2fcf4ed7ba213fa6d19fe7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.213778 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08a66f1770dc45daaac458f3db9df7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.213955 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ddca178f38e46b28fc1b5ed6416b990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.214102 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 997c93bdf78b49709130d97a8d96a5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.214533 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c195d8161e24a2bb02b98c89aaa8d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.217289 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90aa4663989b40b9825b72ce216fa8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.217720 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0b3fe3365f642e1b7b5836388ed7940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.218114 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3050246c0a094c90b0810afcf812aaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.218472 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6697c852d114b7391717c7a36749127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.211634 2303 tablet.cc:1722] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:10.223366 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0d667472ee4f1481c213e03403461e with delete_type TABLET_DATA_DELETED (replaced by tablet 0a64059ef2234ad6adbdfd8d3576f2a6) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:10.227380 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0b3fe3365f642e1b7b5836388ed7940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.230273 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 08a66f1770dc45daaac458f3db9df7cc (DEFAULT_TABLE table=default.Table_e690924686a146e18b23b31b4da1470e [id=ecfae1a1395743d385da5fedb53f5434]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.230952 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a5001fbf122c4ec18fe48ad0196e5b42" } modify_external_catalogs: true
I20260927 15:06:10.231211 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a5001fbf122c4ec18fe48ad0196e5b42" } modify_external_catalogs: true
I20260927 15:06:10.231900 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a490439c7f9f49cc92a26631b8a8d04e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:10.232607 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a490439c7f9f49cc92a26631b8a8d04e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:10.233995 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc2974e11cf1446895607b4ccec16386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.234216 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ddca178f38e46b28fc1b5ed6416b990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.234603 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c37ef29622a4f9ebc2439c001ba8610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.235142 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 997c93bdf78b49709130d97a8d96a5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.235956 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90aa4663989b40b9825b72ce216fa8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.236454 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08a66f1770dc45daaac458f3db9df7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.236898 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0b3fe3365f642e1b7b5836388ed7940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.237344 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e40561ea6c2d4c6b856b3f123e337f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.237757 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a695b4fd5294f32a6644154487c1486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.238380 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0617b596022e48e7a2913762ae39251e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.238812 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba9f24239ae14eaf80b96a711596b00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.239270 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c195d8161e24a2bb02b98c89aaa8d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.240139 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72862763900249b8a7079fde891d8021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.240707 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3050246c0a094c90b0810afcf812aaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.242430 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6697c852d114b7391717c7a36749127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.246997 1267 tablet_service.cc:1467] Processing CreateTablet for tablet e40561ea6c2d4c6b856b3f123e337f64 (DEFAULT_TABLE table=default.Table_a0619053a2d04afda155e55e08d6bc7e [id=a6a404910b2247fa9cdca76d4e9a183d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.247123 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 472) took 4393 ms. Trace:
I20260927 15:06:10.247277 1562 rpcz_store.cc:276] 0927 15:06:05.853736 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.854599 (+ 863us) service_pool.cc:227] Handling call
0927 15:06:09.978633 (+4124034us) ts_tablet_manager.cc:1145] Deleting tablet ad5af5df58824fe88d607a93216bd228
0927 15:06:09.978646 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.111713 (+133067us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.206880 (+ 95167us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.247080 (+ 40200us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4123830}
I20260927 15:06:10.247792 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 474) took 4392 ms. Trace:
I20260927 15:06:10.247931 1562 rpcz_store.cc:276] 0927 15:06:05.855416 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.855566 (+ 150us) service_pool.cc:227] Handling call
0927 15:06:10.247619 (+4392053us) ts_tablet_manager.cc:1145] Deleting tablet 424b66c69254487f932894516d570204
0927 15:06:10.247634 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.247759 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4380189}
I20260927 15:06:10.248278 1562 tablet_replica.cc:330] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:10.248548 1562 raft_consensus.cc:2229] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:10.248739 1562 raft_consensus.cc:2258] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:10.249419 1562 ts_tablet_manager.cc:1905] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:10.244159 1238 connection.cc:535] client connection to 127.0.201.60:46799 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260927 15:06:10.281556 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4128146e2fcf4ed7ba213fa6d19fe7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.269105 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 90aa4663989b40b9825b72ce216fa8d0 (DEFAULT_TABLE table=default.Table_b21edeb66a3d44688131b1bbb44d7dab [id=dcad572d166f492a9486c7cee1df3563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.289300 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet ad5af5df58824fe88d607a93216bd228 (table default.Table_86b086d55b34411782656982b6de6a74 [id=63f859bf91e142e3a4b9600a580b6b39]) successfully deleted
W20260927 15:06:10.289775 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 424b66c69254487f932894516d570204 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 424b66c69254487f932894516d570204 already in progress: creating tablet
I20260927 15:06:10.313005 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 916663fe0c6c46b1b3415e165d60187f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:10.316862 2233 ts_tablet_manager.cc:1918] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:10.316996 2233 log.cc:1196] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/48e7eac8753f425d90302360d228ee54
I20260927 15:06:10.317310 2233 ts_tablet_manager.cc:1939] T 48e7eac8753f425d90302360d228ee54 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:10.329515 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 916663fe0c6c46b1b3415e165d60187f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:10.313273 1552 tablet_bootstrap.cc:492] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:10.329886 1552 ts_tablet_manager.cc:1397] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.511s user 0.020s sys 0.020s
I20260927 15:06:10.330657 1552 raft_consensus.cc:348] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.330979 1552 raft_consensus.cc:374] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.331054 1552 raft_consensus.cc:729] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.331278 1552 consensus_queue.cc:260] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.331787 1552 ts_tablet_manager.cc:1428] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:10.332108 1552 tablet_bootstrap.cc:492] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:10.333688 1552 tablet_bootstrap.cc:654] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.339865 2310 tablet.cc:1722] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:10.317281 1239 leader_election.cc:302] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:10.342971 2299 raft_consensus.cc:2726] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:10.343370 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 346796us
I20260927 15:06:10.343636 1561 tablet_bootstrap.cc:492] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:10.343933 1561 ts_tablet_manager.cc:1397] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.397s user 0.002s sys 0.003s
I20260927 15:06:10.344394 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba14b7531bb647248572be10d2b43cf2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:10.345283 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b375902081c54cdb84fdb075eec6baf7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:10.346091 1301 raft_consensus.cc:3037] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:10.348109 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08a66f1770dc45daaac458f3db9df7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.348587 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90aa4663989b40b9825b72ce216fa8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.348973 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e40561ea6c2d4c6b856b3f123e337f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.319514 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0d667472ee4f1481c213e03403461e with delete_type TABLET_DATA_DELETED (replaced by tablet 0a64059ef2234ad6adbdfd8d3576f2a6) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:10.319716 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 997c93bdf78b49709130d97a8d96a5a5 (DEFAULT_TABLE table=default.Table_279db08831174124bf691a8cad553e81 [id=5de6f33b4fa24254a432ee069ed91324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.359413 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 997c93bdf78b49709130d97a8d96a5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.363562 2322 raft_consensus.cc:482] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:10.364128 2322 raft_consensus.cc:504] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:10.366006 1102 consensus_peers.cc:487] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:10.365965 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41cd38355e64590b43b2e1271c43e91" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:10.366312 1102 leader_election.cc:341] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.366429 1102 leader_election.cc:302] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:10.366529 1376 leader_election.cc:341] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:10.366889 1102 leader_election.cc:341] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Not found: Tablet not found: 377847d06b534883ba2b870ca3317fe0
I20260927 15:06:10.367012 1102 leader_election.cc:302] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:10.367400 1102 leader_election.cc:341] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.367514 1102 leader_election.cc:302] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:10.367759 2288 raft_consensus.cc:2726] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:10.367931 2288 raft_consensus.cc:2726] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:10.367524 2287 raft_consensus.cc:2726] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:10.368455 2322 leader_election.cc:288] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:10.383602 1556 tablet_bootstrap.cc:492] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.383744 1556 ts_tablet_manager.cc:1397] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.240s user 0.021s sys 0.010s
I20260927 15:06:10.384495 1556 raft_consensus.cc:348] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.384691 1556 raft_consensus.cc:374] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.384745 1556 raft_consensus.cc:729] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.384961 1556 consensus_queue.cc:260] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.385490 1556 ts_tablet_manager.cc:1428] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:10.385759 1556 tablet_bootstrap.cc:492] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:10.388427 1556 tablet_bootstrap.cc:654] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.392264 1556 tablet_bootstrap.cc:492] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.392444 1556 ts_tablet_manager.cc:1397] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260927 15:06:10.393911 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 646) took 1269 ms. Trace:
I20260927 15:06:10.394029 2233 rpcz_store.cc:276] 0927 15:06:09.124357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.124951 (+ 594us) service_pool.cc:227] Handling call
0927 15:06:10.137870 (+1012919us) ts_tablet_manager.cc:1145] Deleting tablet 48e7eac8753f425d90302360d228ee54
0927 15:06:10.137880 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.313255 (+175375us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.316754 (+ 3499us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.393886 (+ 77132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1010771}
I20260927 15:06:10.395221 2233 tablet_replica.cc:330] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:10.395428 2233 raft_consensus.cc:2229] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:10.395591 2233 raft_consensus.cc:2258] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:10.396126 2233 ts_tablet_manager.cc:1905] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:10.404302 1556 raft_consensus.cc:348] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.404531 1556 raft_consensus.cc:374] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.404573 1556 raft_consensus.cc:729] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.404736 1556 consensus_queue.cc:260] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.412189 2119 ts_tablet_manager.cc:1918] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:10.412372 2119 log.cc:1196] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/30244d596d4d4090af7656027b48f22e
I20260927 15:06:10.412837 2119 ts_tablet_manager.cc:1939] T 30244d596d4d4090af7656027b48f22e P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:10.421326 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 566) took 1559 ms. Trace:
I20260927 15:06:10.421504 2119 rpcz_store.cc:276] 0927 15:06:08.861514 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.861564 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:10.097850 (+1236286us) ts_tablet_manager.cc:1145] Deleting tablet 30244d596d4d4090af7656027b48f22e
0927 15:06:10.097862 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.347655 (+249793us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.412008 (+ 64353us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.421278 (+ 9270us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1236010}
I20260927 15:06:10.421963 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 568) took 1522 ms. Trace:
I20260927 15:06:10.422103 2119 rpcz_store.cc:276] 0927 15:06:08.899758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.899829 (+ 71us) service_pool.cc:227] Handling call
0927 15:06:10.421796 (+1521967us) ts_tablet_manager.cc:1145] Deleting tablet 1b045b82515540e8813f9250726479e5
0927 15:06:10.421808 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.421921 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1521687}
I20260927 15:06:10.422508 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 570) took 1507 ms. Trace:
I20260927 15:06:10.422652 2119 rpcz_store.cc:276] 0927 15:06:08.915181 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.915451 (+ 270us) service_pool.cc:227] Handling call
0927 15:06:10.422373 (+1506922us) ts_tablet_manager.cc:1145] Deleting tablet 34348cffe35b46728e77df7dede29682
0927 15:06:10.422388 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.422469 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1506693}
I20260927 15:06:10.423000 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 571) took 1507 ms. Trace:
I20260927 15:06:10.423115 2119 rpcz_store.cc:276] 0927 15:06:08.915280 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.915721 (+ 441us) service_pool.cc:227] Handling call
0927 15:06:10.422875 (+1507154us) ts_tablet_manager.cc:1145] Deleting tablet f271c76b5f2447239d3d014fbde4e8b2
0927 15:06:10.422883 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.422966 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1506938}
I20260927 15:06:10.423601 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 572) took 1508 ms. Trace:
I20260927 15:06:10.423725 2119 rpcz_store.cc:276] 0927 15:06:08.915385 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.915971 (+ 586us) service_pool.cc:227] Handling call
0927 15:06:10.423459 (+1507488us) ts_tablet_manager.cc:1145] Deleting tablet 54f5c4b7c7a045bea1a79bc67a913f65
0927 15:06:10.423468 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.423568 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1507314}
I20260927 15:06:10.424055 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 569) took 1509 ms. Trace:
I20260927 15:06:10.424185 2119 rpcz_store.cc:276] 0927 15:06:08.915060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.916176 (+ 1116us) service_pool.cc:227] Handling call
0927 15:06:10.423939 (+1507763us) ts_tablet_manager.cc:1145] Deleting tablet 53ddb28f419d42afbaddf36966fa1509
0927 15:06:10.423947 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.424021 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1507585}
I20260927 15:06:10.424561 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 573) took 1490 ms. Trace:
I20260927 15:06:10.424683 2119 rpcz_store.cc:276] 0927 15:06:08.934587 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.934651 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:10.424444 (+1489793us) ts_tablet_manager.cc:1145] Deleting tablet 1d221f14ad57462e95017b9068eb8714
0927 15:06:10.424452 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.424523 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1489475}
I20260927 15:06:10.425065 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 604) took 1049 ms. Trace:
I20260927 15:06:10.425179 2119 rpcz_store.cc:276] 0927 15:06:09.375653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.376067 (+ 414us) service_pool.cc:227] Handling call
0927 15:06:10.424946 (+1048879us) ts_tablet_manager.cc:1145] Deleting tablet b19ddd29d7214931ad797497a0178544
0927 15:06:10.424959 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.425027 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":963500}
I20260927 15:06:10.425858 2119 tablet_replica.cc:330] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:10.426110 2119 raft_consensus.cc:2229] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:10.430991 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 30244d596d4d4090af7656027b48f22e (table default.Table_46238c103f2247faa5ba7f68d8b744c4 [id=5577906b11a841d58884c42d471a4427]) successfully deleted
W20260927 15:06:10.431669 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1b045b82515540e8813f9250726479e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b045b82515540e8813f9250726479e5 already in progress: creating tablet
W20260927 15:06:10.432268 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 34348cffe35b46728e77df7dede29682 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34348cffe35b46728e77df7dede29682 already in progress: creating tablet
W20260927 15:06:10.432803 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f271c76b5f2447239d3d014fbde4e8b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f271c76b5f2447239d3d014fbde4e8b2 already in progress: creating tablet
W20260927 15:06:10.433681 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 54f5c4b7c7a045bea1a79bc67a913f65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54f5c4b7c7a045bea1a79bc67a913f65 already in progress: creating tablet
W20260927 15:06:10.434111 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 53ddb28f419d42afbaddf36966fa1509 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53ddb28f419d42afbaddf36966fa1509 already in progress: creating tablet
W20260927 15:06:10.434615 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1d221f14ad57462e95017b9068eb8714 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d221f14ad57462e95017b9068eb8714 already in progress: creating tablet
W20260927 15:06:10.435103 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b19ddd29d7214931ad797497a0178544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b19ddd29d7214931ad797497a0178544 already in progress: creating tablet
W20260927 15:06:10.435578 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a8659865bf644458b3b5a78eae36a524 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8659865bf644458b3b5a78eae36a524 already in progress: creating tablet
W20260927 15:06:10.436043 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 81e0be77dff645f795237ffe779ed684 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81e0be77dff645f795237ffe779ed684 already in progress: creating tablet
W20260927 15:06:10.436467 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 81f65ad693894e7c8b575cd8e1942c14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f65ad693894e7c8b575cd8e1942c14 already in progress: creating tablet
I20260927 15:06:10.442009 1561 raft_consensus.cc:348] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.442368 1561 raft_consensus.cc:374] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.443185 1561 raft_consensus.cc:729] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.443464 1561 consensus_queue.cc:260] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.445430 1561 ts_tablet_manager.cc:1428] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.100s user 0.001s sys 0.001s
I20260927 15:06:10.445744 1561 tablet_bootstrap.cc:492] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:10.456398 2290 raft_consensus.cc:482] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:10.456607 2290 raft_consensus.cc:504] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.457501 2119 raft_consensus.cc:2258] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:10.457820 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9598ac8a916f4bf5b1cf9995a8149c70" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:10.458187 2119 ts_tablet_manager.cc:1905] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:10.462157 1556 ts_tablet_manager.cc:1428] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.070s user 0.002s sys 0.001s
I20260927 15:06:10.462548 1556 tablet_bootstrap.cc:492] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:10.464187 1556 tablet_bootstrap.cc:654] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:10.465368 1102 leader_election.cc:341] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.478585 2290 leader_election.cc:288] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:10.480203 1561 tablet_bootstrap.cc:654] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.497354 1556 tablet_bootstrap.cc:492] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.497545 1556 ts_tablet_manager.cc:1397] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.001s
I20260927 15:06:10.498381 1556 raft_consensus.cc:348] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.498610 1556 raft_consensus.cc:374] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.498659 1556 raft_consensus.cc:729] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.498997 1556 consensus_queue.cc:260] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.499570 1556 ts_tablet_manager.cc:1428] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:10.499877 1556 tablet_bootstrap.cc:492] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:10.501729 1556 tablet_bootstrap.cc:654] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.511699 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fe955ec8681e4926943f6748e21f5265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:10.512640 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe955ec8681e4926943f6748e21f5265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:10.514446 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_828cbafda2b74f2f8efdcf10df5e23c5" } new_table_name: "default.Table_2df9a1dcdfdc4adaa653c52a6c069c0f" modify_external_catalogs: true
I20260927 15:06:10.514446 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ac3e364e9065400eaa5e5f1b928fa4ee" } new_table_name: "default.Table_34126485857a4ac3b58dbedcc6d99043" modify_external_catalogs: true
I20260927 15:06:10.536373 2233 ts_tablet_manager.cc:1918] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:10.536705 2233 log.cc:1196] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/dc6f179aab784ae4822356e63332532f
I20260927 15:06:10.537071 2233 ts_tablet_manager.cc:1939] T dc6f179aab784ae4822356e63332532f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:10.557227 1552 tablet_bootstrap.cc:492] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:10.557555 1552 ts_tablet_manager.cc:1397] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.226s user 0.012s sys 0.014s
I20260927 15:06:10.558670 1552 raft_consensus.cc:348] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.559110 1552 raft_consensus.cc:374] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.559285 1552 raft_consensus.cc:729] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.559660 1552 consensus_queue.cc:260] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.561744 1552 ts_tablet_manager.cc:1428] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:10.570603 1552 tablet_bootstrap.cc:492] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:10.581687 1552 tablet_bootstrap.cc:654] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:10.583808 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 220995us
I20260927 15:06:10.584426 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 645) took 1460 ms. Trace:
I20260927 15:06:10.584568 2233 rpcz_store.cc:276] 0927 15:06:09.124263 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.124930 (+ 667us) service_pool.cc:227] Handling call
0927 15:06:10.395172 (+1270242us) ts_tablet_manager.cc:1145] Deleting tablet dc6f179aab784ae4822356e63332532f
0927 15:06:10.395187 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.515514 (+120327us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.518791 (+ 3277us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.584393 (+ 65602us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1236764}
I20260927 15:06:10.584652 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41cd38355e64590b43b2e1271c43e91" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:10.584913 2233 tablet_replica.cc:330] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:10.585105 2233 raft_consensus.cc:2229] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:10.585260 2233 raft_consensus.cc:2258] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:10.586704 2233 ts_tablet_manager.cc:1905] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:10.588253 2322 raft_consensus.cc:482] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:10.588402 2322 raft_consensus.cc:504] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.589068 2322 leader_election.cc:288] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:10.589905 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49913b1763c4a7b9413a801aff93b30" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:10.590634 1376 leader_election.cc:341] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.591005 2322 raft_consensus.cc:482] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:10.591265 1556 tablet_bootstrap.cc:492] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.591136 2322 raft_consensus.cc:504] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.591394 1556 ts_tablet_manager.cc:1397] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.092s user 0.001s sys 0.008s
I20260927 15:06:10.591779 2322 leader_election.cc:288] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:10.592229 1556 raft_consensus.cc:348] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.592519 1556 raft_consensus.cc:374] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.592574 1556 raft_consensus.cc:729] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.592754 1556 consensus_queue.cc:260] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.593181 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd2687f65780481c86a9942960ce7be1" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:10.593386 1556 ts_tablet_manager.cc:1428] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:10.593716 1556 tablet_bootstrap.cc:492] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:10.593880 1376 leader_election.cc:341] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.595525 1556 tablet_bootstrap.cc:654] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.595793 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49913b1763c4a7b9413a801aff93b30" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:10.596666 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd2687f65780481c86a9942960ce7be1" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:10.597301 1374 leader_election.cc:341] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.597481 1374 leader_election.cc:302] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:10.597791 2322 raft_consensus.cc:2726] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:10.599545 1374 leader_election.cc:341] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.599789 1374 leader_election.cc:302] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:10.600075 2322 raft_consensus.cc:2726] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:10.602135 1561 tablet_bootstrap.cc:492] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:10.602380 1561 ts_tablet_manager.cc:1397] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.157s user 0.003s sys 0.007s
I20260927 15:06:10.603427 1561 raft_consensus.cc:348] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.603906 1561 raft_consensus.cc:374] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.604023 1561 raft_consensus.cc:729] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.604360 1561 consensus_queue.cc:260] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.607606 1552 tablet_bootstrap.cc:492] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:10.607599 2290 raft_consensus.cc:482] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:10.607882 1552 ts_tablet_manager.cc:1397] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.003s
I20260927 15:06:10.607856 2290 raft_consensus.cc:504] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.608754 1552 raft_consensus.cc:348] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.609158 2290 leader_election.cc:288] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:10.609457 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54a07831078b48a59807f7da4a42bcec" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:10.610082 1552 raft_consensus.cc:374] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:10.610163 1102 leader_election.cc:341] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.610256 1552 raft_consensus.cc:729] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.610627 1552 consensus_queue.cc:260] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.611792 2119 ts_tablet_manager.cc:1918] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:10.611950 2119 log.cc:1196] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/3d454d65afa94aac9b34c253adfa4b0c
I20260927 15:06:10.612408 2119 ts_tablet_manager.cc:1939] T 3d454d65afa94aac9b34c253adfa4b0c P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:10.612870 1552 ts_tablet_manager.cc:1428] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:10.614854 1552 tablet_bootstrap.cc:492] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:10.616117 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 609) took 1096 ms. Trace:
I20260927 15:06:10.616241 2119 rpcz_store.cc:276] 0927 15:06:09.519461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.529303 (+ 9842us) service_pool.cc:227] Handling call
0927 15:06:10.425792 (+896489us) ts_tablet_manager.cc:1145] Deleting tablet 3d454d65afa94aac9b34c253adfa4b0c
0927 15:06:10.425798 (+ 6us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.519021 (+ 93223us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.611654 (+ 92633us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.616061 (+ 4407us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":888821}
I20260927 15:06:10.616787 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 606) took 1156 ms. Trace:
I20260927 15:06:10.616919 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 3d454d65afa94aac9b34c253adfa4b0c (table default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]) successfully deleted
I20260927 15:06:10.616904 2119 rpcz_store.cc:276] 0927 15:06:09.460231 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.525382 (+ 65151us) service_pool.cc:227] Handling call
0927 15:06:10.616564 (+1091182us) ts_tablet_manager.cc:1145] Deleting tablet f86725bd5d5247faa0dff164857629d3
0927 15:06:10.616576 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.616732 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1072998}
W20260927 15:06:10.617636 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f86725bd5d5247faa0dff164857629d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f86725bd5d5247faa0dff164857629d3 already in progress: creating tablet
W20260927 15:06:10.617915 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bda4bc28542d4b5e9cb1b432e5cf54d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bda4bc28542d4b5e9cb1b432e5cf54d7 already in progress: creating tablet
W20260927 15:06:10.618132 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3a47c42f9edd4e1ab761317b7b58e8df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a47c42f9edd4e1ab761317b7b58e8df already in progress: creating tablet
I20260927 15:06:10.618345 2119 tablet_replica.cc:330] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:10.618561 2119 raft_consensus.cc:2229] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:10.619021 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 610ff6563dc64e73b2b4d7c268468b21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 610ff6563dc64e73b2b4d7c268468b21 already in progress: creating tablet
W20260927 15:06:10.619246 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0d6523d56f344208abc30f0d82138998 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d6523d56f344208abc30f0d82138998 already in progress: creating tablet
W20260927 15:06:10.619447 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b9a97e3e6a5749feb4dd5f835d9c01ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a97e3e6a5749feb4dd5f835d9c01ac already in progress: creating tablet
W20260927 15:06:10.619623 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ddfb62d579704b30a3482b7f95be4922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddfb62d579704b30a3482b7f95be4922 already in progress: creating tablet
I20260927 15:06:10.619728 2119 raft_consensus.cc:2258] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:10.619817 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 01b7e017ead242849585679873a69b43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01b7e017ead242849585679873a69b43 already in progress: creating tablet
W20260927 15:06:10.620039 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 643ec85d098444d6b082fe4038c50c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 643ec85d098444d6b082fe4038c50c4d already in progress: creating tablet
I20260927 15:06:10.620352 2119 ts_tablet_manager.cc:1905] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:10.620817 2322 raft_consensus.cc:482] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:10.621110 2322 raft_consensus.cc:504] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.622462 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70cc2e16bd6c40bf99ed4436f17d7096" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:10.623167 1376 leader_election.cc:341] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.623545 2322 leader_election.cc:288] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:10.627166 2233 ts_tablet_manager.cc:1918] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:10.627377 2233 log.cc:1196] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/fe7816e099094d13887650fc223097c7
I20260927 15:06:10.627794 2233 ts_tablet_manager.cc:1939] T fe7816e099094d13887650fc223097c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:10.633090 1552 tablet_bootstrap.cc:654] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.634346 1556 tablet_bootstrap.cc:492] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.634552 1556 ts_tablet_manager.cc:1397] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.005s
I20260927 15:06:10.635404 1556 raft_consensus.cc:348] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.635710 1556 raft_consensus.cc:374] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.635828 1556 raft_consensus.cc:729] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.636104 1556 consensus_queue.cc:260] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.636727 1556 ts_tablet_manager.cc:1428] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:10.637048 1556 tablet_bootstrap.cc:492] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:10.638643 1791 kernel_stack_watchdog.cc:198] Thread 2099 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 268ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7fbc2e9c1980 (unknown) at ??:0
@ 0x8a5e57 __sanitizer::internal_sched_yield() at ??:?
@ 0x81ec1d __interceptor_pthread_create at ??:?
@ 0x7fbc2b6dbbfb kudu::Thread::StartThread() at ??:0
@ 0x9da5bc kudu::Thread::Create() at ??:?
@ 0x7fbc2b6fbfd8 kudu::ThreadPool::CreateThread() at ??:0
@ 0x7fbc2b6f7beb kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7fbc2b6fccef kudu::ThreadPool::Submit() at ??:0
@ 0x7fbc37eff679 kudu::tablet::OpDriver::ApplyAsync() at ??:0
@ 0x7fbc37efd02f kudu::tablet::OpDriver::Prepare() at ??:0
@ 0x7fbc37efc35a kudu::tablet::OpDriver::PrepareTask() at ??:0
@ 0x7fbc37f041bc kudu::tablet::OpDriver::ExecuteAsync()::$_1::operator()() at ??:0
@ 0x7fbc37f04039 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fbc2b6fe345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbc2b70191c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
I20260927 15:06:10.642341 2327 tablet.cc:1722] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:10.644685 1556 tablet_bootstrap.cc:654] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:10.648561 1099 leader_election.cc:341] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9598ac8a916f4bf5b1cf9995a8149c70
I20260927 15:06:10.648727 1099 leader_election.cc:302] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:10.648970 2290 raft_consensus.cc:2726] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:10.661434 2290 raft_consensus.cc:482] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:10.661650 2290 raft_consensus.cc:504] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.663105 2290 leader_election.cc:288] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:10.663103 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16884c7343be436aa312ec0af40f5e33" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:10.663727 1102 leader_election.cc:341] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:10.667865 1099 leader_election.cc:341] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 54a07831078b48a59807f7da4a42bcec
I20260927 15:06:10.668007 1099 leader_election.cc:302] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:10.668291 2290 raft_consensus.cc:2726] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:10.669431 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 69887.6us
W20260927 15:06:10.669735 1374 leader_election.cc:341] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.669831 1374 leader_election.cc:302] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:10.674331 1552 tablet_bootstrap.cc:492] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:10.674492 1552 ts_tablet_manager.cc:1397] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.002s
I20260927 15:06:10.675290 1561 ts_tablet_manager.cc:1428] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.073s user 0.002s sys 0.000s
I20260927 15:06:10.675360 1552 raft_consensus.cc:348] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.675601 1552 raft_consensus.cc:374] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.675702 1552 raft_consensus.cc:729] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.676086 1552 consensus_queue.cc:260] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.678454 1552 ts_tablet_manager.cc:1428] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260927 15:06:10.679955 1552 tablet_bootstrap.cc:492] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:10.681322 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 01b7e017ead242849585679873a69b43 (table default.Table_fac248ae4718435c9ec9d479beaaeae4 [id=b28d0e08cf944e17a720641dab1f23f5], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 01b7e017ead242849585679873a69b43 consensus state has no leader
I20260927 15:06:10.682883 1552 tablet_bootstrap.cc:654] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.684671 1556 tablet_bootstrap.cc:492] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.684815 1556 ts_tablet_manager.cc:1397] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.003s
W20260927 15:06:10.689325 1099 leader_election.cc:341] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 16884c7343be436aa312ec0af40f5e33
I20260927 15:06:10.689500 1099 leader_election.cc:302] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:10.690555 2290 raft_consensus.cc:2726] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:10.691485 1561 tablet_bootstrap.cc:492] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:10.693672 1561 tablet_bootstrap.cc:654] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.697592 2323 raft_consensus.cc:2726] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:10.697894 1556 raft_consensus.cc:348] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.698144 1556 raft_consensus.cc:374] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.698204 1556 raft_consensus.cc:729] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.698421 1556 consensus_queue.cc:260] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.699015 1556 ts_tablet_manager.cc:1428] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.014s user 0.002s sys 0.001s
I20260927 15:06:10.699357 1556 tablet_bootstrap.cc:492] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:10.701174 1556 tablet_bootstrap.cc:654] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.701439 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70cc2e16bd6c40bf99ed4436f17d7096" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:10.702015 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 655) took 1493 ms. Trace:
I20260927 15:06:10.702111 2233 rpcz_store.cc:276] 0927 15:06:09.208183 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.220742 (+ 12559us) service_pool.cc:227] Handling call
0927 15:06:10.584868 (+1364126us) ts_tablet_manager.cc:1145] Deleting tablet fe7816e099094d13887650fc223097c7
0927 15:06:10.584879 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.612753 (+ 27874us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.626994 (+ 14241us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.701994 (+ 75000us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1363839}
I20260927 15:06:10.702601 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 666) took 1283 ms. Trace:
I20260927 15:06:10.702685 2233 rpcz_store.cc:276] 0927 15:06:09.419535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.419606 (+ 71us) service_pool.cc:227] Handling call
0927 15:06:10.702465 (+1282859us) ts_tablet_manager.cc:1145] Deleting tablet 81f65ad693894e7c8b575cd8e1942c14
0927 15:06:10.702476 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.702585 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1265983}
I20260927 15:06:10.703063 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 662) took 1314 ms. Trace:
I20260927 15:06:10.703138 2233 rpcz_store.cc:276] 0927 15:06:09.388627 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.388723 (+ 96us) service_pool.cc:227] Handling call
0927 15:06:10.702911 (+1314188us) ts_tablet_manager.cc:1145] Deleting tablet b19ddd29d7214931ad797497a0178544
0927 15:06:10.702922 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.703045 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1260943}
I20260927 15:06:10.703457 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 664) took 1309 ms. Trace:
I20260927 15:06:10.703528 2233 rpcz_store.cc:276] 0927 15:06:09.393576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.393686 (+ 110us) service_pool.cc:227] Handling call
0927 15:06:10.703350 (+1309664us) ts_tablet_manager.cc:1145] Deleting tablet f86725bd5d5247faa0dff164857629d3
0927 15:06:10.703359 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.703443 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1256105}
I20260927 15:06:10.703882 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 663) took 1312 ms. Trace:
I20260927 15:06:10.703953 2233 rpcz_store.cc:276] 0927 15:06:09.391460 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.392692 (+ 1232us) service_pool.cc:227] Handling call
0927 15:06:10.703746 (+1311054us) ts_tablet_manager.cc:1145] Deleting tablet a8659865bf644458b3b5a78eae36a524
0927 15:06:10.703755 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.703868 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1255845}
I20260927 15:06:10.704233 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 665) took 1285 ms. Trace:
I20260927 15:06:10.704301 2233 rpcz_store.cc:276] 0927 15:06:09.419151 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.419468 (+ 317us) service_pool.cc:227] Handling call
0927 15:06:10.704133 (+1284665us) ts_tablet_manager.cc:1145] Deleting tablet 81e0be77dff645f795237ffe779ed684
0927 15:06:10.704142 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.704221 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1253736}
I20260927 15:06:10.704608 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 675) took 1034 ms. Trace:
I20260927 15:06:10.704674 2233 rpcz_store.cc:276] 0927 15:06:09.669767 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.670614 (+ 847us) service_pool.cc:227] Handling call
0927 15:06:10.704494 (+1033880us) ts_tablet_manager.cc:1145] Deleting tablet bda4bc28542d4b5e9cb1b432e5cf54d7
0927 15:06:10.704502 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.704594 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1033573}
I20260927 15:06:10.704957 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 676) took 1035 ms. Trace:
I20260927 15:06:10.705025 2233 rpcz_store.cc:276] 0927 15:06:09.669910 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.670965 (+ 1055us) service_pool.cc:227] Handling call
0927 15:06:10.704863 (+1033898us) ts_tablet_manager.cc:1145] Deleting tablet 0d6523d56f344208abc30f0d82138998
0927 15:06:10.704871 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.704943 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1033703}
I20260927 15:06:10.705292 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 677) took 1035 ms. Trace:
I20260927 15:06:10.705364 2233 rpcz_store.cc:276] 0927 15:06:09.670015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.671199 (+ 1184us) service_pool.cc:227] Handling call
0927 15:06:10.705202 (+1034003us) ts_tablet_manager.cc:1145] Deleting tablet 3a47c42f9edd4e1ab761317b7b58e8df
0927 15:06:10.705210 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.705278 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1033827}
I20260927 15:06:10.705673 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 678) took 1035 ms. Trace:
I20260927 15:06:10.705740 2233 rpcz_store.cc:276] 0927 15:06:09.670222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.671406 (+ 1184us) service_pool.cc:227] Handling call
0927 15:06:10.705559 (+1034153us) ts_tablet_manager.cc:1145] Deleting tablet 610ff6563dc64e73b2b4d7c268468b21
0927 15:06:10.705568 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.705658 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1033997}
I20260927 15:06:10.706020 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 679) took 1035 ms. Trace:
I20260927 15:06:10.706085 2233 rpcz_store.cc:276] 0927 15:06:09.670546 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.671587 (+ 1041us) service_pool.cc:227] Handling call
0927 15:06:10.705923 (+1034336us) ts_tablet_manager.cc:1145] Deleting tablet 01b7e017ead242849585679873a69b43
0927 15:06:10.705933 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.706007 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1034218}
I20260927 15:06:10.706357 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 680) took 1029 ms. Trace:
I20260927 15:06:10.706450 2233 rpcz_store.cc:276] 0927 15:06:09.676438 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.676500 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:10.706262 (+1029762us) ts_tablet_manager.cc:1145] Deleting tablet b9a97e3e6a5749feb4dd5f835d9c01ac
0927 15:06:10.706272 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.706343 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029548}
I20260927 15:06:10.706679 2233 tablet_replica.cc:330] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:10.707705 1374 leader_election.cc:341] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:10.707820 1374 leader_election.cc:302] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:10.708076 2323 raft_consensus.cc:2726] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:10.708899 2233 raft_consensus.cc:2229] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:10.709056 2233 raft_consensus.cc:2258] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:10.709583 2233 ts_tablet_manager.cc:1905] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:10.711680 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 48e7eac8753f425d90302360d228ee54 (table default.Table_336bf4e2b65f4a6ea300b83b198b1b4f [id=56f6b3596fe64d17a0b2fcf2c187eb02]) successfully deleted
I20260927 15:06:10.711783 2306 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:60504 (request call id 650) took 1053 ms. Trace:
I20260927 15:06:10.711899 2306 rpcz_store.cc:276] 0927 15:06:09.658812 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.658944 (+ 132us) service_pool.cc:227] Handling call
0927 15:06:10.711738 (+1052794us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:09.659852 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0927 15:06:09.660063 (+ 211us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 15:06:09.660076 (+ 13us) alter_schema_op.cc:65] Acquired schema lock
0927 15:06:09.660086 (+ 10us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0927 15:06:09.660136 (+ 50us) alter_schema_op.cc:126] START. Timestamp: 1790521569660100
0927 15:06:09.660142 (+ 6us) op_driver.cc:331] REPLICATION: starting
0927 15:06:09.660409 (+ 267us) log.cc:842] Serialized 173 byte log entry
0927 15:06:10.045749 (+385340us) op_driver.cc:444] REPLICATION: finished
0927 15:06:10.078546 (+ 32797us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0927 15:06:10.079265 (+ 719us) log.cc:842] Serialized 5 byte log entry
0927 15:06:10.711309 (+632044us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.711645 (+ 336us) log.cc:842] Serialized 14 byte log entry
0927 15:06:10.711689 (+ 44us) alter_schema_op.cc:71] Released schema lock
0927 15:06:10.711696 (+ 7us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":32726,"prepare.queue_time_us":519,"prepare.run_cpu_time_us":692,"prepare.run_wall_time_us":27868,"raft.queue_time_us":824,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":641,"replication_time_us":385576,"thread_start_us":51534,"threads_started":2}]]}
I20260927 15:06:10.712549 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet dc6f179aab784ae4822356e63332532f (table default.Table_2f2bd859db5046c0afc8811df26a404f [id=359e0f2f64c54790a1fbb004164bf090]) successfully deleted
I20260927 15:06:10.712728 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet fe7816e099094d13887650fc223097c7 (table default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]) successfully deleted
W20260927 15:06:10.712893 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 81f65ad693894e7c8b575cd8e1942c14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f65ad693894e7c8b575cd8e1942c14 already in progress: creating tablet
W20260927 15:06:10.713094 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b19ddd29d7214931ad797497a0178544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b19ddd29d7214931ad797497a0178544 already in progress: creating tablet
W20260927 15:06:10.713235 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f86725bd5d5247faa0dff164857629d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f86725bd5d5247faa0dff164857629d3 already in progress: creating tablet
W20260927 15:06:10.713387 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a8659865bf644458b3b5a78eae36a524 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8659865bf644458b3b5a78eae36a524 already in progress: creating tablet
W20260927 15:06:10.713554 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 81e0be77dff645f795237ffe779ed684 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81e0be77dff645f795237ffe779ed684 already in progress: creating tablet
W20260927 15:06:10.713716 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bda4bc28542d4b5e9cb1b432e5cf54d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bda4bc28542d4b5e9cb1b432e5cf54d7 already in progress: creating tablet
W20260927 15:06:10.713850 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0d6523d56f344208abc30f0d82138998 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d6523d56f344208abc30f0d82138998 already in progress: creating tablet
W20260927 15:06:10.714028 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3a47c42f9edd4e1ab761317b7b58e8df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a47c42f9edd4e1ab761317b7b58e8df already in progress: creating tablet
W20260927 15:06:10.714172 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 610ff6563dc64e73b2b4d7c268468b21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 610ff6563dc64e73b2b4d7c268468b21 already in progress: creating tablet
W20260927 15:06:10.714329 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 01b7e017ead242849585679873a69b43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01b7e017ead242849585679873a69b43 already in progress: creating tablet
W20260927 15:06:10.714489 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b9a97e3e6a5749feb4dd5f835d9c01ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a97e3e6a5749feb4dd5f835d9c01ac already in progress: creating tablet
W20260927 15:06:10.714663 898 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 -> Peer 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799): Couldn't send request to peer 2a122de3662f485f8f44b0a5e4b29862. Status: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:10.720034 911 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_d10e6eb8078c475abd696473005670a3 [id=c4ddc66927a94fd2abc8e44012cf69f7]). Expected version 3 got 0
I20260927 15:06:10.720351 1552 tablet_bootstrap.cc:492] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:10.720640 1552 ts_tablet_manager.cc:1397] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.004s
I20260927 15:06:10.721849 1552 raft_consensus.cc:348] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.722146 1552 raft_consensus.cc:374] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.722215 1552 raft_consensus.cc:729] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.722617 1552 consensus_queue.cc:260] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.727728 1268 tablet_service.cc:1467] Processing CreateTablet for tablet e2c276b721a74822a5275c5924de20b6 (DEFAULT_TABLE table=default.Table_2ada29db8b78455c9c8897f8027d3804 [id=578d2d60b6f541d2a6210971d4f94838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.729063 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 27f52b4ae5a2467c86dec6cced142a64 (DEFAULT_TABLE table=default.Table_f0f5be0b569d486990e60f9bdf68958b [id=6b92a3e4c7b74dbf9b8701c821b85aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.729607 1278 tablet_service.cc:1467] Processing CreateTablet for tablet cd1da3a0f4594b8884dd54497f7169ed (DEFAULT_TABLE table=default.Table_7e960dd56c394b6f9171078af38cee79 [id=c0005e04c8324a898f06a42ed2c30c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.731155 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 1defd5bba3c34cae8893559ccfc8b5cd (DEFAULT_TABLE table=default.Table_f4624ee1f1074d14a78879480f51ac28 [id=0773a459433b4fcf9516adf7245d76f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.731693 1272 tablet_service.cc:1467] Processing CreateTablet for tablet b9f9962d4d8c46c49795f95192b79a56 (DEFAULT_TABLE table=default.Table_53dbfc415ede4dc69abb5bd5ede1f297 [id=26a5a564435c4c89ab7ebc90ceded149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.731967 1266 tablet_service.cc:1467] Processing CreateTablet for tablet a0152ed16fbe44c48e17c6bc34328df7 (DEFAULT_TABLE table=default.Table_ecb61742b1f74785ba7bc23a44e91dd3 [id=5319881d05a647bd9b772bd1ff481181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.735723 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 27f52b4ae5a2467c86dec6cced142a64 (DEFAULT_TABLE table=default.Table_f0f5be0b569d486990e60f9bdf68958b [id=6b92a3e4c7b74dbf9b8701c821b85aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.736187 1127 tablet_service.cc:1467] Processing CreateTablet for tablet cd1da3a0f4594b8884dd54497f7169ed (DEFAULT_TABLE table=default.Table_7e960dd56c394b6f9171078af38cee79 [id=c0005e04c8324a898f06a42ed2c30c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.736564 1140 tablet_service.cc:1467] Processing CreateTablet for tablet a0152ed16fbe44c48e17c6bc34328df7 (DEFAULT_TABLE table=default.Table_ecb61742b1f74785ba7bc23a44e91dd3 [id=5319881d05a647bd9b772bd1ff481181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.736903 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 1defd5bba3c34cae8893559ccfc8b5cd (DEFAULT_TABLE table=default.Table_f4624ee1f1074d14a78879480f51ac28 [id=0773a459433b4fcf9516adf7245d76f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.737236 1145 tablet_service.cc:1467] Processing CreateTablet for tablet b9f9962d4d8c46c49795f95192b79a56 (DEFAULT_TABLE table=default.Table_53dbfc415ede4dc69abb5bd5ede1f297 [id=26a5a564435c4c89ab7ebc90ceded149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.737258 1552 ts_tablet_manager.cc:1428] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.017s user 0.001s sys 0.002s
I20260927 15:06:10.737780 1142 tablet_service.cc:1467] Processing CreateTablet for tablet e2c276b721a74822a5275c5924de20b6 (DEFAULT_TABLE table=default.Table_2ada29db8b78455c9c8897f8027d3804 [id=578d2d60b6f541d2a6210971d4f94838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.741511 1552 tablet_bootstrap.cc:492] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:10.742691 2099 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.600s user 0.064s sys 0.140s
W20260927 15:06:10.742817 2099 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.600s user 0.064s sys 0.140s
I20260927 15:06:10.742439 1561 tablet_bootstrap.cc:492] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:10.749871 1561 ts_tablet_manager.cc:1397] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.001s
W20260927 15:06:10.750339 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72862763900249b8a7079fde891d8021 consensus state has no leader
W20260927 15:06:10.751427 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 180c347e066f4d9a897825bad8a32d69 consensus state has no leader
I20260927 15:06:10.751380 1403 tablet_service.cc:1467] Processing CreateTablet for tablet a0152ed16fbe44c48e17c6bc34328df7 (DEFAULT_TABLE table=default.Table_ecb61742b1f74785ba7bc23a44e91dd3 [id=5319881d05a647bd9b772bd1ff481181]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.751564 1405 tablet_service.cc:1467] Processing CreateTablet for tablet e2c276b721a74822a5275c5924de20b6 (DEFAULT_TABLE table=default.Table_2ada29db8b78455c9c8897f8027d3804 [id=578d2d60b6f541d2a6210971d4f94838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.751961 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 1defd5bba3c34cae8893559ccfc8b5cd (DEFAULT_TABLE table=default.Table_f4624ee1f1074d14a78879480f51ac28 [id=0773a459433b4fcf9516adf7245d76f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.752032 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 27f52b4ae5a2467c86dec6cced142a64 (DEFAULT_TABLE table=default.Table_f0f5be0b569d486990e60f9bdf68958b [id=6b92a3e4c7b74dbf9b8701c821b85aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.752405 1413 tablet_service.cc:1467] Processing CreateTablet for tablet cd1da3a0f4594b8884dd54497f7169ed (DEFAULT_TABLE table=default.Table_7e960dd56c394b6f9171078af38cee79 [id=c0005e04c8324a898f06a42ed2c30c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.752692 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5b361eced71042afbda25e212feb6424"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:10.753296 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b361eced71042afbda25e212feb6424 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:10.753667 1407 tablet_service.cc:1467] Processing CreateTablet for tablet b9f9962d4d8c46c49795f95192b79a56 (DEFAULT_TABLE table=default.Table_53dbfc415ede4dc69abb5bd5ede1f297 [id=26a5a564435c4c89ab7ebc90ceded149]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:10.753667 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_59fba975ee904a36b51d48dcc5c0816a" } new_table_name: "default.Table_99fa10fbfa5b42b0a1953eaa2e81f7f7" modify_external_catalogs: true
I20260927 15:06:10.755577 2338 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b6a41e027f0448cafe3365f23103f92)
I20260927 15:06:10.756985 2338 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } }
I20260927 15:06:10.759797 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_d10e6eb8078c475abd696473005670a3 [id=c4ddc66927a94fd2abc8e44012cf69f7]). Expected version 3 got 1
I20260927 15:06:10.760097 910 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14 (table default.Table_bf61e56b4709425c99c5a22da57ddba9 [id=9ac1472258a24d01892257dd9c9874a8]). Expected version 1 got 0
I20260927 15:06:10.760640 1561 raft_consensus.cc:348] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.760843 1561 raft_consensus.cc:374] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.760898 1561 raft_consensus.cc:729] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.761090 1561 consensus_queue.cc:260] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.763217 911 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_d10e6eb8078c475abd696473005670a3 [id=c4ddc66927a94fd2abc8e44012cf69f7] alter complete (version 3)
I20260927 15:06:10.763659 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b06cc424b97d4014bafbcffe9807c8d6" } new_table_name: "default.Table_0c43deb200d24418a40645ddf76cc739" modify_external_catalogs: true
I20260927 15:06:10.765719 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c6971a4f48634ff387b85b96b54d0552"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:10.766294 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6971a4f48634ff387b85b96b54d0552 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:10.767423 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet e9a7ed6e23e1479a86e2abcf6aa5b317 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:10.767709 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d1f23f91bce4df480dd9991659f2e81 with delete_type TABLET_DATA_DELETED (replaced by tablet cd901034653b47dbba7912d5338bc3bb) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:10.767933 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet ba14b7531bb647248572be10d2b43cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:10.769719 1561 ts_tablet_manager.cc:1428] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260927 15:06:10.770951 1561 tablet_bootstrap.cc:492] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:10.774392 2299 raft_consensus.cc:482] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:10.774621 2299 raft_consensus.cc:504] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:10.775645 2299 leader_election.cc:288] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:10.776700 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 63289edbdd734dd5a817df42d83e422e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:10.776970 1239 leader_election.cc:341] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 7d1f23f91bce4df480dd9991659f2e81
I20260927 15:06:10.777340 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_da4a80fa90b442bdb4fb9928235f6f05" } new_table_name: "default.Table_cddac26e26854ad39af5fbd708079159" modify_external_catalogs: true
I20260927 15:06:10.777590 2338 leader_election.cc:288] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b6a41e027f0448cafe3365f23103f92 (127.0.201.61:43763), 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799)
I20260927 15:06:10.779619 924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dbf522d70373412b87815d33c0f1f745" candidate_term: 2 candidate_status { last_received { term: 1 index: 916 } } ignore_live_leader: false dest_uuid: "6b6a41e027f0448cafe3365f23103f92" is_pre_election: true
W20260927 15:06:10.780313 1238 leader_election.cc:341] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 7d1f23f91bce4df480dd9991659f2e81
I20260927 15:06:10.780471 1238 leader_election.cc:302] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:10.781010 2299 raft_consensus.cc:2726] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:10.784118 1552 tablet_bootstrap.cc:654] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.788646 1561 tablet_bootstrap.cc:654] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.798533 1556 tablet_bootstrap.cc:492] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.798679 1556 ts_tablet_manager.cc:1397] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.099s user 0.003s sys 0.005s
I20260927 15:06:10.799428 1556 raft_consensus.cc:348] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.799624 1556 raft_consensus.cc:374] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.799666 1556 raft_consensus.cc:729] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.799849 1556 consensus_queue.cc:260] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.800315 1556 ts_tablet_manager.cc:1428] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:10.800566 1556 tablet_bootstrap.cc:492] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:10.802105 1556 tablet_bootstrap.cc:654] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.804621 1556 tablet_bootstrap.cc:492] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.804754 1556 ts_tablet_manager.cc:1397] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260927 15:06:10.805495 1552 tablet_bootstrap.cc:492] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:10.805661 1552 ts_tablet_manager.cc:1397] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.065s user 0.004s sys 0.000s
I20260927 15:06:10.805519 1556 raft_consensus.cc:348] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.805732 1556 raft_consensus.cc:374] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.805783 1556 raft_consensus.cc:729] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.806030 1556 consensus_queue.cc:260] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.806565 1556 ts_tablet_manager.cc:1428] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:10.806819 1556 tablet_bootstrap.cc:492] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:10.808436 1556 tablet_bootstrap.cc:654] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.808815 1562 ts_tablet_manager.cc:1918] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:10.808931 1562 log.cc:1196] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/fde632b187eb4180b343d7bddc7f0943
I20260927 15:06:10.809221 1562 ts_tablet_manager.cc:1939] T fde632b187eb4180b343d7bddc7f0943 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:10.809722 2119 ts_tablet_manager.cc:1918] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:10.809847 2119 log.cc:1196] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/0df4a23269244191bf1dcd69cb34d371
I20260927 15:06:10.810207 2119 ts_tablet_manager.cc:1939] T 0df4a23269244191bf1dcd69cb34d371 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:10.813421 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2c276b721a74822a5275c5924de20b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.813936 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27f52b4ae5a2467c86dec6cced142a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.814036 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27f52b4ae5a2467c86dec6cced142a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.814437 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9f9962d4d8c46c49795f95192b79a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.814443 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd1da3a0f4594b8884dd54497f7169ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.814850 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0152ed16fbe44c48e17c6bc34328df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.814901 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1defd5bba3c34cae8893559ccfc8b5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.815249 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1defd5bba3c34cae8893559ccfc8b5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.815310 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9f9962d4d8c46c49795f95192b79a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.815364 1556 tablet_bootstrap.cc:492] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:10.815497 1556 ts_tablet_manager.cc:1397] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260927 15:06:10.815663 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd1da3a0f4594b8884dd54497f7169ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.815734 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0152ed16fbe44c48e17c6bc34328df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.816052 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2c276b721a74822a5275c5924de20b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.816215 1556 raft_consensus.cc:348] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.816422 1556 raft_consensus.cc:374] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:10.816486 1556 raft_consensus.cc:729] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:10.816783 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2c276b721a74822a5275c5924de20b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.816704 1556 consensus_queue.cc:260] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:10.816993 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1defd5bba3c34cae8893559ccfc8b5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.817245 1556 ts_tablet_manager.cc:1428] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:11.041682 1556 tablet_bootstrap.cc:492] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:10.856549 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 0df4a23269244191bf1dcd69cb34d371 (table default.Table_30f44c4820b9415daf4edfe7ea689da3 [id=d80cbbb5881e42f0b5651563d6f60bb5]) successfully deleted
W20260927 15:06:11.044034 901 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 187498us
W20260927 15:06:11.044782 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 20278f979638419db92105e55310f605 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20278f979638419db92105e55310f605 already in progress: creating tablet
W20260927 15:06:11.045037 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 5e9b07ea3ec9457399e2b765580d06e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e9b07ea3ec9457399e2b765580d06e7 already in progress: creating tablet
I20260927 15:06:10.974668 804 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
/tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.60:46799
--webserver_interface=127.0.201.60
--webserver_port=39943
--builtin_ntp_servers=127.0.201.20:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260927 15:06:10.885941 1858 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
I20260927 15:06:10.823237 1552 raft_consensus.cc:348] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.051326 1552 raft_consensus.cc:374] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.051499 1552 raft_consensus.cc:729] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.051782 1552 consensus_queue.cc:260] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.052459 1552 ts_tablet_manager.cc:1428] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.247s user 0.001s sys 0.002s
I20260927 15:06:10.823645 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 473) took 4968 ms. Trace:
I20260927 15:06:10.824990 1561 tablet_bootstrap.cc:492] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.052593 1562 rpcz_store.cc:276] 0927 15:06:05.855270 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.855504 (+ 234us) service_pool.cc:227] Handling call
0927 15:06:10.248223 (+4392719us) ts_tablet_manager.cc:1145] Deleting tablet fde632b187eb4180b343d7bddc7f0943
0927 15:06:10.248231 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.551247 (+303016us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.808666 (+257419us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.823615 (+ 14949us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4376552}
I20260927 15:06:11.053166 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 476) took 5186 ms. Trace:
I20260927 15:06:11.053262 1562 rpcz_store.cc:276] 0927 15:06:05.866358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.866420 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:11.053010 (+5186590us) ts_tablet_manager.cc:1145] Deleting tablet a97f72ddef5346c297d73589e926260c
0927 15:06:11.053023 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.053145 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5181267}
I20260927 15:06:11.053637 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 475) took 5196 ms. Trace:
I20260927 15:06:11.053711 1562 rpcz_store.cc:276] 0927 15:06:05.856916 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.857967 (+ 1051us) service_pool.cc:227] Handling call
0927 15:06:11.053523 (+5195556us) ts_tablet_manager.cc:1145] Deleting tablet b2d2501a9f764790818426665e7f0340
0927 15:06:11.053536 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.053620 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5181528}
I20260927 15:06:11.054031 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 477) took 5180 ms. Trace:
I20260927 15:06:11.054101 1562 rpcz_store.cc:276] 0927 15:06:05.873898 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.875623 (+ 1725us) service_pool.cc:227] Handling call
0927 15:06:11.053921 (+5178298us) ts_tablet_manager.cc:1145] Deleting tablet b44e2611d2bf40ae90c4fd857225e39e
0927 15:06:11.053930 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.054016 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5146057}
I20260927 15:06:11.054373 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 491) took 5109 ms. Trace:
I20260927 15:06:11.054440 1562 rpcz_store.cc:276] 0927 15:06:05.945389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:05.945443 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:11.054289 (+5108846us) ts_tablet_manager.cc:1145] Deleting tablet e2ba3bdf50b14aec85a99742426e9298
0927 15:06:11.054297 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.054360 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5105888}
I20260927 15:06:11.054735 1562 tablet_replica.cc:330] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:10.817266 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd1da3a0f4594b8884dd54497f7169ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.055226 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0152ed16fbe44c48e17c6bc34328df7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.887267 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 514ce66d5afd46a7b9cc460776973b06
I20260927 15:06:11.057001 1556 tablet_bootstrap.cc:654] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:10.857468 2119 tablet_replica.cc:330] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:10.966774 2289 raft_consensus.cc:482] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.052752 1561 ts_tablet_manager.cc:1397] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.282s user 0.004s sys 0.000s
I20260927 15:06:11.060916 2289 raft_consensus.cc:504] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.061604 2289 leader_election.cc:288] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.061770 1561 raft_consensus.cc:348] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.061957 1561 raft_consensus.cc:374] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.062007 1561 raft_consensus.cc:729] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.033712 2290 raft_consensus.cc:482] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.062170 1561 consensus_queue.cc:260] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.062314 2290 raft_consensus.cc:504] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.062605 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9f9962d4d8c46c49795f95192b79a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:10.829340 2323 raft_consensus.cc:482] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.062798 1561 ts_tablet_manager.cc:1428] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:11.062913 2323 raft_consensus.cc:504] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.063208 1561 tablet_bootstrap.cc:492] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.063544 2323 leader_election.cc:288] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.063815 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet fde632b187eb4180b343d7bddc7f0943 (table default.Table_be15cdb2ae6a49e38da808ee4cafd27c [id=bb4c8603779d4998bbf639ff0f8b2ed9]) successfully deleted
W20260927 15:06:11.064103 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet a97f72ddef5346c297d73589e926260c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a97f72ddef5346c297d73589e926260c already in progress: creating tablet
W20260927 15:06:11.064321 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b2d2501a9f764790818426665e7f0340 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2d2501a9f764790818426665e7f0340 already in progress: creating tablet
W20260927 15:06:11.064518 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b44e2611d2bf40ae90c4fd857225e39e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b44e2611d2bf40ae90c4fd857225e39e already in progress: creating tablet
W20260927 15:06:11.064756 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e2ba3bdf50b14aec85a99742426e9298 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2ba3bdf50b14aec85a99742426e9298 already in progress: creating tablet
I20260927 15:06:11.064967 1561 tablet_bootstrap.cc:654] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.064987 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 514ce66d5afd46a7b9cc460776973b06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:10.912603 2327 tablet.cc:1722] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:10.910414 2233 ts_tablet_manager.cc:1918] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:11.065831 2233 log.cc:1196] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/9cb0ab983a444d26b903a0cec64f15f0
I20260927 15:06:11.066195 2233 ts_tablet_manager.cc:1939] T 9cb0ab983a444d26b903a0cec64f15f0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:11.066998 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27f52b4ae5a2467c86dec6cced142a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.012504 2322 raft_consensus.cc:482] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.067355 2322 raft_consensus.cc:504] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.067962 2322 leader_election.cc:288] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:10.887559 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b88cb2c53be4463eb17e748d2c17f0e2
I20260927 15:06:11.068380 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c0d51b50b414721a255fdde2fe1732f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.068987 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c0d51b50b414721a255fdde2fe1732f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.068985 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d6c9d61c79934636a425c02a9d7ba5ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.069576 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6c9d61c79934636a425c02a9d7ba5ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:10.887804 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7dccaee87f314cbaa98d66e0bb885a8b
I20260927 15:06:11.071219 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 514ce66d5afd46a7b9cc460776973b06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.071798 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49913b1763c4a7b9413a801aff93b30" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:10.890338 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3042c17580d54082971b761433a7dca9
I20260927 15:06:11.072619 2119 raft_consensus.cc:2229] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.072837 2119 raft_consensus.cc:2258] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.072723 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_368c9daf6cb94ec39b284e00b73ab9c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.073251 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_368c9daf6cb94ec39b284e00b73ab9c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.073437 2119 ts_tablet_manager.cc:1905] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:11.074527 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c313ab6848428d8237557392669f6f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.075157 2299 raft_consensus.cc:482] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.075294 2299 raft_consensus.cc:504] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:11.075430 1374 leader_election.cc:341] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.075664 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75537edf83a040cba4da502c726bf456" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.075901 2299 leader_election.cc:288] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:11.076196 1376 leader_election.cc:341] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.076545 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75537edf83a040cba4da502c726bf456" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.076967 1374 leader_election.cc:341] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:11.077160 1238 leader_election.cc:341] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: e9a7ed6e23e1479a86e2abcf6aa5b317
I20260927 15:06:11.079325 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dccaee87f314cbaa98d66e0bb885a8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.079427 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet b88cb2c53be4463eb17e748d2c17f0e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.079556 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 3042c17580d54082971b761433a7dca9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.081300 1552 tablet_bootstrap.cc:492] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:11.083016 1556 tablet_bootstrap.cc:492] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.083097 1552 tablet_bootstrap.cc:654] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.083153 1556 ts_tablet_manager.cc:1397] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.005s
I20260927 15:06:11.083882 1556 raft_consensus.cc:348] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.084086 1556 raft_consensus.cc:374] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.084146 1556 raft_consensus.cc:729] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.084391 1556 consensus_queue.cc:260] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.085481 1556 ts_tablet_manager.cc:1428] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:11.086167 1556 tablet_bootstrap.cc:492] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.086745 1561 tablet_bootstrap.cc:492] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.086910 1561 ts_tablet_manager.cc:1397] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
W20260927 15:06:11.087404 1102 leader_election.cc:341] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:11.087643 1102 leader_election.cc:341] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:11.087827 1102 consensus_peers.cc:487] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:11.087728 1561 raft_consensus.cc:348] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.088037 1561 raft_consensus.cc:374] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.088091 1562 raft_consensus.cc:2229] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.062805 2290 leader_election.cc:288] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.088125 1561 raft_consensus.cc:729] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.088274 1562 raft_consensus.cc:2258] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.088380 1561 consensus_queue.cc:260] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.088819 1562 ts_tablet_manager.cc:1905] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:11.088809 1239 leader_election.cc:341] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: e9a7ed6e23e1479a86e2abcf6aa5b317
I20260927 15:06:11.088967 1239 leader_election.cc:302] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.089159 1561 ts_tablet_manager.cc:1428] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:11.089380 2299 raft_consensus.cc:2726] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.089437 1561 tablet_bootstrap.cc:492] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.090955 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 682) took 1410 ms. Trace:
I20260927 15:06:11.091090 2233 rpcz_store.cc:276] 0927 15:06:09.680240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.680294 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:10.706640 (+1026346us) ts_tablet_manager.cc:1145] Deleting tablet 9cb0ab983a444d26b903a0cec64f15f0
0927 15:06:10.706649 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:10.813430 (+106781us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:10.910269 (+ 96839us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.090900 (+180631us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026139}
I20260927 15:06:11.091527 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 681) took 1411 ms. Trace:
I20260927 15:06:11.091634 2233 rpcz_store.cc:276] 0927 15:06:09.680119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.680547 (+ 428us) service_pool.cc:227] Handling call
0927 15:06:11.091373 (+1410826us) ts_tablet_manager.cc:1145] Deleting tablet ddfb62d579704b30a3482b7f95be4922
0927 15:06:11.091387 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.091497 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1410657}
I20260927 15:06:11.091959 2233 tablet_replica.cc:330] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:11.092254 2233 raft_consensus.cc:2229] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.092429 2233 raft_consensus.cc:2258] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.092983 909 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_d10e6eb8078c475abd696473005670a3 [id=c4ddc66927a94fd2abc8e44012cf69f7]). Expected version 3 got 1
I20260927 15:06:11.093057 2233 ts_tablet_manager.cc:1905] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:11.093784 2322 raft_consensus.cc:482] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.093979 2322 raft_consensus.cc:504] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.094050 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6ddc5e4aadc942d68b8e80a96575afbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.094655 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ddc5e4aadc942d68b8e80a96575afbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.094749 2322 leader_election.cc:288] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.095198 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 9cb0ab983a444d26b903a0cec64f15f0 (table default.Table_9cb03ce349ee4cefa2a1b109f59c75ee [id=8e5ae781d15d48f7924076fea8d3d292]) successfully deleted
W20260927 15:06:11.095464 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ddfb62d579704b30a3482b7f95be4922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddfb62d579704b30a3482b7f95be4922 already in progress: creating tablet
I20260927 15:06:11.096112 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c65bc09865bc4a0283eaa4af9f860bdd" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.096405 2322 raft_consensus.cc:482] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.096535 2322 raft_consensus.cc:504] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.097091 2322 leader_election.cc:288] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:11.098778 1374 leader_election.cc:341] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.100656 1561 tablet_bootstrap.cc:654] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.101001 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dccaee87f314cbaa98d66e0bb885a8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.101263 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 3042c17580d54082971b761433a7dca9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.101758 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet b88cb2c53be4463eb17e748d2c17f0e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.102717 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0aec677006ab4407bd7ae4c0078d6b7f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:11.104130 1374 leader_election.cc:341] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.106174 1556 tablet_bootstrap.cc:654] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:11.107179 1102 consensus_peers.cc:487] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:11.107928 1561 tablet_bootstrap.cc:492] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.108049 1561 ts_tablet_manager.cc:1397] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.003s
I20260927 15:06:11.108847 1561 raft_consensus.cc:348] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.109079 1561 raft_consensus.cc:374] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.109139 1561 raft_consensus.cc:729] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.109328 1561 consensus_queue.cc:260] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.109869 1561 ts_tablet_manager.cc:1428] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:11.110122 1561 tablet_bootstrap.cc:492] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.111608 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dccaee87f314cbaa98d66e0bb885a8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.111943 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 514ce66d5afd46a7b9cc460776973b06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.112171 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet b88cb2c53be4463eb17e748d2c17f0e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.112392 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 3042c17580d54082971b761433a7dca9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.114216 1561 tablet_bootstrap.cc:654] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.115101 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49913b1763c4a7b9413a801aff93b30" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:11.127503 1099 leader_election.cc:341] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: Tablet not RUNNING: STOPPED
I20260927 15:06:11.128882 1099 leader_election.cc:302] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:11.128826 1858 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.60:46799, user_credentials={real_user=slave}} blocked reactor thread for 242912us
I20260927 15:06:11.131701 2289 raft_consensus.cc:2726] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.132758 1556 tablet_bootstrap.cc:492] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
W20260927 15:06:11.132946 1099 leader_election.cc:341] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 65c313ab6848428d8237557392669f6f
I20260927 15:06:11.132987 1556 ts_tablet_manager.cc:1397] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.004s
I20260927 15:06:11.133123 1099 leader_election.cc:302] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.133390 2289 raft_consensus.cc:2726] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:11.133816 1556 raft_consensus.cc:348] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.134099 1556 raft_consensus.cc:374] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.134204 1556 raft_consensus.cc:729] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.134505 1556 consensus_queue.cc:260] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.135416 1556 ts_tablet_manager.cc:1428] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:11.137682 1552 tablet_bootstrap.cc:492] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:11.138008 1552 ts_tablet_manager.cc:1397] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.006s
I20260927 15:06:11.139163 2322 raft_consensus.cc:482] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.139335 2322 raft_consensus.cc:504] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.139442 1552 raft_consensus.cc:348] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.140020 1552 raft_consensus.cc:374] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.140193 2322 leader_election.cc:288] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:11.140197 1552 raft_consensus.cc:729] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.140550 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ca19b492c4df1b31c78f1629c50b5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.140844 2322 raft_consensus.cc:482] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.140813 1552 consensus_queue.cc:260] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.141005 2322 raft_consensus.cc:504] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:11.141228 1374 leader_election.cc:341] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.141660 2322 leader_election.cc:288] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.142912 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c73e813bb594a5e871718b73fe61fc9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.144012 1552 ts_tablet_manager.cc:1428] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
W20260927 15:06:11.144657 1374 leader_election.cc:341] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.145166 1556 tablet_bootstrap.cc:492] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.145927 1552 tablet_bootstrap.cc:492] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:11.147050 1556 tablet_bootstrap.cc:654] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.150401 1301 raft_consensus.cc:3037] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:11.151407 1858 leader_election.cc:334] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799): Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111)
I20260927 15:06:11.151639 1858 leader_election.cc:302] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbf522d70373412b87815d33c0f1f745; no voters: 2a122de3662f485f8f44b0a5e4b29862, 6b6a41e027f0448cafe3365f23103f92
I20260927 15:06:11.153837 1561 tablet_bootstrap.cc:492] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.155596 1561 ts_tablet_manager.cc:1397] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.004s
I20260927 15:06:11.157140 1561 raft_consensus.cc:348] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.158812 1561 raft_consensus.cc:374] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.159129 1561 raft_consensus.cc:729] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.159636 1561 consensus_queue.cc:260] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.162652 1561 ts_tablet_manager.cc:1428] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 15:06:11.166457 2338 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dbf522d70373412b87815d33c0f1f745 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:11.171366 1552 tablet_bootstrap.cc:654] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.175911 1556 tablet_bootstrap.cc:492] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.176141 1556 ts_tablet_manager.cc:1397] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.012s
I20260927 15:06:11.176477 1561 tablet_bootstrap.cc:492] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.177124 1556 raft_consensus.cc:348] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.177769 1556 raft_consensus.cc:374] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.177886 1556 raft_consensus.cc:729] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.178176 1556 consensus_queue.cc:260] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.178710 1561 tablet_bootstrap.cc:654] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.178970 1556 ts_tablet_manager.cc:1428] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:11.179296 1556 tablet_bootstrap.cc:492] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.184757 2068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b6a41e027f0448cafe3365f23103f92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbf522d70373412b87815d33c0f1f745" member_type: VOTER last_known_addr { host: "127.0.201.62" port: 41167 } } peers { permanent_uuid: "6b6a41e027f0448cafe3365f23103f92" member_type: VOTER last_known_addr { host: "127.0.201.61" port: 43763 } } peers { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" member_type: VOTER last_known_addr { host: "127.0.201.60" port: 46799 } } }
I20260927 15:06:11.185352 2068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 [sys.catalog]: This master's current role is: LEADER
I20260927 15:06:11.188884 1556 tablet_bootstrap.cc:654] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.192998 1552 tablet_bootstrap.cc:492] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:11.193186 1552 ts_tablet_manager.cc:1397] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.000s
I20260927 15:06:11.194221 1552 raft_consensus.cc:348] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.194628 1552 raft_consensus.cc:374] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.194757 1552 raft_consensus.cc:729] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.198565 1376 leader_election.cc:302] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.195643 1552 consensus_queue.cc:260] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:11.200035 1099 consensus_peers.cc:487] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe7816e099094d13887650fc223097c7. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:11.202425 2322 raft_consensus.cc:2726] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.203255 1556 tablet_bootstrap.cc:492] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.203466 1556 ts_tablet_manager.cc:1397] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.003s
I20260927 15:06:11.204361 1556 raft_consensus.cc:348] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.204671 1556 raft_consensus.cc:374] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.204836 1556 raft_consensus.cc:729] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.205156 1556 consensus_queue.cc:260] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.206254 1556 ts_tablet_manager.cc:1428] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:11.205896 1552 ts_tablet_manager.cc:1428] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20260927 15:06:11.206598 1556 tablet_bootstrap.cc:492] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.208005 1552 tablet_bootstrap.cc:492] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:11.209785 1556 tablet_bootstrap.cc:654] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:11.202445 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 126297us
I20260927 15:06:11.213217 1562 ts_tablet_manager.cc:1918] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:11.213356 1562 log.cc:1196] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/89bd5b459caa42e7a9153d9273ad52c4
I20260927 15:06:11.213768 1562 ts_tablet_manager.cc:1939] T 89bd5b459caa42e7a9153d9273ad52c4 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:11.214660 2119 ts_tablet_manager.cc:1918] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:11.214818 2119 log.cc:1196] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/27c3283a40f14eb4868767799cfdf7bd
W20260927 15:06:11.215082 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ffbab94f00ec444b983a61c77544d123 consensus state has no leader
I20260927 15:06:11.215214 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c65bc09865bc4a0283eaa4af9f860bdd" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.215381 2119 ts_tablet_manager.cc:1939] T 27c3283a40f14eb4868767799cfdf7bd P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:11.216135 2299 raft_consensus.cc:482] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.216289 2299 raft_consensus.cc:504] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.216912 2299 leader_election.cc:288] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.217202 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0aec677006ab4407bd7ae4c0078d6b7f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.217880 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59de157335d8475e9e44db8f1d040bb2 consensus state has no leader
I20260927 15:06:11.218152 912 master_service.cc:946] ReplaceTablet: received request to replace tablet fd1f51cb124d4d20a9d6024e6eb6810f from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:11.218110 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ca19b492c4df1b31c78f1629c50b5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.218192 2233 ts_tablet_manager.cc:1918] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:11.218310 2233 log.cc:1196] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/c49913b1763c4a7b9413a801aff93b30
I20260927 15:06:11.218622 2233 ts_tablet_manager.cc:1939] T c49913b1763c4a7b9413a801aff93b30 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:11.218803 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c73e813bb594a5e871718b73fe61fc9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.219185 1239 leader_election.cc:341] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 07b63e63f7cd4075bcf10a463ce16e05
I20260927 15:06:11.221518 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 502) took 5140 ms. Trace:
I20260927 15:06:11.221655 1562 rpcz_store.cc:276] 0927 15:06:06.080857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.080906 (+ 49us) service_pool.cc:227] Handling call
0927 15:06:11.054689 (+4973783us) ts_tablet_manager.cc:1145] Deleting tablet 89bd5b459caa42e7a9153d9273ad52c4
0927 15:06:11.054700 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.138270 (+ 83570us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.213090 (+ 74820us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.221495 (+ 8405us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4970992}
I20260927 15:06:11.222150 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 499) took 5143 ms. Trace:
I20260927 15:06:11.222281 1562 rpcz_store.cc:276] 0927 15:06:06.079183 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.080317 (+ 1134us) service_pool.cc:227] Handling call
0927 15:06:11.221980 (+5141663us) ts_tablet_manager.cc:1145] Deleting tablet cf2d3438867a45319645a7b6bee7022a
0927 15:06:11.221996 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.222110 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5133702}
I20260927 15:06:11.222714 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 503) took 5141 ms. Trace:
I20260927 15:06:11.222815 1562 rpcz_store.cc:276] 0927 15:06:06.081710 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.082269 (+ 559us) service_pool.cc:227] Handling call
0927 15:06:11.222567 (+5140298us) ts_tablet_manager.cc:1145] Deleting tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85
0927 15:06:11.222579 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.222673 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5134030}
I20260927 15:06:11.223259 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 498) took 5147 ms. Trace:
I20260927 15:06:11.223368 1562 rpcz_store.cc:276] 0927 15:06:06.076264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.077997 (+ 1733us) service_pool.cc:227] Handling call
0927 15:06:11.223099 (+5145102us) ts_tablet_manager.cc:1145] Deleting tablet 0f4cff4a06db44269defca578af289d8
0927 15:06:11.223111 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.223211 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5131405}
I20260927 15:06:11.223769 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 507) took 4800 ms. Trace:
I20260927 15:06:11.224071 2323 raft_consensus.cc:482] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.224264 2323 raft_consensus.cc:504] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.224967 2323 leader_election.cc:288] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.225850 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 89bd5b459caa42e7a9153d9273ad52c4 (table default.Table_28678b473eb34fc98fdfa5b51c8f9ecc [id=4686792aaf36414380f3f894a5635874]) successfully deleted
I20260927 15:06:11.226136 1561 tablet_bootstrap.cc:492] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
W20260927 15:06:11.226172 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet cf2d3438867a45319645a7b6bee7022a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf2d3438867a45319645a7b6bee7022a already in progress: creating tablet
I20260927 15:06:11.226289 1561 ts_tablet_manager.cc:1397] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.050s user 0.012s sys 0.022s
W20260927 15:06:11.226366 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 already in progress: creating tablet
W20260927 15:06:11.226591 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0f4cff4a06db44269defca578af289d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f4cff4a06db44269defca578af289d8 already in progress: creating tablet
I20260927 15:06:11.227451 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "373b6e6c03614b78a8343c84095bd347" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:11.228184 1374 leader_election.cc:341] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.228430 1561 raft_consensus.cc:348] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.228653 1561 raft_consensus.cc:374] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.228566 2327 tablet.cc:1722] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:11.228729 1561 raft_consensus.cc:729] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.228948 1561 consensus_queue.cc:260] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.229506 1561 ts_tablet_manager.cc:1428] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260927 15:06:11.229787 1561 tablet_bootstrap.cc:492] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.236526 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fb1ec2ad14a54339a8ded2628758b6ce" } modify_external_catalogs: true
I20260927 15:06:11.236773 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fb1ec2ad14a54339a8ded2628758b6ce" } modify_external_catalogs: true
I20260927 15:06:11.237321 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_bf61e56b4709425c99c5a22da57ddba9 [id=9ac1472258a24d01892257dd9c9874a8] alter complete (version 1)
W20260927 15:06:11.237723 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d827f6a3a6834ecd86d8722b1f1e4444 consensus state has no leader
I20260927 15:06:11.238044 910 master_service.cc:946] ReplaceTablet: received request to replace tablet fd6a824a5a504c92992ceec1cd3eb2e7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:11.238128 913 master_service.cc:946] ReplaceTablet: received request to replace tablet 9f07d07b63834b368930d34956e7d6df from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:11.223845 1562 rpcz_store.cc:276] 0927 15:06:06.423409 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.426871 (+ 3462us) service_pool.cc:227] Handling call
0927 15:06:11.223640 (+4796769us) ts_tablet_manager.cc:1145] Deleting tablet 1c018f11de9842bc883409f8af35fb5f
0927 15:06:11.223652 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.223734 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4796595}
I20260927 15:06:11.239442 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0076a3b473134965a5d828a3acf95007"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:11.239814 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 505) took 4816 ms. Trace:
I20260927 15:06:11.239946 1562 rpcz_store.cc:276] 0927 15:06:06.423167 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.441343 (+ 18176us) service_pool.cc:227] Handling call
0927 15:06:11.239646 (+4798303us) ts_tablet_manager.cc:1145] Deleting tablet 434e9390f1fd4a3ebb65924c37b85bd4
0927 15:06:11.239658 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.239767 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4798041}
W20260927 15:06:11.240110 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0076a3b473134965a5d828a3acf95007 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.240504 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 517) took 4751 ms. Trace:
I20260927 15:06:11.240394 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_15a9a14d40bf4481a5b9de28d05f1833"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:11.240622 1562 rpcz_store.cc:276] 0927 15:06:06.488932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.488991 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:11.240362 (+4751371us) ts_tablet_manager.cc:1145] Deleting tablet 5aa58fa9a1384013ac1674bc7d53c3b1
0927 15:06:11.240374 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.240472 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4751060}
W20260927 15:06:11.240903 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15a9a14d40bf4481a5b9de28d05f1833 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.242152 905 master_service.cc:946] ReplaceTablet: received request to replace tablet ad5af5df58824fe88d607a93216bd228 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:11.242666 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ea693bd966dc4d3282a842b4b41fffe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.243201 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea693bd966dc4d3282a842b4b41fffe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.243744 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d4ca19b492c4df1b31c78f1629c50b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.244026 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fc1fc04814147d8843aa734fd1794da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:11.244446 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1c018f11de9842bc883409f8af35fb5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c018f11de9842bc883409f8af35fb5f already in progress: creating tablet
I20260927 15:06:11.244421 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 1d2404a81332466c93429fbe550527f6 (DEFAULT_TABLE table=default.Table_fe955ec8681e4926943f6748e21f5265 [id=efc046811ca3467bb5579d2aafb2d793]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:11.244701 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 434e9390f1fd4a3ebb65924c37b85bd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 434e9390f1fd4a3ebb65924c37b85bd4 already in progress: creating tablet
I20260927 15:06:11.244851 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d2404a81332466c93429fbe550527f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:11.244889 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aa58fa9a1384013ac1674bc7d53c3b1 already in progress: creating tablet
I20260927 15:06:11.244784 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3028fb3d99c84685ad117fb942f070a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.245229 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3028fb3d99c84685ad117fb942f070a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.246212 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd with delete_type TABLET_DATA_DELETED (replaced by tablet db09498a395b4570a34d32fbfc71e8ed) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.246416 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c73e813bb594a5e871718b73fe61fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.246547 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c0d51b50b414721a255fdde2fe1732f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.247145 1405 tablet_service.cc:1467] Processing CreateTablet for tablet a14f63dc367d45e7ab1adfce6ce499d3 (DEFAULT_TABLE table=default.Table_3dc5ac5b1bbc4b76a78514b41ed76b79 [id=26905e39a93044428fb1f7ebfba22c2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.247584 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a14f63dc367d45e7ab1adfce6ce499d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.247800 1552 tablet_bootstrap.cc:654] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.248615 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6406a4cb5c1b4f18b8d482f820949cad" } new_table_name: "default.Table_c07af699cdab4f7cbedf4ded035a208c" modify_external_catalogs: true
I20260927 15:06:11.251160 1410 tablet_service.cc:1467] Processing CreateTablet for tablet cb75c7fd08964949ad4edf0b46b8cfa6 (DEFAULT_TABLE table=default.Table_bb7abc219f5145b8b5530fbc0aa97af1 [id=24bc319412a04a1aae2c94ac80c1dc68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.251528 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb75c7fd08964949ad4edf0b46b8cfa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.260146 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 0a64059ef2234ad6adbdfd8d3576f2a6 (DEFAULT_TABLE table=default.Table_47142ae009c646398d187fa84231faa2 [id=4a2d7f51ed0d461dab1ea8add3ba8619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.260315 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet c49913b1763c4a7b9413a801aff93b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.260460 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 1d2404a81332466c93429fbe550527f6 (DEFAULT_TABLE table=default.Table_fe955ec8681e4926943f6748e21f5265 [id=efc046811ca3467bb5579d2aafb2d793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.260583 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a64059ef2234ad6adbdfd8d3576f2a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.260902 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d2404a81332466c93429fbe550527f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.260957 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 16884c7343be436aa312ec0af40f5e33 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cc8bd2079f84da39e13113e6699bf5e) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.261255 1140 tablet_service.cc:1467] Processing CreateTablet for tablet a14f63dc367d45e7ab1adfce6ce499d3 (DEFAULT_TABLE table=default.Table_3dc5ac5b1bbc4b76a78514b41ed76b79 [id=26905e39a93044428fb1f7ebfba22c2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.261592 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a14f63dc367d45e7ab1adfce6ce499d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.261699 1552 tablet_bootstrap.cc:492] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:11.261866 1552 ts_tablet_manager.cc:1397] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.002s
I20260927 15:06:11.262662 1552 raft_consensus.cc:348] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.263149 1552 raft_consensus.cc:374] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.263229 1552 raft_consensus.cc:729] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.263470 1552 consensus_queue.cc:260] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.264626 1552 ts_tablet_manager.cc:1428] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260927 15:06:11.264955 1552 tablet_bootstrap.cc:492] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:11.265380 1145 tablet_service.cc:1467] Processing CreateTablet for tablet cb75c7fd08964949ad4edf0b46b8cfa6 (DEFAULT_TABLE table=default.Table_bb7abc219f5145b8b5530fbc0aa97af1 [id=24bc319412a04a1aae2c94ac80c1dc68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.265803 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb75c7fd08964949ad4edf0b46b8cfa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.266614 1552 tablet_bootstrap.cc:654] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.267809 1556 tablet_bootstrap.cc:492] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.267968 1556 ts_tablet_manager.cc:1397] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.061s user 0.005s sys 0.000s
I20260927 15:06:11.268759 1556 raft_consensus.cc:348] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.268967 1556 raft_consensus.cc:374] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.269012 1556 raft_consensus.cc:729] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.269177 1556 consensus_queue.cc:260] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.270310 1556 ts_tablet_manager.cc:1428] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:11.270589 1556 tablet_bootstrap.cc:492] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.271332 1128 tablet_service.cc:1467] Processing CreateTablet for tablet da2cdd6c478a4c0989b9317d0206550c (DEFAULT_TABLE table=default.Table_101d63978331408d8eaeb799e410ebe9 [id=3bd69134b42f418999d2bd1dc7ef752a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.271878 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da2cdd6c478a4c0989b9317d0206550c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.272195 1556 tablet_bootstrap.cc:654] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.273306 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a9272e6bb1f14a3b9e7d4a3dd4a881fb" } new_table_name: "default.Table_6948707de78f431fbfe1b65dda6fe141" modify_external_catalogs: true
I20260927 15:06:11.274595 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 9e7f0754b9ba4e21b05c51b0136729d1 (DEFAULT_TABLE table=default.Table_e7068df5611442f19ba70e32b3b81cb6 [id=7477b4ed19394bb3b325105b0998d4b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.274788 905 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet dd2687f65780481c86a9942960ce7be1 (table default.Table_0c4d630a1b634322b0d6ffdf591dfc97 [id=a56919bbdc0146839e84fcc1224c6b8f]). Expected version 1 got 0
I20260927 15:06:11.275139 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e7f0754b9ba4e21b05c51b0136729d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.277521 1561 tablet_bootstrap.cc:654] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.280010 1556 tablet_bootstrap.cc:492] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.280226 1556 ts_tablet_manager.cc:1397] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260927 15:06:11.280503 1411 tablet_service.cc:1467] Processing CreateTablet for tablet da2cdd6c478a4c0989b9317d0206550c (DEFAULT_TABLE table=default.Table_101d63978331408d8eaeb799e410ebe9 [id=3bd69134b42f418999d2bd1dc7ef752a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.280676 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 9e7f0754b9ba4e21b05c51b0136729d1 (DEFAULT_TABLE table=default.Table_e7068df5611442f19ba70e32b3b81cb6 [id=7477b4ed19394bb3b325105b0998d4b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.280956 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da2cdd6c478a4c0989b9317d0206550c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.281147 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 0a64059ef2234ad6adbdfd8d3576f2a6 (DEFAULT_TABLE table=default.Table_47142ae009c646398d187fa84231faa2 [id=4a2d7f51ed0d461dab1ea8add3ba8619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.281090 1556 raft_consensus.cc:348] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.281286 1556 raft_consensus.cc:374] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.281328 1556 raft_consensus.cc:729] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.281494 1556 consensus_queue.cc:260] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.281499 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a64059ef2234ad6adbdfd8d3576f2a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.282226 1556 ts_tablet_manager.cc:1428] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:11.282467 1556 tablet_bootstrap.cc:492] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.278149 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a07831078b48a59807f7da4a42bcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.285504 1556 tablet_bootstrap.cc:654] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.287384 1552 tablet_bootstrap.cc:492] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:11.287767 1552 ts_tablet_manager.cc:1397] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.004s
I20260927 15:06:11.288295 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e7f0754b9ba4e21b05c51b0136729d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.289542 1552 raft_consensus.cc:348] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.290488 1552 raft_consensus.cc:374] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.290849 1552 raft_consensus.cc:729] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.291452 1552 consensus_queue.cc:260] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.292007 1561 tablet_bootstrap.cc:492] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.292224 1561 ts_tablet_manager.cc:1397] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.006s
I20260927 15:06:11.292707 1552 ts_tablet_manager.cc:1428] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260927 15:06:11.294078 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6f179aab784ae4822356e63332532f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.293148 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 639) took 1341 ms. Trace:
I20260927 15:06:11.294902 1278 tablet_service.cc:1467] Processing CreateTablet for tablet da2cdd6c478a4c0989b9317d0206550c (DEFAULT_TABLE table=default.Table_101d63978331408d8eaeb799e410ebe9 [id=3bd69134b42f418999d2bd1dc7ef752a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.296355 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 0a64059ef2234ad6adbdfd8d3576f2a6 (DEFAULT_TABLE table=default.Table_47142ae009c646398d187fa84231faa2 [id=4a2d7f51ed0d461dab1ea8add3ba8619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.296787 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da2cdd6c478a4c0989b9317d0206550c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.295061 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 109f9088371e4f008b2b5f993f2b4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.298933 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7c3d4666467a46f2a8570f5c26f527fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:11.295348 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 9e7f0754b9ba4e21b05c51b0136729d1 (DEFAULT_TABLE table=default.Table_e7068df5611442f19ba70e32b3b81cb6 [id=7477b4ed19394bb3b325105b0998d4b4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:11.299624 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c3d4666467a46f2a8570f5c26f527fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.299787 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e7f0754b9ba4e21b05c51b0136729d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.301595 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb0ab983a444d26b903a0cec64f15f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ae003f1ca76472cbaa8b577b66fe84c) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.301877 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 48e7eac8753f425d90302360d228ee54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.295591 1268 tablet_service.cc:1467] Processing CreateTablet for tablet a14f63dc367d45e7ab1adfce6ce499d3 (DEFAULT_TABLE table=default.Table_3dc5ac5b1bbc4b76a78514b41ed76b79 [id=26905e39a93044428fb1f7ebfba22c2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.303705 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a14f63dc367d45e7ab1adfce6ce499d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.304224 1561 raft_consensus.cc:348] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.304520 1561 raft_consensus.cc:374] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.304598 1561 raft_consensus.cc:729] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.304867 1561 consensus_queue.cc:260] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.305454 1561 ts_tablet_manager.cc:1428] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.013s user 0.000s sys 0.001s
I20260927 15:06:11.306005 1561 tablet_bootstrap.cc:492] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.295357 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 1d2404a81332466c93429fbe550527f6 (DEFAULT_TABLE table=default.Table_fe955ec8681e4926943f6748e21f5265 [id=efc046811ca3467bb5579d2aafb2d793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.307231 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d2404a81332466c93429fbe550527f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.307633 1561 tablet_bootstrap.cc:654] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:11.310438 1238 leader_election.cc:341] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 07b63e63f7cd4075bcf10a463ce16e05
I20260927 15:06:11.310619 1238 leader_election.cc:302] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.310941 2381 raft_consensus.cc:2726] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.295936 1272 tablet_service.cc:1467] Processing CreateTablet for tablet cb75c7fd08964949ad4edf0b46b8cfa6 (DEFAULT_TABLE table=default.Table_bb7abc219f5145b8b5530fbc0aa97af1 [id=24bc319412a04a1aae2c94ac80c1dc68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.312052 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb75c7fd08964949ad4edf0b46b8cfa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.313683 1556 tablet_bootstrap.cc:492] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.313812 1556 ts_tablet_manager.cc:1397] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260927 15:06:11.314502 1556 raft_consensus.cc:348] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.314707 1556 raft_consensus.cc:374] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.314749 1556 raft_consensus.cc:729] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.315186 1556 consensus_queue.cc:260] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.315454 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 683) took 1603 ms. Trace:
I20260927 15:06:11.315546 2233 rpcz_store.cc:276] 0927 15:06:09.711871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.711927 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:11.091881 (+1379954us) ts_tablet_manager.cc:1145] Deleting tablet c49913b1763c4a7b9413a801aff93b30
0927 15:06:11.091894 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.120288 (+ 28394us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.218065 (+ 97777us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.315432 (+ 97367us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1379755}
I20260927 15:06:11.315663 1556 ts_tablet_manager.cc:1428] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:11.315914 1556 tablet_bootstrap.cc:492] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.316001 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 684) took 1473 ms. Trace:
I20260927 15:06:11.316087 2233 rpcz_store.cc:276] 0927 15:06:09.842871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.842932 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:11.315847 (+1472915us) ts_tablet_manager.cc:1145] Deleting tablet 643ec85d098444d6b082fe4038c50c4d
0927 15:06:11.315858 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.315984 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1472671}
I20260927 15:06:11.316345 2233 tablet_replica.cc:330] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:11.316514 2233 raft_consensus.cc:2229] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.316664 2233 raft_consensus.cc:2258] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.317178 2233 ts_tablet_manager.cc:1905] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:11.317601 1556 tablet_bootstrap.cc:654] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.319717 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a64059ef2234ad6adbdfd8d3576f2a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.323494 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet c49913b1763c4a7b9413a801aff93b30 (table default.Table_6cc665540fb24e17b9284fc911758626 [id=31cb67e2dcb54a029ecdc3457b6139c1]) successfully deleted
W20260927 15:06:11.323837 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 643ec85d098444d6b082fe4038c50c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 643ec85d098444d6b082fe4038c50c4d already in progress: creating tablet
I20260927 15:06:11.296314 2119 rpcz_store.cc:276] 0927 15:06:09.951793 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.951834 (+ 41us) service_pool.cc:227] Handling call
0927 15:06:10.857319 (+905485us) ts_tablet_manager.cc:1145] Deleting tablet 27c3283a40f14eb4868767799cfdf7bd
0927 15:06:10.857331 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.133659 (+276328us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.214547 (+ 80888us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.293088 (+ 78541us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12772,"tablet-delete.queue_time_us":905232}
I20260927 15:06:11.324760 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 636) took 1374 ms. Trace:
I20260927 15:06:11.324875 2119 rpcz_store.cc:276] 0927 15:06:09.950490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.956631 (+ 6141us) service_pool.cc:227] Handling call
0927 15:06:11.324566 (+1367935us) ts_tablet_manager.cc:1145] Deleting tablet ce1c286eea664e2a8ad6ebdf31bd4050
0927 15:06:11.324580 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.324696 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1352964}
I20260927 15:06:11.325309 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 657) took 1093 ms. Trace:
I20260927 15:06:11.325389 2119 rpcz_store.cc:276] 0927 15:06:10.231670 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.311943 (+ 80273us) service_pool.cc:227] Handling call
0927 15:06:11.325140 (+1013197us) ts_tablet_manager.cc:1145] Deleting tablet 7f0d667472ee4f1481c213e03403461e
0927 15:06:11.325153 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.325252 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":966140}
I20260927 15:06:11.325690 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 658) took 1086 ms. Trace:
I20260927 15:06:11.325762 2119 rpcz_store.cc:276] 0927 15:06:10.239030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.312889 (+ 73859us) service_pool.cc:227] Handling call
0927 15:06:11.325574 (+1012685us) ts_tablet_manager.cc:1145] Deleting tablet 916663fe0c6c46b1b3415e165d60187f
0927 15:06:11.325583 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.325647 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":961183}
I20260927 15:06:11.326004 2119 tablet_replica.cc:330] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:11.326172 2119 raft_consensus.cc:2229] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.326336 2119 raft_consensus.cc:2258] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.336508 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 9cb0ab983a444d26b903a0cec64f15f0 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:11.337101 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_abdaaacde40f42b095135b70046aa5a5" } modify_external_catalogs: true
I20260927 15:06:11.337307 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_abdaaacde40f42b095135b70046aa5a5" } modify_external_catalogs: true
I20260927 15:06:11.339246 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f20e18689ad245c5872112d6f987abb1" } modify_external_catalogs: true
I20260927 15:06:11.339457 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f20e18689ad245c5872112d6f987abb1" } modify_external_catalogs: true
I20260927 15:06:11.340129 2119 ts_tablet_manager.cc:1905] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:11.340541 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet c41cd38355e64590b43b2e1271c43e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.341460 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 27c3283a40f14eb4868767799cfdf7bd (table default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85]) successfully deleted
W20260927 15:06:11.341753 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ce1c286eea664e2a8ad6ebdf31bd4050 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce1c286eea664e2a8ad6ebdf31bd4050 already in progress: creating tablet
W20260927 15:06:11.341998 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7f0d667472ee4f1481c213e03403461e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f0d667472ee4f1481c213e03403461e already in progress: creating tablet
W20260927 15:06:11.342195 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 916663fe0c6c46b1b3415e165d60187f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916663fe0c6c46b1b3415e165d60187f already in progress: creating tablet
I20260927 15:06:11.342356 1561 tablet_bootstrap.cc:492] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.342521 1552 tablet_bootstrap.cc:492] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:11.342499 2365 raft_consensus.cc:482] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.342518 1561 ts_tablet_manager.cc:1397] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.003s
I20260927 15:06:11.342654 2365 raft_consensus.cc:504] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.343358 2365 leader_election.cc:288] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.343428 1561 raft_consensus.cc:348] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.343633 1561 raft_consensus.cc:374] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.343720 1561 raft_consensus.cc:729] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.344020 1561 consensus_queue.cc:260] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.344605 1561 ts_tablet_manager.cc:1428] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:11.344940 1561 tablet_bootstrap.cc:492] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.346437 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e9d03457dac43038b4e6fb120ff572c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.347445 1561 tablet_bootstrap.cc:654] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.347674 1556 tablet_bootstrap.cc:492] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.347837 1556 ts_tablet_manager.cc:1397] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.001s
I20260927 15:06:11.348773 1556 raft_consensus.cc:348] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:11.348966 1102 leader_election.cc:341] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.349000 1556 raft_consensus.cc:374] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.349071 1556 raft_consensus.cc:729] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.349303 1556 consensus_queue.cc:260] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.349823 2323 raft_consensus.cc:482] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.349886 1556 ts_tablet_manager.cc:1428] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:11.349962 2323 raft_consensus.cc:504] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.350275 1556 tablet_bootstrap.cc:492] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.350512 2323 leader_election.cc:288] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.351919 1556 tablet_bootstrap.cc:654] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.353701 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9049d003d787403f80aa0c08872dd3b5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.354598 1552 tablet_bootstrap.cc:654] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:11.354993 1374 leader_election.cc:341] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.360049 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 513) took 4871 ms. Trace:
I20260927 15:06:11.360165 2365 raft_consensus.cc:482] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.360332 2365 raft_consensus.cc:504] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.360877 2365 leader_election.cc:288] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.361626 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b045b82515540e8813f9250726479e5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.362151 1102 leader_election.cc:341] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.362430 1561 tablet_bootstrap.cc:492] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.360219 1562 rpcz_store.cc:276] 0927 15:06:06.488300 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.590566 (+102266us) service_pool.cc:227] Handling call
0927 15:06:11.359827 (+4769261us) ts_tablet_manager.cc:1145] Deleting tablet 6cba64a85ff14281a662bb41189a2c5e
0927 15:06:11.359841 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.359979 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4768881}
W20260927 15:06:11.363211 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6cba64a85ff14281a662bb41189a2c5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cba64a85ff14281a662bb41189a2c5e already in progress: creating tablet
I20260927 15:06:11.363528 1561 ts_tablet_manager.cc:1397] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.003s
I20260927 15:06:11.363714 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 518) took 4747 ms. Trace:
I20260927 15:06:11.363832 1562 rpcz_store.cc:276] 0927 15:06:06.616424 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.618953 (+ 2529us) service_pool.cc:227] Handling call
0927 15:06:11.363557 (+4744604us) ts_tablet_manager.cc:1145] Deleting tablet 04007cd4bd214b88a4664e23daf4b790
0927 15:06:11.363568 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.363658 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4744306}
W20260927 15:06:11.364284 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 04007cd4bd214b88a4664e23daf4b790 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04007cd4bd214b88a4664e23daf4b790 already in progress: creating tablet
W20260927 15:06:11.364677 1099 leader_election.cc:341] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6e9d03457dac43038b4e6fb120ff572c
I20260927 15:06:11.364830 1099 leader_election.cc:302] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.364713 1561 raft_consensus.cc:348] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.365304 2365 raft_consensus.cc:2726] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:11.365294 1561 raft_consensus.cc:374] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.365638 1561 raft_consensus.cc:729] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.365914 1561 consensus_queue.cc:260] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.366696 1561 ts_tablet_manager.cc:1428] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:11.367393 1561 tablet_bootstrap.cc:492] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.369014 1561 tablet_bootstrap.cc:654] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.371466 1562 tablet_replica.cc:330] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:06:11.372053 1099 leader_election.cc:341] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 1b045b82515540e8813f9250726479e5
I20260927 15:06:11.372418 1099 leader_election.cc:302] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.372694 2365 raft_consensus.cc:2726] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:11.224076 1376 leader_election.cc:341] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.373106 1376 leader_election.cc:302] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.373135 1562 raft_consensus.cc:2229] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.373292 1562 raft_consensus.cc:2258] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.373371 2323 raft_consensus.cc:2726] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:11.373850 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 149774us
W20260927 15:06:11.374300 1376 leader_election.cc:341] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.374517 1376 leader_election.cc:302] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.374804 2323 raft_consensus.cc:2726] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:11.375264 1376 leader_election.cc:341] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.375434 1376 leader_election.cc:302] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.375896 2323 raft_consensus.cc:2726] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.376130 1562 ts_tablet_manager.cc:1905] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:11.376313 1376 leader_election.cc:341] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.376484 1376 leader_election.cc:302] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.376752 2323 raft_consensus.cc:2726] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:11.377349 1376 leader_election.cc:341] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.377534 1376 leader_election.cc:302] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.377815 2323 raft_consensus.cc:2726] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.378918 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "373b6e6c03614b78a8343c84095bd347" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.380041 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9049d003d787403f80aa0c08872dd3b5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.386217 1376 leader_election.cc:341] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.387046 1376 leader_election.cc:302] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.387363 2323 raft_consensus.cc:2726] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.387591 1556 tablet_bootstrap.cc:492] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.387717 1556 ts_tablet_manager.cc:1397] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.001s
W20260927 15:06:11.387940 1376 leader_election.cc:341] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.388090 1376 leader_election.cc:302] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.388456 1556 raft_consensus.cc:348] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.388659 1556 raft_consensus.cc:374] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.388701 1556 raft_consensus.cc:729] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.388851 1556 consensus_queue.cc:260] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.389986 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fd6a824a5a504c92992ceec1cd3eb2e7
I20260927 15:06:11.390022 2385 tablet.cc:1722] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:11.390512 910 catalog_manager.cc:6565] ReplaceTablet: tablet fd6a824a5a504c92992ceec1cd3eb2e7 deleted and replaced by tablet f92b4b2291fb474093d3fbc942c5d049
I20260927 15:06:11.392589 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_47142ae009c646398d187fa84231faa2" } modify_external_catalogs: true
I20260927 15:06:11.394052 1552 tablet_bootstrap.cc:492] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:11.393996 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_effad7577e2d439c8426666a6d741a88" } modify_external_catalogs: true
I20260927 15:06:11.394591 1552 ts_tablet_manager.cc:1397] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.003s
I20260927 15:06:11.395504 1552 raft_consensus.cc:348] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.396162 1556 ts_tablet_manager.cc:1428] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260927 15:06:11.396600 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8baa02df777404187611de3ae220e39 consensus state has no leader
I20260927 15:06:11.396593 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet fd6a824a5a504c92992ceec1cd3eb2e7 with delete_type TABLET_DATA_DELETED (replaced by tablet f92b4b2291fb474093d3fbc942c5d049) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.396960 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet fd6a824a5a504c92992ceec1cd3eb2e7 with delete_type TABLET_DATA_DELETED (replaced by tablet f92b4b2291fb474093d3fbc942c5d049) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.397078 1552 raft_consensus.cc:374] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.397174 1552 raft_consensus.cc:729] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.397397 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_47142ae009c646398d187fa84231faa2" } modify_external_catalogs: true
I20260927 15:06:11.397557 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet fd6a824a5a504c92992ceec1cd3eb2e7 with delete_type TABLET_DATA_DELETED (replaced by tablet f92b4b2291fb474093d3fbc942c5d049) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.397482 1552 consensus_queue.cc:260] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.397739 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9f07d07b63834b368930d34956e7d6df
I20260927 15:06:11.397975 1556 tablet_bootstrap.cc:492] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.398175 913 catalog_manager.cc:6565] ReplaceTablet: tablet 9f07d07b63834b368930d34956e7d6df deleted and replaced by tablet 9737e70f2ddb45029c042ffbd83af157
W20260927 15:06:11.398350 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31b8ad6c423443c7b1ef95dba6273af5 consensus state has no leader
I20260927 15:06:11.398554 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 921db5dbe31a4d0381bdd823cb497424
I20260927 15:06:11.399120 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f07d07b63834b368930d34956e7d6df with delete_type TABLET_DATA_DELETED (replaced by tablet 9737e70f2ddb45029c042ffbd83af157) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.399353 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_effad7577e2d439c8426666a6d741a88" } modify_external_catalogs: true
I20260927 15:06:11.399772 1552 ts_tablet_manager.cc:1428] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:11.399803 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 921db5dbe31a4d0381bdd823cb497424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.400019 905 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet cad4605da5e045e7969da2d6f56a7e70 (table default.Table_2acab08ececa48aab9e6139d3e031e59 [id=672533238895472b9bfb06706e4b41bb]). Expected version 1 got 0
I20260927 15:06:11.400091 1552 tablet_bootstrap.cc:492] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:11.401018 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 921db5dbe31a4d0381bdd823cb497424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.402552 1556 tablet_bootstrap.cc:654] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.402547 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f07d07b63834b368930d34956e7d6df with delete_type TABLET_DATA_DELETED (replaced by tablet 9737e70f2ddb45029c042ffbd83af157) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.403468 2323 raft_consensus.cc:2726] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.403779 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 921db5dbe31a4d0381bdd823cb497424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.403995 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 07b63e63f7cd4075bcf10a463ce16e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.404402 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f07d07b63834b368930d34956e7d6df with delete_type TABLET_DATA_DELETED (replaced by tablet 9737e70f2ddb45029c042ffbd83af157) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.407089 911 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet a260c9d3b8fb4316864e6f986559bef1 (table default.Table_b592f94f43ea4ffe8068db6aed19c5ef [id=61c39607ad5b482c80883c0e60f0da9c]). Expected version 1 got 0
I20260927 15:06:11.408802 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 765b3ee3323846c5ba598f47478fd367
I20260927 15:06:11.410077 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 765b3ee3323846c5ba598f47478fd367 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.411059 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet a46e15ea145b4eae8f94b664067b4f92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:58 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.411597 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 765b3ee3323846c5ba598f47478fd367 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.411842 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet fde632b187eb4180b343d7bddc7f0943 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.412022 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 765b3ee3323846c5ba598f47478fd367 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.425247 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0af436e324cb429c887fcf9fe3a23b45" } new_table_name: "default.Table_1a390c73cebe4e8dbbc63a31170fdd9f" modify_external_catalogs: true
I20260927 15:06:11.426888 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_23ee3df957cd4a588ff650d85c05ab52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.427445 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23ee3df957cd4a588ff650d85c05ab52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.428854 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b592f94f43ea4ffe8068db6aed19c5ef" } new_table_name: "default.Table_06ad2a9aa89e435eac768eca2abd7bf7" modify_external_catalogs: true
I20260927 15:06:11.430631 2233 ts_tablet_manager.cc:1918] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:11.430761 2233 log.cc:1196] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/c41cd38355e64590b43b2e1271c43e91
I20260927 15:06:11.431116 2233 ts_tablet_manager.cc:1939] T c41cd38355e64590b43b2e1271c43e91 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:11.433820 909 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 373b6e6c03614b78a8343c84095bd347 (table default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63]). Expected version 1 got 0
I20260927 15:06:11.434106 909 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
I20260927 15:06:11.434455 1404 tablet_service.cc:1467] Processing CreateTablet for tablet bc47ec18419c42c5bf64a3a9a414d771 (DEFAULT_TABLE table=default.Table_a490439c7f9f49cc92a26631b8a8d04e [id=137be68ef1884a64910cf42bb3e02263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.434967 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc47ec18419c42c5bf64a3a9a414d771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.436345 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b7e017ead242849585679873a69b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.436610 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet a90039faff27436db7b50fa4c4643d3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.436944 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 2e29abccdacc4a18910470fe104b6801 (DEFAULT_TABLE table=default.Table_368c9daf6cb94ec39b284e00b73ab9c9 [id=92612ac4eadf43be9b7d0d006c9eab09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.437302 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e29abccdacc4a18910470fe104b6801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.438735 1411 tablet_service.cc:1467] Processing CreateTablet for tablet d14eac48c3784a72bd05ca1bb4d4ee4e (DEFAULT_TABLE table=default.Table_5b361eced71042afbda25e212feb6424 [id=1872bb684eb04b4b80f1b66342259ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.439152 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d14eac48c3784a72bd05ca1bb4d4ee4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.440886 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 75537edf83a040cba4da502c726bf456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.441083 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 424b66c69254487f932894516d570204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.441223 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 434e9390f1fd4a3ebb65924c37b85bd4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6de2fca4b792491993fcf23ce6db61e0) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.441371 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cd55e22d8254ea8b1dab989517148ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.441691 1409 tablet_service.cc:1467] Processing CreateTablet for tablet a89ef5f07f67497c9093617557cc4ab7 (DEFAULT_TABLE table=default.Table_6ddc5e4aadc942d68b8e80a96575afbf [id=b607e68bf64f44589761d30552634c3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.442065 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a89ef5f07f67497c9093617557cc4ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.445478 1556 tablet_bootstrap.cc:492] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.445604 1556 ts_tablet_manager.cc:1397] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.048s user 0.008s sys 0.007s
I20260927 15:06:11.446249 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 5bc2abbed22e4bacb31e11ff60593c20 (DEFAULT_TABLE table=default.Table_c6971a4f48634ff387b85b96b54d0552 [id=f25d6a08fe8e46da9f70def4b193a7ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.446621 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bc2abbed22e4bacb31e11ff60593c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.446530 1556 raft_consensus.cc:348] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.446734 1556 raft_consensus.cc:374] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.446780 1556 raft_consensus.cc:729] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.446980 1556 consensus_queue.cc:260] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.448240 1134 tablet_service.cc:1467] Processing CreateTablet for tablet d14eac48c3784a72bd05ca1bb4d4ee4e (DEFAULT_TABLE table=default.Table_5b361eced71042afbda25e212feb6424 [id=1872bb684eb04b4b80f1b66342259ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.448462 1136 tablet_service.cc:1467] Processing CreateTablet for tablet a89ef5f07f67497c9093617557cc4ab7 (DEFAULT_TABLE table=default.Table_6ddc5e4aadc942d68b8e80a96575afbf [id=b607e68bf64f44589761d30552634c3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.448753 1140 tablet_service.cc:1467] Processing CreateTablet for tablet bc47ec18419c42c5bf64a3a9a414d771 (DEFAULT_TABLE table=default.Table_a490439c7f9f49cc92a26631b8a8d04e [id=137be68ef1884a64910cf42bb3e02263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.449072 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd with delete_type TABLET_DATA_DELETED (replaced by tablet db09498a395b4570a34d32fbfc71e8ed) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.449249 1556 ts_tablet_manager.cc:1428] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260927 15:06:11.450449 1556 tablet_bootstrap.cc:492] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.450955 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 5bc2abbed22e4bacb31e11ff60593c20 (DEFAULT_TABLE table=default.Table_c6971a4f48634ff387b85b96b54d0552 [id=f25d6a08fe8e46da9f70def4b193a7ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.452230 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 2e29abccdacc4a18910470fe104b6801 (DEFAULT_TABLE table=default.Table_368c9daf6cb94ec39b284e00b73ab9c9 [id=92612ac4eadf43be9b7d0d006c9eab09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.452909 1561 tablet_bootstrap.cc:492] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.453094 1561 ts_tablet_manager.cc:1397] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.001s
I20260927 15:06:11.453994 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 2e29abccdacc4a18910470fe104b6801 (DEFAULT_TABLE table=default.Table_368c9daf6cb94ec39b284e00b73ab9c9 [id=92612ac4eadf43be9b7d0d006c9eab09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.454149 2381 raft_consensus.cc:482] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.454133 1561 raft_consensus.cc:348] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.454344 1561 raft_consensus.cc:374] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.454422 1561 raft_consensus.cc:729] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.454358 2381 raft_consensus.cc:504] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.454662 1281 tablet_service.cc:1467] Processing CreateTablet for tablet a89ef5f07f67497c9093617557cc4ab7 (DEFAULT_TABLE table=default.Table_6ddc5e4aadc942d68b8e80a96575afbf [id=b607e68bf64f44589761d30552634c3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.454694 1561 consensus_queue.cc:260] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.455209 1268 tablet_service.cc:1467] Processing CreateTablet for tablet d14eac48c3784a72bd05ca1bb4d4ee4e (DEFAULT_TABLE table=default.Table_5b361eced71042afbda25e212feb6424 [id=1872bb684eb04b4b80f1b66342259ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.455281 2381 leader_election.cc:288] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.458451 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a260c9d3b8fb4316864e6f986559bef1" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.458688 1283 tablet_service.cc:1467] Processing CreateTablet for tablet bc47ec18419c42c5bf64a3a9a414d771 (DEFAULT_TABLE table=default.Table_a490439c7f9f49cc92a26631b8a8d04e [id=137be68ef1884a64910cf42bb3e02263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.460177 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 5bc2abbed22e4bacb31e11ff60593c20 (DEFAULT_TABLE table=default.Table_c6971a4f48634ff387b85b96b54d0552 [id=f25d6a08fe8e46da9f70def4b193a7ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.460518 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a4042b50ce5049eab1c96114c73daee3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.461100 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4042b50ce5049eab1c96114c73daee3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.461869 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a260c9d3b8fb4316864e6f986559bef1" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:11.462415 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c6a9f9c3ec2149f4a29f0ff6ed71e1b6" } new_table_name: "default.Table_e0c366d7511445d89c469f2181adb227" modify_external_catalogs: true
I20260927 15:06:11.462949 1238 leader_election.cc:302] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.463399 2381 raft_consensus.cc:2726] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.463913 1561 ts_tablet_manager.cc:1428] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
W20260927 15:06:11.466812 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 consensus state has no leader
I20260927 15:06:11.467384 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_78e7ca7ad476490d8cec4cb0b9e3767e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.467983 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78e7ca7ad476490d8cec4cb0b9e3767e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.469380 1561 tablet_bootstrap.cc:492] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.470404 1556 tablet_bootstrap.cc:654] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.472069 1561 tablet_bootstrap.cc:654] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.472030 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bd0cf44aafbc44baa7c5b165e15e367b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.472584 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd0cf44aafbc44baa7c5b165e15e367b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.418138 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_042148816cc64c47b850ec48a69b9eb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.474851 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_042148816cc64c47b850ec48a69b9eb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.472047 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 685) took 1618 ms. Trace:
I20260927 15:06:11.475329 2233 rpcz_store.cc:276] 0927 15:06:09.853206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.854155 (+ 949us) service_pool.cc:227] Handling call
0927 15:06:11.316285 (+1462130us) ts_tablet_manager.cc:1145] Deleting tablet c41cd38355e64590b43b2e1271c43e91
0927 15:06:11.316317 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.414480 (+ 98163us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.430532 (+ 16052us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.472025 (+ 41493us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1461846}
I20260927 15:06:11.475870 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 695) took 1540 ms. Trace:
I20260927 15:06:11.475864 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet c41cd38355e64590b43b2e1271c43e91 (table default.Table_4239cd3219fb4e32827288ef7222bf2f [id=d49a20ec0aac4d799662a64a906d62f0]) successfully deleted
I20260927 15:06:11.476073 2233 rpcz_store.cc:276] 0927 15:06:09.935881 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.936336 (+ 455us) service_pool.cc:227] Handling call
0927 15:06:11.475749 (+1539413us) ts_tablet_manager.cc:1145] Deleting tablet ce1c286eea664e2a8ad6ebdf31bd4050
0927 15:06:11.475761 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.475855 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1539043}
W20260927 15:06:11.476718 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ce1c286eea664e2a8ad6ebdf31bd4050 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce1c286eea664e2a8ad6ebdf31bd4050 already in progress: creating tablet
I20260927 15:06:11.477075 2233 tablet_replica.cc:330] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:11.477324 2233 raft_consensus.cc:2229] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.477573 2233 raft_consensus.cc:2258] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.478173 2233 ts_tablet_manager.cc:1905] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:11.477933 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet a90039faff27436db7b50fa4c4643d3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.492048 913 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:11.493954 1556 tablet_bootstrap.cc:492] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.494102 1556 ts_tablet_manager.cc:1397] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.003s
I20260927 15:06:11.494791 1556 raft_consensus.cc:348] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.495010 1556 raft_consensus.cc:374] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.495059 1556 raft_consensus.cc:729] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.495239 1556 consensus_queue.cc:260] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.495707 1556 ts_tablet_manager.cc:1428] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:11.495952 1556 tablet_bootstrap.cc:492] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.497466 1556 tablet_bootstrap.cc:654] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.498620 1552 tablet_bootstrap.cc:654] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.505430 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 04007cd4bd214b88a4664e23daf4b790 with delete_type TABLET_DATA_DELETED (replaced by tablet 79c983d3119f4754a33a1ec3a84665c1) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.506707 1561 tablet_bootstrap.cc:492] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.507072 1561 ts_tablet_manager.cc:1397] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.000s
I20260927 15:06:11.507941 1561 raft_consensus.cc:348] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.508349 1561 raft_consensus.cc:374] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.508481 1561 raft_consensus.cc:729] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.508805 1561 consensus_queue.cc:260] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.515861 1556 tablet_bootstrap.cc:492] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.516038 1556 ts_tablet_manager.cc:1397] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260927 15:06:11.516901 1556 raft_consensus.cc:348] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.517145 1556 raft_consensus.cc:374] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.517199 1556 raft_consensus.cc:729] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.517474 1556 consensus_queue.cc:260] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.520314 1556 ts_tablet_manager.cc:1428] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260927 15:06:11.520594 1556 tablet_bootstrap.cc:492] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.522594 2233 ts_tablet_manager.cc:1918] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:11.522732 2233 log.cc:1196] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/27c3283a40f14eb4868767799cfdf7bd
I20260927 15:06:11.523048 2381 raft_consensus.cc:482] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.523277 2381 raft_consensus.cc:504] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.523490 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a89ef5f07f67497c9093617557cc4ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.523533 1556 tablet_bootstrap.cc:654] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.524013 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e29abccdacc4a18910470fe104b6801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.524011 2381 leader_election.cc:288] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.524792 2233 ts_tablet_manager.cc:1939] T 27c3283a40f14eb4868767799cfdf7bd P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:11.524853 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bc2abbed22e4bacb31e11ff60593c20. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:11.525353 1239 leader_election.cc:341] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: fde632b187eb4180b343d7bddc7f0943
I20260927 15:06:11.525940 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d14eac48c3784a72bd05ca1bb4d4ee4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.526530 1552 tablet_bootstrap.cc:492] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:11.526683 1552 ts_tablet_manager.cc:1397] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.127s user 0.002s sys 0.002s
I20260927 15:06:11.526892 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc47ec18419c42c5bf64a3a9a414d771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.527648 1552 raft_consensus.cc:348] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.527884 1552 raft_consensus.cc:374] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.527998 1552 raft_consensus.cc:729] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.528671 1552 consensus_queue.cc:260] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:11.530243 1238 leader_election.cc:341] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: fde632b187eb4180b343d7bddc7f0943
I20260927 15:06:11.530390 1238 leader_election.cc:302] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.530999 2381 raft_consensus.cc:2726] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.531307 1552 ts_tablet_manager.cc:1428] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:11.535147 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0a64059ef2234ad6adbdfd8d3576f2a6
I20260927 15:06:11.535848 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 70cc2e16bd6c40bf99ed4436f17d7096
I20260927 15:06:11.539755 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a64059ef2234ad6adbdfd8d3576f2a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.540699 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 70cc2e16bd6c40bf99ed4436f17d7096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.545109 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_81fe6e6be98b4478bc328f61651f191a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.545763 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81fe6e6be98b4478bc328f61651f191a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.547458 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_37bcd078f99f445fbc5687e1de84b2ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.548003 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37bcd078f99f445fbc5687e1de84b2ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.549636 2323 raft_consensus.cc:482] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.549789 2323 raft_consensus.cc:504] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.550405 2323 leader_election.cc:288] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.550434 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a64059ef2234ad6adbdfd8d3576f2a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.550661 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 566aa5caa012443ea63fcb7389c8b7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.550716 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 0129eaa5636544e696076e439d713b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 7fd8311955974e1cbcdda1961c318588) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.550661 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 70cc2e16bd6c40bf99ed4436f17d7096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:11.551071 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c264c532db8249e5abe1dbef8ee8ffa0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.551635 1552 tablet_bootstrap.cc:492] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:11.553891 1561 ts_tablet_manager.cc:1428] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
W20260927 15:06:11.554557 1374 leader_election.cc:341] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:11.555116 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95c8178680ea4b6b8794150188320ea9 consensus state has no leader
I20260927 15:06:11.555377 2381 raft_consensus.cc:482] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.555574 2381 raft_consensus.cc:504] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.555825 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c264c532db8249e5abe1dbef8ee8ffa0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.556082 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 955461f27b6444d4b4c3f9a9f629d5e3
I20260927 15:06:11.556206 2381 leader_election.cc:288] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:11.556749 1376 leader_election.cc:341] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.556722 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba14b7531bb647248572be10d2b43cf2" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.556869 1376 leader_election.cc:302] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.557039 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 955461f27b6444d4b4c3f9a9f629d5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:11.557278 1238 leader_election.cc:341] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ba14b7531bb647248572be10d2b43cf2
W20260927 15:06:11.557631 1239 leader_election.cc:341] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: Tablet not RUNNING: STOPPED
I20260927 15:06:11.557771 1239 leader_election.cc:302] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.557893 2322 raft_consensus.cc:2726] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.557953 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 955461f27b6444d4b4c3f9a9f629d5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.558156 2381 raft_consensus.cc:2726] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.559258 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a64059ef2234ad6adbdfd8d3576f2a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.559516 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 70cc2e16bd6c40bf99ed4436f17d7096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.560179 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 955461f27b6444d4b4c3f9a9f629d5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:11.567693 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a231aff1a39485db36979208d871ab3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:11.568704 2323 raft_consensus.cc:482] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.568885 2323 raft_consensus.cc:504] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.569630 2323 leader_election.cc:288] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.570611 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4658de7351e9423b83f393f7f7045eed" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.571271 1376 leader_election.cc:341] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.571543 2289 raft_consensus.cc:482] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.571739 2289 raft_consensus.cc:504] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.572125 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4658de7351e9423b83f393f7f7045eed" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.572540 2289 leader_election.cc:288] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:11.572721 1374 leader_election.cc:341] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.572830 1374 leader_election.cc:302] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:11.573807 1099 leader_election.cc:341] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: dc6f179aab784ae4822356e63332532f
I20260927 15:06:11.574424 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6f179aab784ae4822356e63332532f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.574955 1102 leader_election.cc:341] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.575085 1102 leader_election.cc:302] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.575217 2323 raft_consensus.cc:2726] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.575500 2289 raft_consensus.cc:2726] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.576962 1561 tablet_bootstrap.cc:492] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.579118 1561 tablet_bootstrap.cc:654] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.581212 2381 raft_consensus.cc:482] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.581405 2381 raft_consensus.cc:504] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.582103 2381 leader_election.cc:288] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:11.583420 1238 leader_election.cc:341] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 63289edbdd734dd5a817df42d83e422e
W20260927 15:06:11.583738 1239 leader_election.cc:341] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 63289edbdd734dd5a817df42d83e422e
I20260927 15:06:11.583842 1239 leader_election.cc:302] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.584349 2381 raft_consensus.cc:2726] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.598757 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1272c1a627744896856702a8272a54f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.599646 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1272c1a627744896856702a8272a54f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.600214 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 698) took 1663 ms. Trace:
I20260927 15:06:11.600318 2233 rpcz_store.cc:276] 0927 15:06:09.936524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.936582 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:11.477033 (+1540451us) ts_tablet_manager.cc:1145] Deleting tablet 27c3283a40f14eb4868767799cfdf7bd
0927 15:06:11.477044 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.519114 (+ 42070us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.522479 (+ 3365us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.600170 (+ 77691us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540292}
I20260927 15:06:11.600754 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 696) took 1664 ms. Trace:
I20260927 15:06:11.600849 2233 rpcz_store.cc:276] 0927 15:06:09.935961 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.936750 (+ 789us) service_pool.cc:227] Handling call
0927 15:06:11.600612 (+1663862us) ts_tablet_manager.cc:1145] Deleting tablet 20278f979638419db92105e55310f605
0927 15:06:11.600625 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.600734 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1663719}
I20260927 15:06:11.601218 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 697) took 1665 ms. Trace:
I20260927 15:06:11.601305 2233 rpcz_store.cc:276] 0927 15:06:09.936200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.936924 (+ 724us) service_pool.cc:227] Handling call
0927 15:06:11.601099 (+1664175us) ts_tablet_manager.cc:1145] Deleting tablet 5e9b07ea3ec9457399e2b765580d06e7
0927 15:06:11.601111 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.601203 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1664017}
I20260927 15:06:11.601593 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 717) took 1420 ms. Trace:
I20260927 15:06:11.601661 2233 rpcz_store.cc:276] 0927 15:06:10.181352 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.181831 (+ 479us) service_pool.cc:227] Handling call
0927 15:06:11.601500 (+1419669us) ts_tablet_manager.cc:1145] Deleting tablet 7f0d667472ee4f1481c213e03403461e
0927 15:06:11.601508 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.601580 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1419435}
I20260927 15:06:11.602591 2233 tablet_replica.cc:330] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:11.602609 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e7068df5611442f19ba70e32b3b81cb6" } new_table_name: "default.Table_102feaee35d9448e87313b235363314c" modify_external_catalogs: true
I20260927 15:06:11.603736 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 27c3283a40f14eb4868767799cfdf7bd (table default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85]) successfully deleted
W20260927 15:06:11.604053 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 20278f979638419db92105e55310f605 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20278f979638419db92105e55310f605 already in progress: creating tablet
W20260927 15:06:11.604271 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 5e9b07ea3ec9457399e2b765580d06e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e9b07ea3ec9457399e2b765580d06e7 already in progress: creating tablet
I20260927 15:06:11.604243 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a490439c7f9f49cc92a26631b8a8d04e" } new_table_name: "default.Table_3d43a49fe60b43e7920bf4a2da41d743" modify_external_catalogs: true
I20260927 15:06:11.602780 2233 raft_consensus.cc:2229] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.605176 2233 raft_consensus.cc:2258] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.605515 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7c3d4666467a46f2a8570f5c26f527fc" } modify_external_catalogs: true
I20260927 15:06:11.605803 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7c3d4666467a46f2a8570f5c26f527fc" } modify_external_catalogs: true
I20260927 15:06:11.606557 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_da9153d15e4a41a1811d6887fc2a7bd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:11.606782 2233 ts_tablet_manager.cc:1905] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:11.607308 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da9153d15e4a41a1811d6887fc2a7bd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.612002 1552 tablet_bootstrap.cc:654] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.617883 1562 ts_tablet_manager.cc:1918] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:11.618065 1562 log.cc:1196] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/ba14b7531bb647248572be10d2b43cf2
I20260927 15:06:11.618462 1562 ts_tablet_manager.cc:1939] T ba14b7531bb647248572be10d2b43cf2 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:11.624788 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bed9c25eb1f14b99b1f2f4b70e466715"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.625454 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bed9c25eb1f14b99b1f2f4b70e466715 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.643577 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 512) took 5155 ms. Trace:
I20260927 15:06:11.643982 1562 rpcz_store.cc:276] 0927 15:06:06.488202 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.629511 (+141309us) service_pool.cc:227] Handling call
0927 15:06:11.371401 (+4741890us) ts_tablet_manager.cc:1145] Deleting tablet ba14b7531bb647248572be10d2b43cf2
0927 15:06:11.371414 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.523003 (+151589us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.617749 (+ 94746us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.643522 (+ 25773us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4741697}
I20260927 15:06:11.644695 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 520) took 5011 ms. Trace:
I20260927 15:06:11.644974 1562 rpcz_store.cc:276] 0927 15:06:06.633676 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.641821 (+ 8145us) service_pool.cc:227] Handling call
0927 15:06:11.644509 (+5002688us) ts_tablet_manager.cc:1145] Deleting tablet 8d533883e3344eca939cd67644895148
0927 15:06:11.644524 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.644650 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5002412}
I20260927 15:06:11.645503 2323 raft_consensus.cc:482] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.645643 2323 raft_consensus.cc:504] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.646229 2323 leader_election.cc:288] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.646581 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 522) took 5003 ms. Trace:
I20260927 15:06:11.646725 1562 rpcz_store.cc:276] 0927 15:06:06.643314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.643378 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:11.645313 (+5001935us) ts_tablet_manager.cc:1145] Deleting tablet 1ba163e0f6164d65b09da684ee4872e0
0927 15:06:11.645323 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.646536 (+ 1213us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5001676}
I20260927 15:06:11.646895 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fc1fc04814147d8843aa734fd1794da" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.647172 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 511) took 5159 ms. Trace:
I20260927 15:06:11.647261 1562 rpcz_store.cc:276] 0927 15:06:06.488051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.648269 (+160218us) service_pool.cc:227] Handling call
0927 15:06:11.647034 (+4998765us) ts_tablet_manager.cc:1145] Deleting tablet d4f05da432f041378c5ab808536e6b6f
0927 15:06:11.647044 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.647134 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4998265}
I20260927 15:06:11.647710 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 529) took 4934 ms. Trace:
W20260927 15:06:11.647738 1374 leader_election.cc:341] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.647859 1562 rpcz_store.cc:276] 0927 15:06:06.713470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.713520 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:11.647604 (+4934084us) ts_tablet_manager.cc:1145] Deleting tablet f0a71cf0ee554b3eafca3f054cc16b28
0927 15:06:11.647614 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.647680 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4933852}
I20260927 15:06:11.648165 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 530) took 4934 ms. Trace:
I20260927 15:06:11.648247 1562 rpcz_store.cc:276] 0927 15:06:06.713899 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.713942 (+ 43us) service_pool.cc:227] Handling call
0927 15:06:11.648066 (+4934124us) ts_tablet_manager.cc:1145] Deleting tablet e19cd7febe054432899739e21605406d
0927 15:06:11.648074 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.648136 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4933955}
I20260927 15:06:11.648419 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_75127a34541e4a979aace6aa029d396e" } modify_external_catalogs: true
I20260927 15:06:11.648531 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 531) took 4933 ms. Trace:
I20260927 15:06:11.648614 1562 rpcz_store.cc:276] 0927 15:06:06.715359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.732395 (+ 17036us) service_pool.cc:227] Handling call
0927 15:06:11.648426 (+4916031us) ts_tablet_manager.cc:1145] Deleting tablet c5cd55de34d249bc8d3adcf4690f0414
0927 15:06:11.648434 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.648502 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4915769}
I20260927 15:06:11.648663 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_75127a34541e4a979aace6aa029d396e" } modify_external_catalogs: true
I20260927 15:06:11.648882 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 528) took 4941 ms. Trace:
I20260927 15:06:11.648973 1562 rpcz_store.cc:276] 0927 15:06:06.707377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:06.820277 (+112900us) service_pool.cc:227] Handling call
0927 15:06:11.648789 (+4828512us) ts_tablet_manager.cc:1145] Deleting tablet f1ad3b9d5f8244c99a01f5951007e1fd
0927 15:06:11.648797 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.648854 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4450416}
I20260927 15:06:11.649235 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 545) took 4448 ms. Trace:
I20260927 15:06:11.649317 1562 rpcz_store.cc:276] 0927 15:06:07.201162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.201354 (+ 192us) service_pool.cc:227] Handling call
0927 15:06:11.649142 (+4447788us) ts_tablet_manager.cc:1145] Deleting tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4
0927 15:06:11.649150 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.649207 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4447504}
I20260927 15:06:11.649595 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 546) took 4445 ms. Trace:
I20260927 15:06:11.649859 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fc1fc04814147d8843aa734fd1794da" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.650784 1376 leader_election.cc:341] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.651037 1376 leader_election.cc:302] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.651765 2323 raft_consensus.cc:2726] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.649668 1562 rpcz_store.cc:276] 0927 15:06:07.204581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.206859 (+ 2278us) service_pool.cc:227] Handling call
0927 15:06:11.649502 (+4442643us) ts_tablet_manager.cc:1145] Deleting tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4
0927 15:06:11.649510 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.649567 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4442442}
I20260927 15:06:11.652510 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 535) took 4525 ms. Trace:
I20260927 15:06:11.652667 1562 rpcz_store.cc:276] 0927 15:06:07.127288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.127375 (+ 87us) service_pool.cc:227] Handling call
0927 15:06:11.652381 (+4525006us) ts_tablet_manager.cc:1145] Deleting tablet 7a9c96abcfd347a9881b99df093da490
0927 15:06:11.652392 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.652476 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4438903}
I20260927 15:06:11.652987 1562 tablet_replica.cc:330] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:11.653066 2289 raft_consensus.cc:482] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.653316 1562 raft_consensus.cc:2229] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.653362 2289 raft_consensus.cc:504] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.653625 1562 raft_consensus.cc:2258] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.654101 2289 leader_election.cc:288] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.654171 1562 ts_tablet_manager.cc:1905] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:11.654896 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a90039faff27436db7b50fa4c4643d3b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.655519 1102 leader_election.cc:341] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.655798 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a90039faff27436db7b50fa4c4643d3b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:11.656059 1437 raft_consensus.cc:2454] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:11.656347 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e29abccdacc4a18910470fe104b6801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.656576 1099 leader_election.cc:302] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:11.657053 2289 raft_consensus.cc:2781] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:11.657181 2289 raft_consensus.cc:482] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:11.657279 2289 raft_consensus.cc:3037] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:11.658977 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a89ef5f07f67497c9093617557cc4ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.659438 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc47ec18419c42c5bf64a3a9a414d771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.659648 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bc2abbed22e4bacb31e11ff60593c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.661427 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d14eac48c3784a72bd05ca1bb4d4ee4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.665261 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet ba14b7531bb647248572be10d2b43cf2 (table default.Table_bc0cef144e2c48f6883df97308937a76 [id=43c20c5b532545b5b66ad52dc5af5fc2]) successfully deleted
I20260927 15:06:11.665769 2381 raft_consensus.cc:482] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:11.665880 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8d533883e3344eca939cd67644895148 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d533883e3344eca939cd67644895148 already in progress: creating tablet
W20260927 15:06:11.666149 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1ba163e0f6164d65b09da684ee4872e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ba163e0f6164d65b09da684ee4872e0 already in progress: creating tablet
I20260927 15:06:11.666014 2381 raft_consensus.cc:504] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:11.666352 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet d4f05da432f041378c5ab808536e6b6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4f05da432f041378c5ab808536e6b6f already in progress: creating tablet
W20260927 15:06:11.666591 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet f0a71cf0ee554b3eafca3f054cc16b28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0a71cf0ee554b3eafca3f054cc16b28 already in progress: creating tablet
W20260927 15:06:11.666785 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e19cd7febe054432899739e21605406d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e19cd7febe054432899739e21605406d already in progress: creating tablet
W20260927 15:06:11.667048 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c5cd55de34d249bc8d3adcf4690f0414 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5cd55de34d249bc8d3adcf4690f0414 already in progress: creating tablet
W20260927 15:06:11.667232 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet f1ad3b9d5f8244c99a01f5951007e1fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1ad3b9d5f8244c99a01f5951007e1fd already in progress: creating tablet
W20260927 15:06:11.667443 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 already in progress: creating tablet
W20260927 15:06:11.667709 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cd5a8cfb9cd4460bcfeaaf9193c79e4 already in progress: creating tablet
W20260927 15:06:11.667943 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 7a9c96abcfd347a9881b99df093da490 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a9c96abcfd347a9881b99df093da490 already in progress: creating tablet
I20260927 15:06:11.672152 2365 raft_consensus.cc:482] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.672326 2365 raft_consensus.cc:504] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.673002 2365 leader_election.cc:288] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.673899 2381 leader_election.cc:288] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:11.674379 1238 leader_election.cc:341] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3a231aff1a39485db36979208d871ab3
W20260927 15:06:11.677559 1099 leader_election.cc:341] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c41cd38355e64590b43b2e1271c43e91
I20260927 15:06:11.677948 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_53dbfc415ede4dc69abb5bd5ede1f297" } new_table_name: "default.Table_0c6b90a02ef44559bf8e5d972ca1f6f6" modify_external_catalogs: true
I20260927 15:06:11.679592 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1a390c73cebe4e8dbbc63a31170fdd9f" } new_table_name: "default.Table_77aaa5739f804cd985c9096b2b908d21" modify_external_catalogs: true
I20260927 15:06:11.682502 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f42add5ed0a44c3ab8cd106ab1c21187"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.684619 1239 leader_election.cc:341] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 3a231aff1a39485db36979208d871ab3
I20260927 15:06:11.684818 1239 leader_election.cc:302] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:11.685022 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e7f0754b9ba4e21b05c51b0136729d1 consensus state has no leader
I20260927 15:06:11.688659 2381 raft_consensus.cc:2726] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:11.690591 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 921db5dbe31a4d0381bdd823cb497424 (table default.Table_fb1ec2ad14a54339a8ded2628758b6ce [id=b11f83d1010940d5bbd03efa06497202], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 921db5dbe31a4d0381bdd823cb497424 consensus state has no leader
I20260927 15:06:11.690899 2323 raft_consensus.cc:482] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.691066 2323 raft_consensus.cc:504] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.691817 2323 leader_election.cc:288] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.692641 1556 tablet_bootstrap.cc:492] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.692588 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04007cd4bd214b88a4664e23daf4b790" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.692796 1556 ts_tablet_manager.cc:1397] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.172s user 0.014s sys 0.037s
W20260927 15:06:11.693554 1374 leader_election.cc:341] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.694067 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04007cd4bd214b88a4664e23daf4b790" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.694729 1376 leader_election.cc:341] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.694852 1376 leader_election.cc:302] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.695458 2323 raft_consensus.cc:2726] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.698261 1556 raft_consensus.cc:348] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.702880 1556 raft_consensus.cc:374] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.703202 1556 raft_consensus.cc:729] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.703819 1556 consensus_queue.cc:260] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.706060 1556 ts_tablet_manager.cc:1428] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260927 15:06:11.709476 1556 tablet_bootstrap.cc:492] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.711162 1561 tablet_bootstrap.cc:492] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.711355 1561 ts_tablet_manager.cc:1397] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.134s user 0.037s sys 0.039s
I20260927 15:06:11.712420 1561 raft_consensus.cc:348] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.712685 1561 raft_consensus.cc:374] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.712766 1561 raft_consensus.cc:729] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.713109 1561 consensus_queue.cc:260] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.713914 1561 ts_tablet_manager.cc:1428] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:11.714349 1561 tablet_bootstrap.cc:492] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.719113 1556 tablet_bootstrap.cc:654] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.690232 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41cd38355e64590b43b2e1271c43e91" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.720697 2233 ts_tablet_manager.cc:1918] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:11.720842 2233 log.cc:1196] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/0aec677006ab4407bd7ae4c0078d6b7f
I20260927 15:06:11.721166 2233 ts_tablet_manager.cc:1939] T 0aec677006ab4407bd7ae4c0078d6b7f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:11.722083 1561 tablet_bootstrap.cc:654] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.721971 2289 raft_consensus.cc:504] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.722766 2289 leader_election.cc:288] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.726711 1561 tablet_bootstrap.cc:492] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.726917 1561 ts_tablet_manager.cc:1397] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
W20260927 15:06:11.726775 1102 leader_election.cc:341] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.727353 1102 leader_election.cc:302] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.727430 2119 ts_tablet_manager.cc:1918] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:11.727692 1561 raft_consensus.cc:348] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.728363 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a90039faff27436db7b50fa4c4643d3b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:11.728541 1437 raft_consensus.cc:3037] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:11.732748 2289 raft_consensus.cc:2726] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.736743 2119 log.cc:1196] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/e9a7ed6e23e1479a86e2abcf6aa5b317
W20260927 15:06:11.737197 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f42add5ed0a44c3ab8cd106ab1c21187 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.754096 1552 tablet_bootstrap.cc:492] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:11.754415 1552 ts_tablet_manager.cc:1397] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.203s user 0.018s sys 0.015s
I20260927 15:06:11.755375 1552 raft_consensus.cc:348] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.755839 1552 raft_consensus.cc:374] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.755983 1552 raft_consensus.cc:729] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.756909 1552 consensus_queue.cc:260] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.757258 2119 ts_tablet_manager.cc:1939] T e9a7ed6e23e1479a86e2abcf6aa5b317 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:11.757942 2323 raft_consensus.cc:482] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.758082 2323 raft_consensus.cc:504] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.758757 2323 leader_election.cc:288] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.759557 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566aa5caa012443ea63fcb7389c8b7c0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.727949 1561 raft_consensus.cc:374] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.759948 1561 raft_consensus.cc:729] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.760021 2119 tablet_replica.cc:330] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:11.760182 1561 consensus_queue.cc:260] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.760669 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet e9a7ed6e23e1479a86e2abcf6aa5b317 (table default.Table_bbb9f9f890a54220b1065de77e571c1e [id=da0dd555186044f2ac3825b4fbeb645a]) successfully deleted
W20260927 15:06:11.761188 1374 leader_election.cc:341] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.762710 2119 raft_consensus.cc:2229] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.762952 2119 raft_consensus.cc:2258] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.764290 2119 ts_tablet_manager.cc:1905] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:11.765071 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc47ec18419c42c5bf64a3a9a414d771 consensus state has no leader
I20260927 15:06:11.765450 907 master_service.cc:946] ReplaceTablet: received request to replace tablet 89783d26db9e49f0ae5171f929fcf1df from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:11.765674 1561 ts_tablet_manager.cc:1428] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
I20260927 15:06:11.766908 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a90039faff27436db7b50fa4c4643d3b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:11.767784 1102 leader_election.cc:341] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.769613 1561 tablet_bootstrap.cc:492] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.772557 1561 tablet_bootstrap.cc:654] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.773516 1556 tablet_bootstrap.cc:492] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.775213 1556 ts_tablet_manager.cc:1397] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.066s user 0.008s sys 0.004s
I20260927 15:06:11.776077 1556 raft_consensus.cc:348] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.781418 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_56a3935c2e7e42f3a601932943f67459" } modify_external_catalogs: true
I20260927 15:06:11.781656 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_56a3935c2e7e42f3a601932943f67459" } modify_external_catalogs: true
I20260927 15:06:11.782435 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566aa5caa012443ea63fcb7389c8b7c0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.782883 1556 raft_consensus.cc:374] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.782980 1556 raft_consensus.cc:729] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
W20260927 15:06:11.783228 1376 leader_election.cc:341] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.783358 1376 leader_election.cc:302] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.783772 2323 raft_consensus.cc:2726] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.783231 1556 consensus_queue.cc:260] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.786234 1556 ts_tablet_manager.cc:1428] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 15:06:11.786629 1556 tablet_bootstrap.cc:492] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.790799 1556 tablet_bootstrap.cc:654] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.792225 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1272c1a627744896856702a8272a54f9" } modify_external_catalogs: true
I20260927 15:06:11.792008 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 718) took 1603 ms. Trace:
I20260927 15:06:11.792443 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1272c1a627744896856702a8272a54f9" } modify_external_catalogs: true
I20260927 15:06:11.792495 2233 rpcz_store.cc:276] 0927 15:06:10.188277 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.188325 (+ 48us) service_pool.cc:227] Handling call
0927 15:06:11.602547 (+1414222us) ts_tablet_manager.cc:1145] Deleting tablet 0aec677006ab4407bd7ae4c0078d6b7f
0927 15:06:11.602556 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.717471 (+114915us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.720601 (+ 3130us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.791984 (+ 71383us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1414016}
I20260927 15:06:11.792913 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 719) took 1599 ms. Trace:
I20260927 15:06:11.793094 1552 ts_tablet_manager.cc:1428] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260927 15:06:11.793013 2233 rpcz_store.cc:276] 0927 15:06:10.193319 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.193374 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:11.792785 (+1599411us) ts_tablet_manager.cc:1145] Deleting tablet 916663fe0c6c46b1b3415e165d60187f
0927 15:06:11.792797 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.792897 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1599140}
I20260927 15:06:11.793949 2233 tablet_replica.cc:330] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:11.794163 2233 raft_consensus.cc:2229] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:11.794299 2233 raft_consensus.cc:2258] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.794971 1561 tablet_bootstrap.cc:492] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.795137 1561 ts_tablet_manager.cc:1397] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260927 15:06:11.795635 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 0aec677006ab4407bd7ae4c0078d6b7f (table default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]) successfully deleted
W20260927 15:06:11.795920 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 916663fe0c6c46b1b3415e165d60187f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916663fe0c6c46b1b3415e165d60187f already in progress: creating tablet
I20260927 15:06:11.795931 1561 raft_consensus.cc:348] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.796164 1561 raft_consensus.cc:374] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:11.796205 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 514ce66d5afd46a7b9cc460776973b06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 514ce66d5afd46a7b9cc460776973b06 already in progress: creating tablet
I20260927 15:06:11.796245 1561 raft_consensus.cc:729] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:06:11.796458 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7dccaee87f314cbaa98d66e0bb885a8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dccaee87f314cbaa98d66e0bb885a8b already in progress: creating tablet
W20260927 15:06:11.796671 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b88cb2c53be4463eb17e748d2c17f0e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b88cb2c53be4463eb17e748d2c17f0e2 already in progress: creating tablet
I20260927 15:06:11.796526 1561 consensus_queue.cc:260] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:11.796882 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3042c17580d54082971b761433a7dca9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3042c17580d54082971b761433a7dca9 already in progress: creating tablet
I20260927 15:06:11.794808 2233 ts_tablet_manager.cc:1905] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:11.801170 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9f9962d4d8c46c49795f95192b79a56 consensus state has no leader
I20260927 15:06:11.801975 1561 ts_tablet_manager.cc:1428] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 15:06:11.805161 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_124db11735d04945ad242967db096475"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.805828 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_124db11735d04945ad242967db096475 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.808363 2323 raft_consensus.cc:482] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.808425 1561 tablet_bootstrap.cc:492] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.808518 2323 raft_consensus.cc:504] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.809139 2323 leader_election.cc:288] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:11.809993 1561 tablet_bootstrap.cc:654] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.809929 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b7e017ead242849585679873a69b43" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:11.811298 1374 leader_election.cc:341] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.812542 2413 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:11.813028 2414 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:11.816053 1437 raft_consensus.cc:2454] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:11.816522 1556 tablet_bootstrap.cc:492] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
W20260927 15:06:11.816583 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 consensus state has no leader
I20260927 15:06:11.816640 1556 ts_tablet_manager.cc:1397] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.002s
I20260927 15:06:11.817305 1556 raft_consensus.cc:348] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.817507 1556 raft_consensus.cc:374] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.817556 1556 raft_consensus.cc:729] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.820737 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_34e69f03f4ae4aa58a9bffd06b168d85" } new_table_name: "default.Table_2586b19f54004fa690256190a2bc0dcd" modify_external_catalogs: true
I20260927 15:06:11.821003 1556 consensus_queue.cc:260] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.821522 1556 ts_tablet_manager.cc:1428] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:11.821750 1556 tablet_bootstrap.cc:492] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.823299 1556 tablet_bootstrap.cc:654] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.830004 2290 raft_consensus.cc:482] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.832019 1552 tablet_bootstrap.cc:492] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:11.832588 1556 tablet_bootstrap.cc:492] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.832703 1556 ts_tablet_manager.cc:1397] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260927 15:06:11.833336 1556 raft_consensus.cc:348] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.833647 1556 raft_consensus.cc:374] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.833745 1556 raft_consensus.cc:729] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.833882 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5d29cefe8c174dd89895f67e0784bf77" } modify_external_catalogs: true
I20260927 15:06:11.834120 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5d29cefe8c174dd89895f67e0784bf77" } modify_external_catalogs: true
I20260927 15:06:11.834031 1556 consensus_queue.cc:260] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.834939 1556 ts_tablet_manager.cc:1428] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:11.834940 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b7e017ead242849585679873a69b43" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.835294 1556 tablet_bootstrap.cc:492] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:11.836474 1376 leader_election.cc:341] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.836613 1376 leader_election.cc:302] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.836768 1556 tablet_bootstrap.cc:654] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.837000 2323 raft_consensus.cc:2726] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:11.838279 1305 raft_consensus.cc:3037] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:11.839309 1556 tablet_bootstrap.cc:492] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.839501 1556 ts_tablet_manager.cc:1397] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260927 15:06:11.840358 1556 raft_consensus.cc:348] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.840612 1556 raft_consensus.cc:374] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.840708 1556 raft_consensus.cc:729] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.840967 1556 consensus_queue.cc:260] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.841552 1556 ts_tablet_manager.cc:1428] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:11.841833 1556 tablet_bootstrap.cc:492] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.843505 1556 tablet_bootstrap.cc:654] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.852422 1556 tablet_bootstrap.cc:492] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.852576 1556 ts_tablet_manager.cc:1397] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260927 15:06:11.853425 1556 raft_consensus.cc:348] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.853736 1556 raft_consensus.cc:374] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.853820 1556 raft_consensus.cc:729] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.854060 1556 consensus_queue.cc:260] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.854661 1556 ts_tablet_manager.cc:1428] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:11.854996 1556 tablet_bootstrap.cc:492] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.856608 1556 tablet_bootstrap.cc:654] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.857956 1552 tablet_bootstrap.cc:654] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.864197 1556 tablet_bootstrap.cc:492] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.865123 1556 ts_tablet_manager.cc:1397] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260927 15:06:11.866056 1556 raft_consensus.cc:348] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.867264 1556 raft_consensus.cc:374] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.867480 1556 raft_consensus.cc:729] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.867822 1556 consensus_queue.cc:260] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.868779 1556 ts_tablet_manager.cc:1428] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:11.869552 1556 tablet_bootstrap.cc:492] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.871534 1556 tablet_bootstrap.cc:654] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.876271 2323 raft_consensus.cc:482] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.876430 2323 raft_consensus.cc:504] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.877137 2323 leader_election.cc:288] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.879957 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd31ae2ac2e4bc9897724bc9012698d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.880637 1376 leader_election.cc:341] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.882973 1556 tablet_bootstrap.cc:492] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:11.883150 1556 ts_tablet_manager.cc:1397] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.005s
I20260927 15:06:11.884148 1556 raft_consensus.cc:348] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.884423 1556 raft_consensus.cc:374] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.884498 1556 raft_consensus.cc:729] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.884735 1556 consensus_queue.cc:260] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.888077 1556 ts_tablet_manager.cc:1428] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:11.888445 1556 tablet_bootstrap.cc:492] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:11.890839 1556 tablet_bootstrap.cc:654] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.890949 2381 raft_consensus.cc:482] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.891150 2381 raft_consensus.cc:504] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.891809 2381 leader_election.cc:288] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:11.896517 1238 leader_election.cc:341] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 109f9088371e4f008b2b5f993f2b4c3b
I20260927 15:06:11.897076 2323 raft_consensus.cc:482] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.897214 2323 raft_consensus.cc:504] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.897879 2323 leader_election.cc:288] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.898715 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb2a8e788b71451da4a18f52b643e5e2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:11.899286 1376 leader_election.cc:341] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.900121 1552 tablet_bootstrap.cc:492] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:11.900321 1552 ts_tablet_manager.cc:1397] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.006s
I20260927 15:06:11.901399 1552 raft_consensus.cc:348] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.901681 1552 raft_consensus.cc:374] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.901859 1552 raft_consensus.cc:729] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.902124 1552 consensus_queue.cc:260] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.906652 1552 ts_tablet_manager.cc:1428] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:06:11.908655 1552 tablet_bootstrap.cc:492] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:11.920092 2323 raft_consensus.cc:482] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.920281 2323 raft_consensus.cc:504] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.921128 2323 leader_election.cc:288] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.914181 1303 raft_consensus.cc:3037] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:11.917225 2119 ts_tablet_manager.cc:1918] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:11.921865 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "434e9390f1fd4a3ebb65924c37b85bd4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.925853 2119 log.cc:1196] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/7d1f23f91bce4df480dd9991659f2e81
I20260927 15:06:11.926429 2119 ts_tablet_manager.cc:1939] T 7d1f23f91bce4df480dd9991659f2e81 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:11.926916 1376 leader_election.cc:341] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.930750 2233 ts_tablet_manager.cc:1918] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:11.933723 2233 log.cc:1196] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/0d4ca19b492c4df1b31c78f1629c50b5
I20260927 15:06:11.934473 2233 ts_tablet_manager.cc:1939] T 0d4ca19b492c4df1b31c78f1629c50b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:11.935523 2289 raft_consensus.cc:482] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.935786 2365 raft_consensus.cc:482] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.936012 2289 raft_consensus.cc:504] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.935693 1099 leader_election.cc:302] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:11.936455 2290 raft_consensus.cc:504] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.936837 1562 ts_tablet_manager.cc:1918] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:11.936997 1562 log.cc:1196] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/6e9d03457dac43038b4e6fb120ff572c
I20260927 15:06:11.937348 2290 leader_election.cc:288] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.937393 1562 ts_tablet_manager.cc:1939] T 6e9d03457dac43038b4e6fb120ff572c P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:11.937515 2290 raft_consensus.cc:482] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.937633 2290 raft_consensus.cc:504] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.938118 2290 leader_election.cc:288] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.938197 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 536) took 4809 ms. Trace:
I20260927 15:06:11.938292 2290 raft_consensus.cc:482] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.938318 1562 rpcz_store.cc:276] 0927 15:06:07.129060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.129230 (+ 170us) service_pool.cc:227] Handling call
0927 15:06:11.652933 (+4523703us) ts_tablet_manager.cc:1145] Deleting tablet 6e9d03457dac43038b4e6fb120ff572c
0927 15:06:11.652942 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.723066 (+ 70124us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.815794 (+ 92728us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.938151 (+122357us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4439411}
I20260927 15:06:11.938423 2290 raft_consensus.cc:504] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.938737 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 542) took 4791 ms. Trace:
I20260927 15:06:11.938946 2365 raft_consensus.cc:504] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.939402 1561 tablet_bootstrap.cc:492] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:11.939529 2365 leader_election.cc:288] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.939558 1561 ts_tablet_manager.cc:1397] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.131s user 0.003s sys 0.000s
I20260927 15:06:11.942111 2365 raft_consensus.cc:2781] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:11.942545 1552 tablet_bootstrap.cc:654] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.948113 2323 raft_consensus.cc:482] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.948338 2323 raft_consensus.cc:504] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.949215 2323 leader_election.cc:288] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:11.950109 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa192d5cbece4127ace65e564bb1a12a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.938884 2290 leader_election.cc:288] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:11.950891 1376 leader_election.cc:341] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.957643 2365 raft_consensus.cc:686] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:11.957650 1561 raft_consensus.cc:348] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.938886 1562 rpcz_store.cc:276] 0927 15:06:07.146755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.146797 (+ 42us) service_pool.cc:227] Handling call
0927 15:06:11.938587 (+4791790us) ts_tablet_manager.cc:1145] Deleting tablet 9d4487cbbce24e60ae76ec0aca2760f4
0927 15:06:11.938599 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.938694 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4665981}
I20260927 15:06:11.958854 2365 consensus_queue.cc:237] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.959982 2289 leader_election.cc:288] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:11.960594 1561 raft_consensus.cc:374] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.960863 1561 raft_consensus.cc:729] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.961170 1561 consensus_queue.cc:260] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:11.962153 1561 ts_tablet_manager.cc:1428] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260927 15:06:11.962518 1561 tablet_bootstrap.cc:492] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:11.962723 2381 raft_consensus.cc:482] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:11.962917 2381 raft_consensus.cc:504] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.963402 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 543) took 4813 ms. Trace:
I20260927 15:06:11.963574 2381 leader_election.cc:288] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:11.966331 1238 leader_election.cc:341] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ad5af5df58824fe88d607a93216bd228
I20260927 15:06:11.966359 1562 rpcz_store.cc:276] 0927 15:06:07.146963 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.147015 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:11.958161 (+4811146us) ts_tablet_manager.cc:1145] Deleting tablet 96ac92258c6044a891b3325b7aaf3b8f
0927 15:06:11.958176 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.960422 (+ 2246us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4684782}
I20260927 15:06:11.966848 1562 tablet_replica.cc:330] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:11.967135 1562 raft_consensus.cc:2229] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:11.967296 2385 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:11.967522 1562 pending_rounds.cc:62] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:11.967617 1562 pending_rounds.cc:68] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976346067378176 op_type: NO_OP noop_request { }
I20260927 15:06:11.967779 1562 raft_consensus.cc:2866] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:11.967921 1562 raft_consensus.cc:2258] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:11.968657 1562 ts_tablet_manager.cc:1905] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:11.973639 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 7afe7ec3929649a8b647eca15e3b7514 (DEFAULT_TABLE table=default.Table_7c3d4666467a46f2a8570f5c26f527fc [id=acf340a36168495c8df652b81af15fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.974187 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_621ab4142aac41ba946d83825752a245"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:11.974367 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet ad5af5df58824fe88d607a93216bd228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:11.974763 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_621ab4142aac41ba946d83825752a245 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.975046 905 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 80a8563c77484a1ebbbe7dab9a652aeb (table default.Table_60ea7e4921ff40728d6a8b84c9b494c8 [id=f76efa8048524aa9a343ed0912a15500]). Expected version 2 got 0
I20260927 15:06:11.975788 1552 tablet_bootstrap.cc:492] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:11.975968 1552 ts_tablet_manager.cc:1397] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.002s
I20260927 15:06:11.975874 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bb14a6976bce4bd0be92d968861d9269"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:11.976384 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb14a6976bce4bd0be92d968861d9269 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:11.976775 1552 raft_consensus.cc:348] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.977031 1552 raft_consensus.cc:374] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:11.977106 1552 raft_consensus.cc:729] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:11.977393 1552 consensus_queue.cc:260] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:11.978019 1561 tablet_bootstrap.cc:654] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:11.979313 1552 ts_tablet_manager.cc:1428] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:11.980041 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0aec677006ab4407bd7ae4c0078d6b7f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.980073 1297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c65bc09865bc4a0283eaa4af9f860bdd" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.980412 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa192d5cbece4127ace65e564bb1a12a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.982084 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd31ae2ac2e4bc9897724bc9012698d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.982108 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 7afe7ec3929649a8b647eca15e3b7514 (DEFAULT_TABLE table=default.Table_7c3d4666467a46f2a8570f5c26f527fc [id=acf340a36168495c8df652b81af15fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:11.982532 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7afe7ec3929649a8b647eca15e3b7514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.982555 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb2a8e788b71451da4a18f52b643e5e2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.982942 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb0ab983a444d26b903a0cec64f15f0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.983132 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "434e9390f1fd4a3ebb65924c37b85bd4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.983283 1299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48e7eac8753f425d90302360d228ee54" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:11.984247 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7afe7ec3929649a8b647eca15e3b7514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:11.989770 908 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 5b4fe9a85d0a45d3a4c7ba68e6264865
W20260927 15:06:11.992076 1102 leader_election.cc:341] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:11.992489 1102 leader_election.cc:341] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:11.992767 1102 leader_election.cc:341] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:11.993023 1102 leader_election.cc:341] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:11.993338 1102 leader_election.cc:341] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.996135 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa192d5cbece4127ace65e564bb1a12a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:11.996363 1163 raft_consensus.cc:2454] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
W20260927 15:06:11.996747 1239 leader_election.cc:341] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 109f9088371e4f008b2b5f993f2b4c3b
I20260927 15:06:11.996891 1239 leader_election.cc:302] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.997270 2381 raft_consensus.cc:2726] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:11.997641 1239 leader_election.cc:341] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: ad5af5df58824fe88d607a93216bd228
I20260927 15:06:11.997756 1239 leader_election.cc:302] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:11.998116 2381 raft_consensus.cc:2726] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:11.998553 1374 leader_election.cc:341] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.998685 1374 leader_election.cc:302] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:11.999140 2323 raft_consensus.cc:2726] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:11.999572 1374 leader_election.cc:341] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:11.999708 1374 leader_election.cc:302] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.000108 2323 raft_consensus.cc:2726] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:12.000456 1374 leader_election.cc:341] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.000562 1374 leader_election.cc:302] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.000942 2323 raft_consensus.cc:2726] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.001309 1374 leader_election.cc:302] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.001721 2323 raft_consensus.cc:2781] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.001837 2323 raft_consensus.cc:482] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.001952 2323 raft_consensus.cc:3037] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.001907 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae30595912943aaa58f1ebe9dc965e6 (DEFAULT_TABLE table=default.Table_ea693bd966dc4d3282a842b4b41fffe7 [id=47c971f9181046cd9c8609de8df3ef30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.001907 1281 tablet_service.cc:1467] Processing CreateTablet for tablet b5ee2d7382d647cba4f3d55098e437c7 (DEFAULT_TABLE table=default.Table_3028fb3d99c84685ad117fb942f070a9 [id=ef677f118c584abe98964c4402734808]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.004244 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 771ce4b9675742bc88306e4d099cbb82 (DEFAULT_TABLE table=default.Table_15a9a14d40bf4481a5b9de28d05f1833 [id=76d05bc65fa74e7397604e5d63dfcf20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.004751 1268 tablet_service.cc:1467] Processing CreateTablet for tablet cf0cc2ae2792420a91f2c42edcf47fd7 (DEFAULT_TABLE table=default.Table_d6c9d61c79934636a425c02a9d7ba5ba [id=6e8d8381134b494f8e1824f086063971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.008648 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae30595912943aaa58f1ebe9dc965e6 (DEFAULT_TABLE table=default.Table_ea693bd966dc4d3282a842b4b41fffe7 [id=47c971f9181046cd9c8609de8df3ef30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.008714 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 99e672c109e144b09193f916f8c5d516 (DEFAULT_TABLE table=default.Table_0076a3b473134965a5d828a3acf95007 [id=1fc1365d7e0f4733bf58e157df99091a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.009230 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae30595912943aaa58f1ebe9dc965e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.009584 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8f99d6af6eb24a288b8dbf7d1cdc61e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.010161 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f99d6af6eb24a288b8dbf7d1cdc61e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.011106 1404 tablet_service.cc:1467] Processing CreateTablet for tablet b5ee2d7382d647cba4f3d55098e437c7 (DEFAULT_TABLE table=default.Table_3028fb3d99c84685ad117fb942f070a9 [id=ef677f118c584abe98964c4402734808]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.011505 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5ee2d7382d647cba4f3d55098e437c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.016098 1552 tablet_bootstrap.cc:492] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.017952 1410 tablet_service.cc:1467] Processing CreateTablet for tablet cf0cc2ae2792420a91f2c42edcf47fd7 (DEFAULT_TABLE table=default.Table_d6c9d61c79934636a425c02a9d7ba5ba [id=6e8d8381134b494f8e1824f086063971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.018492 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0cc2ae2792420a91f2c42edcf47fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.019405 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 771ce4b9675742bc88306e4d099cbb82 (DEFAULT_TABLE table=default.Table_15a9a14d40bf4481a5b9de28d05f1833 [id=76d05bc65fa74e7397604e5d63dfcf20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.019872 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 771ce4b9675742bc88306e4d099cbb82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.022559 2233 tablet_replica.cc:330] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:12.022643 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2856a29a2594e279b399c7da1921236 consensus state has no leader
I20260927 15:06:12.022850 2233 raft_consensus.cc:2229] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:12.023046 2233 raft_consensus.cc:2258] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.023588 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 99e672c109e144b09193f916f8c5d516 (DEFAULT_TABLE table=default.Table_0076a3b473134965a5d828a3acf95007 [id=1fc1365d7e0f4733bf58e157df99091a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.023979 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e672c109e144b09193f916f8c5d516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.023954 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 0d4ca19b492c4df1b31c78f1629c50b5 (table default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]) successfully deleted
I20260927 15:06:12.024255 2233 ts_tablet_manager.cc:1905] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:12.032210 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d0b0346a14ac4261aa3537ad273e885c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.032907 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0b0346a14ac4261aa3537ad273e885c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.035784 2322 raft_consensus.cc:482] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.036037 2322 raft_consensus.cc:504] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.037129 2322 leader_election.cc:288] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.039194 2323 raft_consensus.cc:504] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.040776 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9049d003d787403f80aa0c08872dd3b5
I20260927 15:06:12.041453 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae30595912943aaa58f1ebe9dc965e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.041791 1556 tablet_bootstrap.cc:492] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:12.041785 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7afe7ec3929649a8b647eca15e3b7514
I20260927 15:06:12.041966 1556 ts_tablet_manager.cc:1397] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.154s user 0.022s sys 0.010s
I20260927 15:06:12.042621 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6b4beb4112734b9c91e32b300fd266d7
I20260927 15:06:12.042709 1556 raft_consensus.cc:348] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.042982 1556 raft_consensus.cc:374] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.043061 1556 raft_consensus.cc:729] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.043210 2381 raft_consensus.cc:482] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.044167 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 9049d003d787403f80aa0c08872dd3b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.044445 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 7afe7ec3929649a8b647eca15e3b7514 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.044684 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b4beb4112734b9c91e32b300fd266d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.046205 2323 leader_election.cc:288] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.047464 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8790d59beb804acb8e4353f862d7f6f8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:12.048204 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa192d5cbece4127ace65e564bb1a12a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:12.048414 1163 raft_consensus.cc:3037] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.048990 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 666) took 1256 ms. Trace:
I20260927 15:06:12.049168 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 9049d003d787403f80aa0c08872dd3b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.049109 2119 rpcz_store.cc:276] 0927 15:06:10.767156 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.767622 (+ 466us) service_pool.cc:227] Handling call
0927 15:06:11.757829 (+990207us) ts_tablet_manager.cc:1145] Deleting tablet 7d1f23f91bce4df480dd9991659f2e81
0927 15:06:11.757850 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:11.820713 (+ 62863us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:11.917093 (+ 96380us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.023691 (+106598us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1280,"tablet-delete.queue_time_us":990013}
I20260927 15:06:12.051280 2385 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:12.052099 2119 tablet_replica.cc:330] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:12.052340 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_408d5290765e4ad48e15300c6ff5f72a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:12.052367 1556 consensus_queue.cc:260] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:12.052994 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_408d5290765e4ad48e15300c6ff5f72a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.054768 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5ee2d7382d647cba4f3d55098e437c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:12.055997 1374 leader_election.cc:341] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.056197 1556 ts_tablet_manager.cc:1428] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260927 15:06:12.057253 2119 raft_consensus.cc:2229] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:12.057299 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 7afe7ec3929649a8b647eca15e3b7514 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.057382 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b4beb4112734b9c91e32b300fd266d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.057700 1556 tablet_bootstrap.cc:492] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:12.057801 2119 raft_consensus.cc:2258] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.054643 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa192d5cbece4127ace65e564bb1a12a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:12.055907 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8790d59beb804acb8e4353f862d7f6f8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.058405 1376 leader_election.cc:341] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.058389 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 7d1f23f91bce4df480dd9991659f2e81 (table default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]) successfully deleted
W20260927 15:06:12.058653 1376 leader_election.cc:341] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.058777 1376 leader_election.cc:302] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.059046 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 771ce4b9675742bc88306e4d099cbb82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.059168 2323 raft_consensus.cc:2726] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.059451 2119 ts_tablet_manager.cc:1905] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:12.059088 1561 tablet_bootstrap.cc:492] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.055747 2381 raft_consensus.cc:504] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.059868 1561 ts_tablet_manager.cc:1397] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.097s user 0.012s sys 0.006s
I20260927 15:06:12.060304 1552 tablet_bootstrap.cc:654] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.061268 1561 raft_consensus.cc:348] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.062268 1556 tablet_bootstrap.cc:654] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.062353 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 6e9d03457dac43038b4e6fb120ff572c (table default.Table_fa178c2ce0e14306911368823822afc2 [id=55e2284e62fa45629d02de072260473c]) successfully deleted
I20260927 15:06:12.062551 1561 raft_consensus.cc:374] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:12.062801 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9d4487cbbce24e60ae76ec0aca2760f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d4487cbbce24e60ae76ec0aca2760f4 already in progress: creating tablet
I20260927 15:06:12.063021 1561 raft_consensus.cc:729] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:06:12.059942 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 242189us
W20260927 15:06:12.063793 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 96ac92258c6044a891b3325b7aaf3b8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96ac92258c6044a891b3325b7aaf3b8f already in progress: creating tablet
I20260927 15:06:12.064246 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0cc2ae2792420a91f2c42edcf47fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.064718 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa192d5cbece4127ace65e564bb1a12a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.064772 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 7afe7ec3929649a8b647eca15e3b7514 (DEFAULT_TABLE table=default.Table_7c3d4666467a46f2a8570f5c26f527fc [id=acf340a36168495c8df652b81af15fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.065004 1437 raft_consensus.cc:2379] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4264874db964ff2830b7894c2b3d61c in current term 1: Already voted for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in this term.
I20260927 15:06:12.065276 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c65bc09865bc4a0283eaa4af9f860bdd" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.065464 1433 raft_consensus.cc:2454] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:12.065794 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 0ae30595912943aaa58f1ebe9dc965e6 (DEFAULT_TABLE table=default.Table_ea693bd966dc4d3282a842b4b41fffe7 [id=47c971f9181046cd9c8609de8df3ef30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.065907 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e672c109e144b09193f916f8c5d516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.066047 1128 tablet_service.cc:1467] Processing CreateTablet for tablet cf0cc2ae2792420a91f2c42edcf47fd7 (DEFAULT_TABLE table=default.Table_d6c9d61c79934636a425c02a9d7ba5ba [id=6e8d8381134b494f8e1824f086063971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.066237 1145 tablet_service.cc:1467] Processing CreateTablet for tablet b5ee2d7382d647cba4f3d55098e437c7 (DEFAULT_TABLE table=default.Table_3028fb3d99c84685ad117fb942f070a9 [id=ef677f118c584abe98964c4402734808]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.066604 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 99e672c109e144b09193f916f8c5d516 (DEFAULT_TABLE table=default.Table_0076a3b473134965a5d828a3acf95007 [id=1fc1365d7e0f4733bf58e157df99091a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.066605 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 771ce4b9675742bc88306e4d099cbb82 (DEFAULT_TABLE table=default.Table_15a9a14d40bf4481a5b9de28d05f1833 [id=76d05bc65fa74e7397604e5d63dfcf20]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:12.066757 1239 leader_election.cc:341] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: a46e15ea145b4eae8f94b664067b4f92
I20260927 15:06:12.067091 2429 raft_consensus.cc:482] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.067135 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 9049d003d787403f80aa0c08872dd3b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.067216 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 7afe7ec3929649a8b647eca15e3b7514 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.067277 2429 raft_consensus.cc:504] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.067569 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b4beb4112734b9c91e32b300fd266d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.068318 2429 leader_election.cc:288] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.068300 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd2687f65780481c86a9942960ce7be1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.068475 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 9737e70f2ddb45029c042ffbd83af157 (DEFAULT_TABLE table=default.Table_523e2ef14fe8419c80231f7d636c8d6b [id=fe1f935eec2040a38d1299ac1e0b24b4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:12.068910 1102 leader_election.cc:341] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.069092 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 9737e70f2ddb45029c042ffbd83af157 (DEFAULT_TABLE table=default.Table_523e2ef14fe8419c80231f7d636c8d6b [id=fe1f935eec2040a38d1299ac1e0b24b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.069625 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd2687f65780481c86a9942960ce7be1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.069854 1433 raft_consensus.cc:2454] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:12.070247 1099 leader_election.cc:341] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 0aec677006ab4407bd7ae4c0078d6b7f
I20260927 15:06:12.070384 1133 tablet_service.cc:1467] Processing CreateTablet for tablet f92b4b2291fb474093d3fbc942c5d049 (DEFAULT_TABLE table=default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.070504 1561 consensus_queue.cc:260] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.071106 1561 ts_tablet_manager.cc:1428] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 15:06:12.071138 2414 tablet.cc:1722] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:12.071374 1561 tablet_bootstrap.cc:492] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.073184 1561 tablet_bootstrap.cc:654] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.079035 1099 leader_election.cc:302] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:12.079545 1099 leader_election.cc:341] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9cb0ab983a444d26b903a0cec64f15f0
I20260927 15:06:12.079679 1099 leader_election.cc:302] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.080005 1099 leader_election.cc:302] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.080231 2423 raft_consensus.cc:2726] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.080389 2423 raft_consensus.cc:2726] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:12.080822 1099 leader_election.cc:341] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 48e7eac8753f425d90302360d228ee54
I20260927 15:06:12.080919 1099 leader_election.cc:302] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.081102 2365 raft_consensus.cc:2726] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.081365 1099 leader_election.cc:302] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.081583 2365 raft_consensus.cc:2781] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.081648 2365 raft_consensus.cc:482] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.081736 2365 raft_consensus.cc:3037] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.082121 1099 leader_election.cc:302] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.082329 2430 raft_consensus.cc:2781] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.082398 2430 raft_consensus.cc:482] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.082501 2430 raft_consensus.cc:3037] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.086302 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 9737e70f2ddb45029c042ffbd83af157 (DEFAULT_TABLE table=default.Table_523e2ef14fe8419c80231f7d636c8d6b [id=fe1f935eec2040a38d1299ac1e0b24b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.086385 1269 tablet_service.cc:1467] Processing CreateTablet for tablet f92b4b2291fb474093d3fbc942c5d049 (DEFAULT_TABLE table=default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.089437 2381 leader_election.cc:288] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:12.092324 1238 leader_election.cc:341] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: a46e15ea145b4eae8f94b664067b4f92
I20260927 15:06:12.092533 1238 leader_election.cc:302] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.092816 2381 raft_consensus.cc:2726] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.093062 1409 tablet_service.cc:1467] Processing CreateTablet for tablet f92b4b2291fb474093d3fbc942c5d049 (DEFAULT_TABLE table=default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.097589 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e83eab00b2e44e7f8307f5bde03f48a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.098201 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e83eab00b2e44e7f8307f5bde03f48a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.099829 1556 tablet_bootstrap.cc:492] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:12.100874 1556 ts_tablet_manager.cc:1397] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260927 15:06:12.101136 2323 raft_consensus.cc:482] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.101306 2323 raft_consensus.cc:504] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.102049 1556 raft_consensus.cc:348] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.102350 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd55e22d8254ea8b1dab989517148ca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.102496 1556 raft_consensus.cc:374] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.102648 1556 raft_consensus.cc:729] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
W20260927 15:06:12.102986 1376 leader_election.cc:341] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.103087 1556 consensus_queue.cc:260] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.103771 1556 ts_tablet_manager.cc:1428] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 15:06:12.104081 1556 tablet_bootstrap.cc:492] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:12.103993 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd55e22d8254ea8b1dab989517148ca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:12.104202 1162 raft_consensus.cc:2454] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:12.105860 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_303a13aa2672477ebf8bf526bc854047" } new_table_name: "default.Table_2a22022572e44dea85461bc93ef993cd" modify_external_catalogs: true
I20260927 15:06:12.105950 2444 tablet.cc:1722] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:12.108752 914 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 373b6e6c03614b78a8343c84095bd347 (table default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63]). Expected version 1 got 0
I20260927 15:06:12.111194 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 0aec677006ab4407bd7ae4c0078d6b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 66b54ee47e424aacb7f53fd95b0ce889) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.111555 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cd55e22d8254ea8b1dab989517148ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.114866 2445 tablet.cc:1722] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:12.117197 905 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 988ae3a67a4b436583cb475fbcf07b8f (table default.Table_fc15353bc7ae407b85aece886ce4db99 [id=19258732f721448fadcdb38690160dd4]). Expected version 2 got 0
I20260927 15:06:12.117558 905 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet a260c9d3b8fb4316864e6f986559bef1 (table default.Table_06ad2a9aa89e435eac768eca2abd7bf7 [id=61c39607ad5b482c80883c0e60f0da9c]). Expected version 2 got 1
I20260927 15:06:12.118440 914 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
I20260927 15:06:12.120857 1163 raft_consensus.cc:2454] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:12.125496 1562 ts_tablet_manager.cc:1918] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:12.125638 1562 log.cc:1196] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/2afab8bf87bc45c899bcd5dfdad48d26
I20260927 15:06:12.125911 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 89783d26db9e49f0ae5171f929fcf1df
I20260927 15:06:12.125963 1562 ts_tablet_manager.cc:1939] T 2afab8bf87bc45c899bcd5dfdad48d26 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:12.126384 907 catalog_manager.cc:6565] ReplaceTablet: tablet 89783d26db9e49f0ae5171f929fcf1df deleted and replaced by tablet 14da025fd0504148961e50d0b572a3ab
I20260927 15:06:12.126637 907 master_service.cc:946] ReplaceTablet: received request to replace tablet a8de6246f7904f6c80df624f3631db17 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:12.127059 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 63fbd388210d4a1aabfcf27c7533efbf
I20260927 15:06:12.129343 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 89783d26db9e49f0ae5171f929fcf1df with delete_type TABLET_DATA_DELETED (replaced by tablet 14da025fd0504148961e50d0b572a3ab) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.129504 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9737e70f2ddb45029c042ffbd83af157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.129619 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_44d528788dc8496cb0a8b81b85716953"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:12.129796 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 63fbd388210d4a1aabfcf27c7533efbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.130080 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92b4b2291fb474093d3fbc942c5d049. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:12.130189 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44d528788dc8496cb0a8b81b85716953 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.131544 2423 raft_consensus.cc:2726] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.131886 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b02433e9b8104b55a95ec09c1725dc4a" } new_table_name: "default.Table_9d78b6648ac548e586c621d86d1938ba" modify_external_catalogs: true
I20260927 15:06:12.133774 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_69940ca5fe094d06b021595f6aedef6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:12.136610 1561 tablet_bootstrap.cc:492] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.135497 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_957e53d26f194ff3aae5a94f8ef7558e" } new_table_name: "default.Table_4a26566124884746903b9a1f03b3cf6c" modify_external_catalogs: true
I20260927 15:06:12.138273 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 63fbd388210d4a1aabfcf27c7533efbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:12.138615 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69940ca5fe094d06b021595f6aedef6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.141145 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 89783d26db9e49f0ae5171f929fcf1df with delete_type TABLET_DATA_DELETED (replaced by tablet 14da025fd0504148961e50d0b572a3ab) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.142899 1561 ts_tablet_manager.cc:1397] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.000s
I20260927 15:06:12.143153 2429 raft_consensus.cc:482] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.143929 2429 raft_consensus.cc:504] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.144991 1552 tablet_bootstrap.cc:492] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.145197 2429 leader_election.cc:288] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.145252 1552 ts_tablet_manager.cc:1397] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.129s user 0.000s sys 0.006s
I20260927 15:06:12.145866 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "373b6e6c03614b78a8343c84095bd347" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.146320 1552 raft_consensus.cc:348] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:12.146539 1102 leader_election.cc:341] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.146620 1552 raft_consensus.cc:374] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.146683 1552 raft_consensus.cc:729] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.147893 1561 raft_consensus.cc:348] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.149645 1374 leader_election.cc:302] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.154577 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9737e70f2ddb45029c042ffbd83af157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.154928 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92b4b2291fb474093d3fbc942c5d049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.155936 2323 leader_election.cc:288] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.156502 1552 consensus_queue.cc:260] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.157531 1552 ts_tablet_manager.cc:1428] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260927 15:06:12.159659 1552 tablet_bootstrap.cc:492] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.164090 1561 raft_consensus.cc:374] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.164521 1561 raft_consensus.cc:729] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.165040 1561 consensus_queue.cc:260] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.168618 1552 tablet_bootstrap.cc:654] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.172719 1561 ts_tablet_manager.cc:1428] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260927 15:06:12.173537 1561 tablet_bootstrap.cc:492] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.176010 1561 tablet_bootstrap.cc:654] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.180697 2438 raft_consensus.cc:482] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.180917 2438 raft_consensus.cc:504] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.181780 2438 leader_election.cc:288] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.181978 2438 raft_consensus.cc:2781] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.182092 2438 raft_consensus.cc:482] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.182190 2438 raft_consensus.cc:3037] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.190511 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c6de440f06ab4616970f89ee3b92b90a" } new_table_name: "default.Table_efdaebdde10c4bc0b43c9b76f254c556" modify_external_catalogs: true
I20260927 15:06:12.190737 1556 tablet_bootstrap.cc:654] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.194564 1552 tablet_bootstrap.cc:492] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.194713 1552 ts_tablet_manager.cc:1397] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.002s
I20260927 15:06:12.194679 910 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_06ad2a9aa89e435eac768eca2abd7bf7 [id=61c39607ad5b482c80883c0e60f0da9c] alter complete (version 2)
I20260927 15:06:12.196128 1552 raft_consensus.cc:348] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.196538 1552 raft_consensus.cc:374] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.196606 1552 raft_consensus.cc:729] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.196828 1552 consensus_queue.cc:260] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.197167 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 10b19de22dd74d74bdf619c75fc17762 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:12.197324 1556 tablet_bootstrap.cc:492] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:12.197453 1556 ts_tablet_manager.cc:1397] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.093s user 0.004s sys 0.000s
I20260927 15:06:12.197500 1552 ts_tablet_manager.cc:1428] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260927 15:06:12.197603 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c74dfa20ed9a4eb197a846b62d859146 consensus state has no leader
I20260927 15:06:12.197988 1552 tablet_bootstrap.cc:492] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.198058 1556 raft_consensus.cc:348] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.198239 1556 raft_consensus.cc:374] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.198280 1556 raft_consensus.cc:729] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.181674 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fc1fc04814147d8843aa734fd1794da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.192306 2429 raft_consensus.cc:482] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.201073 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e9d03457dac43038b4e6fb120ff572c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.201053 2429 raft_consensus.cc:504] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.202293 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70cc2e16bd6c40bf99ed4436f17d7096" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.203094 1102 leader_election.cc:341] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.203784 2429 leader_election.cc:288] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.204559 2429 raft_consensus.cc:482] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.204797 2429 raft_consensus.cc:504] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.205920 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42baac8b7d47433e826eb3bc1980acaa" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.206193 1303 raft_consensus.cc:2454] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:12.206630 1102 leader_election.cc:302] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:12.206993 2423 raft_consensus.cc:2781] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.207082 2423 raft_consensus.cc:482] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.207157 2423 raft_consensus.cc:3037] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.209057 1552 tablet_bootstrap.cc:654] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.214124 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70cc2e16bd6c40bf99ed4436f17d7096" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.214360 1437 raft_consensus.cc:2454] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:12.214548 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "373b6e6c03614b78a8343c84095bd347" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.214751 1436 raft_consensus.cc:2454] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:12.215118 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2f802c3bc340435a81cd94fdb4133818"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:12.215585 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ea693bd966dc4d3282a842b4b41fffe7" } modify_external_catalogs: true
W20260927 15:06:12.215833 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f802c3bc340435a81cd94fdb4133818 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.215773 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ea693bd966dc4d3282a842b4b41fffe7" } modify_external_catalogs: true
W20260927 15:06:12.216347 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 111544us
I20260927 15:06:12.217114 1374 leader_election.cc:302] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.217432 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4bd8182c9d48c7b6e6175ab98d405a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:12.217706 2322 raft_consensus.cc:482] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.217882 2322 raft_consensus.cc:504] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.218530 2322 leader_election.cc:288] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.219133 2322 raft_consensus.cc:2781] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:12.219297 2322 raft_consensus.cc:686] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:12.219399 2429 leader_election.cc:288] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.219522 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 42baac8b7d47433e826eb3bc1980acaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.219573 2322 consensus_queue.cc:237] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.219790 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet e066308fcdfc49ed926cd81963c5f1a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.221210 2365 raft_consensus.cc:504] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.221801 2365 leader_election.cc:288] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.222252 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7afe7ec3929649a8b647eca15e3b7514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.222481 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92b4b2291fb474093d3fbc942c5d049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.222867 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0cc2ae2792420a91f2c42edcf47fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.223269 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e672c109e144b09193f916f8c5d516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.223640 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9737e70f2ddb45029c042ffbd83af157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.225103 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ae30595912943aaa58f1ebe9dc965e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.225476 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 771ce4b9675742bc88306e4d099cbb82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.226378 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8341b16295ad4e1891741ae8dd63bf3a" } new_table_name: "default.Table_a07263485f554aceb3f5fd8f1ef8d033" modify_external_catalogs: true
I20260927 15:06:12.228026 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_279324b06b2d4afda29910c9ca82eba0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.228565 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_279324b06b2d4afda29910c9ca82eba0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.229206 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5ee2d7382d647cba4f3d55098e437c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.230141 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 89783d26db9e49f0ae5171f929fcf1df with delete_type TABLET_DATA_DELETED (replaced by tablet 14da025fd0504148961e50d0b572a3ab) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.230350 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet c90e5c66d8564f68b401b3e4280499a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.230371 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 63fbd388210d4a1aabfcf27c7533efbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.230726 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cc8bd2079f84da39e13113e6699bf5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.230798 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f4bd8182c9d48c7b6e6175ab98d405a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.231096 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 8790d59beb804acb8e4353f862d7f6f8 with delete_type TABLET_DATA_DELETED (replaced by tablet fd5f2ab9677c4598b0b8d9a93a6a23c7) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:12.231705 1374 leader_election.cc:341] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.232007 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424b66c69254487f932894516d570204" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:12.232141 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet c5cd55de34d249bc8d3adcf4690f0414 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.232429 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet ce566cc49cfe4483b942d2eaa8269acc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.235054 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c65bc09865bc4a0283eaa4af9f860bdd" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:12.235231 1436 raft_consensus.cc:3037] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.235934 1099 leader_election.cc:302] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.236145 2429 raft_consensus.cc:2781] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.236202 2429 raft_consensus.cc:482] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.236251 2429 raft_consensus.cc:3037] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.236629 1099 leader_election.cc:302] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.236850 2431 raft_consensus.cc:2781] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.236919 2431 raft_consensus.cc:482] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.236989 2431 raft_consensus.cc:3037] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:12.237033 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 128531us
I20260927 15:06:12.237833 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 558) took 4929 ms. Trace:
I20260927 15:06:12.244098 1562 rpcz_store.cc:276] 0927 15:06:07.308837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.308892 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:11.966743 (+4657851us) ts_tablet_manager.cc:1145] Deleting tablet 2afab8bf87bc45c899bcd5dfdad48d26
0927 15:06:11.966761 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.025903 (+ 59142us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.125380 (+ 99477us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.237801 (+112421us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4657578}
I20260927 15:06:12.244474 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424b66c69254487f932894516d570204" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.244558 1374 leader_election.cc:341] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.244647 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 2afab8bf87bc45c899bcd5dfdad48d26 (table default.Table_a04a6074db084291834a75d52898cf4b [id=15103ee5ddc04d809af8930de02a7d24]) successfully deleted
W20260927 15:06:12.245945 1376 leader_election.cc:341] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.246007 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 559) took 4936 ms. Trace:
I20260927 15:06:12.246063 1376 leader_election.cc:302] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.246106 1562 rpcz_store.cc:276] 0927 15:06:07.309417 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.309479 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:12.245864 (+4936385us) ts_tablet_manager.cc:1145] Deleting tablet 90619b7804324c9589b53342e2f6d0e8
0927 15:06:12.245879 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.245987 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4936116}
I20260927 15:06:12.246238 1556 consensus_queue.cc:260] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:12.246595 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 90619b7804324c9589b53342e2f6d0e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90619b7804324c9589b53342e2f6d0e8 already in progress: creating tablet
I20260927 15:06:12.246721 2323 raft_consensus.cc:2726] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.246873 1556 ts_tablet_manager.cc:1428] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20260927 15:06:12.247176 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 560) took 4937 ms. Trace:
I20260927 15:06:12.247265 1562 rpcz_store.cc:276] 0927 15:06:07.310140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.310188 (+ 48us) service_pool.cc:227] Handling call
0927 15:06:12.246921 (+4936733us) ts_tablet_manager.cc:1145] Deleting tablet af25950fd08043f18a6eaaf46ded4378
0927 15:06:12.246933 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.247157 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4936500}
I20260927 15:06:12.248107 1562 tablet_replica.cc:330] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:12.248418 1562 raft_consensus.cc:2229] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:12.248588 1562 raft_consensus.cc:2258] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.249099 1562 ts_tablet_manager.cc:1905] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:12.249629 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4bd8182c9d48c7b6e6175ab98d405a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.249429 907 catalog_manager.cc:5495] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } }
W20260927 15:06:12.250928 1099 leader_election.cc:341] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 42baac8b7d47433e826eb3bc1980acaa
I20260927 15:06:12.251189 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c65bc09865bc4a0283eaa4af9f860bdd" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:12.252029 1376 leader_election.cc:341] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.252147 1376 leader_election.cc:302] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:12.252174 1102 leader_election.cc:341] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.252657 2322 raft_consensus.cc:2726] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.255313 1556 tablet_bootstrap.cc:492] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:12.257295 2438 raft_consensus.cc:504] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.257929 2438 leader_election.cc:288] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.259063 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd55e22d8254ea8b1dab989517148ca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:12.259590 1376 leader_election.cc:341] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.260203 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd55e22d8254ea8b1dab989517148ca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:12.260421 1164 raft_consensus.cc:3037] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.261760 2233 ts_tablet_manager.cc:1918] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:12.261881 2233 log.cc:1196] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/8fc1fc04814147d8843aa734fd1794da
I20260927 15:06:12.262229 2233 ts_tablet_manager.cc:1939] T 8fc1fc04814147d8843aa734fd1794da P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:12.261862 1556 tablet_bootstrap.cc:654] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:12.268329 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet adf68ba5020446bf8b522ac6db0e21e7 consensus state has no leader
W20260927 15:06:12.268854 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4fc6b5ac75b2436a96fd5fb00d575a99 consensus state has no leader
I20260927 15:06:12.278730 1561 tablet_bootstrap.cc:492] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.279098 1561 ts_tablet_manager.cc:1397] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.004s
I20260927 15:06:12.279985 1561 raft_consensus.cc:348] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.280313 1561 raft_consensus.cc:374] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.280413 1561 raft_consensus.cc:729] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.280685 1561 consensus_queue.cc:260] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.281533 1561 ts_tablet_manager.cc:1428] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:12.282925 1561 tablet_bootstrap.cc:492] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.284775 1561 tablet_bootstrap.cc:654] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.285576 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_60ea7e4921ff40728d6a8b84c9b494c8" } modify_external_catalogs: true
I20260927 15:06:12.285802 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_60ea7e4921ff40728d6a8b84c9b494c8" } modify_external_catalogs: true
W20260927 15:06:12.286466 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aa192d5cbece4127ace65e564bb1a12a consensus state has no leader
I20260927 15:06:12.286854 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_108c4b5538b94b6fad6c4f46eb9a2b1b" } modify_external_catalogs: true
I20260927 15:06:12.287053 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_108c4b5538b94b6fad6c4f46eb9a2b1b" } modify_external_catalogs: true
I20260927 15:06:12.287760 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_809751f8c81a413590d182426a142d1d" } modify_external_catalogs: true
I20260927 15:06:12.287945 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_809751f8c81a413590d182426a142d1d" } modify_external_catalogs: true
I20260927 15:06:12.288323 907 master_service.cc:946] ReplaceTablet: received request to replace tablet 514ce66d5afd46a7b9cc460776973b06 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:12.292084 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1770acc612f4924ba62ee20767a31c1 consensus state has no leader
I20260927 15:06:12.293192 1561 tablet_bootstrap.cc:492] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.293399 1561 ts_tablet_manager.cc:1397] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
I20260927 15:06:12.294346 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c4a123886a847d08b2a94ff5e4e01ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.294235 1561 raft_consensus.cc:348] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.294811 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 610ff6563dc64e73b2b4d7c268468b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.295042 1561 raft_consensus.cc:374] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.295166 1561 raft_consensus.cc:729] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.295459 1561 consensus_queue.cc:260] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.297004 1561 ts_tablet_manager.cc:1428] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:12.297737 1552 tablet_bootstrap.cc:492] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.298753 1561 tablet_bootstrap.cc:492] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.299853 1552 ts_tablet_manager.cc:1397] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.102s user 0.004s sys 0.000s
I20260927 15:06:12.300796 1561 tablet_bootstrap.cc:654] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.301753 1552 raft_consensus.cc:348] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.302766 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d4ca19b492c4df1b31c78f1629c50b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.303014 1552 raft_consensus.cc:374] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.303131 1552 raft_consensus.cc:729] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.303220 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b9e88c3679d412cac7603f200cf899b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.303743 1552 consensus_queue.cc:260] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.304723 1552 ts_tablet_manager.cc:1428] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 15:06:12.305440 1552 tablet_bootstrap.cc:492] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.307552 1552 tablet_bootstrap.cc:654] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.308195 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_70d070cb409140bb950af1749ccc32dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.308849 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70d070cb409140bb950af1749ccc32dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.311951 2438 raft_consensus.cc:482] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.312119 2438 raft_consensus.cc:504] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.312798 2438 leader_election.cc:288] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.313006 1552 tablet_bootstrap.cc:492] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.313110 905 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:12.313542 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80a8563c77484a1ebbbe7dab9a652aeb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:12.314227 1374 leader_election.cc:341] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.313725 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80a8563c77484a1ebbbe7dab9a652aeb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.315001 1552 ts_tablet_manager.cc:1397] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
W20260927 15:06:12.315263 1376 leader_election.cc:341] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.315459 1376 leader_election.cc:302] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.315899 2438 raft_consensus.cc:2726] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.317704 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cff6f4158c88488a9a5ab6a6b59d6711"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.318428 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cff6f4158c88488a9a5ab6a6b59d6711 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.318719 912 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:12.319618 2430 raft_consensus.cc:504] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.320297 2430 leader_election.cc:288] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.321190 1436 raft_consensus.cc:2454] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:12.326382 1099 leader_election.cc:302] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.326936 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd2687f65780481c86a9942960ce7be1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:12.327103 1556 tablet_bootstrap.cc:492] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
W20260927 15:06:12.327605 1102 leader_election.cc:341] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.328604 908 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 14da025fd0504148961e50d0b572a3ab
I20260927 15:06:12.330243 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 732) took 1087 ms. Trace:
I20260927 15:06:12.330343 2233 rpcz_store.cc:276] 0927 15:06:11.242953 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.243961 (+ 1008us) service_pool.cc:227] Handling call
0927 15:06:12.022461 (+778500us) ts_tablet_manager.cc:1145] Deleting tablet 8fc1fc04814147d8843aa734fd1794da
0927 15:06:12.022472 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.120848 (+ 98376us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.261632 (+140784us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.330220 (+ 68588us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":778322}
I20260927 15:06:12.330706 2233 tablet_replica.cc:330] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:12.330911 2233 raft_consensus.cc:2229] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:12.331055 2233 raft_consensus.cc:2258] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.331547 2233 ts_tablet_manager.cc:1905] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:12.333717 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 8fc1fc04814147d8843aa734fd1794da (table default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]) successfully deleted
I20260927 15:06:12.339533 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e0c366d7511445d89c469f2181adb227" } modify_external_catalogs: true
I20260927 15:06:12.339735 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e0c366d7511445d89c469f2181adb227" } modify_external_catalogs: true
I20260927 15:06:12.341946 1552 raft_consensus.cc:348] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.343386 1561 tablet_bootstrap.cc:492] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.343600 1561 ts_tablet_manager.cc:1397] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.003s
I20260927 15:06:12.344353 1561 raft_consensus.cc:348] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.344666 1561 raft_consensus.cc:374] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.344759 1561 raft_consensus.cc:729] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.345193 1561 consensus_queue.cc:260] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.345518 1163 raft_consensus.cc:1261] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Refusing update from remote peer fabb59e74b7d48fa9be047d7f4c4cc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:06:12.345590 2365 raft_consensus.cc:2781] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:12.345701 2365 raft_consensus.cc:686] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
W20260927 15:06:12.345983 1376 consensus_peers.cc:487] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:12.345955 2365 consensus_queue.cc:237] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.346149 2322 consensus_queue.cc:1035] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:12.347396 1561 ts_tablet_manager.cc:1428] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260927 15:06:12.347769 1561 tablet_bootstrap.cc:492] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.348575 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0a7583c562174755b4b1e3a2a442c007"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.349303 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a7583c562174755b4b1e3a2a442c007 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.349661 1561 tablet_bootstrap.cc:654] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.351801 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd2687f65780481c86a9942960ce7be1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:12.352020 1436 raft_consensus.cc:3037] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.352128 1552 raft_consensus.cc:374] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.352239 1552 raft_consensus.cc:729] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.352543 1552 consensus_queue.cc:260] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.353109 1552 ts_tablet_manager.cc:1428] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.038s user 0.000s sys 0.001s
I20260927 15:06:12.353412 1552 tablet_bootstrap.cc:492] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:12.358611 1099 consensus_peers.cc:487] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27c3283a40f14eb4868767799cfdf7bd. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:12.361567 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 45b610025b1a4b68bdc34f870654f9d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 96ac92258c6044a891b3325b7aaf3b8f) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.364835 1556 ts_tablet_manager.cc:1397] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.110s user 0.003s sys 0.000s
I20260927 15:06:12.365762 1556 raft_consensus.cc:348] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.366937 1556 raft_consensus.cc:374] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.367164 1556 raft_consensus.cc:729] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.367594 1556 consensus_queue.cc:260] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.369151 1556 ts_tablet_manager.cc:1428] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:12.369493 1556 tablet_bootstrap.cc:492] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:12.369827 2430 raft_consensus.cc:482] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.369951 2430 raft_consensus.cc:504] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.370555 2430 leader_election.cc:288] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.371266 1556 tablet_bootstrap.cc:654] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.371340 1552 tablet_bootstrap.cc:654] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.372432 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c264c532db8249e5abe1dbef8ee8ffa0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.372447 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c264c532db8249e5abe1dbef8ee8ffa0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.372681 1437 raft_consensus.cc:2454] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:12.373963 1102 leader_election.cc:341] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.375239 1561 tablet_bootstrap.cc:492] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.375425 1561 ts_tablet_manager.cc:1397] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.001s
I20260927 15:06:12.376163 1561 raft_consensus.cc:348] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.376430 1561 raft_consensus.cc:374] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.376523 1561 raft_consensus.cc:729] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.376929 1561 consensus_queue.cc:260] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.377168 1099 leader_election.cc:302] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.377779 1561 ts_tablet_manager.cc:1428] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:12.378057 1561 tablet_bootstrap.cc:492] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.378196 2414 tablet.cc:1722] T aa192d5cbece4127ace65e564bb1a12a P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:12.378690 2289 raft_consensus.cc:2781] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.378775 2289 raft_consensus.cc:482] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.378860 2289 raft_consensus.cc:3037] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.379026 2430 raft_consensus.cc:482] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.379153 2430 raft_consensus.cc:504] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.379498 1561 tablet_bootstrap.cc:654] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.379772 2430 leader_election.cc:288] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.380473 2445 tablet.cc:1722] T aa192d5cbece4127ace65e564bb1a12a P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:12.381129 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fc1fc04814147d8843aa734fd1794da" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.381928 1102 leader_election.cc:341] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.383764 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_07d1ad2a734f423d95208c9ec22f2d24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.384495 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07d1ad2a734f423d95208c9ec22f2d24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.385233 2446 raft_consensus.cc:482] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.385380 2446 raft_consensus.cc:504] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.385982 2446 leader_election.cc:288] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.386360 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5cd55de34d249bc8d3adcf4690f0414" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.386978 1376 leader_election.cc:341] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.387530 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5cd55de34d249bc8d3adcf4690f0414" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:12.388088 1374 leader_election.cc:341] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.388199 1374 leader_election.cc:302] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.388525 2446 raft_consensus.cc:2726] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:12.397533 1099 leader_election.cc:341] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 8fc1fc04814147d8843aa734fd1794da
I20260927 15:06:12.397691 1099 leader_election.cc:302] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.398635 2430 raft_consensus.cc:2726] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.400722 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3ead517549924f16a90ea7b24b577ad0" } new_table_name: "default.Table_5ee809c4799544ffa55ff157b8e9bd43" modify_external_catalogs: true
I20260927 15:06:12.402974 1561 tablet_bootstrap.cc:492] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.403141 1561 ts_tablet_manager.cc:1397] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.000s
I20260927 15:06:12.403946 1561 raft_consensus.cc:348] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.404151 1561 raft_consensus.cc:374] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.404203 1561 raft_consensus.cc:729] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.404407 1561 consensus_queue.cc:260] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.406244 1561 ts_tablet_manager.cc:1428] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:12.406890 1561 tablet_bootstrap.cc:492] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.408993 1561 tablet_bootstrap.cc:654] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.417634 2119 ts_tablet_manager.cc:1918] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:12.417783 2119 log.cc:1196] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/ba14b7531bb647248572be10d2b43cf2
I20260927 15:06:12.418098 2119 ts_tablet_manager.cc:1939] T ba14b7531bb647248572be10d2b43cf2 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:12.421383 2423 raft_consensus.cc:504] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.422259 2423 leader_election.cc:288] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.424067 1436 raft_consensus.cc:2454] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:12.425724 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ffcab397f6434a8ea2ed691bffdbc238"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.426326 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffcab397f6434a8ea2ed691bffdbc238 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.426756 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 667) took 1659 ms. Trace:
I20260927 15:06:12.426877 2119 rpcz_store.cc:276] 0927 15:06:10.767253 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.767843 (+ 590us) service_pool.cc:227] Handling call
0927 15:06:12.051466 (+1283623us) ts_tablet_manager.cc:1145] Deleting tablet ba14b7531bb647248572be10d2b43cf2
0927 15:06:12.051478 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.223070 (+171592us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.417504 (+194434us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.426723 (+ 9219us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1283417}
I20260927 15:06:12.427237 2119 tablet_replica.cc:330] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:12.427415 2119 raft_consensus.cc:2229] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:12.427508 912 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc] alter complete (version 2)
I20260927 15:06:12.427559 2119 raft_consensus.cc:2258] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.428090 2119 ts_tablet_manager.cc:1905] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:12.428188 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42baac8b7d47433e826eb3bc1980acaa" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:12.428375 1298 raft_consensus.cc:3037] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.431229 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet ba14b7531bb647248572be10d2b43cf2 (table default.Table_bc0cef144e2c48f6883df97308937a76 [id=43c20c5b532545b5b66ad52dc5af5fc2]) successfully deleted
I20260927 15:06:12.432475 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_62afe99bf9fe40a2bce5968ced72f01d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:12.432655 1556 tablet_bootstrap.cc:492] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:12.432793 1556 ts_tablet_manager.cc:1397] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.000s
W20260927 15:06:12.433084 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62afe99bf9fe40a2bce5968ced72f01d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.433532 1556 raft_consensus.cc:348] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.433759 1556 raft_consensus.cc:374] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.433813 1556 raft_consensus.cc:729] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.434005 1556 consensus_queue.cc:260] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.434514 1556 ts_tablet_manager.cc:1428] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:12.436398 2233 ts_tablet_manager.cc:1918] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:12.436530 2233 log.cc:1196] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/c65bc09865bc4a0283eaa4af9f860bdd
I20260927 15:06:12.436807 2233 ts_tablet_manager.cc:1939] T c65bc09865bc4a0283eaa4af9f860bdd P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:12.436800 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e812145e2650451b9edebd5769f7ff17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.437441 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e812145e2650451b9edebd5769f7ff17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.438889 2446 raft_consensus.cc:482] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.439018 2446 raft_consensus.cc:504] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.439721 2446 leader_election.cc:288] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.440390 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610ff6563dc64e73b2b4d7c268468b21" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:12.441023 1374 leader_election.cc:341] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.441695 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610ff6563dc64e73b2b4d7c268468b21" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.447485 1376 leader_election.cc:341] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.447625 1376 leader_election.cc:302] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.449041 2446 raft_consensus.cc:2726] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.450297 1556 tablet_bootstrap.cc:492] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:12.451800 1556 tablet_bootstrap.cc:654] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.453055 1099 leader_election.cc:302] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:12.453502 1099 leader_election.cc:341] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 42baac8b7d47433e826eb3bc1980acaa
I20260927 15:06:12.453689 2423 raft_consensus.cc:482] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.453794 2423 raft_consensus.cc:504] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.454373 2423 leader_election.cc:288] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.454507 2423 raft_consensus.cc:2781] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:12.454612 2423 raft_consensus.cc:686] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:12.455564 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b7e017ead242849585679873a69b43" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.456363 1102 leader_election.cc:341] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.456635 2423 consensus_queue.cc:237] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.459786 1552 tablet_bootstrap.cc:492] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.459933 1552 ts_tablet_manager.cc:1397] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.107s user 0.004s sys 0.008s
I20260927 15:06:12.460681 1552 raft_consensus.cc:348] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.460894 1552 raft_consensus.cc:374] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.460948 1552 raft_consensus.cc:729] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.461165 1552 consensus_queue.cc:260] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.461752 1552 ts_tablet_manager.cc:1428] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260927 15:06:12.461884 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 237b6fd8d0ce4576ae84a1fb51dc500d consensus state has no leader
I20260927 15:06:12.462041 1552 tablet_bootstrap.cc:492] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.464859 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda (DEFAULT_TABLE table=default.Table_124db11735d04945ad242967db096475 [id=d2669a56705f43a5933893aa4f7fbd6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.467751 1303 raft_consensus.cc:3037] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.473346 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet aa192d5cbece4127ace65e564bb1a12a (table default.Table_efdaebdde10c4bc0b43c9b76f254c556 [id=f96697b67a7f4eb9b111b258c5fc514a]). Expected version 1 got 0
I20260927 15:06:12.474711 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 29c5d4cfb0d84d30896c0c7913c4d82b (DEFAULT_TABLE table=default.Table_f42add5ed0a44c3ab8cd106ab1c21187 [id=6830da2de6724a4a97408545f22941e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.475139 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 29c5d4cfb0d84d30896c0c7913c4d82b (DEFAULT_TABLE table=default.Table_f42add5ed0a44c3ab8cd106ab1c21187 [id=6830da2de6724a4a97408545f22941e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.475335 1281 tablet_service.cc:1467] Processing CreateTablet for tablet afbfe01feee7463e8c5b795f9fda70cd (DEFAULT_TABLE table=default.Table_da9153d15e4a41a1811d6887fc2a7bd5 [id=777a5110035746269357d9b7c1a758d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.475713 1137 tablet_service.cc:1467] Processing CreateTablet for tablet afbfe01feee7463e8c5b795f9fda70cd (DEFAULT_TABLE table=default.Table_da9153d15e4a41a1811d6887fc2a7bd5 [id=777a5110035746269357d9b7c1a758d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.475975 1410 tablet_service.cc:1467] Processing CreateTablet for tablet afbfe01feee7463e8c5b795f9fda70cd (DEFAULT_TABLE table=default.Table_da9153d15e4a41a1811d6887fc2a7bd5 [id=777a5110035746269357d9b7c1a758d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.476112 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda (DEFAULT_TABLE table=default.Table_124db11735d04945ad242967db096475 [id=d2669a56705f43a5933893aa4f7fbd6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.476191 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 29c5d4cfb0d84d30896c0c7913c4d82b (DEFAULT_TABLE table=default.Table_f42add5ed0a44c3ab8cd106ab1c21187 [id=6830da2de6724a4a97408545f22941e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.476002 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda (DEFAULT_TABLE table=default.Table_124db11735d04945ad242967db096475 [id=d2669a56705f43a5933893aa4f7fbd6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.476611 1413 tablet_service.cc:1467] Processing CreateTablet for tablet ff5f20f300324dbfae4ae771878ac61e (DEFAULT_TABLE table=default.Table_37bcd078f99f445fbc5687e1de84b2ab [id=adebec48fc42493fb5b037f5cbd6f1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.477108 1278 tablet_service.cc:1467] Processing CreateTablet for tablet ff5f20f300324dbfae4ae771878ac61e (DEFAULT_TABLE table=default.Table_37bcd078f99f445fbc5687e1de84b2ab [id=adebec48fc42493fb5b037f5cbd6f1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.477386 1135 tablet_service.cc:1467] Processing CreateTablet for tablet ff5f20f300324dbfae4ae771878ac61e (DEFAULT_TABLE table=default.Table_37bcd078f99f445fbc5687e1de84b2ab [id=adebec48fc42493fb5b037f5cbd6f1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.477548 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 476d3f3762a04acaa10f7b910984bec7 (DEFAULT_TABLE table=default.Table_81fe6e6be98b4478bc328f61651f191a [id=4c6429d7ae094d49bdfaef4d7cfd1f7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.477802 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 476d3f3762a04acaa10f7b910984bec7 (DEFAULT_TABLE table=default.Table_81fe6e6be98b4478bc328f61651f191a [id=4c6429d7ae094d49bdfaef4d7cfd1f7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.478233 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 476d3f3762a04acaa10f7b910984bec7 (DEFAULT_TABLE table=default.Table_81fe6e6be98b4478bc328f61651f191a [id=4c6429d7ae094d49bdfaef4d7cfd1f7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.479097 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 547f5f0f1d444f348cf7efbbdf95523c (DEFAULT_TABLE table=default.Table_78e7ca7ad476490d8cec4cb0b9e3767e [id=6cc24132a6a84286be0b8530c551f0e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.479313 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 547f5f0f1d444f348cf7efbbdf95523c (DEFAULT_TABLE table=default.Table_78e7ca7ad476490d8cec4cb0b9e3767e [id=6cc24132a6a84286be0b8530c551f0e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.479789 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 547f5f0f1d444f348cf7efbbdf95523c (DEFAULT_TABLE table=default.Table_78e7ca7ad476490d8cec4cb0b9e3767e [id=6cc24132a6a84286be0b8530c551f0e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.480294 1408 tablet_service.cc:1467] Processing CreateTablet for tablet f799583600634a8e8c2b4fe9d5aa1e55 (DEFAULT_TABLE table=default.Table_a4042b50ce5049eab1c96114c73daee3 [id=a0dcb125dde145918a031f7a3b6c2166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.481683 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 048a1713b6054024959a9bdc245f71a4 (DEFAULT_TABLE table=default.Table_042148816cc64c47b850ec48a69b9eb1 [id=545388369ed14c26a1d505d328fc51b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.481787 1141 tablet_service.cc:1467] Processing CreateTablet for tablet f799583600634a8e8c2b4fe9d5aa1e55 (DEFAULT_TABLE table=default.Table_a4042b50ce5049eab1c96114c73daee3 [id=a0dcb125dde145918a031f7a3b6c2166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.481895 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 048a1713b6054024959a9bdc245f71a4 (DEFAULT_TABLE table=default.Table_042148816cc64c47b850ec48a69b9eb1 [id=545388369ed14c26a1d505d328fc51b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.482071 1268 tablet_service.cc:1467] Processing CreateTablet for tablet f799583600634a8e8c2b4fe9d5aa1e55 (DEFAULT_TABLE table=default.Table_a4042b50ce5049eab1c96114c73daee3 [id=a0dcb125dde145918a031f7a3b6c2166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.482510 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 048a1713b6054024959a9bdc245f71a4 (DEFAULT_TABLE table=default.Table_042148816cc64c47b850ec48a69b9eb1 [id=545388369ed14c26a1d505d328fc51b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.484329 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 2b02006875534bdb86ffccee52bca32b (DEFAULT_TABLE table=default.Table_bed9c25eb1f14b99b1f2f4b70e466715 [id=6d67856f311c4b09906025d58b6f7b05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.485335 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 24a592ebe7db4f36bd2819f6864436ea (DEFAULT_TABLE table=default.Table_23ee3df957cd4a588ff650d85c05ab52 [id=f83c6f9980a24d428318aa083dbff05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.485553 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 2b02006875534bdb86ffccee52bca32b (DEFAULT_TABLE table=default.Table_bed9c25eb1f14b99b1f2f4b70e466715 [id=6d67856f311c4b09906025d58b6f7b05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.485790 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 3ee9b3d162764abf9d2754ba5c1382fe (DEFAULT_TABLE table=default.Table_621ab4142aac41ba946d83825752a245 [id=297f510547374ee7ac4e2d3b6df202c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.486034 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 24a592ebe7db4f36bd2819f6864436ea (DEFAULT_TABLE table=default.Table_23ee3df957cd4a588ff650d85c05ab52 [id=f83c6f9980a24d428318aa083dbff05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.486505 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 3ee9b3d162764abf9d2754ba5c1382fe (DEFAULT_TABLE table=default.Table_621ab4142aac41ba946d83825752a245 [id=297f510547374ee7ac4e2d3b6df202c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.486703 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 8819b4ac14ca42ed8d7adc31306dcc19 (DEFAULT_TABLE table=default.Table_bd0cf44aafbc44baa7c5b165e15e367b [id=4df60e6d6ebc40538c75c9b623b3e8e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.488425 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 8819b4ac14ca42ed8d7adc31306dcc19 (DEFAULT_TABLE table=default.Table_bd0cf44aafbc44baa7c5b165e15e367b [id=4df60e6d6ebc40538c75c9b623b3e8e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.488509 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 2b02006875534bdb86ffccee52bca32b (DEFAULT_TABLE table=default.Table_bed9c25eb1f14b99b1f2f4b70e466715 [id=6d67856f311c4b09906025d58b6f7b05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.488906 2446 raft_consensus.cc:482] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.489022 2446 raft_consensus.cc:504] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.489606 2446 leader_election.cc:288] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.490101 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b7e017ead242849585679873a69b43" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.490303 1437 raft_consensus.cc:2454] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:12.490697 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 24a592ebe7db4f36bd2819f6864436ea (DEFAULT_TABLE table=default.Table_23ee3df957cd4a588ff650d85c05ab52 [id=f83c6f9980a24d428318aa083dbff05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.491138 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 3ee9b3d162764abf9d2754ba5c1382fe (DEFAULT_TABLE table=default.Table_621ab4142aac41ba946d83825752a245 [id=297f510547374ee7ac4e2d3b6df202c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.497514 1556 tablet_bootstrap.cc:492] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:12.497757 1556 ts_tablet_manager.cc:1397] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.048s user 0.013s sys 0.000s
I20260927 15:06:12.497843 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce566cc49cfe4483b942d2eaa8269acc" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:12.498503 1374 leader_election.cc:341] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.498585 1556 raft_consensus.cc:348] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.498864 1556 raft_consensus.cc:374] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.498971 1556 raft_consensus.cc:729] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.499289 1556 consensus_queue.cc:260] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.499960 1556 ts_tablet_manager.cc:1428] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:12.500270 1556 tablet_bootstrap.cc:492] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:12.500228 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce566cc49cfe4483b942d2eaa8269acc" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.500947 2365 raft_consensus.cc:482] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.501112 2365 raft_consensus.cc:504] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.501380 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 8819b4ac14ca42ed8d7adc31306dcc19 (DEFAULT_TABLE table=default.Table_bd0cf44aafbc44baa7c5b165e15e367b [id=4df60e6d6ebc40538c75c9b623b3e8e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.501677 2365 leader_election.cc:288] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.502319 1556 tablet_bootstrap.cc:654] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.502460 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4658de7351e9423b83f393f7f7045eed" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.503049 1102 leader_election.cc:341] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:12.503564 1376 leader_election.cc:341] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.503714 1376 leader_election.cc:302] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.504208 2446 raft_consensus.cc:2726] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.508857 1552 tablet_bootstrap.cc:654] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.509716 1099 leader_election.cc:302] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.509969 2365 raft_consensus.cc:2781] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.510030 2365 raft_consensus.cc:482] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.510083 2365 raft_consensus.cc:3037] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.510742 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4658de7351e9423b83f393f7f7045eed" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.510991 1437 raft_consensus.cc:2454] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:12.512652 1556 tablet_bootstrap.cc:492] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:12.512848 1556 ts_tablet_manager.cc:1397] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260927 15:06:12.513717 1562 ts_tablet_manager.cc:1918] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:12.513849 1562 log.cc:1196] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/454e637ec622424e81a8770c16bbc941
I20260927 15:06:12.514142 1562 ts_tablet_manager.cc:1939] T 454e637ec622424e81a8770c16bbc941 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:12.514442 2429 raft_consensus.cc:504] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.515108 2429 leader_election.cc:288] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.516117 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c5d4cfb0d84d30896c0c7913c4d82b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.516582 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 733) took 1273 ms. Trace:
I20260927 15:06:12.516667 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff5f20f300324dbfae4ae771878ac61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.516669 2233 rpcz_store.cc:276] 0927 15:06:11.243052 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.246135 (+ 3083us) service_pool.cc:227] Handling call
0927 15:06:12.330655 (+1084520us) ts_tablet_manager.cc:1145] Deleting tablet c65bc09865bc4a0283eaa4af9f860bdd
0927 15:06:12.330667 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.418401 (+ 87734us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.436286 (+ 17885us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.516560 (+ 80274us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1084331}
I20260927 15:06:12.517066 2233 tablet_replica.cc:330] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:12.517280 2233 raft_consensus.cc:2229] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:12.517410 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048a1713b6054024959a9bdc245f71a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.517431 2233 raft_consensus.cc:2258] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.517448 1298 raft_consensus.cc:2454] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:12.517764 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f799583600634a8e8c2b4fe9d5aa1e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.517910 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet c65bc09865bc4a0283eaa4af9f860bdd (table default.Table_a6f756a6136d48a78b4fb2488323f3fd [id=ed34d1e88ae54c6086ae3a7cbfdf7861]) successfully deleted
I20260927 15:06:12.518002 2233 ts_tablet_manager.cc:1905] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:12.518093 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8819b4ac14ca42ed8d7adc31306dcc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.518381 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048a1713b6054024959a9bdc245f71a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.518563 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 476d3f3762a04acaa10f7b910984bec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.518878 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8819b4ac14ca42ed8d7adc31306dcc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.516127 2446 raft_consensus.cc:482] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.519021 2446 raft_consensus.cc:504] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.519254 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.519572 2446 leader_election.cc:288] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.519603 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 476d3f3762a04acaa10f7b910984bec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.519801 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ee9b3d162764abf9d2754ba5c1382fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.520112 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afbfe01feee7463e8c5b795f9fda70cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.520294 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f799583600634a8e8c2b4fe9d5aa1e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.520442 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff5f20f300324dbfae4ae771878ac61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.520586 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24a592ebe7db4f36bd2819f6864436ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.520880 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 547f5f0f1d444f348cf7efbbdf95523c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.521029 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b02006875534bdb86ffccee52bca32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.521175 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c5d4cfb0d84d30896c0c7913c4d82b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.521811 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0129eaa5636544e696076e439d713b1b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:12.522348 1374 leader_election.cc:341] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.523010 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.523468 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c5d4cfb0d84d30896c0c7913c4d82b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.523515 1556 raft_consensus.cc:348] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.523720 1556 raft_consensus.cc:374] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.523782 1556 raft_consensus.cc:729] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.523821 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afbfe01feee7463e8c5b795f9fda70cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.523954 1556 consensus_queue.cc:260] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.524151 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff5f20f300324dbfae4ae771878ac61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.524354 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0129eaa5636544e696076e439d713b1b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.524471 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 476d3f3762a04acaa10f7b910984bec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.524636 1556 ts_tablet_manager.cc:1428] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260927 15:06:12.524796 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 547f5f0f1d444f348cf7efbbdf95523c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.524924 1556 tablet_bootstrap.cc:492] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:12.525163 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f799583600634a8e8c2b4fe9d5aa1e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.525470 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048a1713b6054024959a9bdc245f71a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:12.525439 1376 leader_election.cc:341] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.525543 1376 leader_election.cc:302] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.525748 2446 raft_consensus.cc:2726] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.525774 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24a592ebe7db4f36bd2819f6864436ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.526196 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afbfe01feee7463e8c5b795f9fda70cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.526503 1556 tablet_bootstrap.cc:654] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.526599 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.527247 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 547f5f0f1d444f348cf7efbbdf95523c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.527658 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b02006875534bdb86ffccee52bca32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.528077 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24a592ebe7db4f36bd2819f6864436ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.528491 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ee9b3d162764abf9d2754ba5c1382fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.531400 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ee9b3d162764abf9d2754ba5c1382fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.531841 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8819b4ac14ca42ed8d7adc31306dcc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.534603 1556 tablet_bootstrap.cc:492] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:12.534866 1556 ts_tablet_manager.cc:1397] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260927 15:06:12.535490 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b02006875534bdb86ffccee52bca32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.535689 1556 raft_consensus.cc:348] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.535975 1556 raft_consensus.cc:374] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.536084 1556 raft_consensus.cc:729] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.536336 1556 consensus_queue.cc:260] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.537087 1556 ts_tablet_manager.cc:1428] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:12.537422 1556 tablet_bootstrap.cc:492] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:12.538808 1556 tablet_bootstrap.cc:654] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.543046 1102 leader_election.cc:302] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.543288 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70cc2e16bd6c40bf99ed4436f17d7096" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:12.544064 2430 raft_consensus.cc:2781] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:12.544214 2430 raft_consensus.cc:686] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:12.544443 2430 consensus_queue.cc:237] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:12.546023 1102 leader_election.cc:341] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.550215 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70cc2e16bd6c40bf99ed4436f17d7096" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:12.550421 1437 raft_consensus.cc:3037] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.553320 1099 leader_election.cc:302] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.569437 2429 raft_consensus.cc:2781] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.569577 2429 raft_consensus.cc:482] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.569659 2429 raft_consensus.cc:3037] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.570923 1552 tablet_bootstrap.cc:492] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.571070 1552 ts_tablet_manager.cc:1397] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.109s user 0.002s sys 0.002s
I20260927 15:06:12.571940 1552 raft_consensus.cc:348] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.572240 1552 raft_consensus.cc:374] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.572322 1552 raft_consensus.cc:729] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.572580 1552 consensus_queue.cc:260] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.577569 2436 raft_consensus.cc:482] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.577708 2436 raft_consensus.cc:504] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.578142 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 10b19de22dd74d74bdf619c75fc17762
I20260927 15:06:12.578491 2436 leader_election.cc:288] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.578632 909 catalog_manager.cc:6565] ReplaceTablet: tablet 10b19de22dd74d74bdf619c75fc17762 deleted and replaced by tablet 0c54768b4f18467787d5e9894cb083d0
I20260927 15:06:12.579018 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 3efc44686be2407cbcdca61909301539 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:12.579798 1238 leader_election.cc:341] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 454e637ec622424e81a8770c16bbc941
I20260927 15:06:12.579756 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_37bcd078f99f445fbc5687e1de84b2ab" } new_table_name: "default.Table_1162bbf26733492099dc1bc4d2e6d62d" modify_external_catalogs: true
I20260927 15:06:12.581164 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 10b19de22dd74d74bdf619c75fc17762 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c54768b4f18467787d5e9894cb083d0) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.581552 1552 ts_tablet_manager.cc:1428] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 15:06:12.582384 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0ae30595912943aaa58f1ebe9dc965e6
I20260927 15:06:12.583207 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0dd6d9a00c7743d0954e4d8fea0f2847" } new_table_name: "default.Table_3e56420774eb4ec19f7396adcfe35b0e" modify_external_catalogs: true
I20260927 15:06:12.584944 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ae30595912943aaa58f1ebe9dc965e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.585021 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 80a8563c77484a1ebbbe7dab9a652aeb
I20260927 15:06:12.585772 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_06b5faec9f2740c98a1c07645c8c65c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:12.586483 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 80a8563c77484a1ebbbe7dab9a652aeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:12.586619 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06b5faec9f2740c98a1c07645c8c65c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.586800 1552 tablet_bootstrap.cc:492] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.588692 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6f3bdfede5744513aeadb22da73b6f8a
I20260927 15:06:12.589526 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_279324b06b2d4afda29910c9ca82eba0" } new_table_name: "default.Table_b23a43b448d3437cbd8ce7083dff3d36" modify_external_catalogs: true
I20260927 15:06:12.591626 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 95c8178680ea4b6b8794150188320ea9
I20260927 15:06:12.592568 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7c71092564ca4ec3bffb3b7d20d9623d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.593489 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c71092564ca4ec3bffb3b7d20d9623d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.595737 1552 tablet_bootstrap.cc:654] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.595925 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "454e637ec622424e81a8770c16bbc941" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:12.596894 1239 leader_election.cc:341] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: Tablet not RUNNING: STOPPED
I20260927 15:06:12.597087 1239 leader_election.cc:302] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.597431 2436 raft_consensus.cc:2726] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.599174 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c8178680ea4b6b8794150188320ea9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.599226 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 10b19de22dd74d74bdf619c75fc17762 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c54768b4f18467787d5e9894cb083d0) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.599509 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ae30595912943aaa58f1ebe9dc965e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.599772 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 80a8563c77484a1ebbbe7dab9a652aeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.599999 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3bdfede5744513aeadb22da73b6f8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.601410 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3bdfede5744513aeadb22da73b6f8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.601615 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c8178680ea4b6b8794150188320ea9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.601820 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 10b19de22dd74d74bdf619c75fc17762 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c54768b4f18467787d5e9894cb083d0) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.602073 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ae30595912943aaa58f1ebe9dc965e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.602249 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 80a8563c77484a1ebbbe7dab9a652aeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.602440 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c8178680ea4b6b8794150188320ea9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.602602 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3bdfede5744513aeadb22da73b6f8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.603021 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3cc6cd481b6a4ca798cf1c63e940902d" } new_table_name: "default.Table_2ba4140ca1f545e7b1bef9f2d2f1bc75" modify_external_catalogs: true
I20260927 15:06:12.607182 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_06b1d62a4d4b42b7891157047aafa50f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.607893 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06b1d62a4d4b42b7891157047aafa50f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.613289 2119 ts_tablet_manager.cc:1918] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:12.613463 2119 log.cc:1196] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/63289edbdd734dd5a817df42d83e422e
I20260927 15:06:12.613780 2119 ts_tablet_manager.cc:1939] T 63289edbdd734dd5a817df42d83e422e P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:12.616775 1437 raft_consensus.cc:2454] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:12.617940 1164 raft_consensus.cc:2454] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:12.620368 1374 leader_election.cc:302] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.620826 2446 raft_consensus.cc:2781] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:12.620954 2446 raft_consensus.cc:686] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:12.621204 2446 consensus_queue.cc:237] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.631224 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet f585bcdadbcc4032aa484481cdf94b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.631794 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0393b69c63dc4c42b67201f634d5c6fa" } modify_external_catalogs: true
I20260927 15:06:12.634312 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0393b69c63dc4c42b67201f634d5c6fa" } modify_external_catalogs: true
I20260927 15:06:12.648830 1552 tablet_bootstrap.cc:492] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.648969 1552 ts_tablet_manager.cc:1397] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.062s user 0.000s sys 0.005s
I20260927 15:06:12.655961 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_efdaebdde10c4bc0b43c9b76f254c556 [id=f96697b67a7f4eb9b111b258c5fc514a] alter complete (version 1)
I20260927 15:06:12.656684 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_043de5106d564b02bf3ad90c2a88f918"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.657394 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_043de5106d564b02bf3ad90c2a88f918 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.659780 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a4bbbc1bfddf4db79a05b447895da757"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.660332 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4bbbc1bfddf4db79a05b447895da757 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.669399 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet b3cc37a97bc145bdaa654bcc193fe93b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.673954 2233 ts_tablet_manager.cc:1918] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:12.673954 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c73e813bb594a5e871718b73fe61fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:12.674088 2233 log.cc:1196] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/6c73e813bb594a5e871718b73fe61fc9
I20260927 15:06:12.674427 2233 ts_tablet_manager.cc:1939] T 6c73e813bb594a5e871718b73fe61fc9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:12.679244 2447 raft_consensus.cc:482] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.679409 2447 raft_consensus.cc:504] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.680215 2447 leader_election.cc:288] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:12.661312 2436 raft_consensus.cc:482] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.680315 1552 raft_consensus.cc:348] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.680680 1552 raft_consensus.cc:374] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.680738 1552 raft_consensus.cc:729] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.680953 1552 consensus_queue.cc:260] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.681269 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc8bd2079f84da39e13113e6699bf5e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.681875 1376 leader_election.cc:341] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.680462 2436 raft_consensus.cc:504] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.682500 2436 leader_election.cc:288] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.682521 2479 raft_consensus.cc:482] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.682643 2479 raft_consensus.cc:504] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.683530 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c73e813bb594a5e871718b73fe61fc9" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.683686 1239 leader_election.cc:341] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 6e9d03457dac43038b4e6fb120ff572c
W20260927 15:06:12.684062 1102 leader_election.cc:341] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.685542 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc8bd2079f84da39e13113e6699bf5e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:12.686125 1374 leader_election.cc:341] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.686247 1374 leader_election.cc:302] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.686601 2447 raft_consensus.cc:2726] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.691109 2479 leader_election.cc:288] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.699028 1552 ts_tablet_manager.cc:1428] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.019s user 0.000s sys 0.002s
I20260927 15:06:12.699374 1552 tablet_bootstrap.cc:492] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:12.701189 1238 leader_election.cc:341] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6e9d03457dac43038b4e6fb120ff572c
I20260927 15:06:12.701370 1238 leader_election.cc:302] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.701536 1552 tablet_bootstrap.cc:654] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.701853 2486 raft_consensus.cc:2726] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.702108 2436 raft_consensus.cc:482] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.703536 2436 raft_consensus.cc:504] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.704074 2436 leader_election.cc:288] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.704962 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9598ac8a916f4bf5b1cf9995a8149c70" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:12.705171 1164 raft_consensus.cc:2454] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
W20260927 15:06:12.705724 1238 leader_election.cc:341] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9598ac8a916f4bf5b1cf9995a8149c70
I20260927 15:06:12.705997 1239 leader_election.cc:302] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.706374 2436 raft_consensus.cc:2781] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.706442 2436 raft_consensus.cc:482] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.706504 2436 raft_consensus.cc:3037] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:12.707849 899 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 237b6fd8d0ce4576ae84a1fb51dc500d (table default.Table_5ee809c4799544ffa55ff157b8e9bd43 [id=9f7315df6092401993b757ba891ecf94], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 237b6fd8d0ce4576ae84a1fb51dc500d consensus state has no leader
I20260927 15:06:12.708927 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 668) took 1932 ms. Trace:
I20260927 15:06:12.709013 2119 rpcz_store.cc:276] 0927 15:06:10.776516 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.776615 (+ 99us) service_pool.cc:227] Handling call
0927 15:06:12.427192 (+1650577us) ts_tablet_manager.cc:1145] Deleting tablet 63289edbdd734dd5a817df42d83e422e
0927 15:06:12.427204 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.515510 (+ 88306us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.613180 (+ 97670us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.708912 (+ 95732us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1650361}
I20260927 15:06:12.709403 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 671) took 1598 ms. Trace:
I20260927 15:06:12.709466 2119 rpcz_store.cc:276] 0927 15:06:11.111265 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.111476 (+ 211us) service_pool.cc:227] Handling call
0927 15:06:12.709291 (+1597815us) ts_tablet_manager.cc:1145] Deleting tablet 7dccaee87f314cbaa98d66e0bb885a8b
0927 15:06:12.709300 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.709390 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1597507}
I20260927 15:06:12.709722 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 669) took 1598 ms. Trace:
I20260927 15:06:12.710076 2289 raft_consensus.cc:504] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.710651 2289 leader_election.cc:288] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.714484 1552 tablet_bootstrap.cc:492] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.714608 1552 ts_tablet_manager.cc:1397] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260927 15:06:12.715346 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 63289edbdd734dd5a817df42d83e422e (table default.Table_b093eeae2295436bb418ac8610a19dd0 [id=9680ba832c914d98b077951ac46dc2b6]) successfully deleted
I20260927 15:06:12.715369 1552 raft_consensus.cc:348] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.715602 1552 raft_consensus.cc:374] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.715654 1552 raft_consensus.cc:729] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:12.715703 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7dccaee87f314cbaa98d66e0bb885a8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dccaee87f314cbaa98d66e0bb885a8b already in progress: creating tablet
I20260927 15:06:12.709792 2119 rpcz_store.cc:276] 0927 15:06:11.111028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.111829 (+ 801us) service_pool.cc:227] Handling call
0927 15:06:12.709647 (+1597818us) ts_tablet_manager.cc:1145] Deleting tablet 514ce66d5afd46a7b9cc460776973b06
0927 15:06:12.709654 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.709712 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1597602}
I20260927 15:06:12.716233 1552 consensus_queue.cc:260] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.716399 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 670) took 1605 ms. Trace:
I20260927 15:06:12.716497 2119 rpcz_store.cc:276] 0927 15:06:11.111173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.112079 (+ 906us) service_pool.cc:227] Handling call
0927 15:06:12.716202 (+1604123us) ts_tablet_manager.cc:1145] Deleting tablet b88cb2c53be4463eb17e748d2c17f0e2
0927 15:06:12.716217 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.716379 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1603909}
I20260927 15:06:12.716750 1552 ts_tablet_manager.cc:1428] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:12.716820 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 672) took 1605 ms. Trace:
I20260927 15:06:12.716996 1552 tablet_bootstrap.cc:492] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.721091 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c264c532db8249e5abe1dbef8ee8ffa0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:12.721669 1102 leader_election.cc:341] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.721833 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 734) took 1466 ms. Trace:
W20260927 15:06:12.721980 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30186548510642fab1533ab7183fa7dd consensus state has no leader
I20260927 15:06:12.721968 2233 rpcz_store.cc:276] 0927 15:06:11.243148 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.246351 (+ 3203us) service_pool.cc:227] Handling call
0927 15:06:12.517021 (+1270670us) ts_tablet_manager.cc:1145] Deleting tablet 6c73e813bb594a5e871718b73fe61fc9
0927 15:06:12.517031 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.614063 (+ 97032us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.673847 (+ 59784us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.709846 (+ 35999us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1270521}
I20260927 15:06:12.722415 2233 tablet_replica.cc:330] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:12.722410 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e2cbc77b8d3c4ef28dd3f7049981efa7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:12.722635 2233 raft_consensus.cc:2229] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:12.723037 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2cbc77b8d3c4ef28dd3f7049981efa7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.722797 2233 raft_consensus.cc:2258] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.723624 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 6c73e813bb594a5e871718b73fe61fc9 (table default.Table_00334dfc32284d7fbda19999dd7ad94f [id=a5be5daa955846b58970402702de73f9]) successfully deleted
I20260927 15:06:12.723819 2233 ts_tablet_manager.cc:1905] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:12.724321 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01a81e786b6b47599d4cee122de2c29a has no consensus state
I20260927 15:06:12.724705 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_06d412d20ce24d15a63273b739332b4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:12.724987 1552 tablet_bootstrap.cc:654] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:12.725241 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06d412d20ce24d15a63273b739332b4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.727705 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 561) took 5417 ms. Trace:
I20260927 15:06:12.727640 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c82ee61d4bf4403eb10b6ec67e0a455e" } new_table_name: "default.Table_2815d2fe0cac4aae8f5725df6638903f" modify_external_catalogs: true
I20260927 15:06:12.727793 1562 rpcz_store.cc:276] 0927 15:06:07.310603 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.310641 (+ 38us) service_pool.cc:227] Handling call
0927 15:06:12.248050 (+4937409us) ts_tablet_manager.cc:1145] Deleting tablet 454e637ec622424e81a8770c16bbc941
0927 15:06:12.248070 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.421070 (+173000us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.513610 (+ 92540us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.727600 (+213990us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4937215}
I20260927 15:06:12.728202 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 557) took 5419 ms. Trace:
I20260927 15:06:12.728294 1562 rpcz_store.cc:276] 0927 15:06:07.308725 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.312353 (+ 3628us) service_pool.cc:227] Handling call
0927 15:06:12.728079 (+5415726us) ts_tablet_manager.cc:1145] Deleting tablet 5bc96d1626f24cfab49bf6a36e1da33e
0927 15:06:12.728089 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.728183 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5415491}
I20260927 15:06:12.728572 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 562) took 5350 ms. Trace:
I20260927 15:06:12.728664 1562 rpcz_store.cc:276] 0927 15:06:07.377674 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.378896 (+ 1222us) service_pool.cc:227] Handling call
0927 15:06:12.728481 (+5349585us) ts_tablet_manager.cc:1145] Deleting tablet c6a248ec4ee64d0a8d986fdc683d69ba
0927 15:06:12.728490 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.728557 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5349300}
I20260927 15:06:12.728910 1562 tablet_replica.cc:330] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:06:12.729403 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff5f20f300324dbfae4ae771878ac61e consensus state has no leader
I20260927 15:06:12.729664 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 16884c7343be436aa312ec0af40f5e33 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:12.729708 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 514ce66d5afd46a7b9cc460776973b06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 514ce66d5afd46a7b9cc460776973b06 already in progress: creating tablet
W20260927 15:06:12.729944 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b88cb2c53be4463eb17e748d2c17f0e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b88cb2c53be4463eb17e748d2c17f0e2 already in progress: creating tablet
W20260927 15:06:12.730595 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8472966402af4053b8c883d0c4a7c2a3 consensus state has no leader
I20260927 15:06:12.731344 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7fd8311955974e1cbcdda1961c318588
I20260927 15:06:12.716923 2119 rpcz_store.cc:276] 0927 15:06:11.111415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.112316 (+ 901us) service_pool.cc:227] Handling call
0927 15:06:12.716717 (+1604401us) ts_tablet_manager.cc:1145] Deleting tablet 3042c17580d54082971b761433a7dca9
0927 15:06:12.716728 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.716804 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1604224}
I20260927 15:06:12.736132 2119 tablet_replica.cc:330] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:12.736331 2119 raft_consensus.cc:2229] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:12.736495 2119 raft_consensus.cc:2258] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.737008 2119 ts_tablet_manager.cc:1905] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:12.738909 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd8311955974e1cbcdda1961c318588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:12.739207 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3042c17580d54082971b761433a7dca9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3042c17580d54082971b761433a7dca9 already in progress: creating tablet
I20260927 15:06:12.739333 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd8311955974e1cbcdda1961c318588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.743453 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 454e637ec622424e81a8770c16bbc941 (table default.Table_d80304854a5249a08e5c2098c97d7c1c [id=a1de063eacb94c21b5009200a7517a33]) successfully deleted
I20260927 15:06:12.743453 912 master_service.cc:946] ReplaceTablet: received request to replace tablet e33a8d5908004ab88d4c53b21be4fb42 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:12.743775 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 5bc96d1626f24cfab49bf6a36e1da33e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bc96d1626f24cfab49bf6a36e1da33e already in progress: creating tablet
W20260927 15:06:12.744009 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c6a248ec4ee64d0a8d986fdc683d69ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6a248ec4ee64d0a8d986fdc683d69ba already in progress: creating tablet
I20260927 15:06:12.745267 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd8311955974e1cbcdda1961c318588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:12.749127 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 179974us
I20260927 15:06:12.750813 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c264c532db8249e5abe1dbef8ee8ffa0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:12.751037 1437 raft_consensus.cc:3037] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.751098 1099 leader_election.cc:302] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.751339 2477 raft_consensus.cc:2781] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:12.751446 2477 raft_consensus.cc:686] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:12.751660 2477 consensus_queue.cc:237] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.758101 1562 raft_consensus.cc:2229] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:12.758641 1562 pending_rounds.cc:62] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:12.758710 1562 pending_rounds.cc:68] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976361144500224 op_type: NO_OP noop_request { }
I20260927 15:06:12.758859 1562 raft_consensus.cc:2866] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:12.758947 1562 raft_consensus.cc:2258] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.763661 1552 tablet_bootstrap.cc:492] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.763895 1552 ts_tablet_manager.cc:1397] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.006s
I20260927 15:06:12.764218 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 454e637ec622424e81a8770c16bbc941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.764777 1552 raft_consensus.cc:348] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.765142 1552 raft_consensus.cc:374] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.765406 1552 raft_consensus.cc:729] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.765879 1552 consensus_queue.cc:260] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.766664 1552 ts_tablet_manager.cc:1428] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:12.767191 1552 tablet_bootstrap.cc:492] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.779292 1552 tablet_bootstrap.cc:654] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.780099 1562 ts_tablet_manager.cc:1905] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:12.791941 1552 tablet_bootstrap.cc:492] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.791961 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9a6330b2000f4bb5a7817b924f99ad53" } modify_external_catalogs: true
I20260927 15:06:12.792194 1552 ts_tablet_manager.cc:1397] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20260927 15:06:12.792217 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9a6330b2000f4bb5a7817b924f99ad53" } modify_external_catalogs: true
I20260927 15:06:12.791961 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f4624ee1f1074d14a78879480f51ac28" } modify_external_catalogs: true
I20260927 15:06:12.792930 1552 raft_consensus.cc:348] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.793053 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f4624ee1f1074d14a78879480f51ac28" } modify_external_catalogs: true
I20260927 15:06:12.793136 1552 raft_consensus.cc:374] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.793190 1552 raft_consensus.cc:729] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:12.793183 1099 leader_election.cc:341] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6c73e813bb594a5e871718b73fe61fc9
I20260927 15:06:12.793313 1099 leader_election.cc:302] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.793424 1552 consensus_queue.cc:260] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.794131 1552 ts_tablet_manager.cc:1428] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:12.794453 1552 tablet_bootstrap.cc:492] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.794772 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_85b48f7c2577445481e4ab0d007cf052"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:12.795998 2476 raft_consensus.cc:2726] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:12.795754 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85b48f7c2577445481e4ab0d007cf052 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.798970 1552 tablet_bootstrap.cc:654] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.799207 1561 tablet_bootstrap.cc:492] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.799401 1561 ts_tablet_manager.cc:1397] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.393s user 0.025s sys 0.053s
I20260927 15:06:12.799597 2446 raft_consensus.cc:482] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.799813 2446 raft_consensus.cc:504] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.800359 1561 raft_consensus.cc:348] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.800611 1561 raft_consensus.cc:374] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.800872 1561 raft_consensus.cc:729] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.800935 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c90e5c66d8564f68b401b3e4280499a7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:12.801177 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c90e5c66d8564f68b401b3e4280499a7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.801183 1561 consensus_queue.cc:260] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:12.801517 1374 leader_election.cc:341] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.801772 1561 ts_tablet_manager.cc:1428] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260927 15:06:12.801783 1376 leader_election.cc:341] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.801890 1376 leader_election.cc:302] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:12.802116 2447 raft_consensus.cc:2726] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.802146 1561 tablet_bootstrap.cc:492] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.802386 2446 leader_election.cc:288] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:12.804016 1561 tablet_bootstrap.cc:654] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.811302 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_df52c90f7b0745ef8832a53df04307b9" } modify_external_catalogs: true
I20260927 15:06:12.811560 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_df52c90f7b0745ef8832a53df04307b9" } modify_external_catalogs: true
I20260927 15:06:12.812378 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8f4553657b21460ab92da2ff23dca5d8" } modify_external_catalogs: true
I20260927 15:06:12.812573 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8f4553657b21460ab92da2ff23dca5d8" } modify_external_catalogs: true
I20260927 15:06:12.814544 1437 raft_consensus.cc:2454] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:12.815786 2431 consensus_meta.cc:287] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c: Time spent flushing consensus metadata: real 0.579s user 0.000s sys 0.003s
I20260927 15:06:12.815891 2431 raft_consensus.cc:504] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.816545 2431 leader_election.cc:288] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.816749 1552 tablet_bootstrap.cc:492] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.816907 1552 ts_tablet_manager.cc:1397] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260927 15:06:12.816845 2436 raft_consensus.cc:504] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.817442 2436 leader_election.cc:288] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.817879 1552 raft_consensus.cc:348] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.818130 1552 raft_consensus.cc:374] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.818194 1552 raft_consensus.cc:729] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.818487 1552 consensus_queue.cc:260] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.819151 1552 ts_tablet_manager.cc:1428] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:12.819394 1552 tablet_bootstrap.cc:492] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.819427 1099 leader_election.cc:302] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.819854 2430 raft_consensus.cc:2781] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:12.819976 2430 raft_consensus.cc:686] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:12.820201 2430 consensus_queue.cc:237] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.820933 1552 tablet_bootstrap.cc:654] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.824112 2233 ts_tablet_manager.cc:1918] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:12.824223 2233 log.cc:1196] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/5c0d51b50b414721a255fdde2fe1732f
I20260927 15:06:12.824486 2233 ts_tablet_manager.cc:1939] T 5c0d51b50b414721a255fdde2fe1732f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:12.827502 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9598ac8a916f4bf5b1cf9995a8149c70" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:12.827740 1164 raft_consensus.cc:3037] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.832302 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "373b6e6c03614b78a8343c84095bd347" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:12.832505 1437 raft_consensus.cc:3037] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:12.834141 1102 consensus_peers.cc:487] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:12.835345 2431 raft_consensus.cc:482] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.835515 2431 raft_consensus.cc:504] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.836182 2431 leader_election.cc:288] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.836675 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0429ce74c70c4b5488ea76ad4707da49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.837335 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0429ce74c70c4b5488ea76ad4707da49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.837582 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75537edf83a040cba4da502c726bf456" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.837780 1436 raft_consensus.cc:2454] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:12.842582 1561 tablet_bootstrap.cc:492] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.842747 1561 ts_tablet_manager.cc:1397] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.004s
I20260927 15:06:12.842944 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75537edf83a040cba4da502c726bf456" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:12.843479 1102 leader_election.cc:341] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.844019 1561 raft_consensus.cc:348] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:12.848291 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "373b6e6c03614b78a8343c84095bd347" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:12.851379 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_92cb4bf60a5c4bbeb19ad542a71d46e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.852469 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92cb4bf60a5c4bbeb19ad542a71d46e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:12.849179 1102 leader_election.cc:341] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.856962 1561 raft_consensus.cc:374] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.857091 1561 raft_consensus.cc:729] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.857427 1561 consensus_queue.cc:260] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:12.868076 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9011dcb105cd4d4f89921a300d18bab8 consensus state has no leader
W20260927 15:06:12.868126 1238 leader_election.cc:341] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9598ac8a916f4bf5b1cf9995a8149c70
I20260927 15:06:12.869943 914 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14 (table default.Table_bf61e56b4709425c99c5a22da57ddba9 [id=9ac1472258a24d01892257dd9c9874a8]). Expected version 1 got 0
I20260927 15:06:12.875665 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 9598ac8a916f4bf5b1cf9995a8149c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.876067 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 2afab8bf87bc45c899bcd5dfdad48d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.876392 1561 ts_tablet_manager.cc:1428] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260927 15:06:12.876739 1561 tablet_bootstrap.cc:492] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.877017 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 714f59ebe9cf4568a9aa4d5058200106 (DEFAULT_TABLE table=default.Table_70d070cb409140bb950af1749ccc32dd [id=fb310fcac9aa40dc8d07ec0aa895bbd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.876322 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 0cba2aca10e84d6c9ecb2a42000bba9d (DEFAULT_TABLE table=default.Table_cff6f4158c88488a9a5ab6a6b59d6711 [id=8b568d843eec4a3e9c5938f2603c5c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.877374 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 0cba2aca10e84d6c9ecb2a42000bba9d (DEFAULT_TABLE table=default.Table_cff6f4158c88488a9a5ab6a6b59d6711 [id=8b568d843eec4a3e9c5938f2603c5c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.877790 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cba2aca10e84d6c9ecb2a42000bba9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.878074 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 01a81e786b6b47599d4cee122de2c29a (DEFAULT_TABLE table=default.Table_b23a43b448d3437cbd8ce7083dff3d36 [id=d02c7fc1d93d498b8d95b84b6886f47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.878464 1561 tablet_bootstrap.cc:654] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.878563 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 8d059dff614841a79674d17dfc8870cb (DEFAULT_TABLE table=default.Table_2f802c3bc340435a81cd94fdb4133818 [id=2ca488aa9c3448c68e2aa53d5a2088c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.879396 1134 tablet_service.cc:1467] Processing CreateTablet for tablet bb348ff23de548fca4156a8533579a0e (DEFAULT_TABLE table=default.Table_44d528788dc8496cb0a8b81b85716953 [id=0177e24a771d443295c7a4721cd3167b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.881448 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 543e43d3bb3c4f01abfb1052aa7383c2 (DEFAULT_TABLE table=default.Table_bb14a6976bce4bd0be92d968861d9269 [id=3cd2682f2f48444a9eb08004ea0d4089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.881768 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 714f59ebe9cf4568a9aa4d5058200106 (DEFAULT_TABLE table=default.Table_70d070cb409140bb950af1749ccc32dd [id=fb310fcac9aa40dc8d07ec0aa895bbd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.882114 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 714f59ebe9cf4568a9aa4d5058200106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.882802 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 1b20e031dc7044368c41792118ebe12a (DEFAULT_TABLE table=default.Table_69940ca5fe094d06b021595f6aedef6a [id=998b977c908240088297e5c067324d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.883193 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 35a09718f15147f59575a7ea6f24573b (DEFAULT_TABLE table=default.Table_e83eab00b2e44e7f8307f5bde03f48a2 [id=411952ed24524457bdd4200c53b8530f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.883574 1138 tablet_service.cc:1467] Processing CreateTablet for tablet ea8679cd17ac4004a61d872975133103 (DEFAULT_TABLE table=default.Table_d0b0346a14ac4261aa3537ad273e885c [id=e2a3864f7f81478ea0ba72093e94e879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.885434 1099 leader_election.cc:302] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:12.885473 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 01a81e786b6b47599d4cee122de2c29a (DEFAULT_TABLE table=default.Table_b23a43b448d3437cbd8ce7083dff3d36 [id=d02c7fc1d93d498b8d95b84b6886f47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.885692 2431 raft_consensus.cc:2781] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:12.885780 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01a81e786b6b47599d4cee122de2c29a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.885773 2431 raft_consensus.cc:482] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:12.885842 2431 raft_consensus.cc:3037] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.892525 1561 tablet_bootstrap.cc:492] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:12.892748 1561 ts_tablet_manager.cc:1397] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.003s
I20260927 15:06:12.893383 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 8d059dff614841a79674d17dfc8870cb (DEFAULT_TABLE table=default.Table_2f802c3bc340435a81cd94fdb4133818 [id=2ca488aa9c3448c68e2aa53d5a2088c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.893601 1561 raft_consensus.cc:348] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.893795 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d059dff614841a79674d17dfc8870cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.893803 1561 raft_consensus.cc:374] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.893851 1561 raft_consensus.cc:729] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.894814 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 735) took 1651 ms. Trace:
I20260927 15:06:12.894960 2233 rpcz_store.cc:276] 0927 15:06:11.243263 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.246523 (+ 3260us) service_pool.cc:227] Handling call
0927 15:06:12.722363 (+1475840us) ts_tablet_manager.cc:1145] Deleting tablet 5c0d51b50b414721a255fdde2fe1732f
0927 15:06:12.722375 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.811488 (+ 89113us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.823990 (+ 12502us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.894792 (+ 70802us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1475734}
I20260927 15:06:12.895846 2436 raft_consensus.cc:482] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.895972 2436 raft_consensus.cc:504] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.896179 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 742) took 1499 ms. Trace:
I20260927 15:06:12.896256 2233 rpcz_store.cc:276] 0927 15:06:11.396464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.396537 (+ 73us) service_pool.cc:227] Handling call
0927 15:06:12.895259 (+1498722us) ts_tablet_manager.cc:1145] Deleting tablet fd6a824a5a504c92992ceec1cd3eb2e7
0927 15:06:12.895269 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.895366 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1498540}
I20260927 15:06:12.896572 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 743) took 1497 ms. Trace:
I20260927 15:06:12.896622 2436 leader_election.cc:288] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.896647 2233 rpcz_store.cc:276] 0927 15:06:11.398988 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.399053 (+ 65us) service_pool.cc:227] Handling call
0927 15:06:12.896469 (+1497416us) ts_tablet_manager.cc:1145] Deleting tablet 9f07d07b63834b368930d34956e7d6df
0927 15:06:12.896478 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.896556 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1497224}
I20260927 15:06:12.896986 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 744) took 1496 ms. Trace:
I20260927 15:06:12.897068 2233 rpcz_store.cc:276] 0927 15:06:11.400897 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.400961 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:12.896893 (+1495932us) ts_tablet_manager.cc:1145] Deleting tablet 921db5dbe31a4d0381bdd823cb497424
0927 15:06:12.896904 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.896972 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1495719}
I20260927 15:06:12.897298 2233 tablet_replica.cc:330] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:12.897440 1409 tablet_service.cc:1467] Processing CreateTablet for tablet bb348ff23de548fca4156a8533579a0e (DEFAULT_TABLE table=default.Table_44d528788dc8496cb0a8b81b85716953 [id=0177e24a771d443295c7a4721cd3167b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.897536 2233 raft_consensus.cc:2229] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:12.897794 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb348ff23de548fca4156a8533579a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.897833 2233 raft_consensus.cc:2258] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.898372 2233 ts_tablet_manager.cc:1905] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:12.898855 1239 leader_election.cc:341] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: e066308fcdfc49ed926cd81963c5f1a7
W20260927 15:06:12.899667 1238 leader_election.cc:341] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: e066308fcdfc49ed926cd81963c5f1a7
I20260927 15:06:12.899784 1238 leader_election.cc:302] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.901605 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 543e43d3bb3c4f01abfb1052aa7383c2 (DEFAULT_TABLE table=default.Table_bb14a6976bce4bd0be92d968861d9269 [id=3cd2682f2f48444a9eb08004ea0d4089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.901947 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 543e43d3bb3c4f01abfb1052aa7383c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.894053 1561 consensus_queue.cc:260] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.903316 1561 ts_tablet_manager.cc:1428] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260927 15:06:12.903393 2436 raft_consensus.cc:2726] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.903609 1561 tablet_bootstrap.cc:492] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:12.904904 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 1b20e031dc7044368c41792118ebe12a (DEFAULT_TABLE table=default.Table_69940ca5fe094d06b021595f6aedef6a [id=998b977c908240088297e5c067324d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.905203 1561 tablet_bootstrap.cc:654] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.905305 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 35a09718f15147f59575a7ea6f24573b (DEFAULT_TABLE table=default.Table_e83eab00b2e44e7f8307f5bde03f48a2 [id=411952ed24524457bdd4200c53b8530f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.905675 1405 tablet_service.cc:1467] Processing CreateTablet for tablet ea8679cd17ac4004a61d872975133103 (DEFAULT_TABLE table=default.Table_d0b0346a14ac4261aa3537ad273e885c [id=e2a3864f7f81478ea0ba72093e94e879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.906036 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 2ee20e5e0d894d918ce694ab73fd98e9 (DEFAULT_TABLE table=default.Table_0a7583c562174755b4b1e3a2a442c007 [id=1dbdc1021b4648fb9f0aec6269f07fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.906383 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 62fb9c535738497389ac5711e2f03888 (DEFAULT_TABLE table=default.Table_408d5290765e4ad48e15300c6ff5f72a [id=58d6b5e5764745e99dc79e376ff94c57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.906725 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 16e07e6e289540d6b4a48fede998244c (DEFAULT_TABLE table=default.Table_8f99d6af6eb24a288b8dbf7d1cdc61e8 [id=be68bd3124714767bed83dd9f849d8e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.907064 1437 raft_consensus.cc:2454] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:12.907574 2119 ts_tablet_manager.cc:1918] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:12.907684 2119 log.cc:1196] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/109f9088371e4f008b2b5f993f2b4c3b
I20260927 15:06:12.908011 2119 ts_tablet_manager.cc:1939] T 109f9088371e4f008b2b5f993f2b4c3b P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:12.910279 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 8d059dff614841a79674d17dfc8870cb (DEFAULT_TABLE table=default.Table_2f802c3bc340435a81cd94fdb4133818 [id=2ca488aa9c3448c68e2aa53d5a2088c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.910677 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d059dff614841a79674d17dfc8870cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.910697 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet cd901034653b47dbba7912d5338bc3bb with delete_type TABLET_DATA_DELETED (replaced by tablet 0d4ca19b492c4df1b31c78f1629c50b5) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.910965 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a07831078b48a59807f7da4a42bcec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:12.910905 2365 raft_consensus.cc:504] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.911288 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 0cba2aca10e84d6c9ecb2a42000bba9d (DEFAULT_TABLE table=default.Table_cff6f4158c88488a9a5ab6a6b59d6711 [id=8b568d843eec4a3e9c5938f2603c5c09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.911597 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cba2aca10e84d6c9ecb2a42000bba9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.911594 2365 leader_election.cc:288] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.912212 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 543e43d3bb3c4f01abfb1052aa7383c2 (DEFAULT_TABLE table=default.Table_bb14a6976bce4bd0be92d968861d9269 [id=3cd2682f2f48444a9eb08004ea0d4089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.912544 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 543e43d3bb3c4f01abfb1052aa7383c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.915084 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 714f59ebe9cf4568a9aa4d5058200106 (DEFAULT_TABLE table=default.Table_70d070cb409140bb950af1749ccc32dd [id=fb310fcac9aa40dc8d07ec0aa895bbd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.915125 1283 tablet_service.cc:1467] Processing CreateTablet for tablet bb348ff23de548fca4156a8533579a0e (DEFAULT_TABLE table=default.Table_44d528788dc8496cb0a8b81b85716953 [id=0177e24a771d443295c7a4721cd3167b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.915261 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 35a09718f15147f59575a7ea6f24573b (DEFAULT_TABLE table=default.Table_e83eab00b2e44e7f8307f5bde03f48a2 [id=411952ed24524457bdd4200c53b8530f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.915436 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 714f59ebe9cf4568a9aa4d5058200106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.915474 1285 tablet_service.cc:1467] Processing CreateTablet for tablet ea8679cd17ac4004a61d872975133103 (DEFAULT_TABLE table=default.Table_d0b0346a14ac4261aa3537ad273e885c [id=e2a3864f7f81478ea0ba72093e94e879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.918344 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 2ee20e5e0d894d918ce694ab73fd98e9 (DEFAULT_TABLE table=default.Table_0a7583c562174755b4b1e3a2a442c007 [id=1dbdc1021b4648fb9f0aec6269f07fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.919068 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 01a81e786b6b47599d4cee122de2c29a (DEFAULT_TABLE table=default.Table_b23a43b448d3437cbd8ce7083dff3d36 [id=d02c7fc1d93d498b8d95b84b6886f47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.919387 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 2ee20e5e0d894d918ce694ab73fd98e9 (DEFAULT_TABLE table=default.Table_0a7583c562174755b4b1e3a2a442c007 [id=1dbdc1021b4648fb9f0aec6269f07fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.919682 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 62fb9c535738497389ac5711e2f03888 (DEFAULT_TABLE table=default.Table_408d5290765e4ad48e15300c6ff5f72a [id=58d6b5e5764745e99dc79e376ff94c57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.919984 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 16e07e6e289540d6b4a48fede998244c (DEFAULT_TABLE table=default.Table_8f99d6af6eb24a288b8dbf7d1cdc61e8 [id=be68bd3124714767bed83dd9f849d8e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.920272 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 34308468f31444869011c61da58d30e8 (DEFAULT_TABLE table=default.Table_07d1ad2a734f423d95208c9ec22f2d24 [id=4cf3de5e85b94df68de639da2af2ee46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.921536 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 5c0d51b50b414721a255fdde2fe1732f (table default.Table_52dfae347a16444d9d03a84c7a88721d [id=60be603d0c3844e8925f32c3553e8d56]) successfully deleted
I20260927 15:06:12.921516 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 62fb9c535738497389ac5711e2f03888 (DEFAULT_TABLE table=default.Table_408d5290765e4ad48e15300c6ff5f72a [id=58d6b5e5764745e99dc79e376ff94c57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.921531 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 16e07e6e289540d6b4a48fede998244c (DEFAULT_TABLE table=default.Table_8f99d6af6eb24a288b8dbf7d1cdc61e8 [id=be68bd3124714767bed83dd9f849d8e2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:12.921805 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fd6a824a5a504c92992ceec1cd3eb2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd6a824a5a504c92992ceec1cd3eb2e7 already in progress: creating tablet
W20260927 15:06:12.922042 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9f07d07b63834b368930d34956e7d6df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f07d07b63834b368930d34956e7d6df already in progress: creating tablet
W20260927 15:06:12.922224 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 921db5dbe31a4d0381bdd823cb497424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 921db5dbe31a4d0381bdd823cb497424 already in progress: creating tablet
I20260927 15:06:12.922868 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 34308468f31444869011c61da58d30e8 (DEFAULT_TABLE table=default.Table_07d1ad2a734f423d95208c9ec22f2d24 [id=4cf3de5e85b94df68de639da2af2ee46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.915084 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 1b20e031dc7044368c41792118ebe12a (DEFAULT_TABLE table=default.Table_69940ca5fe094d06b021595f6aedef6a [id=998b977c908240088297e5c067324d34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:12.923398 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35a09718f15147f59575a7ea6f24573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.926800 905 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet fd8a53f3c95c4cb7bce21d23f79af28c (table default.Table_e08ec6e011ab4bf586420eaf92cfe107 [id=a51d9c4b701c4c639d904aef0ac3a2cb]). Expected version 1 got 0
I20260927 15:06:12.927479 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62fb9c535738497389ac5711e2f03888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.928110 910 catalog_manager.cc:5495] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:12.928586 910 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet dd2687f65780481c86a9942960ce7be1 (table default.Table_0c4d630a1b634322b0d6ffdf591dfc97 [id=a56919bbdc0146839e84fcc1224c6b8f]). Expected version 1 got 0
I20260927 15:06:12.930869 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cddac26e26854ad39af5fbd708079159" } new_table_name: "default.Table_40080b13414f408bb2af14042c50fd36" modify_external_catalogs: true
I20260927 15:06:12.931051 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb348ff23de548fca4156a8533579a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.933493 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bb70418fb7a04a5ab0b3b114e8c4fb6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:12.934111 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb70418fb7a04a5ab0b3b114e8c4fb6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:12.936033 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 278205071701447e8ee7457b2ee84be4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.936157 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 with delete_type TABLET_DATA_DELETED (replaced by tablet 99d4707e599840b3bdc2ab13c348ea80) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.936235 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:12.941658 2436 raft_consensus.cc:482] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.941808 2436 raft_consensus.cc:504] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.942574 2436 leader_election.cc:288] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:12.943686 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0702d9501ac047938d02ef2521dbf0d5" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:12.943691 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_802f770c469d4f3daa131645340e456c" } new_table_name: "default.Table_e3fac64ab4014a83baf665b86a27a0e0" modify_external_catalogs: true
I20260927 15:06:12.946116 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16e07e6e289540d6b4a48fede998244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.951069 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea8679cd17ac4004a61d872975133103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.955065 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ee20e5e0d894d918ce694ab73fd98e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.956400 1552 tablet_bootstrap.cc:492] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.956557 1552 ts_tablet_manager.cc:1397] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.137s user 0.015s sys 0.010s
I20260927 15:06:12.957356 1552 raft_consensus.cc:348] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.957561 1552 raft_consensus.cc:374] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.957609 1552 raft_consensus.cc:729] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.957834 1552 consensus_queue.cc:260] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.958714 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_78e7ca7ad476490d8cec4cb0b9e3767e" } new_table_name: "default.Table_e39959afca93471b81608a47e490da22" modify_external_catalogs: true
I20260927 15:06:12.959465 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34308468f31444869011c61da58d30e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.961418 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a9cb632191944d39a0dc0da5abee6a22" } new_table_name: "default.Table_9f691e4415864362a0a11b7ef69d222c" modify_external_catalogs: true
I20260927 15:06:12.963136 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0702d9501ac047938d02ef2521dbf0d5" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:12.963711 1239 leader_election.cc:302] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:12.964082 2436 raft_consensus.cc:2726] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:12.964699 1552 ts_tablet_manager.cc:1428] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260927 15:06:12.965622 1552 tablet_bootstrap.cc:492] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.967278 1552 tablet_bootstrap.cc:654] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.971709 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 714f59ebe9cf4568a9aa4d5058200106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.971975 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16e07e6e289540d6b4a48fede998244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.972198 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cba2aca10e84d6c9ecb2a42000bba9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.972607 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01a81e786b6b47599d4cee122de2c29a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.972973 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d059dff614841a79674d17dfc8870cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.973146 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb348ff23de548fca4156a8533579a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.973500 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 543e43d3bb3c4f01abfb1052aa7383c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.973559 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01a81e786b6b47599d4cee122de2c29a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.979846 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b20e031dc7044368c41792118ebe12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:12.980175 1552 tablet_bootstrap.cc:492] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:12.980304 1552 ts_tablet_manager.cc:1397] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260927 15:06:12.981022 1552 raft_consensus.cc:348] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.981216 1552 raft_consensus.cc:374] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:12.981269 1552 raft_consensus.cc:729] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.982645 1552 consensus_queue.cc:260] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.984697 1552 ts_tablet_manager.cc:1428] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260927 15:06:12.988416 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 673) took 1694 ms. Trace:
I20260927 15:06:12.988519 2119 rpcz_store.cc:276] 0927 15:06:11.293875 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.294952 (+ 1077us) service_pool.cc:227] Handling call
0927 15:06:12.736082 (+1441130us) ts_tablet_manager.cc:1145] Deleting tablet 109f9088371e4f008b2b5f993f2b4c3b
0927 15:06:12.736096 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.837984 (+101888us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.907465 (+ 69481us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:12.988395 (+ 80930us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1436997}
I20260927 15:06:12.988946 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 680) took 1592 ms. Trace:
I20260927 15:06:12.989019 2119 rpcz_store.cc:276] 0927 15:06:11.396780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.397436 (+ 656us) service_pool.cc:227] Handling call
0927 15:06:12.988820 (+1591384us) ts_tablet_manager.cc:1145] Deleting tablet fd6a824a5a504c92992ceec1cd3eb2e7
0927 15:06:12.988832 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.988931 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1591153}
I20260927 15:06:12.989287 1552 tablet_bootstrap.cc:492] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:12.989355 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 682) took 1587 ms. Trace:
I20260927 15:06:12.989444 2119 rpcz_store.cc:276] 0927 15:06:11.401813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.401923 (+ 110us) service_pool.cc:227] Handling call
0927 15:06:12.989241 (+1587318us) ts_tablet_manager.cc:1145] Deleting tablet 921db5dbe31a4d0381bdd823cb497424
0927 15:06:12.989253 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.989338 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1585336}
I20260927 15:06:12.989668 2119 tablet_replica.cc:330] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:12.989835 2119 raft_consensus.cc:2229] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:12.989992 2119 raft_consensus.cc:2258] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:12.990736 2119 ts_tablet_manager.cc:1905] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:12.991099 1552 tablet_bootstrap.cc:654] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:12.993891 1298 raft_consensus.cc:3037] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:12.996374 2447 raft_consensus.cc:482] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:12.996536 2447 raft_consensus.cc:504] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:12.997259 2447 leader_election.cc:288] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:12.998334 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4a123886a847d08b2a94ff5e4e01ca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:12.998910 1552 tablet_bootstrap.cc:492] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
W20260927 15:06:12.998965 1376 leader_election.cc:341] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:12.999034 1552 ts_tablet_manager.cc:1397] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.002s
I20260927 15:06:12.999233 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 109f9088371e4f008b2b5f993f2b4c3b (table default.Table_5e5da599fcef4b94ac03384faad9c44a [id=807446b6eab74770aa64683a5cf590a9]) successfully deleted
W20260927 15:06:12.999539 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet fd6a824a5a504c92992ceec1cd3eb2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd6a824a5a504c92992ceec1cd3eb2e7 already in progress: creating tablet
W20260927 15:06:12.999723 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 921db5dbe31a4d0381bdd823cb497424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 921db5dbe31a4d0381bdd823cb497424 already in progress: creating tablet
I20260927 15:06:12.999807 1552 raft_consensus.cc:348] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.000052 1552 raft_consensus.cc:374] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.000128 1552 raft_consensus.cc:729] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:12.935886 2365 raft_consensus.cc:482] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.005360 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b20e031dc7044368c41792118ebe12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.005259 2365 raft_consensus.cc:504] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.005940 2365 leader_election.cc:288] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.006765 2233 ts_tablet_manager.cc:1918] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:13.006908 2233 log.cc:1196] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/765b3ee3323846c5ba598f47478fd367
I20260927 15:06:13.007242 2233 ts_tablet_manager.cc:1939] T 765b3ee3323846c5ba598f47478fd367 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:13.010670 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ca19b492c4df1b31c78f1629c50b5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:13.011452 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b7e017ead242849585679873a69b43" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
W20260927 15:06:13.011536 1102 leader_election.cc:341] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.011664 1437 raft_consensus.cc:3037] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.011970 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35a09718f15147f59575a7ea6f24573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.012687 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea8679cd17ac4004a61d872975133103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.013535 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35a09718f15147f59575a7ea6f24573b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.014055 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62fb9c535738497389ac5711e2f03888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.014977 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ee20e5e0d894d918ce694ab73fd98e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.015645 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea8679cd17ac4004a61d872975133103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.016292 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16e07e6e289540d6b4a48fede998244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.016671 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b20e031dc7044368c41792118ebe12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.021497 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34308468f31444869011c61da58d30e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.022953 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 745) took 1613 ms. Trace:
I20260927 15:06:13.023304 2233 rpcz_store.cc:276] 0927 15:06:11.409922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.409996 (+ 74us) service_pool.cc:227] Handling call
0927 15:06:12.897261 (+1487265us) ts_tablet_manager.cc:1145] Deleting tablet 765b3ee3323846c5ba598f47478fd367
0927 15:06:12.897270 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.908522 (+ 11252us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.006645 (+ 98123us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.022923 (+ 16278us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1487004}
I20260927 15:06:13.024129 2233 tablet_replica.cc:330] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:13.025421 1552 consensus_queue.cc:260] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.027251 1552 ts_tablet_manager.cc:1428] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260927 15:06:13.027566 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01b7e017ead242849585679873a69b43" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:13.030506 1552 tablet_bootstrap.cc:492] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:13.033824 1102 leader_election.cc:341] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.034452 1552 tablet_bootstrap.cc:654] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.046669 2365 raft_consensus.cc:482] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.055717 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62fb9c535738497389ac5711e2f03888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.056136 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ee20e5e0d894d918ce694ab73fd98e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.057229 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
I20260927 15:06:13.061141 2436 raft_consensus.cc:482] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.061511 2436 raft_consensus.cc:504] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.062300 2436 leader_election.cc:288] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:13.064535 1238 leader_election.cc:341] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 45b610025b1a4b68bdc34f870654f9d1
I20260927 15:06:13.065271 1552 tablet_bootstrap.cc:492] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:13.066354 1552 ts_tablet_manager.cc:1397] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.009s
I20260927 15:06:13.067215 1562 ts_tablet_manager.cc:1918] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:13.067400 1562 log.cc:1196] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/42baac8b7d47433e826eb3bc1980acaa
I20260927 15:06:13.011212 1099 leader_election.cc:302] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.078215 1552 raft_consensus.cc:348] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.078734 1552 raft_consensus.cc:374] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.078883 1552 raft_consensus.cc:729] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.079289 1552 consensus_queue.cc:260] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.080688 1552 ts_tablet_manager.cc:1428] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260927 15:06:13.081099 1552 tablet_bootstrap.cc:492] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:13.070034 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 34308468f31444869011c61da58d30e8 (DEFAULT_TABLE table=default.Table_07d1ad2a734f423d95208c9ec22f2d24 [id=4cf3de5e85b94df68de639da2af2ee46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.081732 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34308468f31444869011c61da58d30e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:13.070785 2429 consensus_meta.cc:287] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c: Time spent flushing consensus metadata: real 0.501s user 0.003s sys 0.000s
I20260927 15:06:13.071126 2477 raft_consensus.cc:2781] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.082012 2477 raft_consensus.cc:686] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
W20260927 15:06:13.070520 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 59342.9us
I20260927 15:06:13.067950 1562 ts_tablet_manager.cc:1939] T 42baac8b7d47433e826eb3bc1980acaa P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:13.084338 1552 tablet_bootstrap.cc:654] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.081928 2429 raft_consensus.cc:504] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:13.088810 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4a123886a847d08b2a94ff5e4e01ca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.046875 2365 raft_consensus.cc:504] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.089946 2365 leader_election.cc:288] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.090155 2477 consensus_queue.cc:237] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:13.089816 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 563) took 5608 ms. Trace:
I20260927 15:06:13.090461 1562 rpcz_store.cc:276] 0927 15:06:07.481493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.481544 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:12.728870 (+5247326us) ts_tablet_manager.cc:1145] Deleting tablet 42baac8b7d47433e826eb3bc1980acaa
0927 15:06:12.728880 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:12.758459 (+ 29579us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x6150000eb3a4. stack: 00007f344c23b66e 00007f344c23b430 00007f344b2c25ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f345777704d 00007f3458a1b5ec 00007f345b3aa2e6 00007f345b3dc404 00007f345b3bd870 00007f345b3bd5fd 00000000009edb7c 00007f344c281344 00007f344c28491b 00007f344c284798
0927 15:06:12.814296 (+ 55837us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.067088 (+252792us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.089793 (+ 22705us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":66726144,"tablet-delete.queue_time_us":5246908}
I20260927 15:06:13.091122 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 42baac8b7d47433e826eb3bc1980acaa (table default.Table_e362bbc19fce4b2a842bd907b98ede40 [id=d3243f5a530645288cdf6befd30c31e3]) successfully deleted
I20260927 15:06:13.091207 1552 tablet_bootstrap.cc:492] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:13.091392 1552 ts_tablet_manager.cc:1397] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260927 15:06:13.091547 1562 tablet_replica.cc:330] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:13.091815 1562 raft_consensus.cc:2229] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:13.091727 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566aa5caa012443ea63fcb7389c8b7c0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:13.092026 1436 raft_consensus.cc:2454] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:13.092257 1374 leader_election.cc:341] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.092310 1562 raft_consensus.cc:2258] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:13.092386 1374 leader_election.cc:302] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.092764 2447 raft_consensus.cc:2726] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.093070 1562 ts_tablet_manager.cc:1905] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:13.094264 2429 leader_election.cc:288] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.094862 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4658de7351e9423b83f393f7f7045eed" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:13.095475 1102 leader_election.cc:341] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.096570 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566aa5caa012443ea63fcb7389c8b7c0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:13.097483 1552 raft_consensus.cc:348] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:13.098527 1099 leader_election.cc:341] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 0d4ca19b492c4df1b31c78f1629c50b5
I20260927 15:06:13.098637 1099 leader_election.cc:302] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.098901 1552 raft_consensus.cc:374] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.099006 1552 raft_consensus.cc:729] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.099186 1099 leader_election.cc:302] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:13.099776 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4658de7351e9423b83f393f7f7045eed" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:13.100026 1436 raft_consensus.cc:3037] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.100171 2365 raft_consensus.cc:2726] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.100319 2365 raft_consensus.cc:2781] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.100371 2365 raft_consensus.cc:482] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.100421 2365 raft_consensus.cc:3037] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.099314 1552 consensus_queue.cc:260] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:13.101761 1239 leader_election.cc:341] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 45b610025b1a4b68bdc34f870654f9d1
I20260927 15:06:13.101881 1239 leader_election.cc:302] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.102717 1552 ts_tablet_manager.cc:1428] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 15:06:13.102903 2436 raft_consensus.cc:2726] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.103087 1552 tablet_bootstrap.cc:492] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:13.103114 2447 raft_consensus.cc:482] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.103236 2447 raft_consensus.cc:504] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.103804 2447 leader_election.cc:288] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:13.104574 1437 raft_consensus.cc:2454] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:13.105185 2119 ts_tablet_manager.cc:1918] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:13.105381 2119 log.cc:1196] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/07b63e63f7cd4075bcf10a463ce16e05
I20260927 15:06:13.105741 2119 ts_tablet_manager.cc:1939] T 07b63e63f7cd4075bcf10a463ce16e05 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:13.105968 2233 raft_consensus.cc:2229] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:13.106387 2233 raft_consensus.cc:2258] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:13.107019 2502 tablet.cc:1722] T ebb4e007cefa4f18bdaa461b43c5c810 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:13.107220 2233 ts_tablet_manager.cc:1905] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:13.107824 1556 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.568s user 0.029s sys 0.048s
W20260927 15:06:13.107969 1556 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.568s user 0.029s sys 0.048s
I20260927 15:06:13.108662 1556 tablet_bootstrap.cc:492] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:13.108776 1556 ts_tablet_manager.cc:1397] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.571s user 0.029s sys 0.049s
I20260927 15:06:13.109467 1556 raft_consensus.cc:348] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.109658 1556 raft_consensus.cc:374] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.109702 1556 raft_consensus.cc:729] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.109953 1556 consensus_queue.cc:260] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.110987 1556 ts_tablet_manager.cc:1428] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:13.111271 1556 tablet_bootstrap.cc:492] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:13.113260 1556 tablet_bootstrap.cc:654] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.121603 1552 tablet_bootstrap.cc:654] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.121986 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1defd5bba3c34cae8893559ccfc8b5cd
I20260927 15:06:13.123689 909 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet ebb4e007cefa4f18bdaa461b43c5c810 (table default.Table_299a7e2d3b174b50b6f535e3971c1f35 [id=49e5a0fcbe0d48aa993446d112ed5d2b]). Expected version 2 got 0
I20260927 15:06:13.124099 2436 raft_consensus.cc:482] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.124233 2436 raft_consensus.cc:504] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.124831 2436 leader_election.cc:288] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:13.125847 1238 leader_election.cc:341] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 2afab8bf87bc45c899bcd5dfdad48d26
I20260927 15:06:13.130952 1099 leader_election.cc:302] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.131400 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 683) took 1729 ms. Trace:
I20260927 15:06:13.131563 2429 raft_consensus.cc:2781] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.131491 2119 rpcz_store.cc:276] 0927 15:06:11.401933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.402017 (+ 84us) service_pool.cc:227] Handling call
0927 15:06:12.989630 (+1587613us) ts_tablet_manager.cc:1145] Deleting tablet 07b63e63f7cd4075bcf10a463ce16e05
0927 15:06:12.989641 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.016970 (+ 27329us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.105045 (+ 88075us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.131379 (+ 26334us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1585548}
I20260927 15:06:13.131686 2429 raft_consensus.cc:686] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:13.131912 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 681) took 1730 ms. Trace:
I20260927 15:06:13.132004 2119 rpcz_store.cc:276] 0927 15:06:11.401717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.402385 (+ 668us) service_pool.cc:227] Handling call
0927 15:06:13.131795 (+1729410us) ts_tablet_manager.cc:1145] Deleting tablet 9f07d07b63834b368930d34956e7d6df
0927 15:06:13.131806 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.131895 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1727266}
I20260927 15:06:13.132230 2119 tablet_replica.cc:330] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:13.132418 2119 raft_consensus.cc:2229] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:13.132557 2119 raft_consensus.cc:2258] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:13.133100 2119 ts_tablet_manager.cc:1905] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:13.137153 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 1defd5bba3c34cae8893559ccfc8b5cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:13.102144 1102 leader_election.cc:341] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.140547 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 07b63e63f7cd4075bcf10a463ce16e05 (table default.Table_f1c5c1132cab4343b25f94cd31941336 [id=36810bbe6edd4d769f3f5da76c71e6e2]) successfully deleted
W20260927 15:06:13.140935 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9f07d07b63834b368930d34956e7d6df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f07d07b63834b368930d34956e7d6df already in progress: creating tablet
I20260927 15:06:13.142776 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b9e88c3679d412cac7603f200cf899b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:13.143404 1376 leader_election.cc:341] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.152570 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 1defd5bba3c34cae8893559ccfc8b5cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.155864 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet b375902081c54cdb84fdb075eec6baf7 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f4cff4a06db44269defca578af289d8) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.156831 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 65c313ab6848428d8237557392669f6f with delete_type TABLET_DATA_DELETED (replaced by tablet 568ba79ea795403cba76fb6632efd7e2) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.157482 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 48e7eac8753f425d90302360d228ee54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.158178 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 16884c7343be436aa312ec0af40f5e33 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cc8bd2079f84da39e13113e6699bf5e) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.162145 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet cb859b43634c420382da5c201ce24dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.162887 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b9e88c3679d412cac7603f200cf899b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:13.163585 1239 leader_election.cc:341] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 2afab8bf87bc45c899bcd5dfdad48d26
I20260927 15:06:13.163717 1239 leader_election.cc:302] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.164096 2436 raft_consensus.cc:2726] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:13.164412 1374 leader_election.cc:341] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.164523 1374 leader_election.cc:302] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.164861 2447 raft_consensus.cc:2726] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.165042 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 1defd5bba3c34cae8893559ccfc8b5cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.168704 1298 raft_consensus.cc:3037] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:13.170310 1131 consensus_meta.cc:287] T 8819b4ac14ca42ed8d7adc31306dcc19 P c4264874db964ff2830b7894c2b3d61c: Time spent flushing consensus metadata: real 0.513s user 0.003s sys 0.000s
I20260927 15:06:13.171624 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 79a3125723034cb48bc1a05fc4abbb82
I20260927 15:06:13.173820 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 79a3125723034cb48bc1a05fc4abbb82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.132027 2429 consensus_queue.cc:237] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.177259 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 79a3125723034cb48bc1a05fc4abbb82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.178485 1552 tablet_bootstrap.cc:492] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:13.178983 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 79a3125723034cb48bc1a05fc4abbb82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.185673 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e63f743dfca44a18bed170b2cd50f413"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.186311 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63f743dfca44a18bed170b2cd50f413 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.187348 1552 ts_tablet_manager.cc:1397] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.084s user 0.005s sys 0.002s
I20260927 15:06:13.188081 1552 raft_consensus.cc:348] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.189558 1552 raft_consensus.cc:374] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.189826 1552 raft_consensus.cc:729] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.190212 1552 consensus_queue.cc:260] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.196796 1552 ts_tablet_manager.cc:1428] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 15:06:13.199199 1552 tablet_bootstrap.cc:492] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:13.210124 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e7051277b0324331a28168eb387c770c
I20260927 15:06:13.211093 1436 raft_consensus.cc:2454] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:13.211027 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c46dfcd5448b4996b4ec02c8e39a25e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.211691 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c46dfcd5448b4996b4ec02c8e39a25e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.213750 1552 tablet_bootstrap.cc:654] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.214780 1099 leader_election.cc:302] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.215075 2477 raft_consensus.cc:2781] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.215196 2477 raft_consensus.cc:686] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:13.215499 2477 consensus_queue.cc:237] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:13.215684 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0e34a679010b4b4fa3a76aec5ae05db4
I20260927 15:06:13.216460 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9308e69b438d4173a3e71eb08336c30a" } modify_external_catalogs: true
I20260927 15:06:13.216657 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9308e69b438d4173a3e71eb08336c30a" } modify_external_catalogs: true
I20260927 15:06:13.220783 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet e7051277b0324331a28168eb387c770c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.220783 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e34a679010b4b4fa3a76aec5ae05db4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.221511 2476 raft_consensus.cc:482] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.221659 2476 raft_consensus.cc:504] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.222247 2476 leader_election.cc:288] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.223452 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd901034653b47dbba7912d5338bc3bb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:13.223703 1303 raft_consensus.cc:2454] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:13.224215 1102 leader_election.cc:302] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:13.225308 2476 raft_consensus.cc:2781] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.225404 2476 raft_consensus.cc:482] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.225478 2476 raft_consensus.cc:3037] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:13.226471 1099 leader_election.cc:341] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: cd901034653b47dbba7912d5338bc3bb
I20260927 15:06:13.226991 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e34a679010b4b4fa3a76aec5ae05db4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.229384 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet e7051277b0324331a28168eb387c770c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.229764 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e34a679010b4b4fa3a76aec5ae05db4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.230042 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet e7051277b0324331a28168eb387c770c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.231642 1561 tablet_bootstrap.cc:492] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:13.235252 1561 ts_tablet_manager.cc:1397] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.332s user 0.013s sys 0.043s
I20260927 15:06:13.236279 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cb0ab983a444d26b903a0cec64f15f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ae003f1ca76472cbaa8b577b66fe84c) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.237031 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 0ac2df48cabc467195f4986238519fb2 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:13.236270 1561 raft_consensus.cc:348] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.237764 1561 raft_consensus.cc:374] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.237952 1561 raft_consensus.cc:729] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.238281 1561 consensus_queue.cc:260] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.240563 1561 ts_tablet_manager.cc:1428] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:13.241353 2447 raft_consensus.cc:482] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.241413 1561 tablet_bootstrap.cc:492] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:13.241501 2447 raft_consensus.cc:504] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.242159 2447 leader_election.cc:288] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:13.243060 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cc37a97bc145bdaa654bcc193fe93b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:13.243619 1376 leader_election.cc:341] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.245798 2512 tablet.cc:1722] T b6f6bdef4ddb4f9c9c0d1f933768cd14 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:13.251288 1556 tablet_bootstrap.cc:492] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:13.251541 1556 ts_tablet_manager.cc:1397] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.140s user 0.004s sys 0.000s
I20260927 15:06:13.252313 1556 raft_consensus.cc:348] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.252610 1556 raft_consensus.cc:374] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.252719 1556 raft_consensus.cc:729] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.242118 2477 consensus_queue.cc:1035] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:13.243019 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cc37a97bc145bdaa654bcc193fe93b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.243453 2431 raft_consensus.cc:504] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:13.255517 1374 leader_election.cc:341] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.255646 1374 leader_election.cc:302] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.255685 2431 leader_election.cc:288] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.243563 2423 raft_consensus.cc:482] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.255884 2423 raft_consensus.cc:504] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:13.255901 1556 consensus_queue.cc:260] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.256140 2446 raft_consensus.cc:2726] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.256445 2423 leader_election.cc:288] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.256575 1561 tablet_bootstrap.cc:654] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.257113 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "434e9390f1fd4a3ebb65924c37b85bd4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:13.243750 1135 consensus_meta.cc:287] T ff5f20f300324dbfae4ae771878ac61e P c4264874db964ff2830b7894c2b3d61c: Time spent flushing consensus metadata: real 0.570s user 0.004s sys 0.000s
W20260927 15:06:13.257669 1102 leader_election.cc:341] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.257994 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75537edf83a040cba4da502c726bf456" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:13.258438 1102 leader_election.cc:341] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.259398 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75537edf83a040cba4da502c726bf456" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:13.259523 2446 raft_consensus.cc:482] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.259527 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "434e9390f1fd4a3ebb65924c37b85bd4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:13.259632 2446 raft_consensus.cc:504] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.259738 1433 raft_consensus.cc:2454] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:13.259575 1437 raft_consensus.cc:3037] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.260200 2446 leader_election.cc:288] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:13.261202 1099 leader_election.cc:302] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.261569 2423 raft_consensus.cc:2781] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.261636 2423 raft_consensus.cc:482] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.261686 2423 raft_consensus.cc:3037] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.262306 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278205071701447e8ee7457b2ee84be4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:13.262861 1374 leader_election.cc:341] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.264509 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278205071701447e8ee7457b2ee84be4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:13.265018 1376 leader_election.cc:341] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.265130 1376 leader_election.cc:302] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.265472 2446 raft_consensus.cc:2726] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.266011 1556 ts_tablet_manager.cc:1428] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260927 15:06:13.267061 1556 tablet_bootstrap.cc:492] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:13.268779 1552 tablet_bootstrap.cc:492] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:13.268959 1561 tablet_bootstrap.cc:492] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:13.269124 1561 ts_tablet_manager.cc:1397] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.002s
I20260927 15:06:13.269554 1552 ts_tablet_manager.cc:1397] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.070s user 0.004s sys 0.005s
I20260927 15:06:13.269881 1561 raft_consensus.cc:348] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.270155 1561 raft_consensus.cc:374] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.270247 1561 raft_consensus.cc:729] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.270269 1556 tablet_bootstrap.cc:654] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.270300 1552 raft_consensus.cc:348] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.270514 1552 raft_consensus.cc:374] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.270574 1552 raft_consensus.cc:729] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.270788 1552 consensus_queue.cc:260] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.271361 1552 ts_tablet_manager.cc:1428] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:13.270706 1561 consensus_queue.cc:260] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.274230 1561 ts_tablet_manager.cc:1428] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:13.274523 1552 tablet_bootstrap.cc:492] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:13.274732 1561 tablet_bootstrap.cc:492] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:13.276293 1552 tablet_bootstrap.cc:654] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.279282 2446 raft_consensus.cc:482] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.283102 1561 tablet_bootstrap.cc:654] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.279448 2446 raft_consensus.cc:504] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.288345 2446 leader_election.cc:288] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:13.289599 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8a53f3c95c4cb7bce21d23f79af28c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:13.290314 1374 leader_election.cc:341] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.290664 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8a53f3c95c4cb7bce21d23f79af28c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:13.291283 1376 leader_election.cc:341] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.291383 1376 leader_election.cc:302] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.291805 2446 raft_consensus.cc:2726] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.294984 2429 raft_consensus.cc:482] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.295166 2429 raft_consensus.cc:504] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:13.296480 2429 leader_election.cc:288] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.296447 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c0d51b50b414721a255fdde2fe1732f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:13.296968 1561 tablet_bootstrap.cc:492] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
W20260927 15:06:13.297087 1102 leader_election.cc:341] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.297168 1561 ts_tablet_manager.cc:1397] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260927 15:06:13.298126 1561 raft_consensus.cc:348] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.298480 1561 raft_consensus.cc:374] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.298607 1561 raft_consensus.cc:729] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.298960 1561 consensus_queue.cc:260] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.299571 1561 ts_tablet_manager.cc:1428] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:13.299574 2446 raft_consensus.cc:482] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.300115 1561 tablet_bootstrap.cc:492] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:13.302286 1561 tablet_bootstrap.cc:654] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.302937 1552 tablet_bootstrap.cc:492] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:13.299710 2446 raft_consensus.cc:504] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.303630 1552 ts_tablet_manager.cc:1397] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260927 15:06:13.304016 2446 leader_election.cc:288] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:13.305437 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033e71f60c3e47fd9647db090d4d6cd5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:13.306015 1374 leader_election.cc:341] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.304384 1552 raft_consensus.cc:348] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.306932 1552 raft_consensus.cc:374] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:13.307216 1099 leader_election.cc:341] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 5c0d51b50b414721a255fdde2fe1732f
I20260927 15:06:13.306998 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033e71f60c3e47fd9647db090d4d6cd5" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:13.308130 1376 leader_election.cc:341] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.308234 1376 leader_election.cc:302] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.308524 1437 raft_consensus.cc:2454] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:13.307015 1552 raft_consensus.cc:729] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.308974 1552 consensus_queue.cc:260] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.309711 1552 ts_tablet_manager.cc:1428] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 15:06:13.309957 1552 tablet_bootstrap.cc:492] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:13.310025 2233 ts_tablet_manager.cc:1918] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:13.310129 2233 log.cc:1196] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/01b7e017ead242849585679873a69b43
I20260927 15:06:13.310416 2233 ts_tablet_manager.cc:1939] T 01b7e017ead242849585679873a69b43 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:13.313716 2446 raft_consensus.cc:2726] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.313763 910 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet b6f6bdef4ddb4f9c9c0d1f933768cd14 (table default.Table_bf61e56b4709425c99c5a22da57ddba9 [id=9ac1472258a24d01892257dd9c9874a8]). Expected version 1 got 0
I20260927 15:06:13.314159 1099 leader_election.cc:302] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.315603 1099 leader_election.cc:302] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.315922 2289 raft_consensus.cc:2726] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.315963 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 42baac8b7d47433e826eb3bc1980acaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.316075 2289 raft_consensus.cc:2781] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.316165 2289 raft_consensus.cc:686] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:13.316370 2289 consensus_queue.cc:237] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:13.316757 1143 consensus_meta.cc:287] T 24a592ebe7db4f36bd2819f6864436ea P c4264874db964ff2830b7894c2b3d61c: Time spent flushing consensus metadata: real 0.651s user 0.005s sys 0.000s
I20260927 15:06:13.320722 1561 tablet_bootstrap.cc:492] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:13.320972 1561 ts_tablet_manager.cc:1397] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
W20260927 15:06:13.321555 1129 consensus_meta.cc:287] T 547f5f0f1d444f348cf7efbbdf95523c P c4264874db964ff2830b7894c2b3d61c: Time spent flushing consensus metadata: real 0.637s user 0.000s sys 0.003s
I20260927 15:06:13.322413 1561 raft_consensus.cc:348] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.322932 1561 raft_consensus.cc:374] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.323045 1561 raft_consensus.cc:729] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.323257 1561 consensus_queue.cc:260] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.323899 1561 ts_tablet_manager.cc:1428] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:13.324432 1561 tablet_bootstrap.cc:492] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:13.326323 1561 tablet_bootstrap.cc:654] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.331305 2436 raft_consensus.cc:482] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.331461 2436 raft_consensus.cc:504] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.332077 2436 leader_election.cc:288] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:13.333420 1238 leader_election.cc:341] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9cb0ab983a444d26b903a0cec64f15f0
I20260927 15:06:13.333773 2436 raft_consensus.cc:482] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.333899 2436 raft_consensus.cc:504] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.334425 2436 leader_election.cc:288] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.309685 1164 raft_consensus.cc:2454] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:13.327142 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c0d51b50b414721a255fdde2fe1732f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:13.326331 1137 consensus_meta.cc:287] T afbfe01feee7463e8c5b795f9fda70cd P c4264874db964ff2830b7894c2b3d61c: Time spent flushing consensus metadata: real 0.647s user 0.003s sys 0.000s
I20260927 15:06:13.335389 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65c313ab6848428d8237557392669f6f" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:13.331610 1130 consensus_meta.cc:287] T 3ee9b3d162764abf9d2754ba5c1382fe P c4264874db964ff2830b7894c2b3d61c: Time spent flushing consensus metadata: real 0.668s user 0.003s sys 0.000s
I20260927 15:06:13.335664 1164 raft_consensus.cc:2379] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in this term.
I20260927 15:06:13.336105 910 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet dd2687f65780481c86a9942960ce7be1 (table default.Table_0c4d630a1b634322b0d6ffdf591dfc97 [id=a56919bbdc0146839e84fcc1224c6b8f]). Expected version 1 got 0
I20260927 15:06:13.336380 1239 leader_election.cc:302] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.337227 2436 raft_consensus.cc:2781] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.340624 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet c49913b1763c4a7b9413a801aff93b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.333016 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb0ab983a444d26b903a0cec64f15f0" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.341001 1166 raft_consensus.cc:2454] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:13.308749 1562 ts_tablet_manager.cc:1918] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:13.341320 1562 log.cc:1196] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/377847d06b534883ba2b870ca3317fe0
I20260927 15:06:13.341722 1562 ts_tablet_manager.cc:1939] T 377847d06b534883ba2b870ca3317fe0 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:13.342769 1239 leader_election.cc:302] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:13.345422 1238 leader_election.cc:341] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 65c313ab6848428d8237557392669f6f
I20260927 15:06:13.345551 1238 leader_election.cc:302] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.346212 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e58cc7be8a9e46679f4791225ae99f5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.346912 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e58cc7be8a9e46679f4791225ae99f5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.348248 1552 tablet_bootstrap.cc:654] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:13.355324 898 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 -> Peer 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799): Couldn't send request to peer 2a122de3662f485f8f44b0a5e4b29862. Status: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260927 15:06:13.358695 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d25749db81f4631bbc1e5581bcc666e consensus state has no leader
I20260927 15:06:13.360536 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f09aa55cb7dc412682bd75ac25798b44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.361224 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f09aa55cb7dc412682bd75ac25798b44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.361168 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_005da4afcceb4fb1830e88ae975dff16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.361445 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d827f6a3a6834ecd86d8722b1f1e4444 consensus state has no leader
W20260927 15:06:13.361698 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_005da4afcceb4fb1830e88ae975dff16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.361773 906 master_service.cc:946] ReplaceTablet: received request to replace tablet b5ee2d7382d647cba4f3d55098e437c7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:13.363583 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_536135893da4487ead7a5f7d1c22a337"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.364198 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_536135893da4487ead7a5f7d1c22a337 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.367076 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8f2843bf6dbf4117b3f44cd39c328b99
W20260927 15:06:13.367487 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 547f5f0f1d444f348cf7efbbdf95523c consensus state has no leader
I20260927 15:06:13.367918 908 master_service.cc:946] ReplaceTablet: received request to replace tablet f585bcdadbcc4032aa484481cdf94b72 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:13.369864 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a5f82e24d3204c97a20b0b8db78e82d4" } new_table_name: "default.Table_977be428b672403db208caad1eb2e402" modify_external_catalogs: true
I20260927 15:06:13.371702 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a6c0a227327c4e8e87ebe7347f94106f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.372263 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6c0a227327c4e8e87ebe7347f94106f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.369620 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cddb7548c5064eeb9988951465de9f24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.374410 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cddb7548c5064eeb9988951465de9f24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:13.375909 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f95d664f1134ac9bbb62c1a3d4b5617 consensus state has no leader
I20260927 15:06:13.376286 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a9af2f731b594d44b346599087573311"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.376768 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9af2f731b594d44b346599087573311 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.389595 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2843bf6dbf4117b3f44cd39c328b99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.400086 1561 tablet_bootstrap.cc:492] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:13.400424 1561 ts_tablet_manager.cc:1397] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.076s user 0.013s sys 0.018s
I20260927 15:06:13.401467 1561 raft_consensus.cc:348] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.403748 1561 raft_consensus.cc:374] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.403903 1561 raft_consensus.cc:729] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.404260 1561 consensus_queue.cc:260] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.408990 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 714f59ebe9cf4568a9aa4d5058200106 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:13.410055 2119 ts_tablet_manager.cc:1918] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:13.410197 2119 log.cc:1196] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/a46e15ea145b4eae8f94b664067b4f92
I20260927 15:06:13.410475 2119 ts_tablet_manager.cc:1939] T a46e15ea145b4eae8f94b664067b4f92 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:13.410844 2365 raft_consensus.cc:504] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.411533 2365 leader_election.cc:288] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.412761 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4cff4a06db44269defca578af289d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.415565 1561 ts_tablet_manager.cc:1428] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260927 15:06:13.415851 1561 tablet_bootstrap.cc:492] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:13.416564 2446 raft_consensus.cc:482] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.417448 1561 tablet_bootstrap.cc:654] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.418815 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 685) took 2008 ms. Trace:
I20260927 15:06:13.419406 2119 rpcz_store.cc:276] 0927 15:06:11.410443 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.410955 (+ 512us) service_pool.cc:227] Handling call
0927 15:06:13.132195 (+1721240us) ts_tablet_manager.cc:1145] Deleting tablet a46e15ea145b4eae8f94b664067b4f92
0927 15:06:13.132203 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.211639 (+ 79436us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.409932 (+198293us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.418784 (+ 8852us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1720987}
I20260927 15:06:13.419740 2119 tablet_replica.cc:330] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:13.419942 2119 raft_consensus.cc:2229] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:13.420120 2119 raft_consensus.cc:2258] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:13.420670 2119 ts_tablet_manager.cc:1905] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:13.425629 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566aa5caa012443ea63fcb7389c8b7c0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:13.425889 1433 raft_consensus.cc:3037] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.429490 2525 raft_consensus.cc:2781] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.429723 2525 raft_consensus.cc:482] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.429896 2525 raft_consensus.cc:3037] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.431763 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_07d1ad2a734f423d95208c9ec22f2d24" } modify_external_catalogs: true
I20260927 15:06:13.431845 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_807b252506684a4a804a3f2a52913df8" } modify_external_catalogs: true
I20260927 15:06:13.432090 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_807b252506684a4a804a3f2a52913df8" } modify_external_catalogs: true
I20260927 15:06:13.432085 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_07d1ad2a734f423d95208c9ec22f2d24" } modify_external_catalogs: true
I20260927 15:06:13.432500 2436 raft_consensus.cc:686] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:13.432889 2436 consensus_queue.cc:237] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.436120 1552 tablet_bootstrap.cc:492] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:13.436173 2526 raft_consensus.cc:3037] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.436527 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2843bf6dbf4117b3f44cd39c328b99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.436753 2527 raft_consensus.cc:482] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.416709 2446 raft_consensus.cc:504] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.436780 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 751) took 2000 ms. Trace:
I20260927 15:06:13.436874 2527 raft_consensus.cc:504] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.436905 2233 rpcz_store.cc:276] 0927 15:06:11.436241 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.436291 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:13.024078 (+1587787us) ts_tablet_manager.cc:1145] Deleting tablet 01b7e017ead242849585679873a69b43
0927 15:06:13.024091 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.106242 (+ 82151us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x615000129e24. stack: 00007f26d729d66e 00007f26d729d430 00007f26d63245ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f26e27d904d 00007f26e3a7d5ec 00007f26e640c2e6 00007f26e643e404 00007f26e641f870 00007f26e641f5fd 00000000009edb7c 00007f26d72e3344 00007f26d72e691b 00007f26d72e6798
0927 15:06:13.208312 (+102070us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.309917 (+101605us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.436749 (+126832us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":187365120,"tablet-delete.queue_time_us":1587598}
I20260927 15:06:13.437345 2446 leader_election.cc:288] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:13.437389 2527 leader_election.cc:288] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.437430 2233 tablet_replica.cc:330] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:13.437618 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 94859us
I20260927 15:06:13.438127 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b1f2143af1142eb9f3dbc777299c186" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:13.438325 1238 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 92914.8us
I20260927 15:06:13.438555 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48e7eac8753f425d90302360d228ee54" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.438745 1164 raft_consensus.cc:2454] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:13.438751 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 01b7e017ead242849585679873a69b43 (table default.Table_fac248ae4718435c9ec9d479beaaeae4 [id=b28d0e08cf944e17a720641dab1f23f5]) successfully deleted
I20260927 15:06:13.439738 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet a46e15ea145b4eae8f94b664067b4f92 (table default.Table_d88f1baa6e6f484cbb3d6fb5315c4a20 [id=3fea2c5530204bb9ada53551032065b7]) successfully deleted
I20260927 15:06:13.439992 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b1f2143af1142eb9f3dbc777299c186" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:13.440358 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2843bf6dbf4117b3f44cd39c328b99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.440622 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566aa5caa012443ea63fcb7389c8b7c0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:13.441092 1376 leader_election.cc:341] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:13.441776 1374 leader_election.cc:341] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.441902 1374 leader_election.cc:302] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.448446 2446 raft_consensus.cc:2726] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.452538 1561 tablet_bootstrap.cc:492] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:13.452734 1561 ts_tablet_manager.cc:1397] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.002s
I20260927 15:06:13.453833 1561 raft_consensus.cc:348] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.436275 1552 ts_tablet_manager.cc:1397] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.126s user 0.005s sys 0.000s
I20260927 15:06:13.456368 1561 raft_consensus.cc:374] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.456517 1561 raft_consensus.cc:729] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.458992 1561 consensus_queue.cc:260] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.460472 1561 ts_tablet_manager.cc:1428] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260927 15:06:13.460922 1561 tablet_bootstrap.cc:492] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:13.461556 1298 raft_consensus.cc:3037] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:13.464185 1238 leader_election.cc:341] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 48e7eac8753f425d90302360d228ee54
I20260927 15:06:13.465330 1552 raft_consensus.cc:348] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.465596 1552 raft_consensus.cc:374] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.465654 1552 raft_consensus.cc:729] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.465879 1552 consensus_queue.cc:260] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.466666 1561 tablet_bootstrap.cc:654] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.475451 1561 tablet_bootstrap.cc:492] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:13.475688 1561 ts_tablet_manager.cc:1397] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.001s
I20260927 15:06:13.475865 1239 leader_election.cc:302] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.476130 2233 raft_consensus.cc:2229] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:13.476466 2233 raft_consensus.cc:2258] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:13.477404 2233 ts_tablet_manager.cc:1905] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:13.479261 1102 leader_election.cc:341] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:13.480639 1376 consensus_peers.cc:487] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:13.481056 1561 raft_consensus.cc:348] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.481361 1561 raft_consensus.cc:374] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.481474 1561 raft_consensus.cc:729] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.481534 2447 consensus_queue.cc:1035] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:13.481812 1561 consensus_queue.cc:260] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.486996 1561 ts_tablet_manager.cc:1428] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260927 15:06:13.487965 1561 tablet_bootstrap.cc:492] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:13.490407 1561 tablet_bootstrap.cc:654] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:13.491109 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9e541ad12fd470986eb82b4855db498 consensus state has no leader
I20260927 15:06:13.491750 907 master_service.cc:946] ReplaceTablet: received request to replace tablet 05d525c1128e4042aa97ff786ffa7ba9 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:13.494513 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d10e6eb8078c475abd696473005670a3" } modify_external_catalogs: true
I20260927 15:06:13.494755 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d10e6eb8078c475abd696473005670a3" } modify_external_catalogs: true
I20260927 15:06:13.496945 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2d1d3aacd61a41a3a18e1952d14a4314" } modify_external_catalogs: true
I20260927 15:06:13.499202 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2d1d3aacd61a41a3a18e1952d14a4314" } modify_external_catalogs: true
I20260927 15:06:13.501657 2531 raft_consensus.cc:2781] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.501847 2531 raft_consensus.cc:482] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.501991 2531 raft_consensus.cc:3037] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.504851 2527 raft_consensus.cc:482] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.505056 2527 raft_consensus.cc:504] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.505759 2527 leader_election.cc:288] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.507368 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd2687f65780481c86a9942960ce7be1" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:13.507462 1099 consensus_peers.cc:487] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c65bc09865bc4a0283eaa4af9f860bdd. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:13.507663 1436 raft_consensus.cc:2379] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate c4264874db964ff2830b7894c2b3d61c in this term.
I20260927 15:06:13.507376 2446 raft_consensus.cc:482] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.508283 2446 raft_consensus.cc:504] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.508936 2446 leader_election.cc:288] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:13.510500 1552 ts_tablet_manager.cc:1428] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.046s user 0.002s sys 0.000s
I20260927 15:06:13.510908 1552 tablet_bootstrap.cc:492] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:13.513849 1561 tablet_bootstrap.cc:492] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:13.514088 1561 ts_tablet_manager.cc:1397] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20260927 15:06:13.515384 1433 raft_consensus.cc:2454] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:13.515967 1099 leader_election.cc:302] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.516060 2423 raft_consensus.cc:504] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:13.516695 2423 leader_election.cc:288] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.517724 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 564) took 6019 ms. Trace:
I20260927 15:06:13.517814 1562 rpcz_store.cc:276] 0927 15:06:07.498037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:07.498656 (+ 619us) service_pool.cc:227] Handling call
0927 15:06:13.091497 (+5592841us) ts_tablet_manager.cc:1145] Deleting tablet 377847d06b534883ba2b870ca3317fe0
0927 15:06:13.091509 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.230523 (+139014us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.308612 (+ 78089us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.517704 (+209092us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5592538}
I20260927 15:06:13.518347 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 377847d06b534883ba2b870ca3317fe0 (table default.Table_0021fd56477c4debbfe492c5673d41c2 [id=56574e770aa74f04a7bf24b7718e4960]) successfully deleted
I20260927 15:06:13.518714 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 578) took 5487 ms. Trace:
I20260927 15:06:13.518800 1562 rpcz_store.cc:276] 0927 15:06:08.031620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.031671 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:13.518169 (+5486498us) ts_tablet_manager.cc:1145] Deleting tablet 05d525c1128e4042aa97ff786ffa7ba9
0927 15:06:13.518586 (+ 417us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.518697 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5486292}
W20260927 15:06:13.519384 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 05d525c1128e4042aa97ff786ffa7ba9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05d525c1128e4042aa97ff786ffa7ba9 already in progress: creating tablet
I20260927 15:06:13.520177 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4cff4a06db44269defca578af289d8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:13.521263 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 580) took 5441 ms. Trace:
I20260927 15:06:13.521364 1562 rpcz_store.cc:276] 0927 15:06:08.079364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.079416 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:13.519068 (+5439652us) ts_tablet_manager.cc:1145] Deleting tablet a9a58b4d602b4f879fc56f5f1648f19c
0927 15:06:13.521152 (+ 2084us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.521246 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5439373}
I20260927 15:06:13.521710 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 579) took 5442 ms. Trace:
I20260927 15:06:13.521782 1562 rpcz_store.cc:276] 0927 15:06:08.079211 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.081198 (+ 1987us) service_pool.cc:227] Handling call
0927 15:06:13.521608 (+5440410us) ts_tablet_manager.cc:1145] Deleting tablet 3fff31ceb379400bbfa4586c749e6d6e
0927 15:06:13.521618 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.521696 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5440218}
I20260927 15:06:13.522055 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 581) took 5418 ms. Trace:
I20260927 15:06:13.522130 1562 rpcz_store.cc:276] 0927 15:06:08.103751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.103822 (+ 71us) service_pool.cc:227] Handling call
0927 15:06:13.521971 (+5418149us) ts_tablet_manager.cc:1145] Deleting tablet edc07b00db3c42eeb7543fecaf515eab
0927 15:06:13.521980 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.522042 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5417882}
I20260927 15:06:13.522387 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 582) took 5381 ms. Trace:
I20260927 15:06:13.522450 1562 rpcz_store.cc:276] 0927 15:06:08.140537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.145404 (+ 4867us) service_pool.cc:227] Handling call
0927 15:06:13.522306 (+5376902us) ts_tablet_manager.cc:1145] Deleting tablet 67ad68a0adad407a92b2335f43e67227
0927 15:06:13.522327 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.522374 (+ 47us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5376594}
I20260927 15:06:13.522724 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 599) took 5052 ms. Trace:
I20260927 15:06:13.522792 1562 rpcz_store.cc:276] 0927 15:06:08.470297 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.470450 (+ 153us) service_pool.cc:227] Handling call
0927 15:06:13.522643 (+5052193us) ts_tablet_manager.cc:1145] Deleting tablet e33a8d5908004ab88d4c53b21be4fb42
0927 15:06:13.522651 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.522711 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5016716}
I20260927 15:06:13.523089 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 596) took 5056 ms. Trace:
I20260927 15:06:13.523156 1562 rpcz_store.cc:276] 0927 15:06:08.466765 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.466873 (+ 108us) service_pool.cc:227] Handling call
0927 15:06:13.523004 (+5056131us) ts_tablet_manager.cc:1145] Deleting tablet 727652500d9a47b68b7a0d0dcf583822
0927 15:06:13.523013 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.523074 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5017003}
I20260927 15:06:13.523453 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 595) took 5056 ms. Trace:
I20260927 15:06:13.523517 1562 rpcz_store.cc:276] 0927 15:06:08.466673 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.489707 (+ 23034us) service_pool.cc:227] Handling call
0927 15:06:13.523362 (+5033655us) ts_tablet_manager.cc:1145] Deleting tablet 1c5c0d205937415ab0214a5bdbd939c1
0927 15:06:13.523371 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.523439 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5012713}
I20260927 15:06:13.523765 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 600) took 5053 ms. Trace:
I20260927 15:06:13.523826 1562 rpcz_store.cc:276] 0927 15:06:08.470402 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.510343 (+ 39941us) service_pool.cc:227] Handling call
0927 15:06:13.523687 (+5013344us) ts_tablet_manager.cc:1145] Deleting tablet 568ba79ea795403cba76fb6632efd7e2
0927 15:06:13.523696 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.523754 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4896670}
I20260927 15:06:13.524037 1562 tablet_replica.cc:330] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:13.524215 1562 raft_consensus.cc:2229] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:13.524102 1561 raft_consensus.cc:348] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.524454 1562 pending_rounds.cc:62] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:13.524538 1562 pending_rounds.cc:68] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976364305883136 op_type: NO_OP noop_request { }
I20260927 15:06:13.524695 1562 raft_consensus.cc:2866] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:13.524791 1562 raft_consensus.cc:2258] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:13.525107 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet a9a58b4d602b4f879fc56f5f1648f19c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9a58b4d602b4f879fc56f5f1648f19c already in progress: creating tablet
W20260927 15:06:13.525211 1376 leader_election.cc:341] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:13.525424 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 3fff31ceb379400bbfa4586c749e6d6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fff31ceb379400bbfa4586c749e6d6e already in progress: creating tablet
W20260927 15:06:13.525628 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet edc07b00db3c42eeb7543fecaf515eab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edc07b00db3c42eeb7543fecaf515eab already in progress: creating tablet
W20260927 15:06:13.525874 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e33a8d5908004ab88d4c53b21be4fb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e33a8d5908004ab88d4c53b21be4fb42 already in progress: creating tablet
I20260927 15:06:13.525966 1562 ts_tablet_manager.cc:1905] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:13.526039 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 727652500d9a47b68b7a0d0dcf583822 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 727652500d9a47b68b7a0d0dcf583822 already in progress: creating tablet
W20260927 15:06:13.526232 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1c5c0d205937415ab0214a5bdbd939c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c5c0d205937415ab0214a5bdbd939c1 already in progress: creating tablet
W20260927 15:06:13.526499 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 568ba79ea795403cba76fb6632efd7e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 568ba79ea795403cba76fb6632efd7e2 already in progress: creating tablet
I20260927 15:06:13.526714 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7816e099094d13887650fc223097c7 with delete_type TABLET_DATA_DELETED (replaced by tablet c90e5c66d8564f68b401b3e4280499a7) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.527098 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "434e9390f1fd4a3ebb65924c37b85bd4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:13.527319 1433 raft_consensus.cc:3037] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.524438 1561 raft_consensus.cc:374] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.529565 1561 raft_consensus.cc:729] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.529666 1556 tablet_bootstrap.cc:492] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:13.529837 1556 ts_tablet_manager.cc:1397] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.264s user 0.006s sys 0.004s
I20260927 15:06:13.529821 1561 consensus_queue.cc:260] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.530184 2365 raft_consensus.cc:2781] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.530308 2365 raft_consensus.cc:686] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:13.530524 2365 consensus_queue.cc:237] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.534603 1556 raft_consensus.cc:348] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.534857 1556 raft_consensus.cc:374] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.534920 1556 raft_consensus.cc:729] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.540464 1561 ts_tablet_manager.cc:1428] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260927 15:06:13.541328 1561 tablet_bootstrap.cc:492] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:13.547473 1561 tablet_bootstrap.cc:654] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.548667 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4cff4a06db44269defca578af289d8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.551121 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b5ee2d7382d647cba4f3d55098e437c7
I20260927 15:06:13.551205 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "434e9390f1fd4a3ebb65924c37b85bd4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:13.551657 906 catalog_manager.cc:6565] ReplaceTablet: tablet b5ee2d7382d647cba4f3d55098e437c7 deleted and replaced by tablet cd3eb83597ef4aae9bf00fcfc2517ea6
W20260927 15:06:13.552230 1102 leader_election.cc:341] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.553109 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet b5ee2d7382d647cba4f3d55098e437c7 with delete_type TABLET_DATA_DELETED (replaced by tablet cd3eb83597ef4aae9bf00fcfc2517ea6) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.554407 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd2687f65780481c86a9942960ce7be1" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.555226 1239 leader_election.cc:302] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.559012 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f88b401dc12e451c80abe1b509e2b532
I20260927 15:06:13.560213 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet f88b401dc12e451c80abe1b509e2b532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.563727 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet d9a3105b7cca4ac18b2c29c8b9dcda64
I20260927 15:06:13.564903 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a3105b7cca4ac18b2c29c8b9dcda64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.566315 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b940bc9596784c36a9dffa12ac026b33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.567046 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b940bc9596784c36a9dffa12ac026b33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.569972 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_01e58c54d7e14dac9f422ff99a6b893e" } new_table_name: "default.Table_10d1055ef5fa4b4394ec82c6ee4b1e01" modify_external_catalogs: true
I20260927 15:06:13.571485 2527 raft_consensus.cc:482] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.571666 2527 raft_consensus.cc:504] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.572311 2527 leader_election.cc:288] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.572464 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a6f756a6136d48a78b4fb2488323f3fd" } new_table_name: "default.Table_5b7e58750e9a481cab2abf34e5753a5e" modify_external_catalogs: true
I20260927 15:06:13.572965 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49913b1763c4a7b9413a801aff93b30" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.573200 1164 raft_consensus.cc:2454] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:13.573655 1239 leader_election.cc:302] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:13.573907 2527 raft_consensus.cc:2781] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.573979 2527 raft_consensus.cc:482] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.574050 2527 raft_consensus.cc:3037] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.574414 2525 raft_consensus.cc:504] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.576597 2436 raft_consensus.cc:3037] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.578629 2423 consensus_queue.cc:1035] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:13.582576 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d0c335be286f4131aa7cf4428ffa5c5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.583352 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0c335be286f4131aa7cf4428ffa5c5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:13.584818 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db09498a395b4570a34d32fbfc71e8ed consensus state has no leader
I20260927 15:06:13.586310 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cddb7548c5064eeb9988951465de9f24" } new_table_name: "default.Table_bb0cfb89d00b491285ded7ae087d8315" modify_external_catalogs: true
I20260927 15:06:13.587498 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ffcab397f6434a8ea2ed691bffdbc238" } new_table_name: "default.Table_8f7bfb2e0ede422b83a9051c840f1649" modify_external_catalogs: true
W20260927 15:06:13.594470 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1dfbe94faecb4c6a9bea043a4b0f6361 consensus state has no leader
I20260927 15:06:13.594509 2431 consensus_queue.cc:1035] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:06:13.596119 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87b54364a63b48e9981463d1019dad59 consensus state has no leader
I20260927 15:06:13.600688 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 24ea887fb6ed4d21b109f825a8d45d9c (DEFAULT_TABLE table=default.Table_e2cbc77b8d3c4ef28dd3f7049981efa7 [id=c72aced9d7674952ba5b0919c64aed50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.601632 1136 tablet_service.cc:1467] Processing CreateTablet for tablet c8d1c148840b4b2989edf860d7401f90 (DEFAULT_TABLE table=default.Table_7c71092564ca4ec3bffb3b7d20d9623d [id=ac56d4eebd164c10a143ebcc639890bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.601838 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 34308468f31444869011c61da58d30e8
I20260927 15:06:13.602515 1142 tablet_service.cc:1467] Processing CreateTablet for tablet b52fd2f819ea48b4aa70060c160fd5a5 (DEFAULT_TABLE table=default.Table_06b5faec9f2740c98a1c07645c8c65c0 [id=0fa0aaacc9394651a3bd7768da465ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.602803 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 34308468f31444869011c61da58d30e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.603021 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0ac2df48cabc467195f4986238519fb2
I20260927 15:06:13.603343 1139 tablet_service.cc:1467] Processing CreateTablet for tablet e2cd5d7ef84e41be9dcc5ca392284a68 (DEFAULT_TABLE table=default.Table_e812145e2650451b9edebd5769f7ff17 [id=0604748936f54dfe983378897d5ad6bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.603757 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ac2df48cabc467195f4986238519fb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 927c8bd9afc54836922dc6d3cc472946) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.605057 909 catalog_manager.cc:6565] ReplaceTablet: tablet 0ac2df48cabc467195f4986238519fb2 deleted and replaced by tablet 927c8bd9afc54836922dc6d3cc472946
I20260927 15:06:13.606773 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b52fd2f819ea48b4aa70060c160fd5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.607234 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8d1c148840b4b2989edf860d7401f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.607590 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2cd5d7ef84e41be9dcc5ca392284a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.607852 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cb0ab983a444d26b903a0cec64f15f0" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:13.608003 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24ea887fb6ed4d21b109f825a8d45d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.608042 1164 raft_consensus.cc:3037] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:13.608731 1102 consensus_peers.cc:487] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:13.609275 2476 raft_consensus.cc:504] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.609860 2476 leader_election.cc:288] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.616091 2476 raft_consensus.cc:482] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.616233 2476 raft_consensus.cc:504] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.616755 2476 leader_election.cc:288] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:13.620551 1099 leader_election.cc:341] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: cd901034653b47dbba7912d5338bc3bb
I20260927 15:06:13.621968 1138 tablet_service.cc:1467] Processing CreateTablet for tablet bfcef74b1b014f57820bf0f4076e8b13 (DEFAULT_TABLE table=default.Table_62afe99bf9fe40a2bce5968ced72f01d [id=36fc5222557e484ba3211694bae04d41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.626693 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3bb06d6047b0410f9305e5eb2ad0952c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:13.627554 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a3e1703b285640dfa4ddf810dad33273"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.627787 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bb06d6047b0410f9305e5eb2ad0952c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:13.627954 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04483a489f254123a1ccd69667acb0b1 has no consensus state
I20260927 15:06:13.629807 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd901034653b47dbba7912d5338bc3bb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:13.630085 1303 raft_consensus.cc:3037] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.631060 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 1dfbe94faecb4c6a9bea043a4b0f6361 (DEFAULT_TABLE table=default.Table_8f7bfb2e0ede422b83a9051c840f1649 [id=1aba62525ed44cf5b169ecf87b4c1c80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.633837 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2ada29db8b78455c9c8897f8027d3804" } modify_external_catalogs: true
I20260927 15:06:13.634620 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2ada29db8b78455c9c8897f8027d3804" } modify_external_catalogs: true
I20260927 15:06:13.594287 2525 leader_election.cc:288] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.619095 2119 ts_tablet_manager.cc:1918] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:13.635191 2119 log.cc:1196] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/765b3ee3323846c5ba598f47478fd367
I20260927 15:06:13.635646 2119 ts_tablet_manager.cc:1939] T 765b3ee3323846c5ba598f47478fd367 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:13.636381 2525 raft_consensus.cc:482] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.636508 2525 raft_consensus.cc:504] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.637260 2525 leader_election.cc:288] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.638079 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9049d003d787403f80aa0c08872dd3b5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:13.638257 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3540982dd7544e60af6c153fc41a412c
I20260927 15:06:13.545851 1556 consensus_queue.cc:260] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:13.549471 1374 leader_election.cc:341] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.638862 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_19b967b211a94e01a88e59b22de81627"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:13.639129 1374 leader_election.cc:302] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.639456 2447 raft_consensus.cc:2726] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:13.639569 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 90115.9us
I20260927 15:06:13.639954 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 3540982dd7544e60af6c153fc41a412c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.639953 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16884c7343be436aa312ec0af40f5e33" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.640233 1166 raft_consensus.cc:2454] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:13.560653 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet b5ee2d7382d647cba4f3d55098e437c7 with delete_type TABLET_DATA_DELETED (replaced by tablet cd3eb83597ef4aae9bf00fcfc2517ea6) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.565021 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet f88b401dc12e451c80abe1b509e2b532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.569075 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a3105b7cca4ac18b2c29c8b9dcda64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:13.640664 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19b967b211a94e01a88e59b22de81627 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.598974 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 24ea887fb6ed4d21b109f825a8d45d9c (DEFAULT_TABLE table=default.Table_e2cbc77b8d3c4ef28dd3f7049981efa7 [id=c72aced9d7674952ba5b0919c64aed50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.640913 1556 ts_tablet_manager.cc:1428] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.111s user 0.002s sys 0.000s
I20260927 15:06:13.641134 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24ea887fb6ed4d21b109f825a8d45d9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:13.641798 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3e1703b285640dfa4ddf810dad33273 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.604735 1413 tablet_service.cc:1467] Processing CreateTablet for tablet c8d1c148840b4b2989edf860d7401f90 (DEFAULT_TABLE table=default.Table_7c71092564ca4ec3bffb3b7d20d9623d [id=ac56d4eebd164c10a143ebcc639890bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.643229 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8d1c148840b4b2989edf860d7401f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.605109 1405 tablet_service.cc:1467] Processing CreateTablet for tablet b52fd2f819ea48b4aa70060c160fd5a5 (DEFAULT_TABLE table=default.Table_06b5faec9f2740c98a1c07645c8c65c0 [id=0fa0aaacc9394651a3bd7768da465ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.647187 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b52fd2f819ea48b4aa70060c160fd5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.647593 1552 tablet_bootstrap.cc:654] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.647668 1401 tablet_service.cc:1467] Processing CreateTablet for tablet ee6ce0821f314b7fbbb97a740193417f (DEFAULT_TABLE table=default.Table_a4bbbc1bfddf4db79a05b447895da757 [id=3ac3717d1ddb413d90e0eb66f1470d5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.648047 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee6ce0821f314b7fbbb97a740193417f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.649430 1556 tablet_bootstrap.cc:492] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:13.650712 1556 tablet_bootstrap.cc:654] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.651167 1416 tablet_service.cc:1467] Processing CreateTablet for tablet b5ffe51b1b834bf4af262dc70b9206f8 (DEFAULT_TABLE table=default.Table_06d412d20ce24d15a63273b739332b4a [id=ab6a871a6c8a4e6e8f34412a1ea2f25c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.651254 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 94cb9a18cf8f42ef81675f176b950c5e (DEFAULT_TABLE table=default.Table_06b1d62a4d4b42b7891157047aafa50f [id=629c97b3409e4a89b4f12592a70d9f1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.651523 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5ffe51b1b834bf4af262dc70b9206f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.605275 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 34308468f31444869011c61da58d30e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.605540 1410 tablet_service.cc:1467] Processing CreateTablet for tablet e2cd5d7ef84e41be9dcc5ca392284a68 (DEFAULT_TABLE table=default.Table_e812145e2650451b9edebd5769f7ff17 [id=0604748936f54dfe983378897d5ad6bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.654938 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94cb9a18cf8f42ef81675f176b950c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.655099 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2cd5d7ef84e41be9dcc5ca392284a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.605710 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ac2df48cabc467195f4986238519fb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 927c8bd9afc54836922dc6d3cc472946) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.605962 1409 tablet_service.cc:1467] Processing CreateTablet for tablet bfcef74b1b014f57820bf0f4076e8b13 (DEFAULT_TABLE table=default.Table_62afe99bf9fe40a2bce5968ced72f01d [id=36fc5222557e484ba3211694bae04d41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.659191 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfcef74b1b014f57820bf0f4076e8b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.659773 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 3540982dd7544e60af6c153fc41a412c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.659973 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 0c54768b4f18467787d5e9894cb083d0 (DEFAULT_TABLE table=default.Table_c792c8cddcc548b387f79c4664d664a4 [id=d4b50c4eac27403fb94efa8aa7ef901c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.660135 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 94cb9a18cf8f42ef81675f176b950c5e (DEFAULT_TABLE table=default.Table_06b1d62a4d4b42b7891157047aafa50f [id=629c97b3409e4a89b4f12592a70d9f1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.660550 1135 tablet_service.cc:1467] Processing CreateTablet for tablet ee6ce0821f314b7fbbb97a740193417f (DEFAULT_TABLE table=default.Table_a4bbbc1bfddf4db79a05b447895da757 [id=3ac3717d1ddb413d90e0eb66f1470d5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.660910 1127 tablet_service.cc:1467] Processing CreateTablet for tablet b5ffe51b1b834bf4af262dc70b9206f8 (DEFAULT_TABLE table=default.Table_06d412d20ce24d15a63273b739332b4a [id=ab6a871a6c8a4e6e8f34412a1ea2f25c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.662508 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 0c54768b4f18467787d5e9894cb083d0 (DEFAULT_TABLE table=default.Table_c792c8cddcc548b387f79c4664d664a4 [id=d4b50c4eac27403fb94efa8aa7ef901c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.662891 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c54768b4f18467787d5e9894cb083d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.665211 907 catalog_manager.cc:5495] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:13.665766 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
I20260927 15:06:13.667637 2423 raft_consensus.cc:482] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.667774 2423 raft_consensus.cc:504] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.668351 2423 leader_election.cc:288] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:13.670272 1102 leader_election.cc:341] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.670369 1239 leader_election.cc:302] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:13.617374 1433 raft_consensus.cc:2454] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:13.620174 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9049d003d787403f80aa0c08872dd3b5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:13.671993 1438 raft_consensus.cc:2454] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:13.671777 907 catalog_manager.cc:5495] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:13.624471 2233 ts_tablet_manager.cc:1918] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:13.637533 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 1dfbe94faecb4c6a9bea043a4b0f6361 (DEFAULT_TABLE table=default.Table_8f7bfb2e0ede422b83a9051c840f1649 [id=1aba62525ed44cf5b169ecf87b4c1c80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.672739 907 catalog_manager.cc:5495] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:13.673115 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dfbe94faecb4c6a9bea043a4b0f6361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.673151 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 373b6e6c03614b78a8343c84095bd347 (table default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63]). Expected version 1 got 0
I20260927 15:06:13.671089 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d4ced27460fd468abb680a28e7f9e530"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.674432 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4ced27460fd468abb680a28e7f9e530 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.674511 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0129eaa5636544e696076e439d713b1b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:13.674716 1438 raft_consensus.cc:2454] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:13.675441 1099 leader_election.cc:302] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.675879 1099 leader_election.cc:302] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.676118 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 2e38c2394c874e49aa148acf7c2d6dee (DEFAULT_TABLE table=default.Table_043de5106d564b02bf3ad90c2a88f918 [id=c34e06de5314431a823279a8de6e2d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.676205 1099 leader_election.cc:302] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:13.676419 2476 raft_consensus.cc:2781] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.676525 2476 raft_consensus.cc:686] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:13.676551 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e38c2394c874e49aa148acf7c2d6dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.676725 2476 consensus_queue.cc:237] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:13.678140 2423 raft_consensus.cc:2781] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.678213 2423 raft_consensus.cc:482] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.678272 2423 raft_consensus.cc:3037] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.678602 2365 raft_consensus.cc:2781] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.678663 2365 raft_consensus.cc:482] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.678714 2365 raft_consensus.cc:3037] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.679359 2233 log.cc:1196] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/a90039faff27436db7b50fa4c4643d3b
I20260927 15:06:13.679781 2233 ts_tablet_manager.cc:1939] T a90039faff27436db7b50fa4c4643d3b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:13.682013 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 2e38c2394c874e49aa148acf7c2d6dee (DEFAULT_TABLE table=default.Table_043de5106d564b02bf3ad90c2a88f918 [id=c34e06de5314431a823279a8de6e2d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.684033 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0129eaa5636544e696076e439d713b1b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:13.685217 1102 consensus_peers.cc:487] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:13.685604 1102 leader_election.cc:341] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.685799 2525 raft_consensus.cc:2781] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.685897 2525 raft_consensus.cc:482] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.685956 2525 raft_consensus.cc:3037] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.688908 2447 raft_consensus.cc:482] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.689033 2447 raft_consensus.cc:504] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.689615 2447 leader_election.cc:288] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:13.690251 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9b07ea3ec9457399e2b765580d06e7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:13.690586 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9b07ea3ec9457399e2b765580d06e7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:13.690812 1376 leader_election.cc:341] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:13.691098 1374 leader_election.cc:341] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.691232 1374 leader_election.cc:302] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.691567 2447 raft_consensus.cc:2726] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.692749 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 714f59ebe9cf4568a9aa4d5058200106
I20260927 15:06:13.693198 910 catalog_manager.cc:6565] ReplaceTablet: tablet 714f59ebe9cf4568a9aa4d5058200106 deleted and replaced by tablet 546c6116a98c4787935f42cf5cca46b6
I20260927 15:06:13.695602 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_40807a5ed0df43dd89c4d4a10827bb9b" } new_table_name: "default.Table_48c42dbc134b41309b69389e2ea71d95" modify_external_catalogs: true
I20260927 15:06:13.695832 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 714f59ebe9cf4568a9aa4d5058200106 with delete_type TABLET_DATA_DELETED (replaced by tablet 546c6116a98c4787935f42cf5cca46b6) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.696054 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_11346dfb3345489f92bad7f598d0192e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.696678 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11346dfb3345489f92bad7f598d0192e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.700673 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_74beb80739aa41539ec16812dd37761c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.701335 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74beb80739aa41539ec16812dd37761c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.706218 1562 ts_tablet_manager.cc:1918] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:13.706367 1562 log.cc:1196] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/75537edf83a040cba4da502c726bf456
I20260927 15:06:13.706784 1562 ts_tablet_manager.cc:1939] T 75537edf83a040cba4da502c726bf456 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:13.709126 2431 consensus_queue.cc:1035] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:13.709251 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 714f59ebe9cf4568a9aa4d5058200106 with delete_type TABLET_DATA_DELETED (replaced by tablet 546c6116a98c4787935f42cf5cca46b6) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:13.709322 898 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 87b54364a63b48e9981463d1019dad59 (table default.Table_10d1055ef5fa4b4394ec82c6ee4b1e01 [id=530ccac0880047cfb6d45de2528cf595], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 87b54364a63b48e9981463d1019dad59 consensus state has no leader
I20260927 15:06:13.715406 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfcef74b1b014f57820bf0f4076e8b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.716143 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94cb9a18cf8f42ef81675f176b950c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.716602 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee6ce0821f314b7fbbb97a740193417f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.716992 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5ffe51b1b834bf4af262dc70b9206f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.717365 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e38c2394c874e49aa148acf7c2d6dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.717732 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c54768b4f18467787d5e9894cb083d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.718442 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dfbe94faecb4c6a9bea043a4b0f6361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.723841 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 04007cd4bd214b88a4664e23daf4b790 with delete_type TABLET_DATA_DELETED (replaced by tablet 79c983d3119f4754a33a1ec3a84665c1) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.724076 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet 434e9390f1fd4a3ebb65924c37b85bd4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6de2fca4b792491993fcf23ce6db61e0) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.725711 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 0129eaa5636544e696076e439d713b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 7fd8311955974e1cbcdda1961c318588) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.725901 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 566aa5caa012443ea63fcb7389c8b7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.726050 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 424b66c69254487f932894516d570204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.733629 911 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet dd2687f65780481c86a9942960ce7be1 (table default.Table_0c4d630a1b634322b0d6ffdf591dfc97 [id=a56919bbdc0146839e84fcc1224c6b8f]). Expected version 1 got 0
I20260927 15:06:13.734531 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet b5ee2d7382d647cba4f3d55098e437c7 with delete_type TABLET_DATA_DELETED (replaced by tablet cd3eb83597ef4aae9bf00fcfc2517ea6) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.735937 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet f88b401dc12e451c80abe1b509e2b532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.736503 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet d9a3105b7cca4ac18b2c29c8b9dcda64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.737015 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 24ea887fb6ed4d21b109f825a8d45d9c (DEFAULT_TABLE table=default.Table_e2cbc77b8d3c4ef28dd3f7049981efa7 [id=c72aced9d7674952ba5b0919c64aed50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.737304 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet c5cd55de34d249bc8d3adcf4690f0414 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.737465 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24ea887fb6ed4d21b109f825a8d45d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.739318 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e2c276b721a74822a5275c5924de20b6
I20260927 15:06:13.740285 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet e2c276b721a74822a5275c5924de20b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.740562 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet e2c276b721a74822a5275c5924de20b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.741652 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cc8bd2079f84da39e13113e6699bf5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.741870 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f4bd8182c9d48c7b6e6175ab98d405a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.742115 1275 tablet_service.cc:1467] Processing CreateTablet for tablet c8d1c148840b4b2989edf860d7401f90 (DEFAULT_TABLE table=default.Table_7c71092564ca4ec3bffb3b7d20d9623d [id=ac56d4eebd164c10a143ebcc639890bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.742519 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8d1c148840b4b2989edf860d7401f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.746301 1164 raft_consensus.cc:2454] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:13.747578 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 754) took 2311 ms. Trace:
I20260927 15:06:13.747766 2233 rpcz_store.cc:276] 0927 15:06:11.436529 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.436566 (+ 37us) service_pool.cc:227] Handling call
0927 15:06:13.437365 (+2000799us) ts_tablet_manager.cc:1145] Deleting tablet a90039faff27436db7b50fa4c4643d3b
0927 15:06:13.437382 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.476349 (+ 38967us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x6150002d3fa4. stack: 00007f26d729d66e 00007f26d729d430 00007f26d63245ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f26e27d904d 00007f26e3a7d5ec 00007f26e640c2e6 00007f26e643e404 00007f26e641f870 00007f26e641f5fd 00000000009edb7c 00007f26d72e3344 00007f26d72e691b 00007f26d72e6798
0927 15:06:13.539934 (+ 63585us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.624341 (+ 84407us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.747557 (+123216us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":661,"spinlock_wait_cycles":88443136,"tablet-delete.queue_time_us":2000642}
I20260927 15:06:13.748359 2233 tablet_replica.cc:330] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:13.748538 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet a90039faff27436db7b50fa4c4643d3b (table default.Table_a97f9c79720e40e48b56f0dd4c7441cc [id=e15024fd65bf43fcadd4253d7f2e991c]) successfully deleted
I20260927 15:06:13.748633 2233 raft_consensus.cc:2229] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:13.748807 2233 raft_consensus.cc:2258] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:13.749358 2233 ts_tablet_manager.cc:1905] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:13.750885 2526 raft_consensus.cc:2726] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.751062 2526 raft_consensus.cc:482] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.751166 2526 raft_consensus.cc:504] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.751909 2526 leader_election.cc:288] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.754078 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_47ac30fcf01e4d908cf79610d7b1ecf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.754794 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47ac30fcf01e4d908cf79610d7b1ecf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.754815 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54a07831078b48a59807f7da4a42bcec" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.755146 1164 raft_consensus.cc:2454] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:13.755638 1239 leader_election.cc:302] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:13.755971 1239 leader_election.cc:302] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
W20260927 15:06:13.757193 1102 consensus_peers.cc:487] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:13.757481 2526 raft_consensus.cc:2781] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.757619 2526 raft_consensus.cc:686] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:13.757897 2526 consensus_queue.cc:237] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.760154 2544 raft_consensus.cc:2781] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.760278 2544 raft_consensus.cc:482] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.760953 2544 raft_consensus.cc:3037] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.762483 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_610a8aaf0f9a4a499029e51d3e290e1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.763306 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_610a8aaf0f9a4a499029e51d3e290e1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.765450 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_aa05ab0cb98542a4b84901b5dcd86aee" } modify_external_catalogs: true
I20260927 15:06:13.766429 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f42add5ed0a44c3ab8cd106ab1c21187" } modify_external_catalogs: true
I20260927 15:06:13.766626 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f42add5ed0a44c3ab8cd106ab1c21187" } modify_external_catalogs: true
I20260927 15:06:13.767160 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_aa05ab0cb98542a4b84901b5dcd86aee" } modify_external_catalogs: true
I20260927 15:06:13.772291 1556 tablet_bootstrap.cc:492] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:13.772500 1556 ts_tablet_manager.cc:1397] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.123s user 0.003s sys 0.000s
I20260927 15:06:13.773268 1556 raft_consensus.cc:348] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.774655 1273 tablet_service.cc:1467] Processing CreateTablet for tablet b52fd2f819ea48b4aa70060c160fd5a5 (DEFAULT_TABLE table=default.Table_06b5faec9f2740c98a1c07645c8c65c0 [id=0fa0aaacc9394651a3bd7768da465ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.775100 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b52fd2f819ea48b4aa70060c160fd5a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:13.776646 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 048719b6bb41462e99ae942c52b2fcdd consensus state has no leader
I20260927 15:06:13.778007 1561 tablet_bootstrap.cc:492] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:13.778142 1561 ts_tablet_manager.cc:1397] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.237s user 0.009s sys 0.021s
I20260927 15:06:13.784268 2512 tablet.cc:1722] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:13.786890 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_02f2c729f727498b8942dc5b6ddcbf70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.787609 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02f2c729f727498b8942dc5b6ddcbf70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.788834 906 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 0702d9501ac047938d02ef2521dbf0d5 (table default.Table_d498ea4d76e248a98a4c6e184d194324 [id=1fceed220c0041ecbcb20d2ee5c0dadc]). Expected version 2 got 0
I20260927 15:06:13.790616 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_70317f25e61f4ec48a720a9f34635030" } new_table_name: "default.Table_9421c4a3c84e449ea9e86594f7342489" modify_external_catalogs: true
I20260927 15:06:13.794867 1561 raft_consensus.cc:348] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.799945 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 34308468f31444869011c61da58d30e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.800227 1284 tablet_service.cc:1467] Processing CreateTablet for tablet e2cd5d7ef84e41be9dcc5ca392284a68 (DEFAULT_TABLE table=default.Table_e812145e2650451b9edebd5769f7ff17 [id=0604748936f54dfe983378897d5ad6bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.800881 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ac2df48cabc467195f4986238519fb2 with delete_type TABLET_DATA_DELETED (replaced by tablet 927c8bd9afc54836922dc6d3cc472946) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.800959 1285 tablet_service.cc:1467] Processing CreateTablet for tablet bfcef74b1b014f57820bf0f4076e8b13 (DEFAULT_TABLE table=default.Table_62afe99bf9fe40a2bce5968ced72f01d [id=36fc5222557e484ba3211694bae04d41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.801322 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 1dfbe94faecb4c6a9bea043a4b0f6361 (DEFAULT_TABLE table=default.Table_8f7bfb2e0ede422b83a9051c840f1649 [id=1aba62525ed44cf5b169ecf87b4c1c80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.801745 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 3540982dd7544e60af6c153fc41a412c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.802146 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 94cb9a18cf8f42ef81675f176b950c5e (DEFAULT_TABLE table=default.Table_06b1d62a4d4b42b7891157047aafa50f [id=629c97b3409e4a89b4f12592a70d9f1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.802698 1269 tablet_service.cc:1467] Processing CreateTablet for tablet ee6ce0821f314b7fbbb97a740193417f (DEFAULT_TABLE table=default.Table_a4bbbc1bfddf4db79a05b447895da757 [id=3ac3717d1ddb413d90e0eb66f1470d5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.803236 1283 tablet_service.cc:1467] Processing CreateTablet for tablet b5ffe51b1b834bf4af262dc70b9206f8 (DEFAULT_TABLE table=default.Table_06d412d20ce24d15a63273b739332b4a [id=ab6a871a6c8a4e6e8f34412a1ea2f25c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.803804 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 0c54768b4f18467787d5e9894cb083d0 (DEFAULT_TABLE table=default.Table_c792c8cddcc548b387f79c4664d664a4 [id=d4b50c4eac27403fb94efa8aa7ef901c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.804358 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 714f59ebe9cf4568a9aa4d5058200106 with delete_type TABLET_DATA_DELETED (replaced by tablet 546c6116a98c4787935f42cf5cca46b6) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.804364 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 2e38c2394c874e49aa148acf7c2d6dee (DEFAULT_TABLE table=default.Table_043de5106d564b02bf3ad90c2a88f918 [id=c34e06de5314431a823279a8de6e2d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.804931 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet e2c276b721a74822a5275c5924de20b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.805542 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfcef74b1b014f57820bf0f4076e8b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.806020 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5ffe51b1b834bf4af262dc70b9206f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.806383 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee6ce0821f314b7fbbb97a740193417f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.806757 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e38c2394c874e49aa148acf7c2d6dee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.807147 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c54768b4f18467787d5e9894cb083d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.807505 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94cb9a18cf8f42ef81675f176b950c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.807578 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_536135893da4487ead7a5f7d1c22a337" } new_table_name: "default.Table_7bbeb71422fd42a0a370d2ed36b85d17" modify_external_catalogs: true
I20260927 15:06:13.807842 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2cd5d7ef84e41be9dcc5ca392284a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.808758 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dfbe94faecb4c6a9bea043a4b0f6361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.809556 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fc15353bc7ae407b85aece886ce4db99" } new_table_name: "default.Table_cfbd877cee6b474bb10ac032debb9d69" modify_external_catalogs: true
I20260927 15:06:13.814713 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3b207b7b6ab747b7a2e504f26bcf201d" } modify_external_catalogs: true
I20260927 15:06:13.814934 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3b207b7b6ab747b7a2e504f26bcf201d" } modify_external_catalogs: true
I20260927 15:06:13.816927 1556 raft_consensus.cc:374] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.816996 1556 raft_consensus.cc:729] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.817179 1556 consensus_queue.cc:260] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.817700 1556 ts_tablet_manager.cc:1428] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.045s user 0.001s sys 0.000s
I20260927 15:06:13.819046 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9a7989e2b91044dab1d3e327958a051a
I20260927 15:06:13.819815 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bd8ee120888747a5a5cf6623783c7562"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.820346 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd8ee120888747a5a5cf6623783c7562 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.816314 2447 raft_consensus.cc:482] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.823235 2447 raft_consensus.cc:504] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.823840 2447 leader_election.cc:288] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:13.824451 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a7989e2b91044dab1d3e327958a051a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.828943 1556 tablet_bootstrap.cc:492] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:13.829233 2543 raft_consensus.cc:482] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.829421 2543 raft_consensus.cc:504] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.829537 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8133a6b1d48149a9a063310debe2bddd" } new_table_name: "default.Table_2d639925527040ccaebe69b8f7c65b5e" modify_external_catalogs: true
I20260927 15:06:13.830209 2543 leader_election.cc:288] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:13.831212 1238 leader_election.cc:341] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c49913b1763c4a7b9413a801aff93b30
W20260927 15:06:13.832435 1238 leader_election.cc:341] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9cb0ab983a444d26b903a0cec64f15f0
W20260927 15:06:13.835635 1238 leader_election.cc:341] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 16884c7343be436aa312ec0af40f5e33
I20260927 15:06:13.837119 1556 tablet_bootstrap.cc:654] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:13.837476 1238 leader_election.cc:341] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 54a07831078b48a59807f7da4a42bcec
I20260927 15:06:13.844338 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 686) took 2433 ms. Trace:
I20260927 15:06:13.844461 2119 rpcz_store.cc:276] 0927 15:06:11.410556 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.411531 (+ 975us) service_pool.cc:227] Handling call
0927 15:06:13.419692 (+2008161us) ts_tablet_manager.cc:1145] Deleting tablet 765b3ee3323846c5ba598f47478fd367
0927 15:06:13.419705 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.515022 (+ 95317us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.618984 (+103962us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.843889 (+224905us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2007978}
I20260927 15:06:13.844805 2119 tablet_replica.cc:330] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:13.844980 2119 raft_consensus.cc:2229] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:13.845113 2119 raft_consensus.cc:2258] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:13.845635 2119 ts_tablet_manager.cc:1905] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:13.846740 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a7989e2b91044dab1d3e327958a051a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.847180 2527 raft_consensus.cc:504] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.847486 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
I20260927 15:06:13.848618 2527 leader_election.cc:288] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:13.850548 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7770c4e004ff47ecbd38f86cf7f6fe74 has no consensus state
I20260927 15:06:13.850976 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb859b43634c420382da5c201ce24dfc" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:13.851588 1376 leader_election.cc:341] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:13.852506 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb5f4a30bac94d72b5265c8a7a0d4d59 consensus state has no leader
I20260927 15:06:13.855954 913 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
I20260927 15:06:13.856585 1552 tablet_bootstrap.cc:492] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:13.856732 1552 ts_tablet_manager.cc:1397] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.346s user 0.002s sys 0.002s
I20260927 15:06:13.857465 1552 raft_consensus.cc:348] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.857668 1552 raft_consensus.cc:374] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.857728 1552 raft_consensus.cc:729] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.857975 1552 consensus_queue.cc:260] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.858526 1552 ts_tablet_manager.cc:1428] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260927 15:06:13.859320 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 318e4bf9d50f4fe6858e438ccf2544bf (DEFAULT_TABLE table=default.Table_a6c0a227327c4e8e87ebe7347f94106f [id=9d4eedcce12640e1b5b65004874f9bdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.859707 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318e4bf9d50f4fe6858e438ccf2544bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.861052 1552 tablet_bootstrap.cc:492] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:13.861413 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d25d98b148a94de4bba78a6969e81430 consensus state has no leader
I20260927 15:06:13.862988 1552 tablet_bootstrap.cc:654] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.863399 1416 tablet_service.cc:1467] Processing CreateTablet for tablet bd0e035cec844fe789fdc815644fc025 (DEFAULT_TABLE table=default.Table_a9af2f731b594d44b346599087573311 [id=ae701d98419e4d69a7aa4f5bc4f2be0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.864791 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_610a8aaf0f9a4a499029e51d3e290e1a" } modify_external_catalogs: true
I20260927 15:06:13.865002 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_610a8aaf0f9a4a499029e51d3e290e1a" } modify_external_catalogs: true
I20260927 15:06:13.865101 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd0e035cec844fe789fdc815644fc025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.865471 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 04483a489f254123a1ccd69667acb0b1 (DEFAULT_TABLE table=default.Table_bb0cfb89d00b491285ded7ae087d8315 [id=ae2447af731a49c38ce43b9d1acfba1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.865832 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04483a489f254123a1ccd69667acb0b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.872160 1401 tablet_service.cc:1467] Processing CreateTablet for tablet b0b25e485f3d4e6780cd34d9e13fa807 (DEFAULT_TABLE table=default.Table_f09aa55cb7dc412682bd75ac25798b44 [id=70d93f35cff84a1e8ee46046e781887c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.801518 2423 raft_consensus.cc:504] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.872568 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0b25e485f3d4e6780cd34d9e13fa807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.872848 2423 leader_election.cc:288] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.824044 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a7989e2b91044dab1d3e327958a051a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.824887 2289 raft_consensus.cc:482] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.830843 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe7816e099094d13887650fc223097c7" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.873109 2289 raft_consensus.cc:504] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.835722 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb859b43634c420382da5c201ce24dfc" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.873677 2289 leader_election.cc:288] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:13.873756 1374 leader_election.cc:341] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.873878 1374 leader_election.cc:302] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:13.874048 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04007cd4bd214b88a4664e23daf4b790" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:13.874195 2446 raft_consensus.cc:2726] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:13.874534 1102 leader_election.cc:341] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.875262 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1a05574f0f734e6d912b375137482a21
I20260927 15:06:13.875213 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9049d003d787403f80aa0c08872dd3b5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:13.875645 1102 leader_election.cc:341] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.875833 1561 raft_consensus.cc:374] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.875922 1561 raft_consensus.cc:729] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.876226 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a05574f0f734e6d912b375137482a21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.876380 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 29c5d4cfb0d84d30896c0c7913c4d82b
I20260927 15:06:13.876432 1561 consensus_queue.cc:260] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.877017 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c5d4cfb0d84d30896c0c7913c4d82b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.877282 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a05574f0f734e6d912b375137482a21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.877343 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c5d4cfb0d84d30896c0c7913c4d82b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.843381 2431 raft_consensus.cc:482] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.848369 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c49913b1763c4a7b9413a801aff93b30" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:13.880544 1163 raft_consensus.cc:3037] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.858948 1140 tablet_service.cc:1467] Processing CreateTablet for tablet bd0e035cec844fe789fdc815644fc025 (DEFAULT_TABLE table=default.Table_a9af2f731b594d44b346599087573311 [id=ae701d98419e4d69a7aa4f5bc4f2be0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.881031 911 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 586249c75cd64353baa4aadc8e6ea597
I20260927 15:06:13.881083 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd0e035cec844fe789fdc815644fc025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.882198 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 8790d59beb804acb8e4353f862d7f6f8 with delete_type TABLET_DATA_DELETED (replaced by tablet fd5f2ab9677c4598b0b8d9a93a6a23c7) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.859254 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 04483a489f254123a1ccd69667acb0b1 (DEFAULT_TABLE table=default.Table_bb0cfb89d00b491285ded7ae087d8315 [id=ae2447af731a49c38ce43b9d1acfba1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.862010 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 318e4bf9d50f4fe6858e438ccf2544bf (DEFAULT_TABLE table=default.Table_a6c0a227327c4e8e87ebe7347f94106f [id=9d4eedcce12640e1b5b65004874f9bdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.884490 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 5f45402b4bc648518433809e28f9444d (DEFAULT_TABLE table=default.Table_85b48f7c2577445481e4ab0d007cf052 [id=ccff3ee07cf549f3a57643b81b8cced2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.884701 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 1e1ae6251bc343b0bd0fbf627083ffb9 (DEFAULT_TABLE table=default.Table_005da4afcceb4fb1830e88ae975dff16 [id=2108107a16de437fb5ba00dc3021ed10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.884949 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 1e1ae6251bc343b0bd0fbf627083ffb9 (DEFAULT_TABLE table=default.Table_005da4afcceb4fb1830e88ae975dff16 [id=2108107a16de437fb5ba00dc3021ed10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.884992 1141 tablet_service.cc:1467] Processing CreateTablet for tablet b0b25e485f3d4e6780cd34d9e13fa807 (DEFAULT_TABLE table=default.Table_f09aa55cb7dc412682bd75ac25798b44 [id=70d93f35cff84a1e8ee46046e781887c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.884708 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04483a489f254123a1ccd69667acb0b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.885424 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318e4bf9d50f4fe6858e438ccf2544bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.885563 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0b25e485f3d4e6780cd34d9e13fa807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.885717 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e1ae6251bc343b0bd0fbf627083ffb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.885947 2431 raft_consensus.cc:504] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:13.889618 2431 leader_election.cc:288] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.889973 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9049d003d787403f80aa0c08872dd3b5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:13.890246 1438 raft_consensus.cc:3037] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.892946 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04007cd4bd214b88a4664e23daf4b790" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:13.889621 1561 ts_tablet_manager.cc:1428] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.111s user 0.002s sys 0.002s
I20260927 15:06:13.893304 1437 raft_consensus.cc:2454] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:13.893505 1561 tablet_bootstrap.cc:492] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:13.893981 1552 tablet_bootstrap.cc:492] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:13.893914 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 5f45402b4bc648518433809e28f9444d (DEFAULT_TABLE table=default.Table_85b48f7c2577445481e4ab0d007cf052 [id=ccff3ee07cf549f3a57643b81b8cced2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.894357 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f45402b4bc648518433809e28f9444d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.896199 1552 ts_tablet_manager.cc:1397] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.003s
I20260927 15:06:13.896926 1552 raft_consensus.cc:348] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.897122 1552 raft_consensus.cc:374] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.897580 1099 leader_election.cc:302] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.897164 1552 raft_consensus.cc:729] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.899084 1552 consensus_queue.cc:260] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.899765 2365 raft_consensus.cc:504] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.900372 2365 leader_election.cc:288] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.900509 2365 raft_consensus.cc:2781] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.900564 2365 raft_consensus.cc:482] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.900619 2365 raft_consensus.cc:3037] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.901516 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424b66c69254487f932894516d570204" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:13.901607 1552 ts_tablet_manager.cc:1428] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260927 15:06:13.901713 1437 raft_consensus.cc:2454] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:13.901903 1552 tablet_bootstrap.cc:492] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:13.902166 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424b66c69254487f932894516d570204" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:13.902649 1102 leader_election.cc:341] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.904104 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 598) took 5433 ms. Trace:
I20260927 15:06:13.904222 1562 rpcz_store.cc:276] 0927 15:06:08.470201 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.516792 (+ 46591us) service_pool.cc:227] Handling call
0927 15:06:13.524002 (+5007210us) ts_tablet_manager.cc:1145] Deleting tablet 75537edf83a040cba4da502c726bf456
0927 15:06:13.524009 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.606154 (+ 82145us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.706077 (+ 99923us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.904077 (+198000us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4811332}
I20260927 15:06:13.904729 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 597) took 5437 ms. Trace:
I20260927 15:06:13.904806 1562 rpcz_store.cc:276] 0927 15:06:08.470047 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.526013 (+ 55966us) service_pool.cc:227] Handling call
0927 15:06:13.904579 (+5378566us) ts_tablet_manager.cc:1145] Deleting tablet 4714d536373a4bf2a4be9ebeaebe77c1
0927 15:06:13.904594 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.904712 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5165815}
I20260927 15:06:13.905179 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 601) took 5155 ms. Trace:
I20260927 15:06:13.905277 1562 rpcz_store.cc:276] 0927 15:06:08.749233 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.749278 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:13.905066 (+5155788us) ts_tablet_manager.cc:1145] Deleting tablet 278205071701447e8ee7457b2ee84be4
0927 15:06:13.905078 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.905162 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5155276}
I20260927 15:06:13.905551 1099 leader_election.cc:302] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.905616 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 602) took 5145 ms. Trace:
I20260927 15:06:13.905700 1562 rpcz_store.cc:276] 0927 15:06:08.759718 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.759770 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:13.905513 (+5145743us) ts_tablet_manager.cc:1145] Deleting tablet 12f6403cde734c1394aabfc92c093290
0927 15:06:13.905523 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.905600 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5139663}
I20260927 15:06:13.905979 1562 tablet_replica.cc:330] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:13.906200 1562 raft_consensus.cc:2229] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:13.906342 1562 raft_consensus.cc:2258] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:13.907194 1562 ts_tablet_manager.cc:1905] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:13.907572 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0129eaa5636544e696076e439d713b1b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:13.908178 1102 leader_election.cc:341] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:13.908380 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 75537edf83a040cba4da502c726bf456 (table default.Table_8472d420763f4fd59e6814326d75b8d7 [id=2637a7b31e84469c82b01a83a6edc97d]) successfully deleted
I20260927 15:06:13.908252 2531 raft_consensus.cc:504] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:13.908643 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 4714d536373a4bf2a4be9ebeaebe77c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4714d536373a4bf2a4be9ebeaebe77c1 already in progress: creating tablet
W20260927 15:06:13.908864 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 278205071701447e8ee7457b2ee84be4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 278205071701447e8ee7457b2ee84be4 already in progress: creating tablet
I20260927 15:06:13.908905 2531 leader_election.cc:288] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:13.909019 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 12f6403cde734c1394aabfc92c093290 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12f6403cde734c1394aabfc92c093290 already in progress: creating tablet
I20260927 15:06:13.910951 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 51f0744f9d804b84a958916c2dd04503 (DEFAULT_TABLE table=default.Table_92cb4bf60a5c4bbeb19ad542a71d46e4 [id=da149c34af0947f9be31b90f531305ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.911130 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f45402b4bc648518433809e28f9444d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.911178 2233 ts_tablet_manager.cc:1918] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:13.911273 2233 log.cc:1196] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/75537edf83a040cba4da502c726bf456
I20260927 15:06:13.911336 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51f0744f9d804b84a958916c2dd04503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.911574 2233 ts_tablet_manager.cc:1939] T 75537edf83a040cba4da502c726bf456 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:13.912807 1552 tablet_bootstrap.cc:654] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.913573 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e1ae6251bc343b0bd0fbf627083ffb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.914139 1561 tablet_bootstrap.cc:654] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.919178 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 51f0744f9d804b84a958916c2dd04503 (DEFAULT_TABLE table=default.Table_92cb4bf60a5c4bbeb19ad542a71d46e4 [id=da149c34af0947f9be31b90f531305ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.919564 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51f0744f9d804b84a958916c2dd04503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.919617 907 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet dd2687f65780481c86a9942960ce7be1 (table default.Table_0c4d630a1b634322b0d6ffdf591dfc97 [id=a56919bbdc0146839e84fcc1224c6b8f]). Expected version 1 got 0
I20260927 15:06:13.919885 907 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
I20260927 15:06:13.922276 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48e7eac8753f425d90302360d228ee54" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:13.922497 1164 raft_consensus.cc:3037] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.923915 2431 raft_consensus.cc:2781] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.924001 2431 raft_consensus.cc:482] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.924065 2431 raft_consensus.cc:3037] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.924419 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0129eaa5636544e696076e439d713b1b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:13.924608 1437 raft_consensus.cc:3037] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.925843 1438 raft_consensus.cc:2454] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:13.926304 1099 leader_election.cc:302] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:13.926690 2289 raft_consensus.cc:2781] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.926839 2289 raft_consensus.cc:686] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:13.927168 2289 consensus_queue.cc:237] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.929352 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.931222 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e5eb2d8b1a334f3ba5ab54469e2071a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.931838 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5eb2d8b1a334f3ba5ab54469e2071a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.933236 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2862452a601c44a69e65c1e58211f3bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.933795 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2862452a601c44a69e65c1e58211f3bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:13.937134 1238 leader_election.cc:341] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: fe7816e099094d13887650fc223097c7
I20260927 15:06:13.937201 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_81f0d439c6f4400abf00d3fbfb715ee1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:13.937544 1238 leader_election.cc:302] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.937808 2527 raft_consensus.cc:2726] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.937973 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 1024b38f06bb4387bd24e98f0dee038c (DEFAULT_TABLE table=default.Table_c46dfcd5448b4996b4ec02c8e39a25e4 [id=f0ae105e934d414cb53fa72e40197e5d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:13.938050 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81f0d439c6f4400abf00d3fbfb715ee1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.938362 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1024b38f06bb4387bd24e98f0dee038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.940492 2527 raft_consensus.cc:482] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:13.940642 2527 raft_consensus.cc:504] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.941195 2527 leader_election.cc:288] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.942178 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b375902081c54cdb84fdb075eec6baf7" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:13.942298 1284 tablet_service.cc:1467] Processing CreateTablet for tablet bd0e035cec844fe789fdc815644fc025 (DEFAULT_TABLE table=default.Table_a9af2f731b594d44b346599087573311 [id=ae701d98419e4d69a7aa4f5bc4f2be0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.942425 1166 raft_consensus.cc:2454] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:13.943014 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 04483a489f254123a1ccd69667acb0b1 (DEFAULT_TABLE table=default.Table_bb0cfb89d00b491285ded7ae087d8315 [id=ae2447af731a49c38ce43b9d1acfba1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.943606 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 318e4bf9d50f4fe6858e438ccf2544bf (DEFAULT_TABLE table=default.Table_a6c0a227327c4e8e87ebe7347f94106f [id=9d4eedcce12640e1b5b65004874f9bdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.944021 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet dc6f179aab784ae4822356e63332532f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.945077 1239 leader_election.cc:302] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:13.945181 1266 tablet_service.cc:1467] Processing CreateTablet for tablet b0b25e485f3d4e6780cd34d9e13fa807 (DEFAULT_TABLE table=default.Table_f09aa55cb7dc412682bd75ac25798b44 [id=70d93f35cff84a1e8ee46046e781887c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.945382 2527 raft_consensus.cc:2781] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:13.945475 2527 raft_consensus.cc:482] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:13.945602 2527 raft_consensus.cc:3037] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.945680 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a05574f0f734e6d912b375137482a21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.945992 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c5d4cfb0d84d30896c0c7913c4d82b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.946468 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 1e1ae6251bc343b0bd0fbf627083ffb9 (DEFAULT_TABLE table=default.Table_005da4afcceb4fb1830e88ae975dff16 [id=2108107a16de437fb5ba00dc3021ed10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.946600 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0021fd56477c4debbfe492c5673d41c2" } modify_external_catalogs: true
I20260927 15:06:13.946792 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0021fd56477c4debbfe492c5673d41c2" } modify_external_catalogs: true
I20260927 15:06:13.947139 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 5f45402b4bc648518433809e28f9444d (DEFAULT_TABLE table=default.Table_85b48f7c2577445481e4ab0d007cf052 [id=ccff3ee07cf549f3a57643b81b8cced2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.948166 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 51f0744f9d804b84a958916c2dd04503 (DEFAULT_TABLE table=default.Table_92cb4bf60a5c4bbeb19ad542a71d46e4 [id=da149c34af0947f9be31b90f531305ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.948645 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_570d1e19c0ad439298f5a54fac20ff7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.949235 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_570d1e19c0ad439298f5a54fac20ff7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.950937 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b045b82515540e8813f9250726479e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:13.951938 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 1024b38f06bb4387bd24e98f0dee038c (DEFAULT_TABLE table=default.Table_c46dfcd5448b4996b4ec02c8e39a25e4 [id=f0ae105e934d414cb53fa72e40197e5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.952272 1552 tablet_bootstrap.cc:492] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:13.952446 1552 ts_tablet_manager.cc:1397] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.002s
I20260927 15:06:13.953522 1552 raft_consensus.cc:348] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.953768 1552 raft_consensus.cc:374] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.953883 1552 raft_consensus.cc:729] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.954296 1552 consensus_queue.cc:260] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.956614 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bcbaed2bd9224a0c867cb8804ce8478e
I20260927 15:06:13.957746 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet bcbaed2bd9224a0c867cb8804ce8478e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.958948 1298 raft_consensus.cc:3037] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:13.960933 1552 ts_tablet_manager.cc:1428] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260927 15:06:13.963289 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet bcbaed2bd9224a0c867cb8804ce8478e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:13.963923 1556 tablet_bootstrap.cc:492] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:13.964053 1556 ts_tablet_manager.cc:1397] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.135s user 0.002s sys 0.000s
I20260927 15:06:13.964836 1556 raft_consensus.cc:348] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.965052 1556 raft_consensus.cc:374] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:13.965114 1556 raft_consensus.cc:729] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:13.965345 1556 consensus_queue.cc:260] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:13.965746 1099 consensus_peers.cc:487] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01b7e017ead242849585679873a69b43. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:13.969082 1556 ts_tablet_manager.cc:1428] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:13.973083 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9cc5859f49a58a35460e504b3f84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:13.974221 1556 tablet_bootstrap.cc:492] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:13.978009 1416 tablet_service.cc:1467] Processing CreateTablet for tablet cd3eb83597ef4aae9bf00fcfc2517ea6 (DEFAULT_TABLE table=default.Table_3028fb3d99c84685ad117fb942f070a9 [id=ef677f118c584abe98964c4402734808]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.979017 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3eb83597ef4aae9bf00fcfc2517ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.980361 1556 tablet_bootstrap.cc:654] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:13.983990 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 1024b38f06bb4387bd24e98f0dee038c (DEFAULT_TABLE table=default.Table_c46dfcd5448b4996b4ec02c8e39a25e4 [id=f0ae105e934d414cb53fa72e40197e5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.985008 1128 tablet_service.cc:1467] Processing CreateTablet for tablet cd3eb83597ef4aae9bf00fcfc2517ea6 (DEFAULT_TABLE table=default.Table_3028fb3d99c84685ad117fb942f070a9 [id=ef677f118c584abe98964c4402734808]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.985721 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a3ced21ba58141f5bafa240f002887b7" } new_table_name: "default.Table_37218c1a7b094f29ab2a481292650fb5" modify_external_catalogs: true
I20260927 15:06:13.986392 1552 tablet_bootstrap.cc:492] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:13.987777 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_27ad686afe10424180ba09fa60122958"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:13.987984 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_779ab963c30743b88c0399bf522b1ef3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:13.988520 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27ad686afe10424180ba09fa60122958 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:13.988605 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_779ab963c30743b88c0399bf522b1ef3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:13.991334 1163 raft_consensus.cc:2454] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:13.991813 1303 raft_consensus.cc:2454] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:13.992338 2436 raft_consensus.cc:2726] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:13.993214 2119 ts_tablet_manager.cc:1918] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:13.993368 2119 log.cc:1196] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/fde632b187eb4180b343d7bddc7f0943
I20260927 15:06:13.993791 2119 ts_tablet_manager.cc:1939] T fde632b187eb4180b343d7bddc7f0943 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:13.994078 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04483a489f254123a1ccd69667acb0b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.994969 1239 leader_election.cc:302] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:13.995317 2436 raft_consensus.cc:2781] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.995465 2436 raft_consensus.cc:686] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:13.995736 2436 consensus_queue.cc:237] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.996299 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 4d4c717419864473b7cd47ece4ffd805 (DEFAULT_TABLE table=default.Table_b940bc9596784c36a9dffa12ac026b33 [id=64b1a2a1b0e348ea8aa3b61f14053bdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:13.996920 1102 leader_election.cc:302] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:13.997375 2423 raft_consensus.cc:2781] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:13.997288 2544 raft_consensus.cc:504] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:13.997500 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9fecfb2325046f98e69797ff8342892 consensus state has no leader
I20260927 15:06:13.997501 2423 raft_consensus.cc:686] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:13.997738 2423 consensus_queue.cc:237] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:13.997967 2544 leader_election.cc:288] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:13.998781 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318e4bf9d50f4fe6858e438ccf2544bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.999310 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0b25e485f3d4e6780cd34d9e13fa807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:13.999733 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e1ae6251bc343b0bd0fbf627083ffb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.000140 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f45402b4bc648518433809e28f9444d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.000536 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51f0744f9d804b84a958916c2dd04503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.003728 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 4d4c717419864473b7cd47ece4ffd805 (DEFAULT_TABLE table=default.Table_b940bc9596784c36a9dffa12ac026b33 [id=64b1a2a1b0e348ea8aa3b61f14053bdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.004127 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d4c717419864473b7cd47ece4ffd805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.006294 1132 tablet_service.cc:1467] Processing CreateTablet for tablet ad445390e18245f68430c0590a378a91 (DEFAULT_TABLE table=default.Table_e63f743dfca44a18bed170b2cd50f413 [id=43b7f5a1d5a3459a92ae578c475a7bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.007131 1401 tablet_service.cc:1467] Processing CreateTablet for tablet ad445390e18245f68430c0590a378a91 (DEFAULT_TABLE table=default.Table_e63f743dfca44a18bed170b2cd50f413 [id=43b7f5a1d5a3459a92ae578c475a7bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.007474 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad445390e18245f68430c0590a378a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.010087 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 749) took 2574 ms. Trace:
I20260927 15:06:14.010177 2233 rpcz_store.cc:276] 0927 15:06:11.436053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.440831 (+ 4778us) service_pool.cc:227] Handling call
0927 15:06:13.748312 (+2307481us) ts_tablet_manager.cc:1145] Deleting tablet 75537edf83a040cba4da502c726bf456
0927 15:06:13.748324 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.851977 (+103653us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.911080 (+ 59103us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.010065 (+ 98985us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62116,"tablet-delete.queue_time_us":2307305}
I20260927 15:06:14.010492 2233 tablet_replica.cc:330] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:14.010663 2233 raft_consensus.cc:2229] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.010790 2233 raft_consensus.cc:2258] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.011338 2233 ts_tablet_manager.cc:1905] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.013715 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd0e035cec844fe789fdc815644fc025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.015149 1437 raft_consensus.cc:2454] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:14.016804 2525 raft_consensus.cc:504] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.017472 2525 leader_election.cc:288] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.020407 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1024b38f06bb4387bd24e98f0dee038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.023415 2365 raft_consensus.cc:504] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.024101 2365 leader_election.cc:288] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.024358 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3eb83597ef4aae9bf00fcfc2517ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.025770 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1024b38f06bb4387bd24e98f0dee038c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.025976 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2f802c3bc340435a81cd94fdb4133818" } modify_external_catalogs: true
I20260927 15:06:14.026201 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2f802c3bc340435a81cd94fdb4133818" } modify_external_catalogs: true
I20260927 15:06:14.031134 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 75537edf83a040cba4da502c726bf456 (table default.Table_8472d420763f4fd59e6814326d75b8d7 [id=2637a7b31e84469c82b01a83a6edc97d]) successfully deleted
I20260927 15:06:14.031283 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d4c717419864473b7cd47ece4ffd805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.032328 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbb2131b0f54a7eb74c5d3cba962860 (DEFAULT_TABLE table=default.Table_e58cc7be8a9e46679f4791225ae99f5a [id=6b905634843f4cf891ef9b6244ecebef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.032717 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbb2131b0f54a7eb74c5d3cba962860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.033294 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54a07831078b48a59807f7da4a42bcec" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:14.033499 1163 raft_consensus.cc:3037] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.034215 2365 raft_consensus.cc:482] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.034334 2365 raft_consensus.cc:504] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.034935 2365 leader_election.cc:288] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.034973 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16884c7343be436aa312ec0af40f5e33" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:14.035140 1162 raft_consensus.cc:3037] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.037177 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 1ccf0780e10445c9ac9a91cbd4052e88 (DEFAULT_TABLE table=default.Table_d0c335be286f4131aa7cf4428ffa5c5c [id=897c3e94bd394d2298c35c3c33ecdac4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.037686 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 7770c4e004ff47ecbd38f86cf7f6fe74 (DEFAULT_TABLE table=default.Table_7bbeb71422fd42a0a370d2ed36b85d17 [id=f031c428665e47f1a5e80f1486e6df6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.038162 1162 raft_consensus.cc:2454] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:14.039333 1164 raft_consensus.cc:2454] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:14.039345 2527 raft_consensus.cc:504] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.039980 2527 leader_election.cc:288] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.040434 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbb2131b0f54a7eb74c5d3cba962860 (DEFAULT_TABLE table=default.Table_e58cc7be8a9e46679f4791225ae99f5a [id=6b905634843f4cf891ef9b6244ecebef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.041009 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9c7849817c4157916905216ad6b632 (DEFAULT_TABLE table=default.Table_bb70418fb7a04a5ab0b3b114e8c4fb6d [id=f228d6a6e9784f48b48e2aeaa6bdbca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.041452 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 1ccf0780e10445c9ac9a91cbd4052e88 (DEFAULT_TABLE table=default.Table_d0c335be286f4131aa7cf4428ffa5c5c [id=897c3e94bd394d2298c35c3c33ecdac4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.041857 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ccf0780e10445c9ac9a91cbd4052e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.042068 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad445390e18245f68430c0590a378a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.041921 2431 raft_consensus.cc:504] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:14.042486 2431 leader_election.cc:288] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.048847 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8d059dff614841a79674d17dfc8870cb
I20260927 15:06:14.051403 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9c7849817c4157916905216ad6b632 (DEFAULT_TABLE table=default.Table_bb70418fb7a04a5ab0b3b114e8c4fb6d [id=f228d6a6e9784f48b48e2aeaa6bdbca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.051803 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9c7849817c4157916905216ad6b632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.055166 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 82482572a07741d0ab1809f04dd24ad1 (DEFAULT_TABLE table=default.Table_0429ce74c70c4b5488ea76ad4707da49 [id=743dd552ea9c45b6a31db3fd4cde43df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.055641 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82482572a07741d0ab1809f04dd24ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.057578 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 927c8bd9afc54836922dc6d3cc472946 (DEFAULT_TABLE table=default.Table_992c531b10424b57a812f821b5bd99bf [id=9a6757ecfe864da7a72798efb131a53f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.058050 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 927c8bd9afc54836922dc6d3cc472946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.059501 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 82482572a07741d0ab1809f04dd24ad1 (DEFAULT_TABLE table=default.Table_0429ce74c70c4b5488ea76ad4707da49 [id=743dd552ea9c45b6a31db3fd4cde43df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.059935 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82482572a07741d0ab1809f04dd24ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.061702 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cfd50ce3e28949c6a277273769c7d2e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.062302 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfd50ce3e28949c6a277273769c7d2e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.064607 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d059dff614841a79674d17dfc8870cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.064568 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_912bad2648f24770970d14968ca68a96" } new_table_name: "default.Table_9a249598fc224c4aaa011514c9a27cab" modify_external_catalogs: true
I20260927 15:06:14.065991 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8a01cb508f7143c699903f946e72bacf" } new_table_name: "default.Table_d107a6a7fa684882b689e8797efe6667" modify_external_catalogs: true
I20260927 15:06:14.066869 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d059dff614841a79674d17dfc8870cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.068773 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 684) took 2658 ms. Trace:
I20260927 15:06:14.068960 2119 rpcz_store.cc:276] 0927 15:06:11.410306 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.411772 (+ 1466us) service_pool.cc:227] Handling call
0927 15:06:13.844750 (+2432978us) ts_tablet_manager.cc:1145] Deleting tablet fde632b187eb4180b343d7bddc7f0943
0927 15:06:13.844761 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.908665 (+ 63904us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:13.993054 (+ 84389us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.068728 (+ 75674us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2432719}
I20260927 15:06:14.069399 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 692) took 2529 ms. Trace:
I20260927 15:06:14.069514 2119 rpcz_store.cc:276] 0927 15:06:11.539503 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.539590 (+ 87us) service_pool.cc:227] Handling call
0927 15:06:14.069260 (+2529670us) ts_tablet_manager.cc:1145] Deleting tablet 0a64059ef2234ad6adbdfd8d3576f2a6
0927 15:06:14.069272 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.069364 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2529293}
I20260927 15:06:14.069840 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 693) took 2529 ms. Trace:
I20260927 15:06:14.069967 2119 rpcz_store.cc:276] 0927 15:06:11.540524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.540586 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:14.069722 (+2529136us) ts_tablet_manager.cc:1145] Deleting tablet 70cc2e16bd6c40bf99ed4436f17d7096
0927 15:06:14.069730 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.069798 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2528861}
I20260927 15:06:14.070272 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 694) took 2512 ms. Trace:
I20260927 15:06:14.070382 2119 rpcz_store.cc:276] 0927 15:06:11.557818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.557872 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:14.070155 (+2512283us) ts_tablet_manager.cc:1145] Deleting tablet 955461f27b6444d4b4c3f9a9f629d5e3
0927 15:06:14.070165 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.070233 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2512093}
I20260927 15:06:14.070627 2119 tablet_replica.cc:330] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.071364 1562 ts_tablet_manager.cc:1918] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.071497 1562 log.cc:1196] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/65c313ab6848428d8237557392669f6f
I20260927 15:06:14.071852 1562 ts_tablet_manager.cc:1939] T 65c313ab6848428d8237557392669f6f P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:14.072361 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ccf0780e10445c9ac9a91cbd4052e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.072849 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7770c4e004ff47ecbd38f86cf7f6fe74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.073215 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbb2131b0f54a7eb74c5d3cba962860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.073657 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9c7849817c4157916905216ad6b632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.075205 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c46dfcd5448b4996b4ec02c8e39a25e4" } new_table_name: "default.Table_b2f533f5104548d88d8fae693168a8b6" modify_external_catalogs: true
I20260927 15:06:14.077900 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 7770c4e004ff47ecbd38f86cf7f6fe74 (DEFAULT_TABLE table=default.Table_7bbeb71422fd42a0a370d2ed36b85d17 [id=f031c428665e47f1a5e80f1486e6df6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.078680 2431 raft_consensus.cc:482] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.078727 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7770c4e004ff47ecbd38f86cf7f6fe74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.078853 2431 raft_consensus.cc:504] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.079493 2431 leader_election.cc:288] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.079653 2119 raft_consensus.cc:2229] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.079849 2119 raft_consensus.cc:2258] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.084069 2429 consensus_queue.cc:1035] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:14.085950 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b375902081c54cdb84fdb075eec6baf7" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:14.086174 1162 raft_consensus.cc:3037] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.086906 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_43b9d3086ec24ab3b899f51a4856222c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.087499 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43b9d3086ec24ab3b899f51a4856222c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.088780 1162 raft_consensus.cc:2454] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:14.094149 1099 leader_election.cc:302] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:14.095975 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424b66c69254487f932894516d570204" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:14.096120 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_76972cc723b84c24856db8afb0f9c6f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.096774 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76972cc723b84c24856db8afb0f9c6f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.096791 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5cd55de34d249bc8d3adcf4690f0414" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:14.097000 1436 raft_consensus.cc:2454] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:14.097450 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_567fc896d4c84f7da0e0933e6f6965de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.097965 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_567fc896d4c84f7da0e0933e6f6965de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.098085 2429 raft_consensus.cc:2781] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.098229 2429 raft_consensus.cc:686] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:14.098498 2429 consensus_queue.cc:237] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.098632 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4a1df0232ef7431f9f29870cfd637429" } modify_external_catalogs: true
I20260927 15:06:14.098863 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4a1df0232ef7431f9f29870cfd637429" } modify_external_catalogs: true
I20260927 15:06:14.099267 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e39959afca93471b81608a47e490da22" } new_table_name: "default.Table_ee20f4e8d38543c38d6f044d132b3a27" modify_external_catalogs: true
I20260927 15:06:14.099862 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4bd8182c9d48c7b6e6175ab98d405a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:14.100059 1438 raft_consensus.cc:2454] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:14.100358 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2116f8e5cf2142249d0b5f3fdbf0b209" } modify_external_catalogs: true
I20260927 15:06:14.100459 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04007cd4bd214b88a4664e23daf4b790" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:14.100605 1437 raft_consensus.cc:3037] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.100558 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2116f8e5cf2142249d0b5f3fdbf0b209" } modify_external_catalogs: true
W20260927 15:06:14.102319 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 611e63080dcb474c8dde370c54a0e777 consensus state has no leader
W20260927 15:06:14.103129 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6697c852d114b7391717c7a36749127 consensus state has no leader
I20260927 15:06:14.107956 2233 ts_tablet_manager.cc:1918] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:06:14.111191 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1024b38f06bb4387bd24e98f0dee038c consensus state has no leader
I20260927 15:06:14.117429 1163 raft_consensus.cc:2454] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
W20260927 15:06:14.118199 1099 leader_election.cc:341] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: Tablet not RUNNING: STOPPED
I20260927 15:06:14.118674 2289 raft_consensus.cc:482] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.119069 2289 raft_consensus.cc:504] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.119939 2289 leader_election.cc:288] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.119083 1099 leader_election.cc:302] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
W20260927 15:06:14.120657 1099 consensus_peers.cc:487] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a90039faff27436db7b50fa4c4643d3b. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:14.120878 1099 leader_election.cc:302] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:14.121333 2476 raft_consensus.cc:2781] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.121428 2476 raft_consensus.cc:482] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.121500 2476 raft_consensus.cc:3037] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.124460 2476 raft_consensus.cc:504] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.125136 2476 leader_election.cc:288] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.125254 2476 raft_consensus.cc:2781] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.125317 2476 raft_consensus.cc:482] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.125387 2476 raft_consensus.cc:3037] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.127921 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 603) took 5356 ms. Trace:
I20260927 15:06:14.128026 1562 rpcz_store.cc:276] 0927 15:06:08.771233 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.771295 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:13.905937 (+5134642us) ts_tablet_manager.cc:1145] Deleting tablet 65c313ab6848428d8237557392669f6f
0927 15:06:13.905948 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:13.994144 (+ 88196us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.071256 (+ 77112us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.127899 (+ 56643us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6279,"tablet-delete.queue_time_us":5128370}
I20260927 15:06:14.128425 1562 tablet_replica.cc:330] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:14.128641 1562 raft_consensus.cc:2229] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:14.128993 1562 raft_consensus.cc:2258] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.130246 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 65c313ab6848428d8237557392669f6f (table default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]) successfully deleted
I20260927 15:06:14.132982 1562 ts_tablet_manager.cc:1905] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.132915 2566 tablet.cc:1722] T 988ae3a67a4b436583cb475fbcf07b8f P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:14.136430 2476 raft_consensus.cc:504] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.140532 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7b4d8af41aa04ef3bf742ff0312c3ba6" } modify_external_catalogs: true
I20260927 15:06:14.140836 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7b4d8af41aa04ef3bf742ff0312c3ba6" } modify_external_catalogs: true
I20260927 15:06:14.128244 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 927c8bd9afc54836922dc6d3cc472946 (DEFAULT_TABLE table=default.Table_992c531b10424b57a812f821b5bd99bf [id=9a6757ecfe864da7a72798efb131a53f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.132460 2565 tablet.cc:1722] T 988ae3a67a4b436583cb475fbcf07b8f P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:14.152042 2527 raft_consensus.cc:482] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.140120 1437 raft_consensus.cc:2454] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:14.152189 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 927c8bd9afc54836922dc6d3cc472946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.153656 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04007cd4bd214b88a4664e23daf4b790" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:14.155859 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4bd8182c9d48c7b6e6175ab98d405a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.156841 1299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424b66c69254487f932894516d570204" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:14.157711 2119 ts_tablet_manager.cc:1905] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.156704 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5cd55de34d249bc8d3adcf4690f0414" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.159220 1296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5cd55de34d249bc8d3adcf4690f0414" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:14.160535 1239 leader_election.cc:302] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:14.160849 1239 leader_election.cc:302] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:14.161115 1239 leader_election.cc:302] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:14.161146 2436 raft_consensus.cc:2781] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.161324 2543 raft_consensus.cc:2781] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.161356 1239 leader_election.cc:302] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:14.161469 2543 raft_consensus.cc:686] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:14.161773 2543 consensus_queue.cc:237] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.162015 2544 raft_consensus.cc:2781] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.164304 2526 raft_consensus.cc:2781] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.164458 2526 raft_consensus.cc:686] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:14.164701 2526 consensus_queue.cc:237] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.165944 2527 raft_consensus.cc:504] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.166523 2527 leader_election.cc:288] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.166930 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4bd8182c9d48c7b6e6175ab98d405a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:14.168646 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd31ae2ac2e4bc9897724bc9012698d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.173465 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6abf703ded884d0aa2706e13cf2df6a9" } modify_external_catalogs: true
I20260927 15:06:14.177650 2233 log.cc:1196] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/424b66c69254487f932894516d570204
I20260927 15:06:14.178092 2233 ts_tablet_manager.cc:1939] T 424b66c69254487f932894516d570204 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:14.178969 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 750) took 2742 ms. Trace:
I20260927 15:06:14.179857 2476 leader_election.cc:288] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.180250 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41cd38355e64590b43b2e1271c43e91" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:14.180789 1164 raft_consensus.cc:2454] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:14.181732 1239 leader_election.cc:302] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:14.182083 2527 raft_consensus.cc:2781] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.182206 2527 raft_consensus.cc:482] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.182314 2527 raft_consensus.cc:3037] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.185299 2527 raft_consensus.cc:504] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.186035 2527 leader_election.cc:288] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.186224 2436 raft_consensus.cc:686] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:14.186529 2436 consensus_queue.cc:237] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.186801 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c41cd38355e64590b43b2e1271c43e91" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:14.187244 1164 raft_consensus.cc:3037] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:14.192260 1102 leader_election.cc:341] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:14.192456 1102 leader_election.cc:341] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:14.192670 1102 consensus_peers.cc:487] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:14.192818 1102 leader_election.cc:341] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.192894 1102 leader_election.cc:302] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:14.193224 1102 leader_election.cc:341] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:14.193586 1102 leader_election.cc:341] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.194141 1562 ts_tablet_manager.cc:1918] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:14.194269 1102 leader_election.cc:341] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:14.194763 1102 leader_election.cc:341] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.197647 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 073b995a22304b0aaf8cfd61ffd5722a
I20260927 15:06:14.197726 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bc2974e11cf1446895607b4ccec16386
I20260927 15:06:14.197880 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f68c513d45714b3eb9c20832e7117145"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:14.199585 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6492d9de2a344924b2bc60390022781a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.200162 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6492d9de2a344924b2bc60390022781a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.200752 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 073b995a22304b0aaf8cfd61ffd5722a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.200969 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet bc2974e11cf1446895607b4ccec16386 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.202230 2431 raft_consensus.cc:2726] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260927 15:06:14.205078 1102 consensus_peers.cc:487] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:14.195194 1238 leader_election.cc:341] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c49913b1763c4a7b9413a801aff93b30
W20260927 15:06:14.206269 1238 leader_election.cc:341] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 48e7eac8753f425d90302360d228ee54
I20260927 15:06:14.206386 1561 tablet_bootstrap.cc:492] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:14.206526 1561 ts_tablet_manager.cc:1397] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.313s user 0.016s sys 0.044s
I20260927 15:06:14.207301 1561 raft_consensus.cc:348] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.207533 1561 raft_consensus.cc:374] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:14.210137 1102 consensus_peers.cc:487] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:14.206350 2119 ts_tablet_manager.cc:1918] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.201957 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet bc2974e11cf1446895607b4ccec16386 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.202172 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 073b995a22304b0aaf8cfd61ffd5722a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.211232 2119 log.cc:1196] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/3a231aff1a39485db36979208d871ab3
I20260927 15:06:14.211206 2233 rpcz_store.cc:276] 0927 15:06:11.436150 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.441049 (+ 4899us) service_pool.cc:227] Handling call
0927 15:06:14.010453 (+2569404us) ts_tablet_manager.cc:1145] Deleting tablet 424b66c69254487f932894516d570204
0927 15:06:14.010464 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.014083 (+ 3619us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.107850 (+ 93767us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.178944 (+ 71094us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2569282}
I20260927 15:06:14.211900 2233 tablet_replica.cc:330] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:14.211920 2119 ts_tablet_manager.cc:1939] T 3a231aff1a39485db36979208d871ab3 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.212117 2233 raft_consensus.cc:2229] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.212289 2233 raft_consensus.cc:2258] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.212630 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 695) took 2645 ms. Trace:
I20260927 15:06:14.212849 2233 ts_tablet_manager.cc:1905] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.212821 2119 rpcz_store.cc:276] 0927 15:06:11.567541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.567592 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:14.070563 (+2502971us) ts_tablet_manager.cc:1145] Deleting tablet 3a231aff1a39485db36979208d871ab3
0927 15:06:14.070573 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.182290 (+111717us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.206185 (+ 23895us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.212560 (+ 6375us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2502682}
I20260927 15:06:14.203924 2446 raft_consensus.cc:482] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.207878 2447 raft_consensus.cc:482] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.213392 2447 raft_consensus.cc:504] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.214183 2447 leader_election.cc:288] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:14.215265 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595c84453cd84c3bb5a4d444892bf5e6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:14.215950 1374 leader_election.cc:341] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.216377 2446 raft_consensus.cc:504] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.217661 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c9cc5859f49a58a35460e504b3f84" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:14.218453 1374 leader_election.cc:341] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.218890 2446 leader_election.cc:288] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:14.221707 1164 raft_consensus.cc:2454] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:14.207585 1561 raft_consensus.cc:729] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.222170 1561 consensus_queue.cc:260] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.222728 1561 ts_tablet_manager.cc:1428] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 15:06:14.223012 1561 tablet_bootstrap.cc:492] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:14.224372 1561 tablet_bootstrap.cc:654] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.228366 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7ec45f56caa54587b84d36ab92e4c546"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.228397 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 547f5f0f1d444f348cf7efbbdf95523c consensus state has no leader
I20260927 15:06:14.228360 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1a7f84a178ab4cd6b7deeae02e1e52ec
W20260927 15:06:14.229826 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f68c513d45714b3eb9c20832e7117145 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.230436 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d22d3d3c2f4845909ca307cd51bb96e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:14.231117 2119 tablet_replica.cc:330] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.231343 2119 raft_consensus.cc:2229] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.231505 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 424b66c69254487f932894516d570204 (table default.Table_af3d6c72bfa14a6d8f04be3fb4a72235 [id=45ff9a80d85b49fc8f74596b7f1dd1ca]) successfully deleted
I20260927 15:06:14.231585 2119 raft_consensus.cc:2258] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.232491 2119 ts_tablet_manager.cc:1905] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.232453 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.220219 1552 tablet_bootstrap.cc:654] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.222461 1239 leader_election.cc:302] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
W20260927 15:06:14.227138 1238 leader_election.cc:341] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b375902081c54cdb84fdb075eec6baf7
I20260927 15:06:14.236968 2543 raft_consensus.cc:2781] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.237139 2543 raft_consensus.cc:686] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:14.237411 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet bcbaed2bd9224a0c867cb8804ce8478e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:14.237563 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d22d3d3c2f4845909ca307cd51bb96e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.237900 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet c41cd38355e64590b43b2e1271c43e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.238585 1279 tablet_service.cc:1467] Processing CreateTablet for tablet cd3eb83597ef4aae9bf00fcfc2517ea6 (DEFAULT_TABLE table=default.Table_3028fb3d99c84685ad117fb942f070a9 [id=ef677f118c584abe98964c4402734808]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.239053 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3eb83597ef4aae9bf00fcfc2517ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.239674 2571 consensus_queue.cc:1035] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:14.245620 1267 tablet_service.cc:1467] Processing CreateTablet for tablet ad445390e18245f68430c0590a378a91 (DEFAULT_TABLE table=default.Table_e63f743dfca44a18bed170b2cd50f413 [id=43b7f5a1d5a3459a92ae578c475a7bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.246034 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad445390e18245f68430c0590a378a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.249403 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_cfbd877cee6b474bb10ac032debb9d69 [id=19258732f721448fadcdb38690160dd4] alter complete (version 3)
I20260927 15:06:14.250787 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet c90e5c66d8564f68b401b3e4280499a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.250861 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.251484 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ff7e9f1a134c4f839069e2670ee81272"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.252171 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff7e9f1a134c4f839069e2670ee81272 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.252079 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6abf703ded884d0aa2706e13cf2df6a9" } modify_external_catalogs: true
I20260927 15:06:14.252799 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbb2131b0f54a7eb74c5d3cba962860 (DEFAULT_TABLE table=default.Table_e58cc7be8a9e46679f4791225ae99f5a [id=6b905634843f4cf891ef9b6244ecebef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.253238 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbb2131b0f54a7eb74c5d3cba962860. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:14.253543 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ec45f56caa54587b84d36ab92e4c546 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.258024 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b1562c61fb3447a9b59d1069cbebee7d" } new_table_name: "default.Table_50835d1170044558b96537c8ecdb13de" modify_external_catalogs: true
I20260927 15:06:14.260179 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 1f9c7849817c4157916905216ad6b632 (DEFAULT_TABLE table=default.Table_bb70418fb7a04a5ab0b3b114e8c4fb6d [id=f228d6a6e9784f48b48e2aeaa6bdbca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.260653 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f9c7849817c4157916905216ad6b632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.263207 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 82482572a07741d0ab1809f04dd24ad1 (DEFAULT_TABLE table=default.Table_0429ce74c70c4b5488ea76ad4707da49 [id=743dd552ea9c45b6a31db3fd4cde43df]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:14.263535 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 142664us
I20260927 15:06:14.263636 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82482572a07741d0ab1809f04dd24ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.264307 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d6ad9c3cd0f24d0bb3360c5847ae34dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.264919 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6ad9c3cd0f24d0bb3360c5847ae34dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.237417 2543 consensus_queue.cc:237] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.268983 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 1ccf0780e10445c9ac9a91cbd4052e88 (DEFAULT_TABLE table=default.Table_d0c335be286f4131aa7cf4428ffa5c5c [id=897c3e94bd394d2298c35c3c33ecdac4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.269498 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ccf0780e10445c9ac9a91cbd4052e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.271150 2119 ts_tablet_manager.cc:1918] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.271777 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c5de1bf320ca4043b31154380710ad79
I20260927 15:06:14.273303 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet c5de1bf320ca4043b31154380710ad79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.273783 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5c817097aae54fadb81259c5729c0b56" } modify_external_catalogs: true
I20260927 15:06:14.274012 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5c817097aae54fadb81259c5729c0b56" } modify_external_catalogs: true
I20260927 15:06:14.274596 2119 log.cc:1196] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/ad5af5df58824fe88d607a93216bd228
I20260927 15:06:14.274802 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet c5de1bf320ca4043b31154380710ad79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.275444 2119 ts_tablet_manager.cc:1939] T ad5af5df58824fe88d607a93216bd228 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:14.280414 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 538a0577d6ce4898828aa0d1ea2a1c85 consensus state has no leader
I20260927 15:06:14.276832 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 4d4c717419864473b7cd47ece4ffd805 (DEFAULT_TABLE table=default.Table_b940bc9596784c36a9dffa12ac026b33 [id=64b1a2a1b0e348ea8aa3b61f14053bdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.280947 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d4c717419864473b7cd47ece4ffd805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.287252 1099 leader_election.cc:302] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:14.288483 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 75360.2us
I20260927 15:06:14.288975 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e9f171fd62d644f38262a2257d47fafe
I20260927 15:06:14.290640 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet e9f171fd62d644f38262a2257d47fafe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.289971 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet e9f171fd62d644f38262a2257d47fafe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.292466 2568 raft_consensus.cc:2781] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.292639 2568 raft_consensus.cc:686] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:14.292778 2544 raft_consensus.cc:686] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:14.292706 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd31ae2ac2e4bc9897724bc9012698d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:14.292963 1437 raft_consensus.cc:2454] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:14.292940 2568 consensus_queue.cc:237] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.293110 2544 consensus_queue.cc:237] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.294029 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595c84453cd84c3bb5a4d444892bf5e6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.296316 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 7770c4e004ff47ecbd38f86cf7f6fe74 (DEFAULT_TABLE table=default.Table_7bbeb71422fd42a0a370d2ed36b85d17 [id=f031c428665e47f1a5e80f1486e6df6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.296409 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c9cc5859f49a58a35460e504b3f84" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.296754 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7770c4e004ff47ecbd38f86cf7f6fe74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.297796 2512 tablet.cc:1722] T 988ae3a67a4b436583cb475fbcf07b8f P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:14.304199 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5cd55de34d249bc8d3adcf4690f0414" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:14.304425 1437 raft_consensus.cc:3037] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.305802 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 073b995a22304b0aaf8cfd61ffd5722a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.306259 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.306643 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet c5de1bf320ca4043b31154380710ad79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.307364 1437 raft_consensus.cc:2454] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:14.307637 1556 tablet_bootstrap.cc:492] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:14.307770 1556 ts_tablet_manager.cc:1397] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.334s user 0.002s sys 0.002s
I20260927 15:06:14.308928 1556 raft_consensus.cc:348] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.309140 1556 raft_consensus.cc:374] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.309202 1556 raft_consensus.cc:729] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.309506 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d059dff614841a79674d17dfc8870cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.311255 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet dd2687f65780481c86a9942960ce7be1 (table default.Table_0c4d630a1b634322b0d6ffdf591dfc97 [id=a56919bbdc0146839e84fcc1224c6b8f]). Expected version 1 got 0
I20260927 15:06:14.313956 2569 raft_consensus.cc:482] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.314163 2569 raft_consensus.cc:504] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.314919 2569 leader_election.cc:288] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.315532 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8790d59beb804acb8e4353f862d7f6f8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:14.316149 1102 leader_election.cc:341] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.318791 1552 tablet_bootstrap.cc:492] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:14.319458 1552 ts_tablet_manager.cc:1397] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.333s user 0.005s sys 0.006s
I20260927 15:06:14.320307 1552 raft_consensus.cc:348] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.320412 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_005da4afcceb4fb1830e88ae975dff16" } new_table_name: "default.Table_34c904ce85ba45cf9da106351336b517" modify_external_catalogs: true
I20260927 15:06:14.319047 2566 tablet.cc:1722] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:14.280442 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 697) took 2306 ms. Trace:
I20260927 15:06:14.322897 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a9af2f731b594d44b346599087573311" } new_table_name: "default.Table_646b4123f3f64322ae6a01a54206087b" modify_external_catalogs: true
I20260927 15:06:14.325141 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f1205bedaac343b3bb93938eb3835eb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.325774 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1205bedaac343b3bb93938eb3835eb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.327966 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet e9f171fd62d644f38262a2257d47fafe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.194269 1562 log.cc:1196] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/f585bcdadbcc4032aa484481cdf94b72
I20260927 15:06:14.328756 1562 ts_tablet_manager.cc:1939] T f585bcdadbcc4032aa484481cdf94b72 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:14.329604 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 604) took 5511 ms. Trace:
W20260927 15:06:14.330205 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e1ae6251bc343b0bd0fbf627083ffb9 consensus state has no leader
I20260927 15:06:14.330644 2512 tablet.cc:1722] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260927 15:06:14.332712 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd0e035cec844fe789fdc815644fc025 consensus state has no leader
I20260927 15:06:14.335119 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 927c8bd9afc54836922dc6d3cc472946 (DEFAULT_TABLE table=default.Table_992c531b10424b57a812f821b5bd99bf [id=9a6757ecfe864da7a72798efb131a53f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.335929 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_06ad2a9aa89e435eac768eca2abd7bf7" } new_table_name: "default.Table_89c2edced1064494a5d6562ecfa933aa" modify_external_catalogs: true
I20260927 15:06:14.338927 1552 raft_consensus.cc:374] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.339052 1552 raft_consensus.cc:729] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.339370 1552 consensus_queue.cc:260] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.339990 1552 ts_tablet_manager.cc:1428] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.020s user 0.000s sys 0.001s
I20260927 15:06:14.340302 1552 tablet_bootstrap.cc:492] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:14.340922 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet fde632b187eb4180b343d7bddc7f0943 (table default.Table_be15cdb2ae6a49e38da808ee4cafd27c [id=bb4c8603779d4998bbf639ff0f8b2ed9]) successfully deleted
I20260927 15:06:14.340775 2119 rpcz_store.cc:276] 0927 15:06:11.974227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.974276 (+ 49us) service_pool.cc:227] Handling call
0927 15:06:14.231027 (+2256751us) ts_tablet_manager.cc:1145] Deleting tablet ad5af5df58824fe88d607a93216bd228
0927 15:06:14.231040 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.255977 (+ 24937us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.271001 (+ 15024us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.280391 (+ 9390us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2256515}
I20260927 15:06:14.341267 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 703) took 2292 ms. Trace:
W20260927 15:06:14.341279 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0a64059ef2234ad6adbdfd8d3576f2a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a64059ef2234ad6adbdfd8d3576f2a6 already in progress: creating tablet
I20260927 15:06:14.341399 2119 rpcz_store.cc:276] 0927 15:06:12.049027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.049081 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:14.341117 (+2292036us) ts_tablet_manager.cc:1145] Deleting tablet 9049d003d787403f80aa0c08872dd3b5
0927 15:06:14.341130 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.341234 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2291827}
W20260927 15:06:14.341684 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 70cc2e16bd6c40bf99ed4436f17d7096 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70cc2e16bd6c40bf99ed4436f17d7096 already in progress: creating tablet
I20260927 15:06:14.341836 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 704) took 2290 ms. Trace:
W20260927 15:06:14.342012 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 955461f27b6444d4b4c3f9a9f629d5e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 955461f27b6444d4b4c3f9a9f629d5e3 already in progress: creating tablet
I20260927 15:06:14.341966 2119 rpcz_store.cc:276] 0927 15:06:12.051580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.051629 (+ 49us) service_pool.cc:227] Handling call
0927 15:06:14.341627 (+2289998us) ts_tablet_manager.cc:1145] Deleting tablet 7afe7ec3929649a8b647eca15e3b7514
0927 15:06:14.341636 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.341720 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2284214}
I20260927 15:06:14.342342 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 705) took 2285 ms. Trace:
I20260927 15:06:14.342443 2119 rpcz_store.cc:276] 0927 15:06:12.056983 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.057050 (+ 67us) service_pool.cc:227] Handling call
0927 15:06:14.342168 (+2285118us) ts_tablet_manager.cc:1145] Deleting tablet 6b4beb4112734b9c91e32b300fd266d7
0927 15:06:14.342178 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.342257 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2284651}
I20260927 15:06:14.342727 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 709) took 2207 ms. Trace:
I20260927 15:06:14.342852 2119 rpcz_store.cc:276] 0927 15:06:12.135277 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.138166 (+ 2889us) service_pool.cc:227] Handling call
0927 15:06:14.342624 (+2204458us) ts_tablet_manager.cc:1145] Deleting tablet 63fbd388210d4a1aabfcf27c7533efbf
0927 15:06:14.342633 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.342697 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2204186}
I20260927 15:06:14.343161 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 708) took 2208 ms. Trace:
I20260927 15:06:14.343262 2119 rpcz_store.cc:276] 0927 15:06:12.135160 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.141059 (+ 5899us) service_pool.cc:227] Handling call
0927 15:06:14.343055 (+2201996us) ts_tablet_manager.cc:1145] Deleting tablet 89783d26db9e49f0ae5171f929fcf1df
0927 15:06:14.343065 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.343131 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2201771}
I20260927 15:06:14.343709 1556 consensus_queue.cc:260] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.345208 1562 rpcz_store.cc:276] 0927 15:06:08.817937 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.818779 (+ 842us) service_pool.cc:227] Handling call
0927 15:06:14.128383 (+5309604us) ts_tablet_manager.cc:1145] Deleting tablet f585bcdadbcc4032aa484481cdf94b72
0927 15:06:14.128392 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.191027 (+ 62635us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.194028 (+ 3001us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.329588 (+135560us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5295677}
I20260927 15:06:14.345675 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 605) took 5455 ms. Trace:
I20260927 15:06:14.345785 1562 rpcz_store.cc:276] 0927 15:06:08.890447 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.890511 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:14.345573 (+5455062us) ts_tablet_manager.cc:1145] Deleting tablet 0e6e3600cbf741419bc7b93eec42eb13
0927 15:06:14.345586 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.345660 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5454824}
I20260927 15:06:14.346077 1562 tablet_replica.cc:330] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:14.346282 1562 raft_consensus.cc:2229] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.346452 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet f585bcdadbcc4032aa484481cdf94b72 (table default.Table_9e37ca2b041a439aa503560c17e5b391 [id=79aefc953f4e419f87376e3ffb2e7a1e]) successfully deleted
I20260927 15:06:14.346567 1562 raft_consensus.cc:2258] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.346577 2119 tablet_replica.cc:330] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
W20260927 15:06:14.346711 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0e6e3600cbf741419bc7b93eec42eb13 because the tablet was not found. No further retry: Not found: Tablet not found: 0e6e3600cbf741419bc7b93eec42eb13
I20260927 15:06:14.346799 2119 raft_consensus.cc:2229] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.347008 2119 raft_consensus.cc:2258] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.347018 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 927c8bd9afc54836922dc6d3cc472946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.349236 1552 tablet_bootstrap.cc:654] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.358484 2119 ts_tablet_manager.cc:1905] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.358817 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 3a231aff1a39485db36979208d871ab3 (table default.Table_f8d8cf187cf24fc9a3d113bc95a0b55f [id=403185df10bf4ed980e2a8ce8427a93f]) successfully deleted
I20260927 15:06:14.363425 1556 ts_tablet_manager.cc:1428] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.056s user 0.001s sys 0.002s
I20260927 15:06:14.367120 1556 tablet_bootstrap.cc:492] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:14.368691 1556 tablet_bootstrap.cc:654] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.380072 1562 ts_tablet_manager.cc:1905] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.387015 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet bc2974e11cf1446895607b4ccec16386 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.387925 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet ad5af5df58824fe88d607a93216bd228 (table default.Table_86b086d55b34411782656982b6de6a74 [id=63f859bf91e142e3a4b9600a580b6b39]) successfully deleted
W20260927 15:06:14.388459 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9049d003d787403f80aa0c08872dd3b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9049d003d787403f80aa0c08872dd3b5 already in progress: creating tablet
W20260927 15:06:14.388859 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7afe7ec3929649a8b647eca15e3b7514 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7afe7ec3929649a8b647eca15e3b7514 already in progress: creating tablet
I20260927 15:06:14.388988 2423 raft_consensus.cc:482] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.389618 2423 raft_consensus.cc:504] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.390626 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc8bd2079f84da39e13113e6699bf5e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:14.391525 1102 leader_election.cc:341] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.391851 2423 leader_election.cc:288] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:14.396319 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6b4beb4112734b9c91e32b300fd266d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b4beb4112734b9c91e32b300fd266d7 already in progress: creating tablet
I20260927 15:06:14.397373 2233 ts_tablet_manager.cc:1918] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.397557 2233 log.cc:1196] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/434e9390f1fd4a3ebb65924c37b85bd4
I20260927 15:06:14.397993 2233 ts_tablet_manager.cc:1939] T 434e9390f1fd4a3ebb65924c37b85bd4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:14.398892 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 752) took 2962 ms. Trace:
I20260927 15:06:14.399034 2233 rpcz_store.cc:276] 0927 15:06:11.436333 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.441194 (+ 4861us) service_pool.cc:227] Handling call
0927 15:06:14.211775 (+2770581us) ts_tablet_manager.cc:1145] Deleting tablet 434e9390f1fd4a3ebb65924c37b85bd4
0927 15:06:14.211855 (+ 80us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.316509 (+104654us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.397252 (+ 80743us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.398867 (+ 1615us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2770473}
I20260927 15:06:14.399596 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 434e9390f1fd4a3ebb65924c37b85bd4 (table default.Table_53f5b1728e4947fca524ecea11ae3d37 [id=fe47ea48cef44035b7d9df3be08eabb1]) successfully deleted
I20260927 15:06:14.399991 2233 tablet_replica.cc:330] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:14.400285 2233 raft_consensus.cc:2229] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:14.400725 2233 raft_consensus.cc:2258] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.404004 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e58cc7be8a9e46679f4791225ae99f5a" } modify_external_catalogs: true
I20260927 15:06:14.404230 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e58cc7be8a9e46679f4791225ae99f5a" } modify_external_catalogs: true
I20260927 15:06:14.404455 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2a8e66ce332c4f78b4c4031a45586dba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:14.404712 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_44d528788dc8496cb0a8b81b85716953" } modify_external_catalogs: true
I20260927 15:06:14.404870 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_44d528788dc8496cb0a8b81b85716953" } modify_external_catalogs: true
W20260927 15:06:14.405045 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a8e66ce332c4f78b4c4031a45586dba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.406425 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fb5e668155a5429e970ced9b7909adf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.406952 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb5e668155a5429e970ced9b7909adf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.409922 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c08ed41f0c434ebb848a2d9e52a6f37e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:14.410252 914 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_0c4d630a1b634322b0d6ffdf591dfc97 [id=a56919bbdc0146839e84fcc1224c6b8f] alter complete (version 1)
W20260927 15:06:14.410625 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c08ed41f0c434ebb848a2d9e52a6f37e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:14.413080 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 63fbd388210d4a1aabfcf27c7533efbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63fbd388210d4a1aabfcf27c7533efbf already in progress: creating tablet
W20260927 15:06:14.413100 1238 leader_election.cc:341] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 16884c7343be436aa312ec0af40f5e33
W20260927 15:06:14.413408 1238 leader_election.cc:341] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 54a07831078b48a59807f7da4a42bcec
W20260927 15:06:14.413699 1238 leader_election.cc:341] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b375902081c54cdb84fdb075eec6baf7
I20260927 15:06:14.416244 2119 ts_tablet_manager.cc:1918] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.416402 2119 log.cc:1196] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/6e9d03457dac43038b4e6fb120ff572c
I20260927 15:06:14.416802 2119 ts_tablet_manager.cc:1939] T 6e9d03457dac43038b4e6fb120ff572c P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.419806 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 710) took 2219 ms. Trace:
I20260927 15:06:14.419904 2119 rpcz_store.cc:276] 0927 15:06:12.200197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.200995 (+ 798us) service_pool.cc:227] Handling call
0927 15:06:14.346505 (+2145510us) ts_tablet_manager.cc:1145] Deleting tablet 6e9d03457dac43038b4e6fb120ff572c
0927 15:06:14.346517 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.408982 (+ 62465us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.416082 (+ 7100us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.419783 (+ 3701us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2145305}
I20260927 15:06:14.422555 2119 tablet_replica.cc:330] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.422780 2119 raft_consensus.cc:2229] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.422962 2119 raft_consensus.cc:2258] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.423471 2119 ts_tablet_manager.cc:1905] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.427423 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 1d2404a81332466c93429fbe550527f6 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:14.428041 1561 tablet_bootstrap.cc:492] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:14.428181 1561 ts_tablet_manager.cc:1397] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.205s user 0.003s sys 0.000s
W20260927 15:06:14.414055 1238 consensus_peers.cc:487] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9598ac8a916f4bf5b1cf9995a8149c70. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:14.435669 1238 leader_election.cc:341] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c41cd38355e64590b43b2e1271c43e91
W20260927 15:06:14.435979 1238 leader_election.cc:341] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c41cd38355e64590b43b2e1271c43e91
I20260927 15:06:14.436049 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0c4d630a1b634322b0d6ffdf591dfc97" } new_table_name: "default.Table_76c776cc4f5d4b82a0d7ecac88eaa80b" modify_external_catalogs: true
I20260927 15:06:14.421514 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet cd76c49eda1c4b4ca0edf0f4d2790188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.430986 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4bd8182c9d48c7b6e6175ab98d405a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:14.437868 1437 raft_consensus.cc:3037] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.439891 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6fefd73ed6c6478da6538b5b9c48e998" } modify_external_catalogs: true
I20260927 15:06:14.440102 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6fefd73ed6c6478da6538b5b9c48e998" } modify_external_catalogs: true
I20260927 15:06:14.440891 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 6e9d03457dac43038b4e6fb120ff572c (table default.Table_fa178c2ce0e14306911368823822afc2 [id=55e2284e62fa45629d02de072260473c]) successfully deleted
I20260927 15:06:14.441534 2365 raft_consensus.cc:482] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.441779 2365 raft_consensus.cc:504] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.442613 2365 leader_election.cc:288] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.444700 1437 raft_consensus.cc:2454] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:14.431161 2575 raft_consensus.cc:482] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.435655 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8790d59beb804acb8e4353f862d7f6f8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:14.445046 1438 raft_consensus.cc:2454] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:14.445019 2575 raft_consensus.cc:504] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.445137 2512 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:14.445648 2575 leader_election.cc:288] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:14.446376 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 70cc2e16bd6c40bf99ed4436f17d7096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.446357 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a74f885820c0411d9d4f5276fadeeaa6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:14.447002 2233 ts_tablet_manager.cc:1905] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:14.447094 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a74f885820c0411d9d4f5276fadeeaa6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.449347 1297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80a8563c77484a1ebbbe7dab9a652aeb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.447468 1556 tablet_bootstrap.cc:492] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:14.451061 1556 ts_tablet_manager.cc:1397] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.084s user 0.001s sys 0.002s
I20260927 15:06:14.452759 1556 raft_consensus.cc:348] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.453194 1556 raft_consensus.cc:374] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.453315 1556 raft_consensus.cc:729] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.453644 1556 consensus_queue.cc:260] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.454422 1556 ts_tablet_manager.cc:1428] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:14.454847 1556 tablet_bootstrap.cc:492] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:14.443389 2566 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:14.446065 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd76c49eda1c4b4ca0edf0f4d2790188" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:14.455899 1374 leader_election.cc:341] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.456799 1556 tablet_bootstrap.cc:654] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:14.453052 1376 leader_election.cc:341] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.457851 1376 leader_election.cc:302] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:14.458148 2575 raft_consensus.cc:2726] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:14.458597 1376 leader_election.cc:341] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.458762 1376 leader_election.cc:302] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:14.459018 2575 raft_consensus.cc:2726] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:14.449880 1102 leader_election.cc:341] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.467610 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 66b54ee47e424aacb7f53fd95b0ce889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.468055 1556 tablet_bootstrap.cc:492] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:14.468673 1556 ts_tablet_manager.cc:1397] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260927 15:06:14.468670 2512 tablet.cc:1722] T dd2687f65780481c86a9942960ce7be1 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:14.469623 1556 raft_consensus.cc:348] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.470768 1556 raft_consensus.cc:374] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.471071 1556 raft_consensus.cc:729] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.472431 909 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_89c2edced1064494a5d6562ecfa933aa [id=61c39607ad5b482c80883c0e60f0da9c] alter complete (version 3)
I20260927 15:06:14.474694 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81a2ca7b51dd46eda17b8ea2776e4b23" } modify_external_catalogs: true
I20260927 15:06:14.474915 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_928c6a3f3fcc44c2a6e5b11a7eea812b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:14.474978 1556 consensus_queue.cc:260] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.475236 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81a2ca7b51dd46eda17b8ea2776e4b23" } modify_external_catalogs: true
W20260927 15:06:14.475662 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_928c6a3f3fcc44c2a6e5b11a7eea812b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.475054 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7c70fe3ebd254ab7aea273501a92997e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.476270 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c70fe3ebd254ab7aea273501a92997e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.476575 2566 tablet.cc:1722] T dd2687f65780481c86a9942960ce7be1 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:14.477344 2119 ts_tablet_manager.cc:1918] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.477464 2119 log.cc:1196] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/42baac8b7d47433e826eb3bc1980acaa
I20260927 15:06:14.477756 2119 ts_tablet_manager.cc:1939] T 42baac8b7d47433e826eb3bc1980acaa P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.477962 1556 ts_tablet_manager.cc:1428] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 15:06:14.478801 1556 tablet_bootstrap.cc:492] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:14.481732 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 with delete_type TABLET_DATA_DELETED (replaced by tablet b2d2501a9f764790818426665e7f0340) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.483044 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_69940ca5fe094d06b021595f6aedef6a" } new_table_name: "default.Table_c55771ffcd764eb98922734d5296d564" modify_external_catalogs: true
I20260927 15:06:14.484382 1556 tablet_bootstrap.cc:654] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.486223 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7d02d4f342db454687368766178c6b74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.486774 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d02d4f342db454687368766178c6b74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.487671 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1ea5ac72d6cf4e4fb24f58b2152fb8e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.488125 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ea5ac72d6cf4e4fb24f58b2152fb8e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.491096 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 711) took 2271 ms. Trace:
I20260927 15:06:14.491216 2119 rpcz_store.cc:276] 0927 15:06:12.219292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.219470 (+ 178us) service_pool.cc:227] Handling call
0927 15:06:14.420146 (+2200676us) ts_tablet_manager.cc:1145] Deleting tablet 42baac8b7d47433e826eb3bc1980acaa
0927 15:06:14.422512 (+ 2366us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.439017 (+ 16505us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.477242 (+ 38225us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.491069 (+ 13827us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2200456}
I20260927 15:06:14.491524 2119 tablet_replica.cc:330] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.494145 2119 raft_consensus.cc:2229] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.494347 2119 raft_consensus.cc:2258] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.495230 2119 ts_tablet_manager.cc:1905] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.495333 2233 ts_tablet_manager.cc:1918] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:14.496503 2233 log.cc:1196] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/2cd55e22d8254ea8b1dab989517148ca
I20260927 15:06:14.497084 2233 ts_tablet_manager.cc:1939] T 2cd55e22d8254ea8b1dab989517148ca P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:14.495574 1556 tablet_bootstrap.cc:492] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:14.497957 1556 ts_tablet_manager.cc:1397] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260927 15:06:14.498163 1562 ts_tablet_manager.cc:1918] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.498704 1556 raft_consensus.cc:348] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.502223 1562 log.cc:1196] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/1b045b82515540e8813f9250726479e5
I20260927 15:06:14.505354 1562 ts_tablet_manager.cc:1939] T 1b045b82515540e8813f9250726479e5 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:14.505493 1556 raft_consensus.cc:374] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.505685 1556 raft_consensus.cc:729] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.506115 1556 consensus_queue.cc:260] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.507069 1556 ts_tablet_manager.cc:1428] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 15:06:14.507897 1556 tablet_bootstrap.cc:492] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:14.509711 2119 ts_tablet_manager.cc:1918] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.505281 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 753) took 3068 ms. Trace:
I20260927 15:06:14.509845 2119 log.cc:1196] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/e066308fcdfc49ed926cd81963c5f1a7
I20260927 15:06:14.509881 2233 rpcz_store.cc:276] 0927 15:06:11.436424 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.441314 (+ 4890us) service_pool.cc:227] Handling call
0927 15:06:14.399928 (+2958614us) ts_tablet_manager.cc:1145] Deleting tablet 2cd55e22d8254ea8b1dab989517148ca
0927 15:06:14.399945 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.472718 (+ 72773us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.495224 (+ 22506us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.505258 (+ 10034us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2958461}
I20260927 15:06:14.510149 2119 ts_tablet_manager.cc:1939] T e066308fcdfc49ed926cd81963c5f1a7 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.510484 2233 tablet_replica.cc:330] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:14.511046 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 712) took 2291 ms. Trace:
I20260927 15:06:14.511162 2119 rpcz_store.cc:276] 0927 15:06:12.219418 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.219728 (+ 310us) service_pool.cc:227] Handling call
0927 15:06:14.491485 (+2271757us) ts_tablet_manager.cc:1145] Deleting tablet e066308fcdfc49ed926cd81963c5f1a7
0927 15:06:14.491495 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.504486 (+ 12991us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.509608 (+ 5122us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.511019 (+ 1411us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2271591}
I20260927 15:06:14.512244 1556 tablet_bootstrap.cc:654] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.512499 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 606) took 5611 ms. Trace:
I20260927 15:06:14.513537 2233 raft_consensus.cc:2229] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.513722 2233 raft_consensus.cc:2258] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.513701 1562 rpcz_store.cc:276] 0927 15:06:08.901435 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.901492 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:14.346033 (+5444541us) ts_tablet_manager.cc:1145] Deleting tablet 1b045b82515540e8813f9250726479e5
0927 15:06:14.346044 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.383622 (+ 37578us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.498048 (+114426us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.512467 (+ 14419us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5444312}
I20260927 15:06:14.514684 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 608) took 5594 ms. Trace:
I20260927 15:06:14.514700 2233 ts_tablet_manager.cc:1905] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.493170 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 42baac8b7d47433e826eb3bc1980acaa (table default.Table_e362bbc19fce4b2a842bd907b98ede40 [id=d3243f5a530645288cdf6befd30c31e3]) successfully deleted
W20260927 15:06:14.504640 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b20e031dc7044368c41792118ebe12a consensus state has no leader
I20260927 15:06:14.515506 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d6ad9c3cd0f24d0bb3360c5847ae34dd" } modify_external_catalogs: true
I20260927 15:06:14.515704 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d6ad9c3cd0f24d0bb3360c5847ae34dd" } modify_external_catalogs: true
I20260927 15:06:14.517294 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet e066308fcdfc49ed926cd81963c5f1a7 (table default.Table_7258841dfdbd45b0a5745d0a4cbd5551 [id=6ed04e9f13a242f581a5c92cca97a25d]) successfully deleted
I20260927 15:06:14.507341 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fd7032c2d0864f37ae99a5152b4f154b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.518020 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd7032c2d0864f37ae99a5152b4f154b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.509284 914 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_76c776cc4f5d4b82a0d7ecac88eaa80b [id=a56919bbdc0146839e84fcc1224c6b8f] alter complete (version 2)
I20260927 15:06:14.510445 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 2cd55e22d8254ea8b1dab989517148ca (table default.Table_0f6a6192da2f4f05af0cad71e5b85ef2 [id=e104421aa3634f9b9868449439d50362]) successfully deleted
I20260927 15:06:14.514361 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 1b045b82515540e8813f9250726479e5 (table default.Table_e301f5a5aea64583a20cf58c548d0934 [id=0268289149d14fd5abd1abecf14a43bb]) successfully deleted
I20260927 15:06:14.520501 2119 tablet_replica.cc:330] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.520709 2119 raft_consensus.cc:2229] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.520871 2119 raft_consensus.cc:2258] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.521379 2119 ts_tablet_manager.cc:1905] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.523300 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc8bd2079f84da39e13113e6699bf5e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:14.523518 1433 raft_consensus.cc:2454] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:14.528522 908 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 756ed56c0c8e478abedb73647f8edfb3
I20260927 15:06:14.530104 2119 ts_tablet_manager.cc:1918] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.530225 2119 log.cc:1196] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/45b610025b1a4b68bdc34f870654f9d1
I20260927 15:06:14.530529 2119 ts_tablet_manager.cc:1939] T 45b610025b1a4b68bdc34f870654f9d1 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.531669 2233 ts_tablet_manager.cc:1918] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.536747 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 713) took 2175 ms. Trace:
I20260927 15:06:14.536993 2119 rpcz_store.cc:276] 0927 15:06:12.361461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.361509 (+ 48us) service_pool.cc:227] Handling call
0927 15:06:14.520443 (+2158934us) ts_tablet_manager.cc:1145] Deleting tablet 45b610025b1a4b68bdc34f870654f9d1
0927 15:06:14.520456 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.526444 (+ 5988us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.530002 (+ 3558us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.536717 (+ 6715us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2158732}
I20260927 15:06:14.539059 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 45b610025b1a4b68bdc34f870654f9d1 (table default.Table_fdbd726355df419fae94cbf8fce53375 [id=f6284e29d38143b38fc421ab5c09538c]) successfully deleted
I20260927 15:06:14.539145 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 730) took 1940 ms. Trace:
I20260927 15:06:14.539287 2119 rpcz_store.cc:276] 0927 15:06:12.599028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.599096 (+ 68us) service_pool.cc:227] Handling call
0927 15:06:14.538953 (+1939857us) ts_tablet_manager.cc:1145] Deleting tablet 95c8178680ea4b6b8794150188320ea9
0927 15:06:14.538974 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.539118 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1939520}
I20260927 15:06:14.539902 1562 rpcz_store.cc:276] 0927 15:06:08.919939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.920186 (+ 247us) service_pool.cc:227] Handling call
0927 15:06:14.514509 (+5594323us) ts_tablet_manager.cc:1145] Deleting tablet 34348cffe35b46728e77df7dede29682
0927 15:06:14.514519 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.514663 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5594078}
I20260927 15:06:14.541873 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a3e1703b285640dfa4ddf810dad33273" } new_table_name: "default.Table_646b99944cd449bca4e0cc9ffb91ae64" modify_external_catalogs: true
I20260927 15:06:14.542121 1552 tablet_bootstrap.cc:492] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:14.542359 1552 ts_tablet_manager.cc:1397] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.202s user 0.026s sys 0.036s
I20260927 15:06:14.542089 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 726) took 1943 ms. Trace:
I20260927 15:06:14.543304 2119 rpcz_store.cc:276] 0927 15:06:12.598506 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.599115 (+ 609us) service_pool.cc:227] Handling call
0927 15:06:14.541977 (+1942862us) ts_tablet_manager.cc:1145] Deleting tablet 10b19de22dd74d74bdf619c75fc17762
0927 15:06:14.541986 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.542071 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1942612}
I20260927 15:06:14.543747 1552 raft_consensus.cc:348] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.543992 1552 raft_consensus.cc:374] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.544064 1552 raft_consensus.cc:729] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.544091 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 727) took 1945 ms. Trace:
I20260927 15:06:14.544164 2119 rpcz_store.cc:276] 0927 15:06:12.598664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.599428 (+ 764us) service_pool.cc:227] Handling call
0927 15:06:14.543966 (+1944538us) ts_tablet_manager.cc:1145] Deleting tablet 0ae30595912943aaa58f1ebe9dc965e6
0927 15:06:14.543978 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.544074 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1944313}
I20260927 15:06:14.544305 1552 consensus_queue.cc:260] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.544734 2233 log.cc:1196] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/04007cd4bd214b88a4664e23daf4b790
I20260927 15:06:14.545154 1552 ts_tablet_manager.cc:1428] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:14.545025 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fb02ad6ad0ce454e9c2678bf69fe98da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.545670 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb02ad6ad0ce454e9c2678bf69fe98da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.545702 2233 ts_tablet_manager.cc:1939] T 04007cd4bd214b88a4664e23daf4b790 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:14.546537 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 757) took 3045 ms. Trace:
I20260927 15:06:14.547418 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 728) took 1948 ms. Trace:
W20260927 15:06:14.547283 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 95c8178680ea4b6b8794150188320ea9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95c8178680ea4b6b8794150188320ea9 already in progress: creating tablet
W20260927 15:06:14.547876 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 10b19de22dd74d74bdf619c75fc17762 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10b19de22dd74d74bdf619c75fc17762 already in progress: creating tablet
I20260927 15:06:14.547993 1552 tablet_bootstrap.cc:492] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:14.548287 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0ae30595912943aaa58f1ebe9dc965e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ae30595912943aaa58f1ebe9dc965e6 already in progress: creating tablet
I20260927 15:06:14.549453 1552 tablet_bootstrap.cc:654] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.547694 2119 rpcz_store.cc:276] 0927 15:06:12.598760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.599714 (+ 954us) service_pool.cc:227] Handling call
0927 15:06:14.544578 (+1944864us) ts_tablet_manager.cc:1145] Deleting tablet 80a8563c77484a1ebbbe7dab9a652aeb
0927 15:06:14.544588 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.547403 (+ 2815us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1944690}
I20260927 15:06:14.550223 2233 rpcz_store.cc:276] 0927 15:06:11.500766 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.505335 (+ 4569us) service_pool.cc:227] Handling call
0927 15:06:14.510442 (+3005107us) ts_tablet_manager.cc:1145] Deleting tablet 04007cd4bd214b88a4664e23daf4b790
0927 15:06:14.510452 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.518201 (+ 7749us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.531560 (+ 13359us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.546514 (+ 14954us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2782,"tablet-delete.queue_time_us":3004827}
W20260927 15:06:14.550666 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 80a8563c77484a1ebbbe7dab9a652aeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80a8563c77484a1ebbbe7dab9a652aeb already in progress: creating tablet
I20260927 15:06:14.550887 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 759) took 3000 ms. Trace:
I20260927 15:06:14.550959 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 729) took 1952 ms. Trace:
I20260927 15:06:14.551079 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 04007cd4bd214b88a4664e23daf4b790 (table default.Table_1363eb0bffb8454a9bfbc067762dad9c [id=ff900aafe4f94663a9633fc0fbec0a06]) successfully deleted
I20260927 15:06:14.551054 2119 rpcz_store.cc:276] 0927 15:06:12.598864 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.599927 (+ 1063us) service_pool.cc:227] Handling call
0927 15:06:14.550851 (+1950924us) ts_tablet_manager.cc:1145] Deleting tablet 6f3bdfede5744513aeadb22da73b6f8a
0927 15:06:14.550863 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.550944 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1950715}
W20260927 15:06:14.551399 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 34348cffe35b46728e77df7dede29682 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34348cffe35b46728e77df7dede29682 already in progress: creating tablet
W20260927 15:06:14.551589 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6f3bdfede5744513aeadb22da73b6f8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f3bdfede5744513aeadb22da73b6f8a already in progress: creating tablet
I20260927 15:06:14.551911 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6492d9de2a344924b2bc60390022781a" } new_table_name: "default.Table_8ba96fdd979f408489e269fdd20a3ddb" modify_external_catalogs: true
I20260927 15:06:14.552037 2119 tablet_replica.cc:330] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.552219 2119 raft_consensus.cc:2229] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.552392 2119 raft_consensus.cc:2258] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.554425 2119 ts_tablet_manager.cc:1905] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.551080 2233 rpcz_store.cc:276] 0927 15:06:11.550313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.550376 (+ 63us) service_pool.cc:227] Handling call
0927 15:06:14.550696 (+3000320us) ts_tablet_manager.cc:1145] Deleting tablet 0a64059ef2234ad6adbdfd8d3576f2a6
0927 15:06:14.550709 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.550864 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3000112}
I20260927 15:06:14.428843 1561 raft_consensus.cc:348] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.555348 1561 raft_consensus.cc:374] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.555436 1561 raft_consensus.cc:729] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:06:14.555735 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0a64059ef2234ad6adbdfd8d3576f2a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a64059ef2234ad6adbdfd8d3576f2a6 already in progress: creating tablet
I20260927 15:06:14.555923 2233 tablet_replica.cc:330] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:14.556190 2233 raft_consensus.cc:2229] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.556088 1561 consensus_queue.cc:260] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.556676 2233 raft_consensus.cc:2258] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.556825 1561 ts_tablet_manager.cc:1428] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.129s user 0.002s sys 0.000s
I20260927 15:06:14.541286 1099 leader_election.cc:302] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:14.541684 1102 consensus_peers.cc:487] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:14.557062 2476 raft_consensus.cc:2781] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.557127 2476 raft_consensus.cc:482] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.557184 2476 raft_consensus.cc:3037] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.557597 2233 ts_tablet_manager.cc:1905] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.559816 2476 raft_consensus.cc:504] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.560464 2476 leader_election.cc:288] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.561147 2476 consensus_queue.cc:1035] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:14.561753 1099 leader_election.cc:302] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:14.561980 2476 raft_consensus.cc:2781] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.562086 2476 raft_consensus.cc:686] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:14.562280 2476 consensus_queue.cc:237] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:14.564239 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e313b183d4549ca975d8077b22fc3f6 has no consensus state
I20260927 15:06:14.565176 1297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd31ae2ac2e4bc9897724bc9012698d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:14.566221 1102 leader_election.cc:341] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.568275 908 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet aa192d5cbece4127ace65e564bb1a12a (table default.Table_efdaebdde10c4bc0b43c9b76f254c556 [id=f96697b67a7f4eb9b111b258c5fc514a]). Expected version 1 got 0
I20260927 15:06:14.570698 1556 tablet_bootstrap.cc:492] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:14.570971 1556 ts_tablet_manager.cc:1397] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.063s user 0.009s sys 0.003s
I20260927 15:06:14.571771 1556 raft_consensus.cc:348] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.572046 1556 raft_consensus.cc:374] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.572130 1556 raft_consensus.cc:729] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.572358 1556 consensus_queue.cc:260] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.573314 908 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet aa192d5cbece4127ace65e564bb1a12a (table default.Table_efdaebdde10c4bc0b43c9b76f254c556 [id=f96697b67a7f4eb9b111b258c5fc514a]). Expected version 1 got 0
I20260927 15:06:14.573523 1556 ts_tablet_manager.cc:1428] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:14.573873 1556 tablet_bootstrap.cc:492] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:14.576686 1099 leader_election.cc:302] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:14.576961 2476 raft_consensus.cc:2781] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.577080 2476 raft_consensus.cc:686] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:14.577314 2476 consensus_queue.cc:237] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.578621 1099 leader_election.cc:302] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:14.576798 1556 tablet_bootstrap.cc:654] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.578872 2365 raft_consensus.cc:2781] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.578951 2365 raft_consensus.cc:482] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.579011 2365 raft_consensus.cc:3037] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.579137 1099 leader_election.cc:302] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:14.579348 2423 raft_consensus.cc:2781] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.579414 2423 raft_consensus.cc:482] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.579479 2423 raft_consensus.cc:3037] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.579864 2569 consensus_queue.cc:1035] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:14.581555 2365 raft_consensus.cc:504] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.582084 2365 leader_election.cc:288] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.582597 2423 raft_consensus.cc:504] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.583088 2423 leader_election.cc:288] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.583796 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8790d59beb804acb8e4353f862d7f6f8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:14.584576 1102 consensus_peers.cc:487] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:14.584699 1102 leader_election.cc:341] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.585311 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a3a8d1e9d1b54c209faf08c4ca2f04aa" } new_table_name: "default.Table_6958e870017a475db49b5dd499a2fed7" modify_external_catalogs: true
I20260927 15:06:14.585387 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc8bd2079f84da39e13113e6699bf5e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:14.585534 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd31ae2ac2e4bc9897724bc9012698d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:14.585714 1435 raft_consensus.cc:3037] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.586024 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80a8563c77484a1ebbbe7dab9a652aeb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:14.586182 1438 raft_consensus.cc:2454] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:14.586344 1305 raft_consensus.cc:3037] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.589277 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 610) took 5669 ms. Trace:
I20260927 15:06:14.589381 1562 rpcz_store.cc:276] 0927 15:06:08.920137 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.920522 (+ 385us) service_pool.cc:227] Handling call
0927 15:06:14.551061 (+5630539us) ts_tablet_manager.cc:1145] Deleting tablet 54f5c4b7c7a045bea1a79bc67a913f65
0927 15:06:14.589115 (+ 38054us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.589246 (+ 131us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5630374}
W20260927 15:06:14.589830 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 54f5c4b7c7a045bea1a79bc67a913f65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54f5c4b7c7a045bea1a79bc67a913f65 already in progress: creating tablet
W20260927 15:06:14.590404 1102 leader_election.cc:341] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.591158 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 609) took 5670 ms. Trace:
I20260927 15:06:14.591308 1562 rpcz_store.cc:276] 0927 15:06:08.920042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.920467 (+ 425us) service_pool.cc:227] Handling call
0927 15:06:14.590323 (+5669856us) ts_tablet_manager.cc:1145] Deleting tablet f271c76b5f2447239d3d014fbde4e8b2
0927 15:06:14.590666 (+ 343us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.590759 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5669303}
W20260927 15:06:14.592670 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet f271c76b5f2447239d3d014fbde4e8b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f271c76b5f2447239d3d014fbde4e8b2 already in progress: creating tablet
I20260927 15:06:14.593680 1552 tablet_bootstrap.cc:492] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:14.593815 1552 ts_tablet_manager.cc:1397] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.004s
I20260927 15:06:14.593755 2565 tablet.cc:1722] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:14.595736 1552 raft_consensus.cc:348] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.595969 1552 raft_consensus.cc:374] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.596027 1552 raft_consensus.cc:729] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.597071 1552 consensus_queue.cc:260] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.597787 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8790d59beb804acb8e4353f862d7f6f8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:14.598001 1433 raft_consensus.cc:3037] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.598553 1435 raft_consensus.cc:2454] T 5cd31ae2ac2e4bc9897724bc9012698d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:14.598647 1099 consensus_peers.cc:487] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 434e9390f1fd4a3ebb65924c37b85bd4. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:14.598786 2431 raft_consensus.cc:482] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.598909 1099 leader_election.cc:302] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:14.598937 2431 raft_consensus.cc:504] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:14.599284 1099 consensus_peers.cc:487] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:14.599511 2431 leader_election.cc:288] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.599650 2431 consensus_queue.cc:1035] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:14.600041 2431 raft_consensus.cc:2781] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.600113 2431 raft_consensus.cc:482] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.600167 2431 raft_consensus.cc:3037] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.601173 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 607) took 5681 ms. Trace:
I20260927 15:06:14.601256 1562 rpcz_store.cc:276] 0927 15:06:08.919761 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.920704 (+ 943us) service_pool.cc:227] Handling call
0927 15:06:14.592985 (+5672281us) ts_tablet_manager.cc:1145] Deleting tablet 53ddb28f419d42afbaddf36966fa1509
0927 15:06:14.601044 (+ 8059us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.601154 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5671920}
W20260927 15:06:14.601722 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 53ddb28f419d42afbaddf36966fa1509 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53ddb28f419d42afbaddf36966fa1509 already in progress: creating tablet
I20260927 15:06:14.602123 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 611) took 5665 ms. Trace:
I20260927 15:06:14.602195 1562 rpcz_store.cc:276] 0927 15:06:08.936347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:08.936539 (+ 192us) service_pool.cc:227] Handling call
0927 15:06:14.601983 (+5665444us) ts_tablet_manager.cc:1145] Deleting tablet 1d221f14ad57462e95017b9068eb8714
0927 15:06:14.601997 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.602106 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5665205}
W20260927 15:06:14.602602 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1d221f14ad57462e95017b9068eb8714 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d221f14ad57462e95017b9068eb8714 already in progress: creating tablet
I20260927 15:06:14.602626 1099 leader_election.cc:302] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:14.603004 1561 tablet_bootstrap.cc:492] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:14.603286 2569 raft_consensus.cc:2781] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.603406 2569 raft_consensus.cc:686] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:14.603626 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6f179aab784ae4822356e63332532f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.603638 2569 consensus_queue.cc:237] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.603828 1298 raft_consensus.cc:2454] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:14.604647 1102 leader_election.cc:302] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:14.609342 2565 tablet.cc:1722] T dd2687f65780481c86a9942960ce7be1 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:14.609622 2543 raft_consensus.cc:482] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.609740 2233 ts_tablet_manager.cc:1918] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.609869 2233 log.cc:1196] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/566aa5caa012443ea63fcb7389c8b7c0
I20260927 15:06:14.609767 2543 raft_consensus.cc:504] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.610216 2233 ts_tablet_manager.cc:1939] T 566aa5caa012443ea63fcb7389c8b7c0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:14.610364 2543 leader_election.cc:288] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.611169 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd76c49eda1c4b4ca0edf0f4d2790188" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.611466 1552 ts_tablet_manager.cc:1428] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260927 15:06:14.611788 1552 tablet_bootstrap.cc:492] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:14.611912 1298 raft_consensus.cc:3037] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.613126 1552 tablet_bootstrap.cc:654] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.614506 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 758) took 3064 ms. Trace:
I20260927 15:06:14.614601 2233 rpcz_store.cc:276] 0927 15:06:11.550208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.550599 (+ 391us) service_pool.cc:227] Handling call
0927 15:06:14.555793 (+3005194us) ts_tablet_manager.cc:1145] Deleting tablet 566aa5caa012443ea63fcb7389c8b7c0
0927 15:06:14.555809 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.560941 (+ 5132us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.609603 (+ 48662us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.614480 (+ 4877us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3005013}
I20260927 15:06:14.616199 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 566aa5caa012443ea63fcb7389c8b7c0 (table default.Table_166945d9ee0740f2b92a0138063f8891 [id=cad1448cfd5a4e76afe95e544d8a30b0]) successfully deleted
I20260927 15:06:14.616501 2447 raft_consensus.cc:482] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.604691 1561 tablet_bootstrap.cc:654] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.610756 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6f179aab784ae4822356e63332532f" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:14.605051 2365 raft_consensus.cc:2781] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.619938 1164 raft_consensus.cc:2454] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:14.620258 2365 raft_consensus.cc:482] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.620342 2365 raft_consensus.cc:3037] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.622043 1239 leader_election.cc:302] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:14.622375 2543 raft_consensus.cc:2781] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.622470 2543 raft_consensus.cc:482] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.622541 2543 raft_consensus.cc:3037] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.622687 2233 tablet_replica.cc:330] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:14.623348 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9a1d9c742204cd3b7c0e0bd3c1d7e69 consensus state has no leader
I20260927 15:06:14.622991 2233 raft_consensus.cc:2229] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.626673 2543 raft_consensus.cc:504] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.627460 2543 leader_election.cc:288] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:14.627504 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0feb5ba11c943b0a1e97e493ddcb9e2 has no consensus state
I20260927 15:06:14.628324 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6f179aab784ae4822356e63332532f" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:14.605319 2431 raft_consensus.cc:504] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.616618 2447 raft_consensus.cc:504] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.629678 2431 leader_election.cc:288] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.629954 2447 leader_election.cc:288] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:14.609370 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc8bd2079f84da39e13113e6699bf5e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:14.630506 1435 raft_consensus.cc:3037] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.630734 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc20a62bbd484c4e9e25cf1c15e1dde0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:14.631073 2233 raft_consensus.cc:2258] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:14.631247 1374 leader_election.cc:341] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.631615 2233 ts_tablet_manager.cc:1905] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.631795 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80a8563c77484a1ebbbe7dab9a652aeb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:14.632025 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7922646448e64068a424e80834b4ca50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.632422 1102 leader_election.cc:341] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:14.632663 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7922646448e64068a424e80834b4ca50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.633528 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2850befe4b7a44f883a51838f3297f0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:14.634653 2365 raft_consensus.cc:504] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.635030 1164 raft_consensus.cc:2379] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate c4264874db964ff2830b7894c2b3d61c in this term.
W20260927 15:06:14.636029 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2850befe4b7a44f883a51838f3297f0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.636235 2365 leader_election.cc:288] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.636780 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6f179aab784ae4822356e63332532f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:14.637049 1301 raft_consensus.cc:2379] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c4264874db964ff2830b7894c2b3d61c in current term 1: Already voted for candidate 4769a710b72a4b49b816725a5921e86e in this term.
I20260927 15:06:14.638607 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7c21987b6b304665a44fbb61a3d4e790"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.639338 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c21987b6b304665a44fbb61a3d4e790 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.612730 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 643) took 5237 ms. Trace:
I20260927 15:06:14.647353 1562 rpcz_store.cc:276] 0927 15:06:09.375059 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.375342 (+ 283us) service_pool.cc:227] Handling call
0927 15:06:14.612571 (+5237229us) ts_tablet_manager.cc:1145] Deleting tablet b19ddd29d7214931ad797497a0178544
0927 15:06:14.612583 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.612706 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5236980}
W20260927 15:06:14.648096 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b19ddd29d7214931ad797497a0178544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b19ddd29d7214931ad797497a0178544 already in progress: creating tablet
I20260927 15:06:14.648613 1562 tablet_replica.cc:330] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:14.648916 1562 raft_consensus.cc:2229] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:14.649277 1562 pending_rounds.cc:62] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:14.649395 1562 pending_rounds.cc:68] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976367097020416 op_type: NO_OP noop_request { }
I20260927 15:06:14.649600 1562 raft_consensus.cc:2866] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:14.649725 1562 raft_consensus.cc:2258] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.661011 1435 raft_consensus.cc:2454] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:14.618111 1376 leader_election.cc:341] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.661916 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 30925f27bf5e45b8a038d0179a6a4439 (DEFAULT_TABLE table=default.Table_cfd50ce3e28949c6a277273769c7d2e3 [id=6fef5e76ffc74a648c0bfd124864f564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.662072 1376 leader_election.cc:302] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:14.662353 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30925f27bf5e45b8a038d0179a6a4439. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:14.662382 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 44280.4us
I20260927 15:06:14.662577 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 30925f27bf5e45b8a038d0179a6a4439 (DEFAULT_TABLE table=default.Table_cfd50ce3e28949c6a277273769c7d2e3 [id=6fef5e76ffc74a648c0bfd124864f564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.662855 2446 raft_consensus.cc:2726] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:14.662951 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30925f27bf5e45b8a038d0179a6a4439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.663087 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_da9153d15e4a41a1811d6887fc2a7bd5" } new_table_name: "default.Table_616b395e89e04a72b5950685fde37543" modify_external_catalogs: true
I20260927 15:06:14.664258 1127 tablet_service.cc:1467] Processing CreateTablet for tablet e4888cae0c0749dbab2c94185cd36df8 (DEFAULT_TABLE table=default.Table_27ad686afe10424180ba09fa60122958 [id=a965da69552c4e7daf2f57b616f1d06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.664661 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4888cae0c0749dbab2c94185cd36df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.665017 908 master_service.cc:946] ReplaceTablet: received request to replace tablet 534a74d9f8e648168b87e26fb73c8b3a from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:14.665424 1130 tablet_service.cc:1467] Processing CreateTablet for tablet d2510150b0d04fc994ebc2058a38ebb0 (DEFAULT_TABLE table=default.Table_2862452a601c44a69e65c1e58211f3bf [id=6baa3555bdc74977863af8a1b02ae539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.665715 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2510150b0d04fc994ebc2058a38ebb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.666740 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 30925f27bf5e45b8a038d0179a6a4439 (DEFAULT_TABLE table=default.Table_cfd50ce3e28949c6a277273769c7d2e3 [id=6fef5e76ffc74a648c0bfd124864f564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.667150 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30925f27bf5e45b8a038d0179a6a4439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.675591 1274 tablet_service.cc:1467] Processing CreateTablet for tablet e4888cae0c0749dbab2c94185cd36df8 (DEFAULT_TABLE table=default.Table_27ad686afe10424180ba09fa60122958 [id=a965da69552c4e7daf2f57b616f1d06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.675611 1279 tablet_service.cc:1467] Processing CreateTablet for tablet dbeebc4fdf444b24ab901e4bb80b49d1 (DEFAULT_TABLE table=default.Table_570d1e19c0ad439298f5a54fac20ff7e [id=067fc9654d754eaa9ecd59fc5c71db9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.676093 1267 tablet_service.cc:1467] Processing CreateTablet for tablet d2510150b0d04fc994ebc2058a38ebb0 (DEFAULT_TABLE table=default.Table_2862452a601c44a69e65c1e58211f3bf [id=6baa3555bdc74977863af8a1b02ae539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.676093 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbeebc4fdf444b24ab901e4bb80b49d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.676395 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2510150b0d04fc994ebc2058a38ebb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.676461 914 catalog_manager.cc:5495] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:14.678941 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4888cae0c0749dbab2c94185cd36df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.679118 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 9b233493cb7e41a0b34d9c99a693bed7 (DEFAULT_TABLE table=default.Table_e5eb2d8b1a334f3ba5ab54469e2071a6 [id=edeab9a95d0941599fc88a7267d87caa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.679416 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b233493cb7e41a0b34d9c99a693bed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.679792 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 9b233493cb7e41a0b34d9c99a693bed7 (DEFAULT_TABLE table=default.Table_e5eb2d8b1a334f3ba5ab54469e2071a6 [id=edeab9a95d0941599fc88a7267d87caa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.680154 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b233493cb7e41a0b34d9c99a693bed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.680737 1562 ts_tablet_manager.cc:1905] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.683463 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 33bbd34a3c6148b5a49aa92d54aad36d (DEFAULT_TABLE table=default.Table_02f2c729f727498b8942dc5b6ddcbf70 [id=f259fb0e1ea547209eb5a86e32390356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.683808 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33bbd34a3c6148b5a49aa92d54aad36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.687561 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 31b84cba09754a898a1a7ba1111d6b9a (DEFAULT_TABLE table=default.Table_47ac30fcf01e4d908cf79610d7b1ecf0 [id=7131c110e7be42c5a7ee233a60e43361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.687930 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b84cba09754a898a1a7ba1111d6b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.688035 1401 tablet_service.cc:1467] Processing CreateTablet for tablet e4888cae0c0749dbab2c94185cd36df8 (DEFAULT_TABLE table=default.Table_27ad686afe10424180ba09fa60122958 [id=a965da69552c4e7daf2f57b616f1d06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.688376 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4888cae0c0749dbab2c94185cd36df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.690795 1135 tablet_service.cc:1467] Processing CreateTablet for tablet f052aaaa3793455bb19d7cceb4e127c4 (DEFAULT_TABLE table=default.Table_11346dfb3345489f92bad7f598d0192e [id=bb0f60f9c5364ca4aa0c63070a4c6718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.691073 1416 tablet_service.cc:1467] Processing CreateTablet for tablet d2510150b0d04fc994ebc2058a38ebb0 (DEFAULT_TABLE table=default.Table_2862452a601c44a69e65c1e58211f3bf [id=6baa3555bdc74977863af8a1b02ae539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.691174 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f052aaaa3793455bb19d7cceb4e127c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.691378 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2510150b0d04fc994ebc2058a38ebb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.694320 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 0c0f030a072347fbaabddb2a5c58c45a (DEFAULT_TABLE table=default.Table_3bb06d6047b0410f9305e5eb2ad0952c [id=49d42ee0950d495f9fb50dff5a66cd8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.694622 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c0f030a072347fbaabddb2a5c58c45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.697701 907 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (table default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8]). Expected version 3 got 0
I20260927 15:06:14.699168 1407 tablet_service.cc:1467] Processing CreateTablet for tablet dbeebc4fdf444b24ab901e4bb80b49d1 (DEFAULT_TABLE table=default.Table_570d1e19c0ad439298f5a54fac20ff7e [id=067fc9654d754eaa9ecd59fc5c71db9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.699460 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_25e39a1524f9443bada5d1bb6c74b002"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:14.699751 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 31b84cba09754a898a1a7ba1111d6b9a (DEFAULT_TABLE table=default.Table_47ac30fcf01e4d908cf79610d7b1ecf0 [id=7131c110e7be42c5a7ee233a60e43361]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:14.700028 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25e39a1524f9443bada5d1bb6c74b002 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.700307 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 31b84cba09754a898a1a7ba1111d6b9a (DEFAULT_TABLE table=default.Table_47ac30fcf01e4d908cf79610d7b1ecf0 [id=7131c110e7be42c5a7ee233a60e43361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.700650 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b84cba09754a898a1a7ba1111d6b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.702216 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 0e313b183d4549ca975d8077b22fc3f6 (DEFAULT_TABLE table=default.Table_646b99944cd449bca4e0cc9ffb91ae64 [id=1d0ed2ac8c8f40a299df4a05171fbe77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.702615 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e313b183d4549ca975d8077b22fc3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.703022 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b72f9960a56647c4ab39a68b197799de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:14.703148 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 0e313b183d4549ca975d8077b22fc3f6 (DEFAULT_TABLE table=default.Table_646b99944cd449bca4e0cc9ffb91ae64 [id=1d0ed2ac8c8f40a299df4a05171fbe77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.703497 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e313b183d4549ca975d8077b22fc3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.703706 1130 tablet_service.cc:1467] Processing CreateTablet for tablet eed526a0500c4f098719c74dd74975c6 (DEFAULT_TABLE table=default.Table_19b967b211a94e01a88e59b22de81627 [id=177449f85b094131b5ea1be5d4e4592d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.704545 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed526a0500c4f098719c74dd74975c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.706969 1266 tablet_service.cc:1467] Processing CreateTablet for tablet eed526a0500c4f098719c74dd74975c6 (DEFAULT_TABLE table=default.Table_19b967b211a94e01a88e59b22de81627 [id=177449f85b094131b5ea1be5d4e4592d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.707170 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 546c6116a98c4787935f42cf5cca46b6 (DEFAULT_TABLE table=default.Table_70d070cb409140bb950af1749ccc32dd [id=fb310fcac9aa40dc8d07ec0aa895bbd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.707316 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed526a0500c4f098719c74dd74975c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.707502 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 546c6116a98c4787935f42cf5cca46b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.708137 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 512a2f4e3c3f479daba37eb1ca0d463b (DEFAULT_TABLE table=default.Table_74beb80739aa41539ec16812dd37761c [id=056840e50d5b497bb0b22822397a0864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.708415 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 512a2f4e3c3f479daba37eb1ca0d463b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.708838 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b84cba09754a898a1a7ba1111d6b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.709064 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbeebc4fdf444b24ab901e4bb80b49d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.702236 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc20a62bbd484c4e9e25cf1c15e1dde0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.712427 1561 tablet_bootstrap.cc:492] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:14.712544 1561 ts_tablet_manager.cc:1397] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.110s user 0.003s sys 0.000s
W20260927 15:06:14.715142 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b72f9960a56647c4ab39a68b197799de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.715975 1561 raft_consensus.cc:348] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.720109 1561 raft_consensus.cc:374] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.720876 1561 raft_consensus.cc:729] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:06:14.722175 899 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet a0feb5ba11c943b0a1e97e493ddcb9e2 (table default.Table_8ba96fdd979f408489e269fdd20a3ddb [id=6aa5513cc702466ebd6a136f5468be3e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a0feb5ba11c943b0a1e97e493ddcb9e2 has no consensus state
I20260927 15:06:14.724167 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 71dcc9a493bb46399ac7e38afc2bfef0 (DEFAULT_TABLE table=default.Table_81f0d439c6f4400abf00d3fbfb715ee1 [id=e3a3ff0683444a6296b94a90d9e9ad90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.724684 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71dcc9a493bb46399ac7e38afc2bfef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.716346 1562 ts_tablet_manager.cc:1918] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:14.717397 1144 tablet_service.cc:1467] Processing CreateTablet for tablet bf2c20ff67ba49a588bcd755ca7c12d9 (DEFAULT_TABLE table=default.Table_d4ced27460fd468abb680a28e7f9e530 [id=8db52e72da1747719e1b7df57aaf8a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.724936 1562 log.cc:1196] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/cd901034653b47dbba7912d5338bc3bb
I20260927 15:06:14.724960 2543 raft_consensus.cc:482] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.725152 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf2c20ff67ba49a588bcd755ca7c12d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.725082 2543 raft_consensus.cc:504] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.725360 1562 ts_tablet_manager.cc:1939] T cd901034653b47dbba7912d5338bc3bb P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:14.725638 2543 leader_election.cc:288] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.726132 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 644) took 5348 ms. Trace:
I20260927 15:06:14.726215 1562 rpcz_store.cc:276] 0927 15:06:09.377222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.377274 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:14.648540 (+5271266us) ts_tablet_manager.cc:1145] Deleting tablet cd901034653b47dbba7912d5338bc3bb
0927 15:06:14.648558 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.704156 (+ 55598us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.716259 (+ 12103us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.726112 (+ 9853us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5263796}
I20260927 15:06:14.726680 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet cd901034653b47dbba7912d5338bc3bb (table default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]) successfully deleted
I20260927 15:06:14.727005 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0aec677006ab4407bd7ae4c0078d6b7f" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:14.727203 1164 raft_consensus.cc:2454] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:14.727586 1239 leader_election.cc:302] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:14.727843 2543 raft_consensus.cc:2781] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:14.727909 2543 raft_consensus.cc:482] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:14.727962 2543 raft_consensus.cc:3037] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.727937 1146 tablet_service.cc:1467] Processing CreateTablet for tablet df186082f2ee46768b9a5d77f19f8e2e (DEFAULT_TABLE table=default.Table_bd8ee120888747a5a5cf6623783c7562 [id=2e360b2699e04fb6b2e1f74958bcd933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.729282 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df186082f2ee46768b9a5d77f19f8e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.730330 2543 raft_consensus.cc:504] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.731621 1282 tablet_service.cc:1467] Processing CreateTablet for tablet df186082f2ee46768b9a5d77f19f8e2e (DEFAULT_TABLE table=default.Table_bd8ee120888747a5a5cf6623783c7562 [id=2e360b2699e04fb6b2e1f74958bcd933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.732012 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df186082f2ee46768b9a5d77f19f8e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.732604 1433 raft_consensus.cc:2454] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:14.732642 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 645) took 5348 ms. Trace:
I20260927 15:06:14.732730 1562 rpcz_store.cc:276] 0927 15:06:09.384692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.384793 (+ 101us) service_pool.cc:227] Handling call
0927 15:06:14.732508 (+5347715us) ts_tablet_manager.cc:1145] Deleting tablet a8659865bf644458b3b5a78eae36a524
0927 15:06:14.732519 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.732622 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5347502}
W20260927 15:06:14.733228 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet a8659865bf644458b3b5a78eae36a524 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8659865bf644458b3b5a78eae36a524 already in progress: creating tablet
I20260927 15:06:14.733729 1403 tablet_service.cc:1467] Processing CreateTablet for tablet f052aaaa3793455bb19d7cceb4e127c4 (DEFAULT_TABLE table=default.Table_11346dfb3345489f92bad7f598d0192e [id=bb0f60f9c5364ca4aa0c63070a4c6718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.734041 1561 consensus_queue.cc:260] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.732976 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80a8563c77484a1ebbbe7dab9a652aeb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:14.735733 1438 raft_consensus.cc:3037] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.738081 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 646) took 5350 ms. Trace:
I20260927 15:06:14.738309 1562 rpcz_store.cc:276] 0927 15:06:09.387609 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.387662 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:14.737883 (+5350221us) ts_tablet_manager.cc:1145] Deleting tablet f86725bd5d5247faa0dff164857629d3
0927 15:06:14.737896 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.738058 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5349425}
I20260927 15:06:14.738782 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 33bbd34a3c6148b5a49aa92d54aad36d (DEFAULT_TABLE table=default.Table_02f2c729f727498b8942dc5b6ddcbf70 [id=f259fb0e1ea547209eb5a86e32390356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.738782 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 9b233493cb7e41a0b34d9c99a693bed7 (DEFAULT_TABLE table=default.Table_e5eb2d8b1a334f3ba5ab54469e2071a6 [id=edeab9a95d0941599fc88a7267d87caa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:14.739085 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet f86725bd5d5247faa0dff164857629d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f86725bd5d5247faa0dff164857629d3 already in progress: creating tablet
I20260927 15:06:14.740610 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f052aaaa3793455bb19d7cceb4e127c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.741318 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b233493cb7e41a0b34d9c99a693bed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.741554 2544 consensus_queue.cc:1035] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:14.742573 2543 leader_election.cc:288] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.746320 1281 tablet_service.cc:1467] Processing CreateTablet for tablet f052aaaa3793455bb19d7cceb4e127c4 (DEFAULT_TABLE table=default.Table_11346dfb3345489f92bad7f598d0192e [id=bb0f60f9c5364ca4aa0c63070a4c6718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.749003 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f052aaaa3793455bb19d7cceb4e127c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.751762 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 0c0f030a072347fbaabddb2a5c58c45a (DEFAULT_TABLE table=default.Table_3bb06d6047b0410f9305e5eb2ad0952c [id=49d42ee0950d495f9fb50dff5a66cd8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.752219 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c0f030a072347fbaabddb2a5c58c45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.752779 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33bbd34a3c6148b5a49aa92d54aad36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.755192 2233 ts_tablet_manager.cc:1918] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.755317 2233 log.cc:1196] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/0129eaa5636544e696076e439d713b1b
I20260927 15:06:14.748381 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 33bbd34a3c6148b5a49aa92d54aad36d (DEFAULT_TABLE table=default.Table_02f2c729f727498b8942dc5b6ddcbf70 [id=f259fb0e1ea547209eb5a86e32390356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.756793 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33bbd34a3c6148b5a49aa92d54aad36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.758002 1408 tablet_service.cc:1467] Processing CreateTablet for tablet eed526a0500c4f098719c74dd74975c6 (DEFAULT_TABLE table=default.Table_19b967b211a94e01a88e59b22de81627 [id=177449f85b094131b5ea1be5d4e4592d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.758517 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed526a0500c4f098719c74dd74975c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.760504 2233 ts_tablet_manager.cc:1939] T 0129eaa5636544e696076e439d713b1b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:14.767434 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 761) took 3216 ms. Trace:
I20260927 15:06:14.768006 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 0e313b183d4549ca975d8077b22fc3f6 (DEFAULT_TABLE table=default.Table_646b99944cd449bca4e0cc9ffb91ae64 [id=1d0ed2ac8c8f40a299df4a05171fbe77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.768421 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e313b183d4549ca975d8077b22fc3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.768376 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 546c6116a98c4787935f42cf5cca46b6 (DEFAULT_TABLE table=default.Table_70d070cb409140bb950af1749ccc32dd [id=fb310fcac9aa40dc8d07ec0aa895bbd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.750634 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 25628ba242e34341b9c10fb68bbd8635 (DEFAULT_TABLE table=default.Table_779ab963c30743b88c0399bf522b1ef3 [id=61c5bdcfabd2455cab364eb831b6673f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.771505 1438 raft_consensus.cc:2454] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:14.772162 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 512a2f4e3c3f479daba37eb1ca0d463b (DEFAULT_TABLE table=default.Table_74beb80739aa41539ec16812dd37761c [id=056840e50d5b497bb0b22822397a0864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.775079 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 512a2f4e3c3f479daba37eb1ca0d463b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.776073 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 546c6116a98c4787935f42cf5cca46b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.777531 2447 raft_consensus.cc:482] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.777674 2447 raft_consensus.cc:504] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.778220 2447 leader_election.cc:288] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:14.750051 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 0c0f030a072347fbaabddb2a5c58c45a (DEFAULT_TABLE table=default.Table_3bb06d6047b0410f9305e5eb2ad0952c [id=49d42ee0950d495f9fb50dff5a66cd8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.769659 1552 tablet_bootstrap.cc:492] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
W20260927 15:06:14.773306 1238 leader_election.cc:341] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: dc6f179aab784ae4822356e63332532f
I20260927 15:06:14.780478 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c0f030a072347fbaabddb2a5c58c45a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:14.780681 1238 leader_election.cc:341] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 0aec677006ab4407bd7ae4c0078d6b7f
W20260927 15:06:14.780970 1238 consensus_peers.cc:487] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9cb0ab983a444d26b903a0cec64f15f0. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:14.781095 1238 leader_election.cc:341] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 0aec677006ab4407bd7ae4c0078d6b7f
W20260927 15:06:14.781224 1238 leader_election.cc:341] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: dc6f179aab784ae4822356e63332532f
I20260927 15:06:14.781282 1238 leader_election.cc:302] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:14.781795 2543 raft_consensus.cc:2726] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 15:06:14.783352 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 512a2f4e3c3f479daba37eb1ca0d463b (DEFAULT_TABLE table=default.Table_74beb80739aa41539ec16812dd37761c [id=056840e50d5b497bb0b22822397a0864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.783595 1552 ts_tablet_manager.cc:1397] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.172s user 0.013s sys 0.010s
I20260927 15:06:14.783723 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 512a2f4e3c3f479daba37eb1ca0d463b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.784327 1552 raft_consensus.cc:348] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.738472 1561 ts_tablet_manager.cc:1428] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.022s user 0.002s sys 0.001s
I20260927 15:06:14.743957 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0aec677006ab4407bd7ae4c0078d6b7f" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:14.784832 1561 tablet_bootstrap.cc:492] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:14.740854 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 25628ba242e34341b9c10fb68bbd8635 (DEFAULT_TABLE table=default.Table_779ab963c30743b88c0399bf522b1ef3 [id=61c5bdcfabd2455cab364eb831b6673f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.785240 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25628ba242e34341b9c10fb68bbd8635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.757834 1099 leader_election.cc:302] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:14.779053 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efc44686be2407cbcdca61909301539" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:14.786137 1099 leader_election.cc:341] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: dc6f179aab784ae4822356e63332532f
I20260927 15:06:14.784852 1163 raft_consensus.cc:3037] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:14.786383 1099 leader_election.cc:302] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:14.786634 1099 leader_election.cc:341] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: dc6f179aab784ae4822356e63332532f
I20260927 15:06:14.786701 1099 leader_election.cc:302] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:14.787084 2431 raft_consensus.cc:2781] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.787204 2431 raft_consensus.cc:686] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:14.787250 2476 raft_consensus.cc:2726] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 15:06:14.787432 2431 consensus_queue.cc:237] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.789098 1163 raft_consensus.cc:2454] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
W20260927 15:06:14.789886 1374 leader_election.cc:341] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.739465 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 647) took 5350 ms. Trace:
I20260927 15:06:14.794994 1562 rpcz_store.cc:276] 0927 15:06:09.388880 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.388936 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:14.739348 (+5350412us) ts_tablet_manager.cc:1145] Deleting tablet 81e0be77dff645f795237ffe779ed684
0927 15:06:14.739361 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.739446 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5350239}
I20260927 15:06:14.795406 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 648) took 5352 ms. Trace:
I20260927 15:06:14.795475 1562 rpcz_store.cc:276] 0927 15:06:09.442974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.443169 (+ 195us) service_pool.cc:227] Handling call
0927 15:06:14.795252 (+5352083us) ts_tablet_manager.cc:1145] Deleting tablet 81f65ad693894e7c8b575cd8e1942c14
0927 15:06:14.795265 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.795377 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5351841}
I20260927 15:06:14.795717 1562 tablet_replica.cc:330] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:14.795894 1562 raft_consensus.cc:2229] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:14.796172 1562 raft_consensus.cc:2258] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.785998 2423 raft_consensus.cc:2781] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
W20260927 15:06:14.796641 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 81e0be77dff645f795237ffe779ed684 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81e0be77dff645f795237ffe779ed684 already in progress: creating tablet
I20260927 15:06:14.796705 2423 raft_consensus.cc:686] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:14.796909 2423 consensus_queue.cc:237] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:14.797039 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 81f65ad693894e7c8b575cd8e1942c14 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81f65ad693894e7c8b575cd8e1942c14 already in progress: creating tablet
I20260927 15:06:14.797079 1562 ts_tablet_manager.cc:1905] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.797684 1099 leader_election.cc:302] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:14.798203 2365 raft_consensus.cc:2781] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.749752 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 71dcc9a493bb46399ac7e38afc2bfef0 (DEFAULT_TABLE table=default.Table_81f0d439c6f4400abf00d3fbfb715ee1 [id=e3a3ff0683444a6296b94a90d9e9ad90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.798439 2365 raft_consensus.cc:686] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:14.798607 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71dcc9a493bb46399ac7e38afc2bfef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.798635 2365 consensus_queue.cc:237] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.803848 1562 ts_tablet_manager.cc:1918] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:14.804029 1562 log.cc:1196] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/fe7816e099094d13887650fc223097c7
I20260927 15:06:14.804214 1133 tablet_service.cc:1467] Processing CreateTablet for tablet dbeebc4fdf444b24ab901e4bb80b49d1 (DEFAULT_TABLE table=default.Table_570d1e19c0ad439298f5a54fac20ff7e [id=067fc9654d754eaa9ecd59fc5c71db9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.804443 1562 ts_tablet_manager.cc:1939] T fe7816e099094d13887650fc223097c7 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:14.804957 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbeebc4fdf444b24ab901e4bb80b49d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.805173 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 649) took 5362 ms. Trace:
I20260927 15:06:14.805266 1562 rpcz_store.cc:276] 0927 15:06:09.443115 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.443446 (+ 331us) service_pool.cc:227] Handling call
0927 15:06:14.795679 (+5352233us) ts_tablet_manager.cc:1145] Deleting tablet fe7816e099094d13887650fc223097c7
0927 15:06:14.795688 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.800178 (+ 4490us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.803745 (+ 3567us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.805155 (+ 1410us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5352069}
I20260927 15:06:14.805569 1562 tablet_replica.cc:330] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:14.805745 1562 raft_consensus.cc:2229] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.805765 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet fe7816e099094d13887650fc223097c7 (table default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]) successfully deleted
I20260927 15:06:14.805883 1562 raft_consensus.cc:2258] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.806362 1562 ts_tablet_manager.cc:1905] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.757350 1284 tablet_service.cc:1467] Processing CreateTablet for tablet bf2c20ff67ba49a588bcd755ca7c12d9 (DEFAULT_TABLE table=default.Table_d4ced27460fd468abb680a28e7f9e530 [id=8db52e72da1747719e1b7df57aaf8a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.789847 1239 leader_election.cc:302] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:14.807355 1552 raft_consensus.cc:374] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.807442 1552 raft_consensus.cc:729] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.807616 1552 consensus_queue.cc:260] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.807937 2544 raft_consensus.cc:2781] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:14.794046 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25628ba242e34341b9c10fb68bbd8635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.808044 2544 raft_consensus.cc:686] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:14.808223 2544 consensus_queue.cc:237] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.815025 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf2c20ff67ba49a588bcd755ca7c12d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.819285 1561 tablet_bootstrap.cc:654] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.803259 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 546c6116a98c4787935f42cf5cca46b6 (DEFAULT_TABLE table=default.Table_70d070cb409140bb950af1749ccc32dd [id=fb310fcac9aa40dc8d07ec0aa895bbd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.820868 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 546c6116a98c4787935f42cf5cca46b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:14.822818 1376 leader_election.cc:341] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.822986 1376 leader_election.cc:302] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:14.823344 2447 raft_consensus.cc:2726] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:14.823601 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 25628ba242e34341b9c10fb68bbd8635 (DEFAULT_TABLE table=default.Table_779ab963c30743b88c0399bf522b1ef3 [id=61c5bdcfabd2455cab364eb831b6673f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.823964 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25628ba242e34341b9c10fb68bbd8635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.824863 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efc44686be2407cbcdca61909301539" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:14.825911 1376 leader_election.cc:341] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.826035 1376 leader_election.cc:302] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:14.826660 2447 raft_consensus.cc:2726] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:14.767590 2233 rpcz_store.cc:276] 0927 15:06:11.550547 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.550687 (+ 140us) service_pool.cc:227] Handling call
0927 15:06:14.622630 (+3071943us) ts_tablet_manager.cc:1145] Deleting tablet 0129eaa5636544e696076e439d713b1b
0927 15:06:14.622644 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.661256 (+ 38612us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.755062 (+ 93806us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.767409 (+ 12347us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3071828}
I20260927 15:06:14.828166 2233 tablet_replica.cc:330] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:14.828332 2233 raft_consensus.cc:2229] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.828485 2233 raft_consensus.cc:2258] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.820065 1552 ts_tablet_manager.cc:1428] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20260927 15:06:14.829293 1552 tablet_bootstrap.cc:492] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:14.830132 809 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 182170us
I20260927 15:06:14.830475 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1d2404a81332466c93429fbe550527f6
I20260927 15:06:14.831012 910 catalog_manager.cc:6565] ReplaceTablet: tablet 1d2404a81332466c93429fbe550527f6 deleted and replaced by tablet 26b846a6145b432b9df58aaade7a3996
I20260927 15:06:14.831884 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d2404a81332466c93429fbe550527f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 26b846a6145b432b9df58aaade7a3996) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.833302 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 373b6e6c03614b78a8343c84095bd347 (table default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63]). Expected version 1 got 0
I20260927 15:06:14.834012 2512 tablet.cc:1722] T aa192d5cbece4127ace65e564bb1a12a P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:14.839685 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2bbb2131b0f54a7eb74c5d3cba962860
I20260927 15:06:14.840992 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bbb2131b0f54a7eb74c5d3cba962860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.845912 2447 raft_consensus.cc:482] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.845876 1417 tablet_service.cc:1467] Processing CreateTablet for tablet bf2c20ff67ba49a588bcd755ca7c12d9 (DEFAULT_TABLE table=default.Table_d4ced27460fd468abb680a28e7f9e530 [id=8db52e72da1747719e1b7df57aaf8a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.846065 2447 raft_consensus.cc:504] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.847221 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b54ee47e424aacb7f53fd95b0ce889" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:14.853160 2447 leader_election.cc:288] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
W20260927 15:06:14.853395 1374 leader_election.cc:341] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.855018 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b54ee47e424aacb7f53fd95b0ce889" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:14.855566 1376 leader_election.cc:341] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.855760 1376 leader_election.cc:302] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:14.856328 2447 raft_consensus.cc:2726] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:14.856528 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bbb2131b0f54a7eb74c5d3cba962860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.863243 1419 tablet_service.cc:1467] Processing CreateTablet for tablet df186082f2ee46768b9a5d77f19f8e2e (DEFAULT_TABLE table=default.Table_bd8ee120888747a5a5cf6623783c7562 [id=2e360b2699e04fb6b2e1f74958bcd933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.863535 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 71dcc9a493bb46399ac7e38afc2bfef0 (DEFAULT_TABLE table=default.Table_81f0d439c6f4400abf00d3fbfb715ee1 [id=e3a3ff0683444a6296b94a90d9e9ad90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:14.866333 1562 ts_tablet_manager.cc:1918] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.866495 1562 log.cc:1196] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/b375902081c54cdb84fdb075eec6baf7
I20260927 15:06:14.871001 2233 ts_tablet_manager.cc:1905] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.871680 1562 ts_tablet_manager.cc:1939] T b375902081c54cdb84fdb075eec6baf7 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:14.872970 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 659) took 5207 ms. Trace:
I20260927 15:06:14.873896 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ba9f24239ae14eaf80b96a711596b00a
I20260927 15:06:14.873974 2119 ts_tablet_manager.cc:1918] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:14.874125 2119 log.cc:1196] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/f585bcdadbcc4032aa484481cdf94b72
I20260927 15:06:14.874055 1562 rpcz_store.cc:276] 0927 15:06:09.665671 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.665715 (+ 44us) service_pool.cc:227] Handling call
0927 15:06:14.805535 (+5139820us) ts_tablet_manager.cc:1145] Deleting tablet b375902081c54cdb84fdb075eec6baf7
0927 15:06:14.805544 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.861936 (+ 56392us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.866226 (+ 4290us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.872948 (+ 6722us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5139598}
I20260927 15:06:14.875237 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet b375902081c54cdb84fdb075eec6baf7 (table default.Table_1b1639fc47724907a79f94e34f6b9469 [id=8be5c577dcb3490d883bede28c6b73ea]) successfully deleted
W20260927 15:06:14.875274 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet afbfe01feee7463e8c5b795f9fda70cd consensus state has no leader
I20260927 15:06:14.875195 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 660) took 5199 ms. Trace:
I20260927 15:06:14.876020 2119 ts_tablet_manager.cc:1939] T f585bcdadbcc4032aa484481cdf94b72 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.876631 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bb348ff23de548fca4156a8533579a0e
I20260927 15:06:14.876624 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d2404a81332466c93429fbe550527f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 26b846a6145b432b9df58aaade7a3996) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.876829 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 3efc44686be2407cbcdca61909301539 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.876807 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 731) took 2245 ms. Trace:
I20260927 15:06:14.876912 2119 rpcz_store.cc:276] 0927 15:06:12.631088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.631148 (+ 60us) service_pool.cc:227] Handling call
0927 15:06:14.551995 (+1920847us) ts_tablet_manager.cc:1145] Deleting tablet f585bcdadbcc4032aa484481cdf94b72
0927 15:06:14.552005 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.593713 (+ 41708us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.873863 (+280150us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.876782 (+ 2919us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1920606}
I20260927 15:06:14.875787 1562 rpcz_store.cc:276] 0927 15:06:09.675827 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.675881 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:14.875064 (+5199183us) ts_tablet_manager.cc:1145] Deleting tablet bda4bc28542d4b5e9cb1b432e5cf54d7
0927 15:06:14.875076 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.875178 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5198813}
I20260927 15:06:14.877413 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 534a74d9f8e648168b87e26fb73c8b3a
I20260927 15:06:14.877787 908 catalog_manager.cc:6565] ReplaceTablet: tablet 534a74d9f8e648168b87e26fb73c8b3a deleted and replaced by tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6
I20260927 15:06:14.878134 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 661) took 5200 ms. Trace:
I20260927 15:06:14.878470 1562 rpcz_store.cc:276] 0927 15:06:09.677709 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.677771 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:14.878011 (+5200240us) ts_tablet_manager.cc:1145] Deleting tablet 0d6523d56f344208abc30f0d82138998
0927 15:06:14.878023 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.878117 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5199734}
W20260927 15:06:14.878723 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet bda4bc28542d4b5e9cb1b432e5cf54d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bda4bc28542d4b5e9cb1b432e5cf54d7 already in progress: creating tablet
I20260927 15:06:14.879142 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 662) took 5200 ms. Trace:
I20260927 15:06:14.879551 1562 rpcz_store.cc:276] 0927 15:06:09.678326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.678372 (+ 46us) service_pool.cc:227] Handling call
0927 15:06:14.879023 (+5200651us) ts_tablet_manager.cc:1145] Deleting tablet 3a47c42f9edd4e1ab761317b7b58e8df
0927 15:06:14.879033 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.879124 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5200448}
I20260927 15:06:14.879963 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 534a74d9f8e648168b87e26fb73c8b3a with delete_type TABLET_DATA_DELETED (replaced by tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:14.880132 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0d6523d56f344208abc30f0d82138998 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d6523d56f344208abc30f0d82138998 already in progress: creating tablet
I20260927 15:06:14.880393 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet ba9f24239ae14eaf80b96a711596b00a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:14.880509 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 3a47c42f9edd4e1ab761317b7b58e8df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a47c42f9edd4e1ab761317b7b58e8df already in progress: creating tablet
I20260927 15:06:14.880577 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet bb348ff23de548fca4156a8533579a0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.880961 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 663) took 5202 ms. Trace:
I20260927 15:06:14.881584 1562 rpcz_store.cc:276] 0927 15:06:09.678789 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.678857 (+ 68us) service_pool.cc:227] Handling call
0927 15:06:14.880785 (+5201928us) ts_tablet_manager.cc:1145] Deleting tablet 610ff6563dc64e73b2b4d7c268468b21
0927 15:06:14.880821 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.880939 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5201703}
W20260927 15:06:14.882561 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 610ff6563dc64e73b2b4d7c268468b21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 610ff6563dc64e73b2b4d7c268468b21 already in progress: creating tablet
I20260927 15:06:14.883118 1562 tablet_replica.cc:330] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:14.883188 2543 raft_consensus.cc:482] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.883654 1562 raft_consensus.cc:2229] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:14.883509 2543 raft_consensus.cc:504] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.884397 1562 pending_rounds.cc:62] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:14.884368 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet f585bcdadbcc4032aa484481cdf94b72 (table default.Table_9e37ca2b041a439aa503560c17e5b391 [id=79aefc953f4e419f87376e3ffb2e7a1e]) successfully deleted
I20260927 15:06:14.884575 2543 leader_election.cc:288] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.884801 1562 pending_rounds.cc:68] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976363727405056 op_type: NO_OP noop_request { }
I20260927 15:06:14.885120 1562 raft_consensus.cc:2866] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260927 15:06:14.885275 1239 leader_election.cc:341] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 1b045b82515540e8813f9250726479e5
I20260927 15:06:14.885394 1562 raft_consensus.cc:2258] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.885371 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet bb348ff23de548fca4156a8533579a0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.885707 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet ba9f24239ae14eaf80b96a711596b00a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.885973 1562 ts_tablet_manager.cc:1905] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.885987 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 534a74d9f8e648168b87e26fb73c8b3a with delete_type TABLET_DATA_DELETED (replaced by tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.886293 2447 raft_consensus.cc:482] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.886469 2447 raft_consensus.cc:504] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.887236 2447 leader_election.cc:288] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:14.887518 2365 raft_consensus.cc:482] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.887672 2365 raft_consensus.cc:504] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.888381 2365 leader_election.cc:288] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.888402 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bbb2131b0f54a7eb74c5d3cba962860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.888489 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf2c20ff67ba49a588bcd755ca7c12d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.889187 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet bb348ff23de548fca4156a8533579a0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.889698 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3939bfd903d42e9bfaaf6ecdf50b8d4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:14.890079 1099 consensus_peers.cc:487] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:14.891747 1561 tablet_bootstrap.cc:492] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:14.891873 1561 ts_tablet_manager.cc:1397] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.107s user 0.008s sys 0.000s
I20260927 15:06:14.892572 1561 raft_consensus.cc:348] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.892766 1561 raft_consensus.cc:374] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.892825 1561 raft_consensus.cc:729] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.893922 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3939bfd903d42e9bfaaf6ecdf50b8d4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.894939 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c90e5c66d8564f68b401b3e4280499a7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:14.896173 1561 consensus_queue.cc:260] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:14.896430 1102 leader_election.cc:341] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.896535 1552 tablet_bootstrap.cc:654] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.897373 1561 ts_tablet_manager.cc:1428] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:14.897635 1561 tablet_bootstrap.cc:492] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:14.898573 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 796eef27ca8341b1a1ccc95770892e04
I20260927 15:06:14.901722 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet fe7816e099094d13887650fc223097c7 with delete_type TABLET_DATA_DELETED (replaced by tablet c90e5c66d8564f68b401b3e4280499a7) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.902683 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 796eef27ca8341b1a1ccc95770892e04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.904147 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d2404a81332466c93429fbe550527f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 26b846a6145b432b9df58aaade7a3996) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.904417 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ab38ee49123642b6b2546b1eca782405" } modify_external_catalogs: true
I20260927 15:06:14.904692 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ab38ee49123642b6b2546b1eca782405" } modify_external_catalogs: true
I20260927 15:06:14.908986 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 732) took 2173 ms. Trace:
I20260927 15:06:14.909098 2119 rpcz_store.cc:276] 0927 15:06:12.735541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.739261 (+ 3720us) service_pool.cc:227] Handling call
0927 15:06:14.908855 (+2169594us) ts_tablet_manager.cc:1145] Deleting tablet 7fd8311955974e1cbcdda1961c318588
0927 15:06:14.908866 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.908968 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2169301}
I20260927 15:06:14.909423 2119 tablet_replica.cc:330] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.909663 2119 raft_consensus.cc:2229] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.909821 2119 raft_consensus.cc:2258] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.909785 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cb01b40008664904bb98fdf1526b779f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.910420 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb01b40008664904bb98fdf1526b779f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.910449 2119 ts_tablet_manager.cc:1905] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.911839 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_27ad686afe10424180ba09fa60122958" } new_table_name: "default.Table_934b9c0792974bde9a2a2325b1839ab1" modify_external_catalogs: true
I20260927 15:06:14.913108 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e812145e2650451b9edebd5769f7ff17" } new_table_name: "default.Table_4574d98643e5499fba08e6216e70f0b1" modify_external_catalogs: true
I20260927 15:06:14.914471 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7f3a9856266c44c491c1e528ba208be8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.915014 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f3a9856266c44c491c1e528ba208be8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.917029 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_86ef5c917c4d4a1290da0798310e13a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.917549 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86ef5c917c4d4a1290da0798310e13a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.919967 1561 tablet_bootstrap.cc:654] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.920370 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7c30e063ac3349c8a514e1c3859e829a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.920843 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c30e063ac3349c8a514e1c3859e829a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.922235 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3ed05ef39f8d4541adb74fb6cfdab68c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.922739 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ed05ef39f8d4541adb74fb6cfdab68c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.922794 2119 ts_tablet_manager.cc:1918] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.923065 2119 log.cc:1196] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/454e637ec622424e81a8770c16bbc941
I20260927 15:06:14.923367 2119 ts_tablet_manager.cc:1939] T 454e637ec622424e81a8770c16bbc941 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.924279 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 733) took 2160 ms. Trace:
I20260927 15:06:14.924365 2119 rpcz_store.cc:276] 0927 15:06:12.764027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.764155 (+ 128us) service_pool.cc:227] Handling call
0927 15:06:14.909375 (+2145220us) ts_tablet_manager.cc:1145] Deleting tablet 454e637ec622424e81a8770c16bbc941
0927 15:06:14.909386 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.915928 (+ 6542us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.922701 (+ 6773us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.924261 (+ 1560us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2145033}
I20260927 15:06:14.924643 2119 tablet_replica.cc:330] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.924805 2119 raft_consensus.cc:2229] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:14.925088 2119 raft_consensus.cc:2258] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.926070 2119 ts_tablet_manager.cc:1905] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.928444 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 796eef27ca8341b1a1ccc95770892e04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:14.929528 1238 consensus_peers.cc:487] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c49913b1763c4a7b9413a801aff93b30. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:14.932689 1374 leader_election.cc:341] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.933727 2119 ts_tablet_manager.cc:1918] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:14.933827 2119 log.cc:1196] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/9598ac8a916f4bf5b1cf9995a8149c70
I20260927 15:06:14.934270 2119 ts_tablet_manager.cc:1939] T 9598ac8a916f4bf5b1cf9995a8149c70 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.935209 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 734) took 2059 ms. Trace:
I20260927 15:06:14.935299 2119 rpcz_store.cc:276] 0927 15:06:12.875411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.875583 (+ 172us) service_pool.cc:227] Handling call
0927 15:06:14.924602 (+2049019us) ts_tablet_manager.cc:1145] Deleting tablet 9598ac8a916f4bf5b1cf9995a8149c70
0927 15:06:14.924617 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.929937 (+ 5320us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.933642 (+ 3705us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.935185 (+ 1543us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":768,"tablet-delete.queue_time_us":2048768}
I20260927 15:06:14.935905 2119 tablet_replica.cc:330] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.936098 2119 raft_consensus.cc:2229] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.936234 2119 raft_consensus.cc:2258] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.888182 2604 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:14.937705 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet ba9f24239ae14eaf80b96a711596b00a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.938560 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 534a74d9f8e648168b87e26fb73c8b3a with delete_type TABLET_DATA_DELETED (replaced by tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:14.939653 2119 ts_tablet_manager.cc:1905] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:14.941324 1238 leader_election.cc:341] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 1b045b82515540e8813f9250726479e5
I20260927 15:06:14.941443 1238 leader_election.cc:302] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:14.941865 1376 leader_election.cc:341] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:14.941905 913 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 373b6e6c03614b78a8343c84095bd347 (table default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63]). Expected version 1 got 0
I20260927 15:06:14.942016 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df186082f2ee46768b9a5d77f19f8e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.942936 2423 consensus_queue.cc:1035] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:14.944480 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet b3cc37a97bc145bdaa654bcc193fe93b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.945259 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:14.945807 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_102feaee35d9448e87313b235363314c" } new_table_name: "default.Table_5b3f43b2aacd4b89b990a6df9e1e7bd6" modify_external_catalogs: true
I20260927 15:06:14.947139 1562 ts_tablet_manager.cc:1918] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:14.947587 2119 ts_tablet_manager.cc:1918] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.947714 2119 log.cc:1196] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/2afab8bf87bc45c899bcd5dfdad48d26
I20260927 15:06:14.947842 1562 log.cc:1196] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/01b7e017ead242849585679873a69b43
I20260927 15:06:14.948012 2119 ts_tablet_manager.cc:1939] T 2afab8bf87bc45c899bcd5dfdad48d26 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.948747 1562 ts_tablet_manager.cc:1939] T 01b7e017ead242849585679873a69b43 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:14.949469 2544 raft_consensus.cc:2726] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:14.927038 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7fd8311955974e1cbcdda1961c318588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fd8311955974e1cbcdda1961c318588 already in progress: creating tablet
I20260927 15:06:14.952353 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 454e637ec622424e81a8770c16bbc941 (table default.Table_d80304854a5249a08e5c2098c97d7c1c [id=a1de063eacb94c21b5009200a7517a33]) successfully deleted
I20260927 15:06:14.952629 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 9598ac8a916f4bf5b1cf9995a8149c70 (table default.Table_3c3f771ede53431eac4f72641bf34c64 [id=11eb50b78bd74a098a861d227a4e2662]) successfully deleted
I20260927 15:06:14.953554 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 735) took 2078 ms. Trace:
I20260927 15:06:14.953642 2119 rpcz_store.cc:276] 0927 15:06:12.875537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.876015 (+ 478us) service_pool.cc:227] Handling call
0927 15:06:14.935848 (+2059833us) ts_tablet_manager.cc:1145] Deleting tablet 2afab8bf87bc45c899bcd5dfdad48d26
0927 15:06:14.935858 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.943745 (+ 7887us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.947509 (+ 3764us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.953534 (+ 6025us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2059660}
I20260927 15:06:14.953969 2119 tablet_replica.cc:330] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.954147 2119 raft_consensus.cc:2229] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.954294 2119 raft_consensus.cc:2258] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.955080 2119 ts_tablet_manager.cc:1905] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.956319 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 0aec677006ab4407bd7ae4c0078d6b7f with delete_type TABLET_DATA_DELETED (replaced by tablet 66b54ee47e424aacb7f53fd95b0ce889) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.956568 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd with delete_type TABLET_DATA_DELETED (replaced by tablet db09498a395b4570a34d32fbfc71e8ed) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:14.957059 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 2afab8bf87bc45c899bcd5dfdad48d26 (table default.Table_a04a6074db084291834a75d52898cf4b [id=15103ee5ddc04d809af8930de02a7d24]) successfully deleted
I20260927 15:06:14.957594 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71dcc9a493bb46399ac7e38afc2bfef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:14.959008 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 664) took 5279 ms. Trace:
I20260927 15:06:14.959275 1562 rpcz_store.cc:276] 0927 15:06:09.679264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.679305 (+ 41us) service_pool.cc:227] Handling call
0927 15:06:14.883055 (+5203750us) ts_tablet_manager.cc:1145] Deleting tablet 01b7e017ead242849585679873a69b43
0927 15:06:14.883070 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.932869 (+ 49799us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.946950 (+ 14081us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.958986 (+ 12036us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5203565}
I20260927 15:06:14.959991 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 01b7e017ead242849585679873a69b43 (table default.Table_fac248ae4718435c9ec9d479beaaeae4 [id=b28d0e08cf944e17a720641dab1f23f5]) successfully deleted
I20260927 15:06:14.960625 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 665) took 5281 ms. Trace:
I20260927 15:06:14.961058 1562 rpcz_store.cc:276] 0927 15:06:09.679644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.679688 (+ 44us) service_pool.cc:227] Handling call
0927 15:06:14.960488 (+5280800us) ts_tablet_manager.cc:1145] Deleting tablet b9a97e3e6a5749feb4dd5f835d9c01ac
0927 15:06:14.960501 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.960606 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5280621}
I20260927 15:06:14.961164 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 796eef27ca8341b1a1ccc95770892e04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:14.961807 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b9a97e3e6a5749feb4dd5f835d9c01ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a97e3e6a5749feb4dd5f835d9c01ac already in progress: creating tablet
I20260927 15:06:14.962268 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 666) took 5282 ms. Trace:
I20260927 15:06:14.962579 1562 rpcz_store.cc:276] 0927 15:06:09.680128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.680167 (+ 39us) service_pool.cc:227] Handling call
0927 15:06:14.962157 (+5281990us) ts_tablet_manager.cc:1145] Deleting tablet ddfb62d579704b30a3482b7f95be4922
0927 15:06:14.962167 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.962251 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5281827}
I20260927 15:06:14.963125 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3bb06d6047b0410f9305e5eb2ad0952c" } new_table_name: "default.Table_bb9703afb61f4d828edae8a2396aea39" modify_external_catalogs: true
W20260927 15:06:14.964504 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ddfb62d579704b30a3482b7f95be4922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ddfb62d579704b30a3482b7f95be4922 already in progress: creating tablet
I20260927 15:06:14.965233 1562 tablet_replica.cc:330] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:14.965663 1562 raft_consensus.cc:2229] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:14.965883 1562 raft_consensus.cc:2258] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.966742 1562 ts_tablet_manager.cc:1905] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.968312 2119 ts_tablet_manager.cc:1918] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:14.968497 2119 log.cc:1196] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/cd901034653b47dbba7912d5338bc3bb
I20260927 15:06:14.968880 2119 ts_tablet_manager.cc:1939] T cd901034653b47dbba7912d5338bc3bb P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:14.971410 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 736) took 2061 ms. Trace:
I20260927 15:06:14.971535 2119 rpcz_store.cc:276] 0927 15:06:12.909570 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.910630 (+ 1060us) service_pool.cc:227] Handling call
0927 15:06:14.953920 (+2043290us) ts_tablet_manager.cc:1145] Deleting tablet cd901034653b47dbba7912d5338bc3bb
0927 15:06:14.953934 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.958349 (+ 4415us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.968214 (+ 9865us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.971376 (+ 3162us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2043083}
I20260927 15:06:14.971925 2119 tablet_replica.cc:330] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:14.972088 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet cd901034653b47dbba7912d5338bc3bb (table default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]) successfully deleted
I20260927 15:06:14.972136 2119 raft_consensus.cc:2229] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:14.972347 2119 pending_rounds.cc:62] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:14.972473 2119 pending_rounds.cc:68] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976367780827136 op_type: NO_OP noop_request { }
I20260927 15:06:14.972662 2119 raft_consensus.cc:2866] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:14.972828 2119 raft_consensus.cc:2258] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:14.973739 2544 raft_consensus.cc:482] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:14.973971 2544 raft_consensus.cc:504] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:14.974282 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4888cae0c0749dbab2c94185cd36df8 consensus state has no leader
I20260927 15:06:14.974684 2544 leader_election.cc:288] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:14.975987 2119 ts_tablet_manager.cc:1905] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:14.975926 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c65bc09865bc4a0283eaa4af9f860bdd" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:14.976485 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2bc6e62cbfb54cca8084c68be203a786"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.977075 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bc6e62cbfb54cca8084c68be203a786 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:14.977660 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a03e73d7c41e4809994e97b00b8743e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.978137 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a03e73d7c41e4809994e97b00b8743e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:14.980556 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2cd5d7ef84e41be9dcc5ca392284a68 consensus state has no leader
I20260927 15:06:14.982337 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_69295492061f4d4faebde34d5343c0ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:14.982975 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69295492061f4d4faebde34d5343c0ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:14.984138 1238 leader_election.cc:341] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c65bc09865bc4a0283eaa4af9f860bdd
I20260927 15:06:14.984252 1238 leader_election.cc:302] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:14.984776 2544 raft_consensus.cc:2726] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:14.985335 1561 tablet_bootstrap.cc:492] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:14.985459 1561 ts_tablet_manager.cc:1397] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.001s
W20260927 15:06:14.986151 1102 consensus_peers.cc:487] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:14.986166 1561 raft_consensus.cc:348] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.986625 1561 raft_consensus.cc:374] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:14.986717 1561 raft_consensus.cc:729] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:14.986999 1561 consensus_queue.cc:260] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:14.990557 1561 ts_tablet_manager.cc:1428] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:14.992692 1561 tablet_bootstrap.cc:492] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:14.994912 1561 tablet_bootstrap.cc:654] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:14.995276 905 master_service.cc:946] ReplaceTablet: received request to replace tablet 16884c7343be436aa312ec0af40f5e33 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:14.995448 1376 leader_election.cc:302] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:14.995770 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 101243us
I20260927 15:06:14.996578 1562 ts_tablet_manager.cc:1918] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:14.997522 1562 log.cc:1196] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/9598ac8a916f4bf5b1cf9995a8149c70
I20260927 15:06:14.997979 1562 ts_tablet_manager.cc:1939] T 9598ac8a916f4bf5b1cf9995a8149c70 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:14.998878 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 668) took 5218 ms. Trace:
I20260927 15:06:14.999007 1562 rpcz_store.cc:276] 0927 15:06:09.780495 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.780555 (+ 60us) service_pool.cc:227] Handling call
0927 15:06:14.965193 (+5184638us) ts_tablet_manager.cc:1145] Deleting tablet 9598ac8a916f4bf5b1cf9995a8149c70
0927 15:06:14.965203 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.973076 (+ 7873us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.996483 (+ 23407us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.998857 (+ 2374us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5182393}
I20260927 15:06:14.999541 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 9598ac8a916f4bf5b1cf9995a8149c70 (table default.Table_3c3f771ede53431eac4f72641bf34c64 [id=11eb50b78bd74a098a861d227a4e2662]) successfully deleted
I20260927 15:06:15.000037 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 669) took 5156 ms. Trace:
I20260927 15:06:15.000170 1562 rpcz_store.cc:276] 0927 15:06:09.844055 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.844167 (+ 112us) service_pool.cc:227] Handling call
0927 15:06:14.999885 (+5155718us) ts_tablet_manager.cc:1145] Deleting tablet 643ec85d098444d6b082fe4038c50c4d
0927 15:06:14.999897 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.000018 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5144884}
W20260927 15:06:15.000710 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 643ec85d098444d6b082fe4038c50c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 643ec85d098444d6b082fe4038c50c4d already in progress: creating tablet
I20260927 15:06:15.001086 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 680) took 5061 ms. Trace:
I20260927 15:06:15.001205 1562 rpcz_store.cc:276] 0927 15:06:09.939621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.939721 (+ 100us) service_pool.cc:227] Handling call
0927 15:06:15.000978 (+5061257us) ts_tablet_manager.cc:1145] Deleting tablet 5e9b07ea3ec9457399e2b765580d06e7
0927 15:06:15.000989 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.001073 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5060993}
I20260927 15:06:15.001489 1556 tablet_bootstrap.cc:492] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
W20260927 15:06:15.001758 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 5e9b07ea3ec9457399e2b765580d06e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e9b07ea3ec9457399e2b765580d06e7 already in progress: creating tablet
I20260927 15:06:15.002780 2447 raft_consensus.cc:2726] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:15.002411 1562 tablet_replica.cc:330] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:15.003638 1434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c90e5c66d8564f68b401b3e4280499a7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.003818 1562 raft_consensus.cc:2229] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:15.003947 1434 raft_consensus.cc:2454] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.004313 1562 raft_consensus.cc:2258] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.004382 1099 leader_election.cc:302] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.004802 2423 raft_consensus.cc:2781] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.004885 2423 raft_consensus.cc:482] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.004949 2423 raft_consensus.cc:3037] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.004981 2233 ts_tablet_manager.cc:1918] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:15.005096 2233 log.cc:1196] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/70cc2e16bd6c40bf99ed4436f17d7096
I20260927 15:06:15.005482 1556 ts_tablet_manager.cc:1397] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.428s user 0.015s sys 0.006s
I20260927 15:06:15.006139 1556 raft_consensus.cc:348] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.006325 1556 raft_consensus.cc:374] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.006366 1556 raft_consensus.cc:729] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.006577 1556 consensus_queue.cc:260] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.007474 2423 raft_consensus.cc:504] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.007579 1556 ts_tablet_manager.cc:1428] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:15.008064 1556 tablet_bootstrap.cc:492] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:15.008724 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c90e5c66d8564f68b401b3e4280499a7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:15.009142 2431 raft_consensus.cc:482] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.009258 2431 raft_consensus.cc:504] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.009507 1556 tablet_bootstrap.cc:654] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.009773 2431 leader_election.cc:288] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:15.010919 1102 leader_election.cc:341] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.011077 2423 leader_election.cc:288] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.011313 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8a53f3c95c4cb7bce21d23f79af28c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:15.012089 1102 leader_election.cc:341] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.005479 2233 ts_tablet_manager.cc:1939] T 70cc2e16bd6c40bf99ed4436f17d7096 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:15.013181 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 760) took 3462 ms. Trace:
I20260927 15:06:15.013595 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8a53f3c95c4cb7bce21d23f79af28c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.013617 1434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c90e5c66d8564f68b401b3e4280499a7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.013813 1436 raft_consensus.cc:2454] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.013835 1434 raft_consensus.cc:3037] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.016363 1434 raft_consensus.cc:2454] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:15.013348 2233 rpcz_store.cc:276] 0927 15:06:11.550432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.550610 (+ 178us) service_pool.cc:227] Handling call
0927 15:06:14.828113 (+3277503us) ts_tablet_manager.cc:1145] Deleting tablet 70cc2e16bd6c40bf99ed4436f17d7096
0927 15:06:14.828127 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:14.943282 (+115155us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:14.999960 (+ 56678us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.013164 (+ 13204us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3277214}
I20260927 15:06:15.017858 1099 leader_election.cc:302] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.018193 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 70cc2e16bd6c40bf99ed4436f17d7096 (table default.Table_f20e18689ad245c5872112d6f987abb1 [id=2f01e95ae3994ed8aaf98bc5743e267d]) successfully deleted
I20260927 15:06:15.018260 1099 leader_election.cc:302] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.018579 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 762) took 3461 ms. Trace:
I20260927 15:06:15.018654 2233 rpcz_store.cc:276] 0927 15:06:11.556913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.556966 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:15.018454 (+3461488us) ts_tablet_manager.cc:1145] Deleting tablet 955461f27b6444d4b4c3f9a9f629d5e3
0927 15:06:15.018466 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.018563 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3461307}
I20260927 15:06:15.019105 2365 raft_consensus.cc:2781] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260927 15:06:15.019095 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 955461f27b6444d4b4c3f9a9f629d5e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 955461f27b6444d4b4c3f9a9f629d5e3 already in progress: creating tablet
I20260927 15:06:15.019186 2365 raft_consensus.cc:482] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.019246 2365 raft_consensus.cc:3037] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.019375 2233 tablet_replica.cc:330] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:15.021868 2365 raft_consensus.cc:504] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.022393 2119 ts_tablet_manager.cc:1918] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:15.022516 2119 log.cc:1196] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/54a07831078b48a59807f7da4a42bcec
I20260927 15:06:15.022481 2365 leader_election.cc:288] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.022632 2365 raft_consensus.cc:2781] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.023324 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8a53f3c95c4cb7bce21d23f79af28c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:15.023919 1102 leader_election.cc:341] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.025333 1552 tablet_bootstrap.cc:492] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:15.025746 1552 ts_tablet_manager.cc:1397] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.197s user 0.002s sys 0.001s
I20260927 15:06:15.029554 2233 raft_consensus.cc:2229] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.030210 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd8a53f3c95c4cb7bce21d23f79af28c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.030400 1433 raft_consensus.cc:3037] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.032974 1433 raft_consensus.cc:2454] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:15.026527 1552 raft_consensus.cc:348] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.033277 1552 raft_consensus.cc:374] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.033353 1552 raft_consensus.cc:729] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.033907 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 0ddca178f38e46b28fc1b5ed6416b990 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:15.033895 1552 consensus_queue.cc:260] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:15.035782 1102 consensus_peers.cc:487] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.038605 1099 leader_election.cc:302] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.038889 1556 tablet_bootstrap.cc:492] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:15.038975 2431 raft_consensus.cc:2781] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.039005 1556 ts_tablet_manager.cc:1397] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260927 15:06:15.039086 2431 raft_consensus.cc:686] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.039304 2431 consensus_queue.cc:237] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.039659 1556 raft_consensus.cc:348] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.039958 1556 raft_consensus.cc:374] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.040011 1556 raft_consensus.cc:729] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.040189 1556 consensus_queue.cc:260] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.040791 1556 ts_tablet_manager.cc:1428] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:15.041107 1556 tablet_bootstrap.cc:492] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:15.042549 1556 tablet_bootstrap.cc:654] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.043876 1552 ts_tablet_manager.cc:1428] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20260927 15:06:15.044512 1552 tablet_bootstrap.cc:492] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:15.046576 2365 raft_consensus.cc:686] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
W20260927 15:06:15.042018 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e7f0754b9ba4e21b05c51b0136729d1 consensus state has no leader
I20260927 15:06:15.048580 2365 consensus_queue.cc:237] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:15.049742 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0c0f030a072347fbaabddb2a5c58c45a consensus state has no leader
I20260927 15:06:15.043354 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2996ce3719d74bc9814dedbb61678d95" } modify_external_catalogs: true
I20260927 15:06:15.050030 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2996ce3719d74bc9814dedbb61678d95" } modify_external_catalogs: true
I20260927 15:06:15.051316 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet a90039faff27436db7b50fa4c4643d3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:15.052202 1099 consensus_peers.cc:487] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.041507 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 373b6e6c03614b78a8343c84095bd347 (table default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63]). Expected version 1 got 0
I20260927 15:06:15.056833 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet f271c76b5f2447239d3d014fbde4e8b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.064030 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 9576d1a36d7547bf81faabe9c362e3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.064934 2233 pending_rounds.cc:62] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:15.065001 2233 pending_rounds.cc:68] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976366807592960 op_type: NO_OP noop_request { }
I20260927 15:06:15.065140 2233 raft_consensus.cc:2866] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:15.065260 2233 raft_consensus.cc:2258] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:15.066778 809 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 44745.8us
I20260927 15:06:15.068938 2233 ts_tablet_manager.cc:1905] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.070004 2119 ts_tablet_manager.cc:1939] T 54a07831078b48a59807f7da4a42bcec P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:15.073215 1561 tablet_bootstrap.cc:492] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:15.073362 1561 ts_tablet_manager.cc:1397] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.083s user 0.003s sys 0.000s
I20260927 15:06:15.074220 1561 raft_consensus.cc:348] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.074455 1561 raft_consensus.cc:374] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.074522 1561 raft_consensus.cc:729] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.074911 1561 consensus_queue.cc:260] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.072474 1552 tablet_bootstrap.cc:654] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.077175 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1162bbf26733492099dc1bc4d2e6d62d" } new_table_name: "default.Table_1ee3f1481e2f48cbae9d666de8d1d7ff" modify_external_catalogs: true
I20260927 15:06:15.077376 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 737) took 2167 ms. Trace:
I20260927 15:06:15.078568 1556 tablet_bootstrap.cc:492] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:15.078540 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_72b3658396124482993401cff12bf063" } modify_external_catalogs: true
I20260927 15:06:15.077476 2119 rpcz_store.cc:276] 0927 15:06:12.909663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.910922 (+ 1259us) service_pool.cc:227] Handling call
0927 15:06:14.971876 (+2060954us) ts_tablet_manager.cc:1145] Deleting tablet 54a07831078b48a59807f7da4a42bcec
0927 15:06:14.971889 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.019096 (+ 47207us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.022254 (+ 3158us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.077353 (+ 55099us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2060816}
I20260927 15:06:15.078783 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_72b3658396124482993401cff12bf063" } modify_external_catalogs: true
I20260927 15:06:15.079097 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 751) took 1953 ms. Trace:
I20260927 15:06:15.079306 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 54a07831078b48a59807f7da4a42bcec (table default.Table_c8f0a331bf1f4f7c969299f5f0c4d5a6 [id=aa16f23914de4c7db1e460bb1c743a4d]) successfully deleted
I20260927 15:06:15.079670 1556 ts_tablet_manager.cc:1397] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.002s
I20260927 15:06:15.080487 1556 raft_consensus.cc:348] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.080775 1556 raft_consensus.cc:374] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.080888 1556 raft_consensus.cc:729] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.081122 1556 consensus_queue.cc:260] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.083781 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_15a9a14d40bf4481a5b9de28d05f1833" } modify_external_catalogs: true
I20260927 15:06:15.083962 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_15a9a14d40bf4481a5b9de28d05f1833" } modify_external_catalogs: true
I20260927 15:06:15.085271 1556 ts_tablet_manager.cc:1428] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:15.085600 1556 tablet_bootstrap.cc:492] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:15.087318 1556 tablet_bootstrap.cc:654] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.088913 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 429088342b4743c39fb1e38d235024de with delete_type TABLET_DATA_DELETED (replaced by tablet 79a3125723034cb48bc1a05fc4abbb82) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.092787 1561 ts_tablet_manager.cc:1428] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260927 15:06:15.093111 1561 tablet_bootstrap.cc:492] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:15.094273 1562 ts_tablet_manager.cc:1905] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:15.088207 1238 consensus_peers.cc:487] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48e7eac8753f425d90302360d228ee54. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.095402 2119 rpcz_store.cc:276] 0927 15:06:13.125292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.137058 (+ 11766us) service_pool.cc:227] Handling call
0927 15:06:15.078956 (+1941898us) ts_tablet_manager.cc:1145] Deleting tablet 1defd5bba3c34cae8893559ccfc8b5cd
0927 15:06:15.078968 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.079077 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1941646}
W20260927 15:06:15.095985 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1defd5bba3c34cae8893559ccfc8b5cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1defd5bba3c34cae8893559ccfc8b5cd already in progress: creating tablet
I20260927 15:06:15.096411 2119 tablet_replica.cc:330] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:15.099313 2119 raft_consensus.cc:2229] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:15.102284 2119 pending_rounds.cc:62] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:15.102465 2119 pending_rounds.cc:68] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976368308019200 op_type: NO_OP noop_request { }
I20260927 15:06:15.102670 2119 raft_consensus.cc:2866] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:15.102866 2119 raft_consensus.cc:2258] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.103634 1561 tablet_bootstrap.cc:654] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:15.104365 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff5f20f300324dbfae4ae771878ac61e consensus state has no leader
I20260927 15:06:15.105268 2119 ts_tablet_manager.cc:1905] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.106541 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet fd8a53f3c95c4cb7bce21d23f79af28c (table default.Table_e08ec6e011ab4bf586420eaf92cfe107 [id=a51d9c4b701c4c639d904aef0ac3a2cb]). Expected version 1 got 0
I20260927 15:06:15.108388 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b2f533f5104548d88d8fae693168a8b6" } modify_external_catalogs: true
I20260927 15:06:15.108623 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b2f533f5104548d88d8fae693168a8b6" } modify_external_catalogs: true
I20260927 15:06:15.110796 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 814c20f4af8a401a890f4a873ddcb0f3 (DEFAULT_TABLE table=default.Table_7c21987b6b304665a44fbb61a3d4e790 [id=5916c96fec3f4f4d97497103e76e1e21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.111245 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 814c20f4af8a401a890f4a873ddcb0f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.111486 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 03ce4e8370634ff4967865be6caafab2 (DEFAULT_TABLE table=default.Table_1ea5ac72d6cf4e4fb24f58b2152fb8e8 [id=43c7c1feaff744c2888233c3504489fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.111811 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ce4e8370634ff4967865be6caafab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.111792 1562 ts_tablet_manager.cc:1918] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:15.111920 1562 log.cc:1196] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/27c3283a40f14eb4868767799cfdf7bd
I20260927 15:06:15.112282 1562 ts_tablet_manager.cc:1939] T 27c3283a40f14eb4868767799cfdf7bd P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:15.115139 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 1e526da71e8d4be7b0038837da6bce07 (DEFAULT_TABLE table=default.Table_2850befe4b7a44f883a51838f3297f0b [id=290722bccdea4c8082457054deae52fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.115151 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 814c20f4af8a401a890f4a873ddcb0f3 (DEFAULT_TABLE table=default.Table_7c21987b6b304665a44fbb61a3d4e790 [id=5916c96fec3f4f4d97497103e76e1e21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.115504 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e526da71e8d4be7b0038837da6bce07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.115530 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 814c20f4af8a401a890f4a873ddcb0f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.116364 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 79f98202a2004a3caf95c768d7f7095c (DEFAULT_TABLE table=default.Table_fb02ad6ad0ce454e9c2678bf69fe98da [id=e2fb9257389a4ea487e977b36c3ccdc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.116449 1561 tablet_bootstrap.cc:492] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:15.116570 1561 ts_tablet_manager.cc:1397] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20260927 15:06:15.118443 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 03ce4e8370634ff4967865be6caafab2 (DEFAULT_TABLE table=default.Table_1ea5ac72d6cf4e4fb24f58b2152fb8e8 [id=43c7c1feaff744c2888233c3504489fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.118582 1146 tablet_service.cc:1467] Processing CreateTablet for tablet c675eec4031342e8899134ac7b13feca (DEFAULT_TABLE table=default.Table_7d02d4f342db454687368766178c6b74 [id=e915a3cde65f49b59cc0d82c7f07b177]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.119009 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 79f98202a2004a3caf95c768d7f7095c (DEFAULT_TABLE table=default.Table_fb02ad6ad0ce454e9c2678bf69fe98da [id=e2fb9257389a4ea487e977b36c3ccdc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.119410 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f98202a2004a3caf95c768d7f7095c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.118810 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 814c20f4af8a401a890f4a873ddcb0f3 (DEFAULT_TABLE table=default.Table_7c21987b6b304665a44fbb61a3d4e790 [id=5916c96fec3f4f4d97497103e76e1e21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.118863 1130 tablet_service.cc:1467] Processing CreateTablet for tablet a19a13469f46417fa46f655effecf6b1 (DEFAULT_TABLE table=default.Table_fd7032c2d0864f37ae99a5152b4f154b [id=dbf6b00bba534e9aa884b741bb5f2d7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.119050 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 27228383f92b4fc9a8a975e9ed7adb76 (DEFAULT_TABLE table=default.Table_7c70fe3ebd254ab7aea273501a92997e [id=d55613d63aae48639cab3149f71fae31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.119314 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 79f98202a2004a3caf95c768d7f7095c (DEFAULT_TABLE table=default.Table_fb02ad6ad0ce454e9c2678bf69fe98da [id=e2fb9257389a4ea487e977b36c3ccdc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.119086 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 1e526da71e8d4be7b0038837da6bce07 (DEFAULT_TABLE table=default.Table_2850befe4b7a44f883a51838f3297f0b [id=290722bccdea4c8082457054deae52fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.122455 1274 tablet_service.cc:1467] Processing CreateTablet for tablet db4b79f03a3f4bddaa58b01aa432287f (DEFAULT_TABLE table=default.Table_f68c513d45714b3eb9c20832e7117145 [id=22effe62309e41cdb6182d18b721032f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.122670 1281 tablet_service.cc:1467] Processing CreateTablet for tablet c675eec4031342e8899134ac7b13feca (DEFAULT_TABLE table=default.Table_7d02d4f342db454687368766178c6b74 [id=e915a3cde65f49b59cc0d82c7f07b177]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.122845 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db4b79f03a3f4bddaa58b01aa432287f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.123041 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c675eec4031342e8899134ac7b13feca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.122457 1267 tablet_service.cc:1467] Processing CreateTablet for tablet a19a13469f46417fa46f655effecf6b1 (DEFAULT_TABLE table=default.Table_fd7032c2d0864f37ae99a5152b4f154b [id=dbf6b00bba534e9aa884b741bb5f2d7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.123442 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19a13469f46417fa46f655effecf6b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.126082 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 1e526da71e8d4be7b0038837da6bce07 (DEFAULT_TABLE table=default.Table_2850befe4b7a44f883a51838f3297f0b [id=290722bccdea4c8082457054deae52fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.126495 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e526da71e8d4be7b0038837da6bce07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.126899 1403 tablet_service.cc:1467] Processing CreateTablet for tablet db4b79f03a3f4bddaa58b01aa432287f (DEFAULT_TABLE table=default.Table_f68c513d45714b3eb9c20832e7117145 [id=22effe62309e41cdb6182d18b721032f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.127104 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 27228383f92b4fc9a8a975e9ed7adb76 (DEFAULT_TABLE table=default.Table_7c70fe3ebd254ab7aea273501a92997e [id=d55613d63aae48639cab3149f71fae31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.127542 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27228383f92b4fc9a8a975e9ed7adb76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.129392 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1e0508139d3f403a94638c6a7cfb6a35
I20260927 15:06:15.131006 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 49071911dfd6435e93f3c223a8b52a15 (DEFAULT_TABLE table=default.Table_fb5e668155a5429e970ced9b7909adf5 [id=f2dc71e4066642a2bf4b23d3df72b133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.131038 1561 raft_consensus.cc:348] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.131495 1561 raft_consensus.cc:374] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.131554 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 1d4ce536aa8448e08da50ef168c924f2 (DEFAULT_TABLE table=default.Table_2a8e66ce332c4f78b4c4031a45586dba [id=a61c0bfa74064a11b47930153b739294]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.131621 1561 raft_consensus.cc:729] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.133488 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 27228383f92b4fc9a8a975e9ed7adb76 (DEFAULT_TABLE table=default.Table_7c70fe3ebd254ab7aea273501a92997e [id=d55613d63aae48639cab3149f71fae31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.133905 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27228383f92b4fc9a8a975e9ed7adb76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.131930 1561 consensus_queue.cc:260] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.134289 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 1d4ce536aa8448e08da50ef168c924f2 (DEFAULT_TABLE table=default.Table_2a8e66ce332c4f78b4c4031a45586dba [id=a61c0bfa74064a11b47930153b739294]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.134655 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d4ce536aa8448e08da50ef168c924f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.137529 1561 ts_tablet_manager.cc:1428] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.021s user 0.003s sys 0.001s
I20260927 15:06:15.138505 1561 tablet_bootstrap.cc:492] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:15.139179 2446 raft_consensus.cc:482] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.139315 2446 raft_consensus.cc:504] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.139555 1552 tablet_bootstrap.cc:492] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:15.139441 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2804c8e3cffa4b3db7b87ebed56475b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:15.139679 1552 ts_tablet_manager.cc:1397] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.095s user 0.002s sys 0.006s
I20260927 15:06:15.139907 2446 leader_election.cc:288] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:15.140048 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2804c8e3cffa4b3db7b87ebed56475b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.140317 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_437d2682e5f7473fa0056683c1d8babc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:15.140566 1552 raft_consensus.cc:348] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.140785 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f98202a2004a3caf95c768d7f7095c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:15.140764 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_437d2682e5f7473fa0056683c1d8babc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.140807 1552 raft_consensus.cc:374] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.140865 1552 raft_consensus.cc:729] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.141088 1552 consensus_queue.cc:260] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.141799 1552 ts_tablet_manager.cc:1428] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:15.142505 1552 tablet_bootstrap.cc:492] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:15.144586 1552 tablet_bootstrap.cc:654] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.147096 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f271c76b5f2447239d3d014fbde4e8b2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:15.147806 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d4ce536aa8448e08da50ef168c924f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.147922 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 771ce4b9675742bc88306e4d099cbb82
I20260927 15:06:15.148677 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f271c76b5f2447239d3d014fbde4e8b2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:15.119781 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ce4e8370634ff4967865be6caafab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.149539 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19a13469f46417fa46f655effecf6b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.150909 1411 tablet_service.cc:1467] Processing CreateTablet for tablet a0feb5ba11c943b0a1e97e493ddcb9e2 (DEFAULT_TABLE table=default.Table_8ba96fdd979f408489e269fdd20a3ddb [id=6aa5513cc702466ebd6a136f5468be3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.151283 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0feb5ba11c943b0a1e97e493ddcb9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.152177 1552 tablet_bootstrap.cc:492] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:15.152426 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 771ce4b9675742bc88306e4d099cbb82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.152951 1552 ts_tablet_manager.cc:1397] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260927 15:06:15.155098 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27228383f92b4fc9a8a975e9ed7adb76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.156946 1561 tablet_bootstrap.cc:654] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.158054 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7f2a9378aa46462b97906be25df8d90f
I20260927 15:06:15.158993 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b5e418f9ce5e41128b17f01e9e909ecb
I20260927 15:06:15.159135 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c675eec4031342e8899134ac7b13feca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.159353 1552 raft_consensus.cc:348] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.160163 1552 raft_consensus.cc:374] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.160388 1552 raft_consensus.cc:729] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.162184 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f2a9378aa46462b97906be25df8d90f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.163020 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e526da71e8d4be7b0038837da6bce07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.163132 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e418f9ce5e41128b17f01e9e909ecb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.161973 1552 consensus_queue.cc:260] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.163501 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79f98202a2004a3caf95c768d7f7095c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.163938 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 814c20f4af8a401a890f4a873ddcb0f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:15.164913 1376 leader_election.cc:341] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.165220 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49071911dfd6435e93f3c223a8b52a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.167717 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 37c8d609473e438f84ac761853944fae (DEFAULT_TABLE table=default.Table_c08ed41f0c434ebb848a2d9e52a6f37e [id=7d59497564f040f484c642920028ea6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.168087 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37c8d609473e438f84ac761853944fae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:15.168533 1374 leader_election.cc:341] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.170173 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0508139d3f403a94638c6a7cfb6a35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.170459 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 49071911dfd6435e93f3c223a8b52a15 (DEFAULT_TABLE table=default.Table_fb5e668155a5429e970ced9b7909adf5 [id=f2dc71e4066642a2bf4b23d3df72b133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.170811 1132 tablet_service.cc:1467] Processing CreateTablet for tablet a0feb5ba11c943b0a1e97e493ddcb9e2 (DEFAULT_TABLE table=default.Table_8ba96fdd979f408489e269fdd20a3ddb [id=6aa5513cc702466ebd6a136f5468be3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.171686 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 1d4ce536aa8448e08da50ef168c924f2 (DEFAULT_TABLE table=default.Table_2a8e66ce332c4f78b4c4031a45586dba [id=a61c0bfa74064a11b47930153b739294]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.172152 1140 tablet_service.cc:1467] Processing CreateTablet for tablet db4b79f03a3f4bddaa58b01aa432287f (DEFAULT_TABLE table=default.Table_f68c513d45714b3eb9c20832e7117145 [id=22effe62309e41cdb6182d18b721032f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.172462 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0ddca178f38e46b28fc1b5ed6416b990
I20260927 15:06:15.172605 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 40d9fc9ea036480b815773e8dc860f71 (DEFAULT_TABLE table=default.Table_ff7e9f1a134c4f839069e2670ee81272 [id=517c09199418410cae057a3062cc183c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.172861 909 catalog_manager.cc:6565] ReplaceTablet: tablet 0ddca178f38e46b28fc1b5ed6416b990 deleted and replaced by tablet 2c58c58ec7b94896a8d5d8dad7c0884b
I20260927 15:06:15.172889 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 771ce4b9675742bc88306e4d099cbb82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.173205 1136 tablet_service.cc:1467] Processing CreateTablet for tablet db62070ea78b43e69ddd249a71e9ceea (DEFAULT_TABLE table=default.Table_7922646448e64068a424e80834b4ca50 [id=bd33a6834c0643959c1aa982cd603abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.173319 2119 ts_tablet_manager.cc:1918] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:15.173444 2119 log.cc:1196] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/b375902081c54cdb84fdb075eec6baf7
I20260927 15:06:15.173722 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 024f439ab5774474ad197bf7fa557ac7 (DEFAULT_TABLE table=default.Table_a74f885820c0411d9d4f5276fadeeaa6 [id=21a22075da8c4ddfb2fdad488ef5fc39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.173864 2119 ts_tablet_manager.cc:1939] T b375902081c54cdb84fdb075eec6baf7 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:15.174095 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f2a9378aa46462b97906be25df8d90f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.174279 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_878d06515f18478389e9e413449a06e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:15.174443 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 7fc551eab48542029c50a300b33dab5f (DEFAULT_TABLE table=default.Table_928c6a3f3fcc44c2a6e5b11a7eea812b [id=a6f4d760e6644b2a9ff195a8ba16b32c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.174844 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e418f9ce5e41128b17f01e9e909ecb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:15.174889 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_878d06515f18478389e9e413449a06e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.175037 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ddca178f38e46b28fc1b5ed6416b990 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c58c58ec7b94896a8d5d8dad7c0884b) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.175400 1145 tablet_service.cc:1467] Processing CreateTablet for tablet c90e10a8cad34967be2fab613de9c78f (DEFAULT_TABLE table=default.Table_76972cc723b84c24856db8afb0f9c6f0 [id=c2ede5d3c31b4690b9e6e8fffa4bf397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.175848 1143 tablet_service.cc:1467] Processing CreateTablet for tablet da2f0eb83f064440a6cc732cb73f749e (DEFAULT_TABLE table=default.Table_7ec45f56caa54587b84d36ab92e4c546 [id=85a279dd520c47e49cc48da0d6b21d21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.176050 1552 ts_tablet_manager.cc:1428] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260927 15:06:15.176331 1552 tablet_bootstrap.cc:492] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:15.176317 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 37c8d609473e438f84ac761853944fae (DEFAULT_TABLE table=default.Table_c08ed41f0c434ebb848a2d9e52a6f37e [id=7d59497564f040f484c642920028ea6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.176594 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_50835d1170044558b96537c8ecdb13de" } new_table_name: "default.Table_b473384d24f249f3ae8bafb57472b121" modify_external_catalogs: true
I20260927 15:06:15.176764 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 7b20c32fb6ca424c9cf3f4609c1a009f (DEFAULT_TABLE table=default.Table_f1205bedaac343b3bb93938eb3835eb9 [id=c8b1240defce4a96b8aadfb152d40099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.177742 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 40e38de6a140441181beab1d7c2e6d79 (DEFAULT_TABLE table=default.Table_43b9d3086ec24ab3b899f51a4856222c [id=1ca006da0ee04bd686e93da1f990f96c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.177990 1552 tablet_bootstrap.cc:654] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.179034 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 0163a49d9a894953905e20941878400b (DEFAULT_TABLE table=default.Table_d22d3d3c2f4845909ca307cd51bb96e3 [id=a19724b91bbe4d8caf3fd8fc5cc05b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.186945 2544 consensus_queue.cc:1035] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:15.189738 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0508139d3f403a94638c6a7cfb6a35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.189671 1271 tablet_service.cc:1467] Processing CreateTablet for tablet da2f0eb83f064440a6cc732cb73f749e (DEFAULT_TABLE table=default.Table_7ec45f56caa54587b84d36ab92e4c546 [id=85a279dd520c47e49cc48da0d6b21d21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.190168 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da2f0eb83f064440a6cc732cb73f749e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.190115 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 7b20c32fb6ca424c9cf3f4609c1a009f (DEFAULT_TABLE table=default.Table_f1205bedaac343b3bb93938eb3835eb9 [id=c8b1240defce4a96b8aadfb152d40099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.190333 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 024f439ab5774474ad197bf7fa557ac7 (DEFAULT_TABLE table=default.Table_a74f885820c0411d9d4f5276fadeeaa6 [id=21a22075da8c4ddfb2fdad488ef5fc39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.190444 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b20c32fb6ca424c9cf3f4609c1a009f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.190672 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024f439ab5774474ad197bf7fa557ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.190904 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 40d9fc9ea036480b815773e8dc860f71 (DEFAULT_TABLE table=default.Table_ff7e9f1a134c4f839069e2670ee81272 [id=517c09199418410cae057a3062cc183c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.190980 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet b5e418f9ce5e41128b17f01e9e909ecb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.191201 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d9fc9ea036480b815773e8dc860f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.191274 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 40e38de6a140441181beab1d7c2e6d79 (DEFAULT_TABLE table=default.Table_43b9d3086ec24ab3b899f51a4856222c [id=1ca006da0ee04bd686e93da1f990f96c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.191608 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40e38de6a140441181beab1d7c2e6d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.194290 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 0163a49d9a894953905e20941878400b (DEFAULT_TABLE table=default.Table_d22d3d3c2f4845909ca307cd51bb96e3 [id=a19724b91bbe4d8caf3fd8fc5cc05b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.194559 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0163a49d9a894953905e20941878400b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.195043 1283 tablet_service.cc:1467] Processing CreateTablet for tablet a0feb5ba11c943b0a1e97e493ddcb9e2 (DEFAULT_TABLE table=default.Table_8ba96fdd979f408489e269fdd20a3ddb [id=6aa5513cc702466ebd6a136f5468be3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.195135 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 37c8d609473e438f84ac761853944fae (DEFAULT_TABLE table=default.Table_c08ed41f0c434ebb848a2d9e52a6f37e [id=7d59497564f040f484c642920028ea6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.195327 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 771ce4b9675742bc88306e4d099cbb82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.190929 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f2a9378aa46462b97906be25df8d90f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.195598 1285 tablet_service.cc:1467] Processing CreateTablet for tablet db62070ea78b43e69ddd249a71e9ceea (DEFAULT_TABLE table=default.Table_7922646448e64068a424e80834b4ca50 [id=bd33a6834c0643959c1aa982cd603abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.195768 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 7fc551eab48542029c50a300b33dab5f (DEFAULT_TABLE table=default.Table_928c6a3f3fcc44c2a6e5b11a7eea812b [id=a6f4d760e6644b2a9ff195a8ba16b32c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.196143 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fc551eab48542029c50a300b33dab5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.196738 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37c8d609473e438f84ac761853944fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.198176 2431 raft_consensus.cc:482] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.198381 2431 raft_consensus.cc:504] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.199097 2431 leader_election.cc:288] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.199869 2431 raft_consensus.cc:482] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.199997 2431 raft_consensus.cc:504] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.200559 2431 leader_election.cc:288] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.201228 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4a123886a847d08b2a94ff5e4e01ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:15.202169 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb2a8e788b71451da4a18f52b643e5e2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:15.202600 1102 leader_election.cc:341] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:15.203014 1102 leader_election.cc:341] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.161459 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 024f439ab5774474ad197bf7fa557ac7 (DEFAULT_TABLE table=default.Table_a74f885820c0411d9d4f5276fadeeaa6 [id=21a22075da8c4ddfb2fdad488ef5fc39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.204246 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0feb5ba11c943b0a1e97e493ddcb9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.204684 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db62070ea78b43e69ddd249a71e9ceea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.168666 1374 leader_election.cc:302] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:15.168674 1401 tablet_service.cc:1467] Processing CreateTablet for tablet da2f0eb83f064440a6cc732cb73f749e (DEFAULT_TABLE table=default.Table_7ec45f56caa54587b84d36ab92e4c546 [id=85a279dd520c47e49cc48da0d6b21d21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.185041 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 7b20c32fb6ca424c9cf3f4609c1a009f (DEFAULT_TABLE table=default.Table_f1205bedaac343b3bb93938eb3835eb9 [id=c8b1240defce4a96b8aadfb152d40099]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.202936 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e0508139d3f403a94638c6a7cfb6a35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.209657 2447 raft_consensus.cc:2726] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:15.203609 1406 tablet_service.cc:1467] Processing CreateTablet for tablet db62070ea78b43e69ddd249a71e9ceea (DEFAULT_TABLE table=default.Table_7922646448e64068a424e80834b4ca50 [id=bd33a6834c0643959c1aa982cd603abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.204008 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 03ce4e8370634ff4967865be6caafab2 (DEFAULT_TABLE table=default.Table_1ea5ac72d6cf4e4fb24f58b2152fb8e8 [id=43c7c1feaff744c2888233c3504489fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.204115 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 0163a49d9a894953905e20941878400b (DEFAULT_TABLE table=default.Table_d22d3d3c2f4845909ca307cd51bb96e3 [id=a19724b91bbe4d8caf3fd8fc5cc05b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.209627 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 7fc551eab48542029c50a300b33dab5f (DEFAULT_TABLE table=default.Table_928c6a3f3fcc44c2a6e5b11a7eea812b [id=a6f4d760e6644b2a9ff195a8ba16b32c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.216727 906 master_service.cc:946] ReplaceTablet: received request to replace tablet ee27f67bc245495a9e29bcac3e7d3846 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:15.219220 2544 raft_consensus.cc:482] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.219367 2544 raft_consensus.cc:504] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.219995 2544 leader_election.cc:288] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:15.222288 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "373b6e6c03614b78a8343c84095bd347" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:15.230716 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db4b79f03a3f4bddaa58b01aa432287f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.231177 1402 tablet_service.cc:1467] Processing CreateTablet for tablet a19a13469f46417fa46f655effecf6b1 (DEFAULT_TABLE table=default.Table_fd7032c2d0864f37ae99a5152b4f154b [id=dbf6b00bba534e9aa884b741bb5f2d7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.231582 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 40e38de6a140441181beab1d7c2e6d79 (DEFAULT_TABLE table=default.Table_43b9d3086ec24ab3b899f51a4856222c [id=1ca006da0ee04bd686e93da1f990f96c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.232471 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb2a8e788b71451da4a18f52b643e5e2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.232674 1433 raft_consensus.cc:2454] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.233106 2544 consensus_queue.cc:1035] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:15.238956 2544 consensus_queue.cc:1035] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:15.243474 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da2f0eb83f064440a6cc732cb73f749e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.243531 1413 tablet_service.cc:1467] Processing CreateTablet for tablet c675eec4031342e8899134ac7b13feca (DEFAULT_TABLE table=default.Table_7d02d4f342db454687368766178c6b74 [id=e915a3cde65f49b59cc0d82c7f07b177]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.246160 1099 leader_election.cc:302] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:15.246666 1099 consensus_peers.cc:487] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0129eaa5636544e696076e439d713b1b. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.247054 2431 raft_consensus.cc:2781] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.247155 2431 raft_consensus.cc:482] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.247226 2431 raft_consensus.cc:3037] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.247454 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024f439ab5774474ad197bf7fa557ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.249153 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 40d9fc9ea036480b815773e8dc860f71 (DEFAULT_TABLE table=default.Table_ff7e9f1a134c4f839069e2670ee81272 [id=517c09199418410cae057a3062cc183c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.249362 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 49071911dfd6435e93f3c223a8b52a15 (DEFAULT_TABLE table=default.Table_fb5e668155a5429e970ced9b7909adf5 [id=f2dc71e4066642a2bf4b23d3df72b133]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.249670 2431 raft_consensus.cc:504] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.251034 2431 leader_election.cc:288] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.251497 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb2a8e788b71451da4a18f52b643e5e2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:15.252389 1102 leader_election.cc:341] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.260450 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "373b6e6c03614b78a8343c84095bd347" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.260842 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4a123886a847d08b2a94ff5e4e01ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.261022 1436 raft_consensus.cc:2454] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.261114 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb2a8e788b71451da4a18f52b643e5e2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.261281 1433 raft_consensus.cc:3037] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.261801 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c675eec4031342e8899134ac7b13feca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.262918 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ddca178f38e46b28fc1b5ed6416b990 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c58c58ec7b94896a8d5d8dad7c0884b) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.263291 1410 tablet_service.cc:1467] Processing CreateTablet for tablet c90e10a8cad34967be2fab613de9c78f (DEFAULT_TABLE table=default.Table_76972cc723b84c24856db8afb0f9c6f0 [id=c2ede5d3c31b4690b9e6e8fffa4bf397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.267115 1099 leader_election.cc:302] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.270026 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ce4e8370634ff4967865be6caafab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.275054 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0feb5ba11c943b0a1e97e493ddcb9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.275678 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49071911dfd6435e93f3c223a8b52a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.270984 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19a13469f46417fa46f655effecf6b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.276093 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da2f0eb83f064440a6cc732cb73f749e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.276467 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d9fc9ea036480b815773e8dc860f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.276823 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d4ce536aa8448e08da50ef168c924f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.277168 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37c8d609473e438f84ac761853944fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.277905 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db4b79f03a3f4bddaa58b01aa432287f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.278255 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024f439ab5774474ad197bf7fa557ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.278599 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b20c32fb6ca424c9cf3f4609c1a009f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.278950 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40e38de6a140441181beab1d7c2e6d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.279263 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db62070ea78b43e69ddd249a71e9ceea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.279683 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fc551eab48542029c50a300b33dab5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.279685 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0163a49d9a894953905e20941878400b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.280086 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c90e10a8cad34967be2fab613de9c78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.281337 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49071911dfd6435e93f3c223a8b52a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.281474 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40e38de6a140441181beab1d7c2e6d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.281574 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db62070ea78b43e69ddd249a71e9ceea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.281915 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40d9fc9ea036480b815773e8dc860f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.273615 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 75b4abbc451b44a2af08e17f49f570f1 (DEFAULT_TABLE table=default.Table_567fc896d4c84f7da0e0933e6f6965de [id=a22352b708874707a61f43a3823e1ac3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.284745 2568 raft_consensus.cc:2781] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.284828 2568 raft_consensus.cc:482] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.284896 2568 raft_consensus.cc:3037] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.288444 2568 raft_consensus.cc:504] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.289136 2568 leader_election.cc:288] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.290131 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4a123886a847d08b2a94ff5e4e01ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:15.290494 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b20c32fb6ca424c9cf3f4609c1a009f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:15.290729 1102 leader_election.cc:341] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.290997 1433 raft_consensus.cc:2454] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:15.292490 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c90e10a8cad34967be2fab613de9c78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.294492 1099 leader_election.cc:302] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.275625 2233 ts_tablet_manager.cc:1918] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:15.295099 2233 log.cc:1196] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/9049d003d787403f80aa0c08872dd3b5
I20260927 15:06:15.295138 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fc551eab48542029c50a300b33dab5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.295670 2233 ts_tablet_manager.cc:1939] T 9049d003d787403f80aa0c08872dd3b5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:15.296653 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 770) took 3252 ms. Trace:
I20260927 15:06:15.296840 2233 rpcz_store.cc:276] 0927 15:06:12.043757 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.044095 (+ 338us) service_pool.cc:227] Handling call
0927 15:06:15.019331 (+2975236us) ts_tablet_manager.cc:1145] Deleting tablet 9049d003d787403f80aa0c08872dd3b5
0927 15:06:15.019342 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.064770 (+ 45428us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x61500012b224. stack: 00007f26d729d66e 00007f26d729d430 00007f26d63245ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f26e27d904d 00007f26e3a7d5ec 00007f26e640c2e6 00007f26e643e404 00007f26e641f870 00007f26e641f5fd 00000000009edb7c 00007f26d72e3344 00007f26d72e691b 00007f26d72e6798
0927 15:06:15.245378 (+180608us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.275524 (+ 30146us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.296628 (+ 21104us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":22936320,"tablet-delete.queue_time_us":2974976}
I20260927 15:06:15.297788 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 771) took 3253 ms. Trace:
I20260927 15:06:15.297993 2233 rpcz_store.cc:276] 0927 15:06:12.043887 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.044398 (+ 511us) service_pool.cc:227] Handling call
0927 15:06:15.297630 (+3253232us) ts_tablet_manager.cc:1145] Deleting tablet 7afe7ec3929649a8b647eca15e3b7514
0927 15:06:15.297645 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.297768 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3253069}
I20260927 15:06:15.298583 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 772) took 3254 ms. Trace:
I20260927 15:06:15.298702 2233 rpcz_store.cc:276] 0927 15:06:12.044037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.044601 (+ 564us) service_pool.cc:227] Handling call
0927 15:06:15.298475 (+3253874us) ts_tablet_manager.cc:1145] Deleting tablet 6b4beb4112734b9c91e32b300fd266d7
0927 15:06:15.298488 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.298572 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3253682}
I20260927 15:06:15.299449 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c4a123886a847d08b2a94ff5e4e01ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.299626 1433 raft_consensus.cc:3037] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.300073 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 775) took 3070 ms. Trace:
I20260927 15:06:15.300189 2233 rpcz_store.cc:276] 0927 15:06:12.230014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.230078 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:15.299979 (+3069901us) ts_tablet_manager.cc:1145] Deleting tablet 89783d26db9e49f0ae5171f929fcf1df
0927 15:06:15.299988 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.300056 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3069699}
I20260927 15:06:15.300625 2233 tablet_replica.cc:330] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:15.300944 2233 raft_consensus.cc:2229] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.301195 2233 raft_consensus.cc:2258] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.305397 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75b4abbc451b44a2af08e17f49f570f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.308838 1433 raft_consensus.cc:2454] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:15.316363 2233 ts_tablet_manager.cc:1905] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.323168 1556 tablet_bootstrap.cc:492] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:15.323381 1556 ts_tablet_manager.cc:1397] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.238s user 0.007s sys 0.010s
W20260927 15:06:15.323710 898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260927 15:06:15.329123 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_49701096d396411d89d8c88cc143c535"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.329782 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49701096d396411d89d8c88cc143c535 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.330768 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5ee809c4799544ffa55ff157b8e9bd43" } new_table_name: "default.Table_361742bb3ec54d7691380cd64898d3ea" modify_external_catalogs: true
I20260927 15:06:15.332091 1099 leader_election.cc:302] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.332504 2365 raft_consensus.cc:2781] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.332629 2365 raft_consensus.cc:686] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.332832 2365 consensus_queue.cc:237] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.333597 2569 raft_consensus.cc:2781] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.333712 2569 raft_consensus.cc:686] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.336342 912 catalog_manager.cc:5495] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:15.336690 1552 tablet_bootstrap.cc:492] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:15.336838 1552 ts_tablet_manager.cc:1397] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.161s user 0.000s sys 0.006s
I20260927 15:06:15.336834 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet fd8a53f3c95c4cb7bce21d23f79af28c (table default.Table_e08ec6e011ab4bf586420eaf92cfe107 [id=a51d9c4b701c4c639d904aef0ac3a2cb]). Expected version 1 got 0
I20260927 15:06:15.337532 1552 raft_consensus.cc:348] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.338944 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_068b8f93e2ef411b871c5550785e4ecc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.339473 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_068b8f93e2ef411b871c5550785e4ecc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.333894 2569 consensus_queue.cc:237] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.344759 910 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 373b6e6c03614b78a8343c84095bd347 (table default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63]). Expected version 1 got 0
I20260927 15:06:15.345603 1552 raft_consensus.cc:374] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.345679 1552 raft_consensus.cc:729] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.345873 1552 consensus_queue.cc:260] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.345871 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_551c1ec5b4f142ce8a709cc61e04ff56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.346611 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_551c1ec5b4f142ce8a709cc61e04ff56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.347282 2233 ts_tablet_manager.cc:1918] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:15.348444 1552 ts_tablet_manager.cc:1428] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260927 15:06:15.348685 1552 tablet_bootstrap.cc:492] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:15.349727 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fd7032c2d0864f37ae99a5152b4f154b" } new_table_name: "default.Table_4b000705b3ae4cca9dcf80f96bc1757c" modify_external_catalogs: true
I20260927 15:06:15.350203 1552 tablet_bootstrap.cc:654] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.352228 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1024b38f06bb4387bd24e98f0dee038c
I20260927 15:06:15.357340 1556 raft_consensus.cc:348] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.357566 1556 raft_consensus.cc:374] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.357612 1556 raft_consensus.cc:729] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.357777 1556 consensus_queue.cc:260] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.358284 1556 ts_tablet_manager.cc:1428] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.035s user 0.000s sys 0.000s
I20260927 15:06:15.360400 1556 tablet_bootstrap.cc:492] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:15.360678 1099 consensus_peers.cc:487] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04007cd4bd214b88a4664e23daf4b790. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.360872 2476 consensus_queue.cc:1035] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:15.363974 2233 log.cc:1196] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/c90e5c66d8564f68b401b3e4280499a7
I20260927 15:06:15.364472 2233 ts_tablet_manager.cc:1939] T c90e5c66d8564f68b401b3e4280499a7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:15.366199 2476 raft_consensus.cc:482] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.366333 2476 raft_consensus.cc:504] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.366961 2476 leader_election.cc:288] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.371520 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b9e88c3679d412cac7603f200cf899b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:15.372570 1102 leader_election.cc:341] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.372928 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0429ce74c70c4b5488ea76ad4707da49" } new_table_name: "default.Table_6b800efef870411cbff2ac364cc80460" modify_external_catalogs: true
I20260927 15:06:15.382985 2544 consensus_queue.cc:1035] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:15.386622 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3efa50b5970d4c598a6ea55a5273f07c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.387355 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3efa50b5970d4c598a6ea55a5273f07c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:15.389719 1238 consensus_peers.cc:487] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16884c7343be436aa312ec0af40f5e33. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.389910 1238 leader_election.cc:302] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:15.390122 2544 raft_consensus.cc:2726] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:15.393363 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ddca178f38e46b28fc1b5ed6416b990 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c58c58ec7b94896a8d5d8dad7c0884b) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.393744 1280 tablet_service.cc:1467] Processing CreateTablet for tablet c90e10a8cad34967be2fab613de9c78f (DEFAULT_TABLE table=default.Table_76972cc723b84c24856db8afb0f9c6f0 [id=c2ede5d3c31b4690b9e6e8fffa4bf397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.394091 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c90e10a8cad34967be2fab613de9c78f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.395159 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 752) took 2239 ms. Trace:
I20260927 15:06:15.395228 2119 rpcz_store.cc:276] 0927 15:06:13.155676 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.155798 (+ 122us) service_pool.cc:227] Handling call
0927 15:06:15.096350 (+1940552us) ts_tablet_manager.cc:1145] Deleting tablet b375902081c54cdb84fdb075eec6baf7
0927 15:06:15.096368 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.168835 (+ 72467us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.173237 (+ 4402us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.395144 (+221907us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1940302}
I20260927 15:06:15.395483 2119 tablet_replica.cc:330] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:15.395642 2119 raft_consensus.cc:2229] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.395812 2119 raft_consensus.cc:2258] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.396338 2119 ts_tablet_manager.cc:1905] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.398196 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cd55e22d8254ea8b1dab989517148ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.398384 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 1024b38f06bb4387bd24e98f0dee038c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.398521 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 75537edf83a040cba4da502c726bf456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.401961 2119 ts_tablet_manager.cc:1918] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:15.402105 2119 log.cc:1196] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/65c313ab6848428d8237557392669f6f
I20260927 15:06:15.402422 2119 ts_tablet_manager.cc:1939] T 65c313ab6848428d8237557392669f6f P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:15.402719 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 753) took 2246 ms. Trace:
I20260927 15:06:15.405479 2568 raft_consensus.cc:482] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:15.405632 2568 raft_consensus.cc:504] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.406178 2568 leader_election.cc:288] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:15.407192 1102 leader_election.cc:341] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Not found: Tablet not found: 765b3ee3323846c5ba598f47478fd367
I20260927 15:06:15.409053 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 777) took 3178 ms. Trace:
I20260927 15:06:15.409168 2233 rpcz_store.cc:276] 0927 15:06:12.230242 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.230285 (+ 43us) service_pool.cc:227] Handling call
0927 15:06:15.300586 (+3070301us) ts_tablet_manager.cc:1145] Deleting tablet c90e5c66d8564f68b401b3e4280499a7
0927 15:06:15.300596 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.338118 (+ 37522us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.347187 (+ 9069us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.409029 (+ 61842us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3070095}
I20260927 15:06:15.409674 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 776) took 3179 ms. Trace:
I20260927 15:06:15.409761 2233 rpcz_store.cc:276] 0927 15:06:12.230155 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.230314 (+ 159us) service_pool.cc:227] Handling call
0927 15:06:15.409521 (+3179207us) ts_tablet_manager.cc:1145] Deleting tablet 63fbd388210d4a1aabfcf27c7533efbf
0927 15:06:15.409538 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.409656 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17,"tablet-delete.queue_time_us":3179021}
I20260927 15:06:15.410022 2233 tablet_replica.cc:330] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:15.410197 2233 raft_consensus.cc:2229] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.410357 2233 raft_consensus.cc:2258] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.410980 2233 ts_tablet_manager.cc:1905] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.414561 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 1024b38f06bb4387bd24e98f0dee038c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:15.417743 1099 leader_election.cc:341] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 765b3ee3323846c5ba598f47478fd367
I20260927 15:06:15.417863 1099 leader_election.cc:302] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:15.417781 2233 ts_tablet_manager.cc:1918] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:15.418033 2233 log.cc:1196] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/6cc8bd2079f84da39e13113e6699bf5e
I20260927 15:06:15.418217 2568 consensus_queue.cc:1035] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:15.418404 2233 ts_tablet_manager.cc:1939] T 6cc8bd2079f84da39e13113e6699bf5e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:15.418730 2568 raft_consensus.cc:2726] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:15.419019 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b9e88c3679d412cac7603f200cf899b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.419270 1438 raft_consensus.cc:2454] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.420064 1099 leader_election.cc:302] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.420377 2431 raft_consensus.cc:2781] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.420437 2431 raft_consensus.cc:482] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.420487 2431 raft_consensus.cc:3037] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.419268 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 778) took 3188 ms. Trace:
I20260927 15:06:15.422055 2233 rpcz_store.cc:276] 0927 15:06:12.230622 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.230664 (+ 42us) service_pool.cc:227] Handling call
0927 15:06:15.409989 (+3179325us) ts_tablet_manager.cc:1145] Deleting tablet 6cc8bd2079f84da39e13113e6699bf5e
0927 15:06:15.409997 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.414089 (+ 4092us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.417698 (+ 3609us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.419252 (+ 1554us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3179118}
I20260927 15:06:15.422156 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet b375902081c54cdb84fdb075eec6baf7 (table default.Table_1b1639fc47724907a79f94e34f6b9469 [id=8be5c577dcb3490d883bede28c6b73ea]) successfully deleted
I20260927 15:06:15.422465 2233 tablet_replica.cc:330] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:15.422663 2233 raft_consensus.cc:2229] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.422842 2233 raft_consensus.cc:2258] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.423369 2233 ts_tablet_manager.cc:1905] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:15.428136 1102 consensus_peers.cc:487] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.436662 2476 raft_consensus.cc:482] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.436803 2476 raft_consensus.cc:504] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.437314 2476 leader_election.cc:288] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.437985 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033e71f60c3e47fd9647db090d4d6cd5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:15.438606 1102 leader_election.cc:341] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.442950 1556 tablet_bootstrap.cc:654] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.445621 2544 raft_consensus.cc:482] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.445745 2544 raft_consensus.cc:504] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.446333 2544 leader_election.cc:288] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.451651 1556 tablet_bootstrap.cc:492] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:15.451999 1556 ts_tablet_manager.cc:1397] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.092s user 0.001s sys 0.003s
I20260927 15:06:15.453094 1556 raft_consensus.cc:348] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.453893 2431 raft_consensus.cc:504] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.454870 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b9e88c3679d412cac7603f200cf899b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:15.455658 1552 tablet_bootstrap.cc:492] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
W20260927 15:06:15.455714 1099 consensus_peers.cc:487] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.455781 1552 ts_tablet_manager.cc:1397] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.107s user 0.003s sys 0.000s
W20260927 15:06:15.455960 1102 leader_election.cc:341] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.456795 1561 tablet_bootstrap.cc:492] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:15.456926 1561 ts_tablet_manager.cc:1397] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.319s user 0.012s sys 0.051s
I20260927 15:06:15.457436 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd55e22d8254ea8b1dab989517148ca" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:15.458036 1561 raft_consensus.cc:348] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.458277 1561 raft_consensus.cc:374] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.458340 1561 raft_consensus.cc:729] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.458546 1561 consensus_queue.cc:260] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.459254 1561 ts_tablet_manager.cc:1428] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:15.459549 1561 tablet_bootstrap.cc:492] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:15.460866 1561 tablet_bootstrap.cc:654] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.462188 2431 leader_election.cc:288] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.455928 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033e71f60c3e47fd9647db090d4d6cd5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.463594 1556 raft_consensus.cc:374] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.463680 1433 raft_consensus.cc:2454] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.463685 1556 raft_consensus.cc:729] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.464231 1556 consensus_queue.cc:260] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.464510 1552 raft_consensus.cc:348] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.464716 1552 raft_consensus.cc:374] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.464778 1552 raft_consensus.cc:729] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.468394 1552 consensus_queue.cc:260] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.469306 1556 ts_tablet_manager.cc:1428] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.017s user 0.000s sys 0.001s
I20260927 15:06:15.469511 1099 leader_election.cc:302] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.470058 2568 raft_consensus.cc:2781] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.470142 2568 raft_consensus.cc:482] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.470218 2568 raft_consensus.cc:3037] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.472218 1561 tablet_bootstrap.cc:492] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:15.472370 1561 ts_tablet_manager.cc:1397] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260927 15:06:15.472798 2568 raft_consensus.cc:504] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.473474 2568 leader_election.cc:288] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.473850 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033e71f60c3e47fd9647db090d4d6cd5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:15.474335 1102 leader_election.cc:341] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.474677 1561 raft_consensus.cc:348] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.474917 1561 raft_consensus.cc:374] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.474999 1561 raft_consensus.cc:729] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.475189 1561 consensus_queue.cc:260] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.475342 1552 ts_tablet_manager.cc:1428] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260927 15:06:15.475729 1561 ts_tablet_manager.cc:1428] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:15.475868 1556 tablet_bootstrap.cc:492] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:15.476019 1561 tablet_bootstrap.cc:492] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:15.477245 1561 tablet_bootstrap.cc:654] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.477504 1552 tablet_bootstrap.cc:492] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:15.479110 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b9e88c3679d412cac7603f200cf899b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.479331 1433 raft_consensus.cc:3037] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.482520 1561 tablet_bootstrap.cc:492] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:15.482678 1561 ts_tablet_manager.cc:1397] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260927 15:06:15.483342 1433 raft_consensus.cc:2454] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:15.484215 1102 consensus_peers.cc:487] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.486454 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 75b4abbc451b44a2af08e17f49f570f1 (DEFAULT_TABLE table=default.Table_567fc896d4c84f7da0e0933e6f6965de [id=a22352b708874707a61f43a3823e1ac3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.486999 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75b4abbc451b44a2af08e17f49f570f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.402803 2119 rpcz_store.cc:276] 0927 15:06:13.156712 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.156770 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:15.395450 (+2238680us) ts_tablet_manager.cc:1145] Deleting tablet 65c313ab6848428d8237557392669f6f
0927 15:06:15.395458 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.399037 (+ 3579us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.401892 (+ 2855us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.402704 (+ 812us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2238498}
I20260927 15:06:15.491559 2119 tablet_replica.cc:330] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:15.491839 2119 raft_consensus.cc:2229] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:15.492239 2119 pending_rounds.cc:62] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:15.492357 2119 pending_rounds.cc:68] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976367769169920 op_type: NO_OP noop_request { }
I20260927 15:06:15.492553 2119 raft_consensus.cc:2866] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:15.492712 2119 raft_consensus.cc:2258] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.395628 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 75b4abbc451b44a2af08e17f49f570f1 (DEFAULT_TABLE table=default.Table_567fc896d4c84f7da0e0933e6f6965de [id=a22352b708874707a61f43a3823e1ac3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.493860 1561 raft_consensus.cc:348] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.494065 1561 raft_consensus.cc:374] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.494110 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75b4abbc451b44a2af08e17f49f570f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.494143 1561 raft_consensus.cc:729] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.494692 1556 tablet_bootstrap.cc:654] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.495370 1561 consensus_queue.cc:260] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.496305 1561 ts_tablet_manager.cc:1428] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260927 15:06:15.496907 1552 tablet_bootstrap.cc:654] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.496940 1561 tablet_bootstrap.cc:492] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:15.497514 2431 raft_consensus.cc:482] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.497615 2431 raft_consensus.cc:504] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.498121 2431 leader_election.cc:288] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.498656 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd76c49eda1c4b4ca0edf0f4d2790188" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:15.499588 1102 leader_election.cc:341] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.500095 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "033e71f60c3e47fd9647db090d4d6cd5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.500295 1433 raft_consensus.cc:3037] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.500463 1434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd76c49eda1c4b4ca0edf0f4d2790188" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.500576 1099 leader_election.cc:302] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.500636 1434 raft_consensus.cc:2454] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.500897 2423 raft_consensus.cc:2781] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.500993 2423 raft_consensus.cc:686] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.501178 2423 consensus_queue.cc:237] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.503044 1433 raft_consensus.cc:2454] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:15.504142 1561 tablet_bootstrap.cc:654] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.501190 1099 leader_election.cc:302] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.506278 2431 raft_consensus.cc:2781] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.506381 2431 raft_consensus.cc:482] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.506460 2431 raft_consensus.cc:3037] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.507278 1099 leader_election.cc:302] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.509233 2431 raft_consensus.cc:504] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.510300 2476 raft_consensus.cc:2781] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.510396 2476 raft_consensus.cc:686] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.510584 2476 consensus_queue.cc:237] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.511652 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 65c313ab6848428d8237557392669f6f (table default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]) successfully deleted
I20260927 15:06:15.513396 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd76c49eda1c4b4ca0edf0f4d2790188" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:15.514056 1102 leader_election.cc:341] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:15.514739 1102 consensus_peers.cc:487] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.515897 2431 leader_election.cc:288] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:15.519200 1238 leader_election.cc:341] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 2cd55e22d8254ea8b1dab989517148ca
I20260927 15:06:15.519379 1238 leader_election.cc:302] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:15.519814 1238 consensus_peers.cc:487] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c41cd38355e64590b43b2e1271c43e91. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:15.528735 1102 consensus_peers.cc:487] T 5cd31ae2ac2e4bc9897724bc9012698d P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.531260 1561 tablet_bootstrap.cc:492] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:15.531488 1561 ts_tablet_manager.cc:1397] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.002s
I20260927 15:06:15.532512 1561 raft_consensus.cc:348] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.533268 1561 raft_consensus.cc:374] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.533591 2649 raft_consensus.cc:2726] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:15.533916 1561 raft_consensus.cc:729] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.534261 1561 consensus_queue.cc:260] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.535106 1561 ts_tablet_manager.cc:1428] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:15.536125 2119 ts_tablet_manager.cc:1905] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.539510 1561 tablet_bootstrap.cc:492] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:15.541061 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd76c49eda1c4b4ca0edf0f4d2790188" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.541314 1433 raft_consensus.cc:3037] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.544344 1556 tablet_bootstrap.cc:492] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:15.544473 1556 ts_tablet_manager.cc:1397] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.075s user 0.001s sys 0.003s
I20260927 15:06:15.545164 1556 raft_consensus.cc:348] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.545807 1556 raft_consensus.cc:374] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.545868 1556 raft_consensus.cc:729] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.546048 1556 consensus_queue.cc:260] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.547529 1433 raft_consensus.cc:2454] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:15.556474 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.60:46799, user_credentials={real_user=slave}} blocked reactor thread for 232751us
I20260927 15:06:15.557951 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 9049d003d787403f80aa0c08872dd3b5 (table default.Table_75127a34541e4a979aace6aa029d396e [id=67ad7f9c36834f09a601dbf2841ebc48]) successfully deleted
W20260927 15:06:15.558380 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7afe7ec3929649a8b647eca15e3b7514 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7afe7ec3929649a8b647eca15e3b7514 already in progress: creating tablet
W20260927 15:06:15.558712 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6b4beb4112734b9c91e32b300fd266d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b4beb4112734b9c91e32b300fd266d7 already in progress: creating tablet
I20260927 15:06:15.560272 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet c90e5c66d8564f68b401b3e4280499a7 (table default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]) successfully deleted
W20260927 15:06:15.560632 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 63fbd388210d4a1aabfcf27c7533efbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63fbd388210d4a1aabfcf27c7533efbf already in progress: creating tablet
I20260927 15:06:15.561244 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 6cc8bd2079f84da39e13113e6699bf5e (table default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388]) successfully deleted
I20260927 15:06:15.562311 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 1024b38f06bb4387bd24e98f0dee038c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.564667 1099 leader_election.cc:302] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.565402 2431 raft_consensus.cc:2781] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.565529 2431 raft_consensus.cc:686] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.565728 2431 consensus_queue.cc:237] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:15.567884 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 538a0577d6ce4898828aa0d1ea2a1c85 consensus state has no leader
I20260927 15:06:15.577936 1552 tablet_bootstrap.cc:492] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:15.578070 1552 ts_tablet_manager.cc:1397] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.101s user 0.001s sys 0.001s
I20260927 15:06:15.578768 1552 raft_consensus.cc:348] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.579013 1552 raft_consensus.cc:374] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.579077 1552 raft_consensus.cc:729] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.579265 1552 consensus_queue.cc:260] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:15.580114 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 237b6fd8d0ce4576ae84a1fb51dc500d consensus state has no leader
I20260927 15:06:15.581012 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ee27f67bc245495a9e29bcac3e7d3846
I20260927 15:06:15.581696 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6652d48cff0e433f9269a620c82cb64a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.582271 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6652d48cff0e433f9269a620c82cb64a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:15.583741 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82482572a07741d0ab1809f04dd24ad1 consensus state has no leader
I20260927 15:06:15.584122 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_79a73a988c8143c9b9b339591b234581"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.584604 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79a73a988c8143c9b9b339591b234581 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.584712 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_50a63eb480b7485eb5086db00570f5ef" } new_table_name: "default.Table_01c07aa5c93a471881eb298f14cc1d32" modify_external_catalogs: true
I20260927 15:06:15.585949 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ac7bff6e03d44dba9636e37f00fa658b" } modify_external_catalogs: true
I20260927 15:06:15.586105 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ac7bff6e03d44dba9636e37f00fa658b" } modify_external_catalogs: true
W20260927 15:06:15.586607 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a19a13469f46417fa46f655effecf6b1 consensus state has no leader
I20260927 15:06:15.591620 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 681) took 5651 ms. Trace:
I20260927 15:06:15.548240 1561 tablet_bootstrap.cc:654] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.591733 1562 rpcz_store.cc:276] 0927 15:06:09.940600 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.940654 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:15.002372 (+5061718us) ts_tablet_manager.cc:1145] Deleting tablet 27c3283a40f14eb4868767799cfdf7bd
0927 15:06:15.002383 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.101855 (+ 99472us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.111683 (+ 9828us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.591593 (+479910us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5061110}
I20260927 15:06:15.593626 906 catalog_manager.cc:6565] ReplaceTablet: tablet ee27f67bc245495a9e29bcac3e7d3846 deleted and replaced by tablet a593985d1968440e90bda26faa098445
I20260927 15:06:15.594017 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_762b6b45a11f476c9aee7e80c706ee9d" } modify_external_catalogs: true
I20260927 15:06:15.594215 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_762b6b45a11f476c9aee7e80c706ee9d" } modify_external_catalogs: true
I20260927 15:06:15.594341 1552 ts_tablet_manager.cc:1428] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 15:06:15.594624 1552 tablet_bootstrap.cc:492] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:15.581753 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_19cff94cd880489087101b1fb339fc27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.595487 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19cff94cd880489087101b1fb339fc27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.595893 1552 tablet_bootstrap.cc:654] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.596467 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 679) took 5656 ms. Trace:
I20260927 15:06:15.596545 1562 rpcz_store.cc:276] 0927 15:06:09.939525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.941074 (+ 1549us) service_pool.cc:227] Handling call
0927 15:06:15.596322 (+5655248us) ts_tablet_manager.cc:1145] Deleting tablet 20278f979638419db92105e55310f605
0927 15:06:15.596335 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.596444 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5655007}
I20260927 15:06:15.597416 1556 ts_tablet_manager.cc:1428] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.053s user 0.000s sys 0.002s
I20260927 15:06:15.599042 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b72f9960a56647c4ab39a68b197799de" } modify_external_catalogs: true
I20260927 15:06:15.599236 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b72f9960a56647c4ab39a68b197799de" } modify_external_catalogs: true
I20260927 15:06:15.600476 1556 tablet_bootstrap.cc:492] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:15.603149 2658 raft_consensus.cc:482] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.603403 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 27c3283a40f14eb4868767799cfdf7bd (table default.Table_331e24eda68d4fcab4e75f6cc79a555e [id=a9323db788294017b88166e1c7973f85]) successfully deleted
I20260927 15:06:15.603379 2658 raft_consensus.cc:504] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:15.603641 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 20278f979638419db92105e55310f605 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20278f979638419db92105e55310f605 already in progress: creating tablet
I20260927 15:06:15.603924 2658 leader_election.cc:288] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:15.605020 1238 leader_election.cc:341] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 75537edf83a040cba4da502c726bf456
I20260927 15:06:15.607417 1561 tablet_bootstrap.cc:492] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:15.607549 1561 ts_tablet_manager.cc:1397] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.000s
I20260927 15:06:15.608359 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet ee27f67bc245495a9e29bcac3e7d3846 with delete_type TABLET_DATA_DELETED (replaced by tablet a593985d1968440e90bda26faa098445) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.608238 1561 raft_consensus.cc:348] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.608460 1561 raft_consensus.cc:374] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.608247 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet ee27f67bc245495a9e29bcac3e7d3846 with delete_type TABLET_DATA_DELETED (replaced by tablet a593985d1968440e90bda26faa098445) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.608877 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_567fc896d4c84f7da0e0933e6f6965de" } modify_external_catalogs: true
I20260927 15:06:15.609076 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_567fc896d4c84f7da0e0933e6f6965de" } modify_external_catalogs: true
I20260927 15:06:15.611421 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 678) took 5672 ms. Trace:
I20260927 15:06:15.611557 1562 rpcz_store.cc:276] 0927 15:06:09.939351 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:09.941349 (+ 1998us) service_pool.cc:227] Handling call
0927 15:06:15.611283 (+5669934us) ts_tablet_manager.cc:1145] Deleting tablet ce1c286eea664e2a8ad6ebdf31bd4050
0927 15:06:15.611305 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.611405 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5669719}
I20260927 15:06:15.612114 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 700) took 5412 ms. Trace:
I20260927 15:06:15.612237 1562 rpcz_store.cc:276] 0927 15:06:10.200130 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.223261 (+ 23131us) service_pool.cc:227] Handling call
0927 15:06:15.611995 (+5388734us) ts_tablet_manager.cc:1145] Deleting tablet 7f0d667472ee4f1481c213e03403461e
0927 15:06:15.612005 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.612100 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5388429}
I20260927 15:06:15.612480 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 01b7e017ead242849585679873a69b43 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:15.612758 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 701) took 5385 ms. Trace:
I20260927 15:06:15.612890 1562 rpcz_store.cc:276] 0927 15:06:10.227143 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:10.329393 (+102250us) service_pool.cc:227] Handling call
0927 15:06:15.612654 (+5283261us) ts_tablet_manager.cc:1145] Deleting tablet 916663fe0c6c46b1b3415e165d60187f
0927 15:06:15.612662 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.612745 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5282974}
I20260927 15:06:15.613130 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a407bc25637a4990bf7860f31e2efbc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:15.613516 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 711) took 4554 ms. Trace:
I20260927 15:06:15.613623 1562 rpcz_store.cc:276] 0927 15:06:11.059553 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.064914 (+ 5361us) service_pool.cc:227] Handling call
0927 15:06:15.613258 (+4548344us) ts_tablet_manager.cc:1145] Deleting tablet 514ce66d5afd46a7b9cc460776973b06
0927 15:06:15.613267 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.613501 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4548154}
W20260927 15:06:15.613713 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a407bc25637a4990bf7860f31e2efbc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:15.615449 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ce1c286eea664e2a8ad6ebdf31bd4050 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce1c286eea664e2a8ad6ebdf31bd4050 already in progress: creating tablet
W20260927 15:06:15.615782 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 916663fe0c6c46b1b3415e165d60187f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916663fe0c6c46b1b3415e165d60187f already in progress: creating tablet
W20260927 15:06:15.618463 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 74167.6us
I20260927 15:06:15.620301 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet ee27f67bc245495a9e29bcac3e7d3846 with delete_type TABLET_DATA_DELETED (replaced by tablet a593985d1968440e90bda26faa098445) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:15.623178 1239 leader_election.cc:341] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 75537edf83a040cba4da502c726bf456
I20260927 15:06:15.623353 1239 leader_election.cc:302] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:15.625505 2661 raft_consensus.cc:482] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.625694 2661 raft_consensus.cc:504] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.625984 2657 raft_consensus.cc:2726] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:15.626423 2661 leader_election.cc:288] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:15.627143 1238 leader_election.cc:341] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: a90039faff27436db7b50fa4c4643d3b
I20260927 15:06:15.627467 1556 tablet_bootstrap.cc:654] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:15.629141 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 514ce66d5afd46a7b9cc460776973b06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 514ce66d5afd46a7b9cc460776973b06 already in progress: creating tablet
I20260927 15:06:15.617739 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c4a123886a847d08b2a94ff5e4e01ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.608512 1561 raft_consensus.cc:729] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.626682 2365 raft_consensus.cc:482] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:15.627439 1102 consensus_peers.cc:487] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.629753 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 713) took 4529 ms. Trace:
I20260927 15:06:15.589596 2119 ts_tablet_manager.cc:1918] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:15.630889 2119 log.cc:1196] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/48e7eac8753f425d90302360d228ee54
I20260927 15:06:15.631289 2119 ts_tablet_manager.cc:1939] T 48e7eac8753f425d90302360d228ee54 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:15.631624 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 754) took 2474 ms. Trace:
I20260927 15:06:15.631716 2119 rpcz_store.cc:276] 0927 15:06:13.157404 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.157448 (+ 44us) service_pool.cc:227] Handling call
0927 15:06:15.491506 (+2334058us) ts_tablet_manager.cc:1145] Deleting tablet 48e7eac8753f425d90302360d228ee54
0927 15:06:15.491521 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.586845 (+ 95324us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.589516 (+ 2671us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.631609 (+ 42093us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2333916}
I20260927 15:06:15.629719 2365 raft_consensus.cc:504] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.632025 2119 tablet_replica.cc:330] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:15.632128 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 48e7eac8753f425d90302360d228ee54 (table default.Table_336bf4e2b65f4a6ea300b83b198b1b4f [id=56f6b3596fe64d17a0b2fcf2c187eb02]) successfully deleted
I20260927 15:06:15.632889 2365 leader_election.cc:288] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.628161 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a90039faff27436db7b50fa4c4643d3b" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:15.630045 1561 consensus_queue.cc:260] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.633569 1561 ts_tablet_manager.cc:1428] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260927 15:06:15.633877 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c9cc5859f49a58a35460e504b3f84" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.634084 1433 raft_consensus.cc:2454] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.633987 1562 rpcz_store.cc:276] 0927 15:06:11.100615 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.100919 (+ 304us) service_pool.cc:227] Handling call
0927 15:06:15.629646 (+4528727us) ts_tablet_manager.cc:1145] Deleting tablet 7dccaee87f314cbaa98d66e0bb885a8b
0927 15:06:15.629656 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.629736 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4528496}
I20260927 15:06:15.634436 1561 tablet_bootstrap.cc:492] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:15.634440 1099 leader_election.cc:302] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:15.634699 2365 raft_consensus.cc:2781] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.634852 2365 raft_consensus.cc:482] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.634966 2365 raft_consensus.cc:3037] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:15.634478 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 7dccaee87f314cbaa98d66e0bb885a8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7dccaee87f314cbaa98d66e0bb885a8b already in progress: creating tablet
I20260927 15:06:15.635850 1561 tablet_bootstrap.cc:654] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.636410 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0163a49d9a894953905e20941878400b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.637580 2365 raft_consensus.cc:504] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.638381 2365 leader_election.cc:288] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.638931 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c9cc5859f49a58a35460e504b3f84" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.639114 1433 raft_consensus.cc:3037] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.641675 1433 raft_consensus.cc:2454] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:15.642130 1099 leader_election.cc:302] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:15.642400 2365 raft_consensus.cc:2781] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.642679 2365 raft_consensus.cc:686] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.642966 2365 consensus_queue.cc:237] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.643508 2233 ts_tablet_manager.cc:1918] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:15.643667 2233 log.cc:1196] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/8f4bd8182c9d48c7b6e6175ab98d405a
I20260927 15:06:15.644011 2233 ts_tablet_manager.cc:1939] T 8f4bd8182c9d48c7b6e6175ab98d405a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:15.633848 1239 leader_election.cc:302] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:15.644960 2665 raft_consensus.cc:2726] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:15.645308 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c9cc5859f49a58a35460e504b3f84" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:15.645812 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19c9cc5859f49a58a35460e504b3f84" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:15.646919 1102 leader_election.cc:341] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:15.647470 1102 leader_election.cc:341] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.643373 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 714) took 4542 ms. Trace:
I20260927 15:06:15.647894 1562 rpcz_store.cc:276] 0927 15:06:11.100729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.101203 (+ 474us) service_pool.cc:227] Handling call
0927 15:06:15.643187 (+4541984us) ts_tablet_manager.cc:1145] Deleting tablet 3042c17580d54082971b761433a7dca9
0927 15:06:15.643199 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.643316 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4541822}
W20260927 15:06:15.648552 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 3042c17580d54082971b761433a7dca9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3042c17580d54082971b761433a7dca9 already in progress: creating tablet
I20260927 15:06:15.649047 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 712) took 4548 ms. Trace:
I20260927 15:06:15.650584 1562 rpcz_store.cc:276] 0927 15:06:11.100361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.101719 (+ 1358us) service_pool.cc:227] Handling call
0927 15:06:15.648905 (+4547186us) ts_tablet_manager.cc:1145] Deleting tablet b88cb2c53be4463eb17e748d2c17f0e2
0927 15:06:15.648919 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.649028 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4547037}
I20260927 15:06:15.652272 1305 raft_consensus.cc:3037] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:15.654702 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 047fe4ed761642ccbfecdf543900d064 consensus state has no leader
I20260927 15:06:15.659217 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c0d51b50b414721a255fdde2fe1732f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.659972 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d3fb059bc4dc4e9da4b50184855ddc9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.660740 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3fb059bc4dc4e9da4b50184855ddc9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.662370 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 779) took 3431 ms. Trace:
I20260927 15:06:15.662314 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ad7e667a8ad34ec0982da6f0d22e165d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:15.661634 1562 tablet_replica.cc:330] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:15.662779 1562 raft_consensus.cc:2229] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:15.662865 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad7e667a8ad34ec0982da6f0d22e165d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.662985 1562 raft_consensus.cc:2258] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.663668 2233 rpcz_store.cc:276] 0927 15:06:12.230728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.230767 (+ 39us) service_pool.cc:227] Handling call
0927 15:06:15.422417 (+3191650us) ts_tablet_manager.cc:1145] Deleting tablet 8f4bd8182c9d48c7b6e6175ab98d405a
0927 15:06:15.422431 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.588009 (+165578us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.630747 (+ 42738us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.662344 (+ 31597us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3191506}
I20260927 15:06:15.664312 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7f32f20313364f5787a4bb5c09f5ca22" } modify_external_catalogs: true
I20260927 15:06:15.664525 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7f32f20313364f5787a4bb5c09f5ca22" } modify_external_catalogs: true
I20260927 15:06:15.664927 1562 ts_tablet_manager.cc:1905] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:15.667836 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b88cb2c53be4463eb17e748d2c17f0e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b88cb2c53be4463eb17e748d2c17f0e2 already in progress: creating tablet
I20260927 15:06:15.669936 2233 tablet_replica.cc:330] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:15.670398 2233 raft_consensus.cc:2229] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.670890 2233 raft_consensus.cc:2258] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.674444 2233 ts_tablet_manager.cc:1905] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.675112 912 master_service.cc:946] ReplaceTablet: received request to replace tablet 2bb9540030834895ac069a0d516d7ee4 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:15.701064 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 8f4bd8182c9d48c7b6e6175ab98d405a (table default.Table_f473e7d31ecc4adfbda7d8a1df28ec33 [id=a8244b3e082b4423bdf4d108ee1647b4]) successfully deleted
I20260927 15:06:15.707190 905 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 1ef93a120f00423d91664ce4eaf03803 (table default.Table_69e7da33db594b0494d614660c3525f8 [id=40aeb63abca64c3a8d12f9085fd816d8]). Expected version 3 got 0
W20260927 15:06:15.718293 1238 consensus_peers.cc:487] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0aec677006ab4407bd7ae4c0078d6b7f. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.719539 908 master_service.cc:946] ReplaceTablet: received request to replace tablet 3540982dd7544e60af6c153fc41a412c from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:15.726656 1562 ts_tablet_manager.cc:1918] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:15.727483 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 82482572a07741d0ab1809f04dd24ad1 (table default.Table_6b800efef870411cbff2ac364cc80460 [id=743dd552ea9c45b6a31db3fd4cde43df], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82482572a07741d0ab1809f04dd24ad1 consensus state has no leader
I20260927 15:06:15.728480 1273 tablet_service.cc:1467] Processing CreateTablet for tablet ba091a75c676405aa50773a1bc9e3e99 (DEFAULT_TABLE table=default.Table_a03e73d7c41e4809994e97b00b8743e7 [id=898288ec89214232a41cd82934e8947f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.728732 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 28b6bc8e3a234191807aeec78d368c72 (DEFAULT_TABLE table=default.Table_7f3a9856266c44c491c1e528ba208be8 [id=64ec59d6654a4a218ffca012618783bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.729326 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 917b445477c4403980f2fdfeaeab0854 (DEFAULT_TABLE table=default.Table_25e39a1524f9443bada5d1bb6c74b002 [id=ca4679b9de274cf699d441223178e781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.729895 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 58d7e01486e941f9a6a5f691ae6c7d68 (DEFAULT_TABLE table=default.Table_2bc6e62cbfb54cca8084c68be203a786 [id=78aa7969041d478490851a5d4a2fd470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.730355 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 26b846a6145b432b9df58aaade7a3996 (DEFAULT_TABLE table=default.Table_fe955ec8681e4926943f6748e21f5265 [id=efc046811ca3467bb5579d2aafb2d793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.730768 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 433ffc2f727340649ac93bb4d0f52ad3 (DEFAULT_TABLE table=default.Table_7c30e063ac3349c8a514e1c3859e829a [id=3ca33e685b7a432c86426c221095336e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.728869 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba091a75c676405aa50773a1bc9e3e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.733165 2233 ts_tablet_manager.cc:1918] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:15.733264 2233 log.cc:1196] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/8790d59beb804acb8e4353f862d7f6f8
I20260927 15:06:15.733551 2233 ts_tablet_manager.cc:1939] T 8790d59beb804acb8e4353f862d7f6f8 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:15.734272 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 780) took 3503 ms. Trace:
I20260927 15:06:15.734366 2233 rpcz_store.cc:276] 0927 15:06:12.231011 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.231052 (+ 41us) service_pool.cc:227] Handling call
0927 15:06:15.669873 (+3438821us) ts_tablet_manager.cc:1145] Deleting tablet 8790d59beb804acb8e4353f862d7f6f8
0927 15:06:15.669888 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.713560 (+ 43672us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.733069 (+ 19509us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.734252 (+ 1183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3438667}
I20260927 15:06:15.735029 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b846a6145b432b9df58aaade7a3996. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:15.737128 809 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 63825.3us
I20260927 15:06:15.738991 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 433ffc2f727340649ac93bb4d0f52ad3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:15.738065 1102 consensus_peers.cc:487] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.741412 1562 log.cc:1196] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/c49913b1763c4a7b9413a801aff93b30
I20260927 15:06:15.741778 1562 ts_tablet_manager.cc:1939] T c49913b1763c4a7b9413a801aff93b30 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:15.742978 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 917b445477c4403980f2fdfeaeab0854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.744787 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 724) took 4481 ms. Trace:
I20260927 15:06:15.745309 1562 rpcz_store.cc:276] 0927 15:06:11.260172 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.260223 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:15.661580 (+4401357us) ts_tablet_manager.cc:1145] Deleting tablet c49913b1763c4a7b9413a801aff93b30
0927 15:06:15.661594 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.723059 (+ 61465us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.726554 (+ 3495us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.742040 (+ 15486us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4401101}
I20260927 15:06:15.746452 1562 tablet_replica.cc:330] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:15.746691 1562 raft_consensus.cc:2229] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.746889 1562 raft_consensus.cc:2258] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.747009 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d7e01486e941f9a6a5f691ae6c7d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.747707 2233 tablet_replica.cc:330] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:15.747952 2233 raft_consensus.cc:2229] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.748124 2233 raft_consensus.cc:2258] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.751188 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28b6bc8e3a234191807aeec78d368c72. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:15.758136 1099 consensus_peers.cc:487] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cc8bd2079f84da39e13113e6699bf5e. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.758714 2233 ts_tablet_manager.cc:1905] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.759163 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 28b6bc8e3a234191807aeec78d368c72 (DEFAULT_TABLE table=default.Table_7f3a9856266c44c491c1e528ba208be8 [id=64ec59d6654a4a218ffca012618783bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.759560 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28b6bc8e3a234191807aeec78d368c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.760411 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet c49913b1763c4a7b9413a801aff93b30 (table default.Table_6cc665540fb24e17b9284fc911758626 [id=31cb67e2dcb54a029ecdc3457b6139c1]) successfully deleted
I20260927 15:06:15.761238 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 917b445477c4403980f2fdfeaeab0854 (DEFAULT_TABLE table=default.Table_25e39a1524f9443bada5d1bb6c74b002 [id=ca4679b9de274cf699d441223178e781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.761579 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 917b445477c4403980f2fdfeaeab0854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.767263 1146 tablet_service.cc:1467] Processing CreateTablet for tablet ba091a75c676405aa50773a1bc9e3e99 (DEFAULT_TABLE table=default.Table_a03e73d7c41e4809994e97b00b8743e7 [id=898288ec89214232a41cd82934e8947f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.767717 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba091a75c676405aa50773a1bc9e3e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.771154 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 58d7e01486e941f9a6a5f691ae6c7d68 (DEFAULT_TABLE table=default.Table_2bc6e62cbfb54cca8084c68be203a786 [id=78aa7969041d478490851a5d4a2fd470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.771606 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d7e01486e941f9a6a5f691ae6c7d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.772068 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ec7d1d16936a48d3a1b9f06bde8060da" } new_table_name: "default.Table_d850ef4a397e4cae954fa146a59cd6e4" modify_external_catalogs: true
I20260927 15:06:15.775139 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 26b846a6145b432b9df58aaade7a3996 (DEFAULT_TABLE table=default.Table_fe955ec8681e4926943f6748e21f5265 [id=efc046811ca3467bb5579d2aafb2d793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.775578 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b846a6145b432b9df58aaade7a3996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.776752 2447 raft_consensus.cc:482] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.776893 2447 raft_consensus.cc:504] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.777469 2447 leader_election.cc:288] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:15.778383 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429088342b4743c39fb1e38d235024de" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:15.778918 1374 leader_election.cc:341] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.779095 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 433ffc2f727340649ac93bb4d0f52ad3 (DEFAULT_TABLE table=default.Table_7c30e063ac3349c8a514e1c3859e829a [id=3ca33e685b7a432c86426c221095336e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.779435 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 433ffc2f727340649ac93bb4d0f52ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.779488 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429088342b4743c39fb1e38d235024de" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:15.779978 1376 leader_election.cc:341] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.780063 1376 leader_election.cc:302] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:15.780360 2447 raft_consensus.cc:2726] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:15.783134 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 2c58c58ec7b94896a8d5d8dad7c0884b (DEFAULT_TABLE table=default.Table_f5fc14b511cb4c4ba6a023f692f00c9f [id=505e0f5de6b846e88d4a3773336b6a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.783495 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c58c58ec7b94896a8d5d8dad7c0884b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.784902 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 0bd5193dc6554c70abc4d597aae4da9e (DEFAULT_TABLE table=default.Table_69295492061f4d4faebde34d5343c0ab [id=ab159c655c8146108179bd84ebd042a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.785254 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bd5193dc6554c70abc4d597aae4da9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.787678 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 0bd5193dc6554c70abc4d597aae4da9e (DEFAULT_TABLE table=default.Table_69295492061f4d4faebde34d5343c0ab [id=ab159c655c8146108179bd84ebd042a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.787976 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bd5193dc6554c70abc4d597aae4da9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.789427 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 2c58c58ec7b94896a8d5d8dad7c0884b (DEFAULT_TABLE table=default.Table_f5fc14b511cb4c4ba6a023f692f00c9f [id=505e0f5de6b846e88d4a3773336b6a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.789862 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c58c58ec7b94896a8d5d8dad7c0884b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.792073 2365 raft_consensus.cc:482] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.792204 2365 raft_consensus.cc:504] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.792747 2365 leader_election.cc:288] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.793602 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cc37a97bc145bdaa654bcc193fe93b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:15.794528 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cc37a97bc145bdaa654bcc193fe93b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.794782 1435 raft_consensus.cc:2454] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:15.795368 1102 leader_election.cc:341] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.795671 1099 leader_election.cc:302] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.796098 2365 raft_consensus.cc:2781] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.796168 2365 raft_consensus.cc:482] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.796222 2365 raft_consensus.cc:3037] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.798408 2365 raft_consensus.cc:504] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.798741 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 98af26391d6c4093b7e727efd7067000 (DEFAULT_TABLE table=default.Table_cb01b40008664904bb98fdf1526b779f [id=6aac5f6d47ee4157b57e1a8be402b2f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.799187 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98af26391d6c4093b7e727efd7067000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.799237 2365 leader_election.cc:288] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.799698 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cc37a97bc145bdaa654bcc193fe93b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:15.800572 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3cc37a97bc145bdaa654bcc193fe93b" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.800758 1435 raft_consensus.cc:3037] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.801069 2665 raft_consensus.cc:482] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.801172 2665 raft_consensus.cc:504] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.801681 2665 leader_election.cc:288] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:15.803120 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 522fd5bb334f47d2a1b898ade8c1a8bd (DEFAULT_TABLE table=default.Table_86ef5c917c4d4a1290da0798310e13a9 [id=37529e50dea34ee0b19fa047829b4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.803421 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4658de7351e9423b83f393f7f7045eed" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:15.803560 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 522fd5bb334f47d2a1b898ade8c1a8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.804054 1434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4658de7351e9423b83f393f7f7045eed" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:15.804943 1102 leader_election.cc:341] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.805648 1238 leader_election.cc:302] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:15.805994 2665 raft_consensus.cc:2726] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:15.806756 1435 raft_consensus.cc:2454] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:15.807193 1099 leader_election.cc:302] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.807639 2365 raft_consensus.cc:2781] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.807919 2365 raft_consensus.cc:686] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.808099 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6 (DEFAULT_TABLE table=default.Table_d072149ddba94cff935fb906dcf0524c [id=ba95aca9e7c449bd8fe939e896ab1ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.808604 2365 consensus_queue.cc:237] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.808802 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.809311 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6 (DEFAULT_TABLE table=default.Table_d072149ddba94cff935fb906dcf0524c [id=ba95aca9e7c449bd8fe939e896ab1ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.809695 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.813511 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 21da5f76a51045789261e7cfe0feacd3 (DEFAULT_TABLE table=default.Table_3ed05ef39f8d4541adb74fb6cfdab68c [id=6a971c0918334f6f94c3881d675a0b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.813943 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21da5f76a51045789261e7cfe0feacd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.814487 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 98af26391d6c4093b7e727efd7067000 (DEFAULT_TABLE table=default.Table_cb01b40008664904bb98fdf1526b779f [id=6aac5f6d47ee4157b57e1a8be402b2f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.815065 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98af26391d6c4093b7e727efd7067000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.817421 2447 raft_consensus.cc:482] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.817566 2447 raft_consensus.cc:504] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.817843 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet fd8a53f3c95c4cb7bce21d23f79af28c (table default.Table_e08ec6e011ab4bf586420eaf92cfe107 [id=a51d9c4b701c4c639d904aef0ac3a2cb]). Expected version 1 got 0
I20260927 15:06:15.818178 2447 leader_election.cc:288] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:15.818334 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 21da5f76a51045789261e7cfe0feacd3 (DEFAULT_TABLE table=default.Table_3ed05ef39f8d4541adb74fb6cfdab68c [id=6a971c0918334f6f94c3881d675a0b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.818585 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 373b6e6c03614b78a8343c84095bd347 (table default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63]). Expected version 1 got 0
I20260927 15:06:15.818727 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21da5f76a51045789261e7cfe0feacd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.819072 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9576d1a36d7547bf81faabe9c362e3cb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:15.819129 907 catalog_manager.cc:5495] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
W20260927 15:06:15.819550 1374 leader_election.cc:341] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.819785 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9576d1a36d7547bf81faabe9c362e3cb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:15.820086 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
W20260927 15:06:15.820251 1376 leader_election.cc:341] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.820354 1376 leader_election.cc:302] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:15.820672 2447 raft_consensus.cc:2726] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:15.822523 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.62:41167, user_credentials={real_user=slave}} blocked reactor thread for 120398us
I20260927 15:06:15.823549 2119 raft_consensus.cc:2229] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:15.824112 2119 raft_consensus.cc:2258] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.824780 2119 ts_tablet_manager.cc:1905] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.827915 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 (DEFAULT_TABLE table=default.Table_b72f9960a56647c4ab39a68b197799de [id=749a36e7d5bd4b3c9edbefbaa8becfe5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.828403 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.830492 2119 ts_tablet_manager.cc:1918] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:15.830581 2119 log.cc:1196] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/16884c7343be436aa312ec0af40f5e33
I20260927 15:06:15.830909 2119 ts_tablet_manager.cc:1939] T 16884c7343be436aa312ec0af40f5e33 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:15.832608 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 522fd5bb334f47d2a1b898ade8c1a8bd (DEFAULT_TABLE table=default.Table_86ef5c917c4d4a1290da0798310e13a9 [id=37529e50dea34ee0b19fa047829b4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.833014 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 522fd5bb334f47d2a1b898ade8c1a8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.835593 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 28b6bc8e3a234191807aeec78d368c72 (DEFAULT_TABLE table=default.Table_7f3a9856266c44c491c1e528ba208be8 [id=64ec59d6654a4a218ffca012618783bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.836731 2665 consensus_queue.cc:1035] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:15.838201 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 (DEFAULT_TABLE table=default.Table_b72f9960a56647c4ab39a68b197799de [id=749a36e7d5bd4b3c9edbefbaa8becfe5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.838244 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 917b445477c4403980f2fdfeaeab0854 (DEFAULT_TABLE table=default.Table_25e39a1524f9443bada5d1bb6c74b002 [id=ca4679b9de274cf699d441223178e781]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.838734 1420 tablet_service.cc:1467] Processing CreateTablet for tablet ba091a75c676405aa50773a1bc9e3e99 (DEFAULT_TABLE table=default.Table_a03e73d7c41e4809994e97b00b8743e7 [id=898288ec89214232a41cd82934e8947f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.838584 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.839165 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 0bd5193dc6554c70abc4d597aae4da9e (DEFAULT_TABLE table=default.Table_69295492061f4d4faebde34d5343c0ab [id=ab159c655c8146108179bd84ebd042a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.839262 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 58d7e01486e941f9a6a5f691ae6c7d68 (DEFAULT_TABLE table=default.Table_2bc6e62cbfb54cca8084c68be203a786 [id=78aa7969041d478490851a5d4a2fd470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.839684 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 26b846a6145b432b9df58aaade7a3996 (DEFAULT_TABLE table=default.Table_fe955ec8681e4926943f6748e21f5265 [id=efc046811ca3467bb5579d2aafb2d793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.840080 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 433ffc2f727340649ac93bb4d0f52ad3 (DEFAULT_TABLE table=default.Table_7c30e063ac3349c8a514e1c3859e829a [id=3ca33e685b7a432c86426c221095336e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.840523 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 2c58c58ec7b94896a8d5d8dad7c0884b (DEFAULT_TABLE table=default.Table_f5fc14b511cb4c4ba6a023f692f00c9f [id=505e0f5de6b846e88d4a3773336b6a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.842324 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 21da5f76a51045789261e7cfe0feacd3 (DEFAULT_TABLE table=default.Table_3ed05ef39f8d4541adb74fb6cfdab68c [id=6a971c0918334f6f94c3881d675a0b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.843070 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 98af26391d6c4093b7e727efd7067000 (DEFAULT_TABLE table=default.Table_cb01b40008664904bb98fdf1526b779f [id=6aac5f6d47ee4157b57e1a8be402b2f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.843472 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 8790d59beb804acb8e4353f862d7f6f8 (table default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]) successfully deleted
I20260927 15:06:15.842770 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6 (DEFAULT_TABLE table=default.Table_d072149ddba94cff935fb906dcf0524c [id=ba95aca9e7c449bd8fe939e896ab1ba5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:15.843932 898 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 -> Peer 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799): Couldn't send request to peer 2a122de3662f485f8f44b0a5e4b29862. Status: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260927 15:06:15.843968 880 master_runner.cc:186] Error getting master registration for 127.0.201.60:46799: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111),
I20260927 15:06:15.844142 880 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:06:15.844363 2569 raft_consensus.cc:482] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.844470 2569 raft_consensus.cc:504] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.844969 2569 leader_election.cc:288] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.845096 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 (DEFAULT_TABLE table=default.Table_b72f9960a56647c4ab39a68b197799de [id=749a36e7d5bd4b3c9edbefbaa8becfe5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.845258 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 522fd5bb334f47d2a1b898ade8c1a8bd (DEFAULT_TABLE table=default.Table_86ef5c917c4d4a1290da0798310e13a9 [id=37529e50dea34ee0b19fa047829b4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:15.845983 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595c84453cd84c3bb5a4d444892bf5e6" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:15.846899 1102 leader_election.cc:341] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.847817 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595c84453cd84c3bb5a4d444892bf5e6" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.848009 1435 raft_consensus.cc:2454] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.848490 1099 leader_election.cc:302] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.848896 2569 raft_consensus.cc:2781] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.848964 2569 raft_consensus.cc:482] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.849018 2569 raft_consensus.cc:3037] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.849241 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 755) took 2691 ms. Trace:
I20260927 15:06:15.847486 2675 tablet.cc:1722] T 373b6e6c03614b78a8343c84095bd347 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:15.849781 2119 rpcz_store.cc:276] 0927 15:06:13.158001 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.158146 (+ 145us) service_pool.cc:227] Handling call
0927 15:06:15.631985 (+2473839us) ts_tablet_manager.cc:1145] Deleting tablet 16884c7343be436aa312ec0af40f5e33
0927 15:06:15.631995 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.823767 (+191772us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x6150001962a4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d4604d 00007fcdb9fea5ec 00007fcdbc9792e6 00007fcdbc9ab404 00007fcdbc98c870 00007fcdbc98c5fd 00000000009edb7c 00007fcdad850344 00007fcdad85391b 00007fcdad853798
0927 15:06:15.827692 (+ 3925us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.830422 (+ 2730us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.849148 (+ 18726us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":409229568,"tablet-delete.queue_time_us":2473708}
I20260927 15:06:15.851537 2569 raft_consensus.cc:504] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.851804 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 16884c7343be436aa312ec0af40f5e33 (table default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388]) successfully deleted
I20260927 15:06:15.852464 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595c84453cd84c3bb5a4d444892bf5e6" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:15.853004 1102 leader_election.cc:341] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.853391 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 756) took 2679 ms. Trace:
I20260927 15:06:15.853827 2569 leader_election.cc:288] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.854547 1552 tablet_bootstrap.cc:492] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:15.854171 2119 rpcz_store.cc:276] 0927 15:06:13.173696 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.173762 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:15.852492 (+2678730us) ts_tablet_manager.cc:1145] Deleting tablet 79a3125723034cb48bc1a05fc4abbb82
0927 15:06:15.852569 (+ 77us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.853249 (+ 680us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2678449}
I20260927 15:06:15.855078 1552 ts_tablet_manager.cc:1397] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.261s user 0.015s sys 0.017s
I20260927 15:06:15.855504 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595c84453cd84c3bb5a4d444892bf5e6" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.855679 1435 raft_consensus.cc:3037] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:15.855886 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 79a3125723034cb48bc1a05fc4abbb82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79a3125723034cb48bc1a05fc4abbb82 already in progress: creating tablet
I20260927 15:06:15.857427 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 757) took 2636 ms. Trace:
I20260927 15:06:15.858220 1435 raft_consensus.cc:2454] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:15.857895 2119 rpcz_store.cc:276] 0927 15:06:13.220531 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.220678 (+ 147us) service_pool.cc:227] Handling call
0927 15:06:15.856730 (+2636052us) ts_tablet_manager.cc:1145] Deleting tablet e7051277b0324331a28168eb387c770c
0927 15:06:15.856807 (+ 77us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.857346 (+ 539us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2635634}
W20260927 15:06:15.859381 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e7051277b0324331a28168eb387c770c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e7051277b0324331a28168eb387c770c already in progress: creating tablet
W20260927 15:06:15.859980 1102 consensus_peers.cc:487] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.860599 1099 leader_election.cc:302] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.860947 2568 raft_consensus.cc:2781] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.861055 2568 raft_consensus.cc:686] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.860661 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 758) took 2640 ms. Trace:
I20260927 15:06:15.861258 2568 consensus_queue.cc:237] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.861656 1562 ts_tablet_manager.cc:1905] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.867120 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58d7e01486e941f9a6a5f691ae6c7d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.867406 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28b6bc8e3a234191807aeec78d368c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.867581 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c58c58ec7b94896a8d5d8dad7c0884b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.867817 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 522fd5bb334f47d2a1b898ade8c1a8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.867995 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba091a75c676405aa50773a1bc9e3e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.868322 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98af26391d6c4093b7e727efd7067000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.869645 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26b846a6145b432b9df58aaade7a3996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.870927 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21da5f76a51045789261e7cfe0feacd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.871259 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31acc27b65bc4b0eaf1bacba6ee3f3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.871583 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bd5193dc6554c70abc4d597aae4da9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.874975 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:15.876045 1099 consensus_peers.cc:487] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c90e5c66d8564f68b401b3e4280499a7. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.877004 1552 raft_consensus.cc:348] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.877207 1552 raft_consensus.cc:374] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.877251 1552 raft_consensus.cc:729] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.877434 1552 consensus_queue.cc:260] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.877992 1552 ts_tablet_manager.cc:1428] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.023s user 0.001s sys 0.000s
I20260927 15:06:15.878252 1552 tablet_bootstrap.cc:492] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:15.879035 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 433ffc2f727340649ac93bb4d0f52ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.880141 2233 ts_tablet_manager.cc:1918] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:15.880232 2233 log.cc:1196] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/c5cd55de34d249bc8d3adcf4690f0414
I20260927 15:06:15.882932 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 917b445477c4403980f2fdfeaeab0854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:15.884198 1562 ts_tablet_manager.cc:1918] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:15.884310 1562 log.cc:1196] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/16884c7343be436aa312ec0af40f5e33
I20260927 15:06:15.884646 1562 ts_tablet_manager.cc:1939] T 16884c7343be436aa312ec0af40f5e33 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:15.885339 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 722) took 4625 ms. Trace:
I20260927 15:06:15.885418 1562 rpcz_store.cc:276] 0927 15:06:11.259951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.260894 (+ 943us) service_pool.cc:227] Handling call
0927 15:06:15.746395 (+4485501us) ts_tablet_manager.cc:1145] Deleting tablet 16884c7343be436aa312ec0af40f5e33
0927 15:06:15.746410 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.864876 (+118466us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.884113 (+ 19237us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.885318 (+ 1205us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4485317}
I20260927 15:06:15.885877 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 16884c7343be436aa312ec0af40f5e33 (table default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388]) successfully deleted
I20260927 15:06:15.887975 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6d167c390ed546e09f31f1e08988500c
I20260927 15:06:15.888616 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_91bf12e088ba482ba6effe0407e05844" } new_table_name: "default.Table_c33713f5f5d841b1a1f9e687db26c2e6" modify_external_catalogs: true
I20260927 15:06:15.888851 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d167c390ed546e09f31f1e08988500c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.889257 2233 ts_tablet_manager.cc:1939] T c5cd55de34d249bc8d3adcf4690f0414 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:15.889994 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 72f87499645e4f55bc3d6edeba50eb64
I20260927 15:06:15.889982 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 781) took 3658 ms. Trace:
I20260927 15:06:15.890062 2233 rpcz_store.cc:276] 0927 15:06:12.231331 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.232104 (+ 773us) service_pool.cc:227] Handling call
0927 15:06:15.747645 (+3515541us) ts_tablet_manager.cc:1145] Deleting tablet c5cd55de34d249bc8d3adcf4690f0414
0927 15:06:15.747663 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.870887 (+123224us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.880068 (+ 9181us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.889962 (+ 9894us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3515408}
I20260927 15:06:15.890667 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 72f87499645e4f55bc3d6edeba50eb64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.890591 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5b0805950ba34c63a8168418bb62f2ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:15.890673 2431 raft_consensus.cc:482] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.891053 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 75b4abbc451b44a2af08e17f49f570f1
I20260927 15:06:15.891073 2233 tablet_replica.cc:330] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:15.890951 2431 raft_consensus.cc:504] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.891250 2233 raft_consensus.cc:2229] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.891399 2233 raft_consensus.cc:2258] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.891496 2431 leader_election.cc:288] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.891595 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0f0652967878460c8defab6738bc1839"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:15.891892 2233 ts_tablet_manager.cc:1905] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:15.892122 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f0652967878460c8defab6738bc1839 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.893023 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610ff6563dc64e73b2b4d7c268468b21" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:15.893268 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9f7afa41d7cb4daa89fee5d6036e7cf8
I20260927 15:06:15.893813 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_977be428b672403db208caad1eb2e402" } new_table_name: "default.Table_59427058129c43e293490854f6f7ec86" modify_external_catalogs: true
W20260927 15:06:15.893904 1102 leader_election.cc:341] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.894966 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cdcc55fb32b14935922e5870819bc266
I20260927 15:06:15.895547 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cc3a42843c734375a3ab18a970b34402"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.896024 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc3a42843c734375a3ab18a970b34402 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.896040 1562 tablet_replica.cc:330] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:15.896325 1562 raft_consensus.cc:2229] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.896474 1562 raft_consensus.cc:2258] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:15.897172 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 929425d7dab14084acef649e54a9b32b consensus state has no leader
I20260927 15:06:15.897540 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0403b43bad954117a65684b5aeeebe11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:15.897972 1562 ts_tablet_manager.cc:1905] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:15.898039 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0403b43bad954117a65684b5aeeebe11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.898547 1305 raft_consensus.cc:3037] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:15.900230 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b0805950ba34c63a8168418bb62f2ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.901610 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2bb9540030834895ac069a0d516d7ee4
I20260927 15:06:15.901971 912 catalog_manager.cc:6565] ReplaceTablet: tablet 2bb9540030834895ac069a0d516d7ee4 deleted and replaced by tablet abbe0b6179d44ae58da14741c2db3ae9
I20260927 15:06:15.902174 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610ff6563dc64e73b2b4d7c268468b21" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.902276 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2acab08ececa48aab9e6139d3e031e59" } new_table_name: "default.Table_dd8f1d71fa7d4665b96954a6d766c9ce" modify_external_catalogs: true
I20260927 15:06:15.902382 1438 raft_consensus.cc:2454] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:15.903779 1099 leader_election.cc:302] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.903920 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 72f87499645e4f55bc3d6edeba50eb64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.903954 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 75b4abbc451b44a2af08e17f49f570f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.904119 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.904162 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 75b4abbc451b44a2af08e17f49f570f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.904328 2431 consensus_queue.cc:1035] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:15.904708 2431 raft_consensus.cc:2781] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:15.904767 2431 raft_consensus.cc:482] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:15.904844 2431 raft_consensus.cc:3037] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.905087 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.905772 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet cdcc55fb32b14935922e5870819bc266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.906740 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bb9540030834895ac069a0d516d7ee4 with delete_type TABLET_DATA_DELETED (replaced by tablet abbe0b6179d44ae58da14741c2db3ae9) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.907550 2431 raft_consensus.cc:504] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.908475 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610ff6563dc64e73b2b4d7c268468b21" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:15.908866 2431 leader_election.cc:288] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:15.909124 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fb84ec6d634043ce8005943e925ef9fd" } new_table_name: "default.Table_2ad5d2ac920c40f197a7134129b64442" modify_external_catalogs: true
W20260927 15:06:15.909185 1102 leader_election.cc:341] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:15.910588 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "610ff6563dc64e73b2b4d7c268468b21" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:15.910744 1436 raft_consensus.cc:3037] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:15.911815 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_198df37a55574154a04d6ef03a65c140"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:15.912326 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_198df37a55574154a04d6ef03a65c140 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:15.913209 1436 raft_consensus.cc:2454] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:15.914721 1099 leader_election.cc:302] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:15.915525 2568 raft_consensus.cc:2781] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:15.915633 2568 raft_consensus.cc:686] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:15.915838 2568 consensus_queue.cc:237] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:15.918154 1102 consensus_peers.cc:487] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.920758 1562 ts_tablet_manager.cc:1918] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:15.922359 2233 ts_tablet_manager.cc:1918] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:15.924424 2233 log.cc:1196] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/ce566cc49cfe4483b942d2eaa8269acc
I20260927 15:06:15.923296 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet cdcc55fb32b14935922e5870819bc266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.923411 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.923507 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 75b4abbc451b44a2af08e17f49f570f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.923599 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 72f87499645e4f55bc3d6edeba50eb64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.923688 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.923848 2674 tablet.cc:1722] T 373b6e6c03614b78a8343c84095bd347 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:15.925158 2233 ts_tablet_manager.cc:1939] T ce566cc49cfe4483b942d2eaa8269acc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:15.924155 1556 tablet_bootstrap.cc:492] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:15.923153 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bb9540030834895ac069a0d516d7ee4 with delete_type TABLET_DATA_DELETED (replaced by tablet abbe0b6179d44ae58da14741c2db3ae9) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.927227 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 782) took 3694 ms. Trace:
I20260927 15:06:15.927484 1562 log.cc:1196] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/54a07831078b48a59807f7da4a42bcec
I20260927 15:06:15.930696 1562 ts_tablet_manager.cc:1939] T 54a07831078b48a59807f7da4a42bcec P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:15.927842 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d167c390ed546e09f31f1e08988500c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.928257 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet d4f05da432f041378c5ab808536e6b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:15.931891 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 723) took 4671 ms. Trace:
I20260927 15:06:15.932650 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d167c390ed546e09f31f1e08988500c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.926225 1556 ts_tablet_manager.cc:1397] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.326s user 0.003s sys 0.032s
I20260927 15:06:15.930841 2233 rpcz_store.cc:276] 0927 15:06:12.232358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.232396 (+ 38us) service_pool.cc:227] Handling call
0927 15:06:15.891026 (+3658630us) ts_tablet_manager.cc:1145] Deleting tablet ce566cc49cfe4483b942d2eaa8269acc
0927 15:06:15.891038 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.914692 (+ 23654us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.922270 (+ 7578us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.927206 (+ 4936us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3658493}
I20260927 15:06:15.933722 2233 tablet_replica.cc:330] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:15.934012 2233 raft_consensus.cc:2229] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.933995 1556 raft_consensus.cc:348] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.934142 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet c5cd55de34d249bc8d3adcf4690f0414 (table default.Table_4e746f160fe7481ea3947c59c33ed5ee [id=1b056b1df8b440a7a49989039998313c]) successfully deleted
I20260927 15:06:15.934208 2233 raft_consensus.cc:2258] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.934911 2233 ts_tablet_manager.cc:1905] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.935070 1562 rpcz_store.cc:276] 0927 15:06:11.260060 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.278035 (+ 17975us) service_pool.cc:227] Handling call
0927 15:06:15.895990 (+4617955us) ts_tablet_manager.cc:1145] Deleting tablet 54a07831078b48a59807f7da4a42bcec
0927 15:06:15.896005 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.917702 (+ 21697us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.920665 (+ 2963us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.931867 (+ 11202us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4611395}
I20260927 15:06:15.933964 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b9e88c3679d412cac7603f200cf899b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.935276 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 16884c7343be436aa312ec0af40f5e33 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cc8bd2079f84da39e13113e6699bf5e) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.935649 1562 tablet_replica.cc:330] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:15.934237 1556 raft_consensus.cc:374] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.940188 1556 raft_consensus.cc:729] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.940558 1562 raft_consensus.cc:2229] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:15.940853 1556 consensus_queue.cc:260] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.927163 1561 tablet_bootstrap.cc:492] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:15.941381 1561 ts_tablet_manager.cc:1397] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.307s user 0.013s sys 0.019s
I20260927 15:06:15.942401 1561 raft_consensus.cc:348] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.943023 1556 ts_tablet_manager.cc:1428] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260927 15:06:15.943257 1552 tablet_bootstrap.cc:654] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.861271 2119 rpcz_store.cc:276] 0927 15:06:13.220617 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.220670 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:15.859976 (+2639306us) ts_tablet_manager.cc:1145] Deleting tablet 0e34a679010b4b4fa3a76aec5ae05db4
0927 15:06:15.860051 (+ 75us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.860582 (+ 531us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2638708}
I20260927 15:06:15.943900 2119 tablet_replica.cc:330] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:15.941025 1562 raft_consensus.cc:2258] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.944100 2119 raft_consensus.cc:2229] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:15.944367 2119 raft_consensus.cc:2258] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:15.944897 1562 ts_tablet_manager.cc:1905] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.945775 1556 tablet_bootstrap.cc:492] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:15.946942 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 54a07831078b48a59807f7da4a42bcec (table default.Table_c8f0a331bf1f4f7c969299f5f0c4d5a6 [id=aa16f23914de4c7db1e460bb1c743a4d]) successfully deleted
I20260927 15:06:15.943877 1561 raft_consensus.cc:374] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.947181 1561 raft_consensus.cc:729] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:15.947469 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet c49913b1763c4a7b9413a801aff93b30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.947485 1561 consensus_queue.cc:260] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.948057 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 610ff6563dc64e73b2b4d7c268468b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.948473 1561 ts_tablet_manager.cc:1428] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 15:06:15.950261 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet ce566cc49cfe4483b942d2eaa8269acc (table default.Table_3d65f616a187485eaa9298155971a648 [id=5c5e1b2501064bd5a6df36c4dddda94a]) successfully deleted
W20260927 15:06:15.953030 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9e541ad12fd470986eb82b4855db498 consensus state has no leader
I20260927 15:06:15.953358 1561 tablet_bootstrap.cc:492] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:15.953758 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 595c84453cd84c3bb5a4d444892bf5e6 consensus state has no leader
I20260927 15:06:15.958287 1561 tablet_bootstrap.cc:654] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:15.961107 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bb9540030834895ac069a0d516d7ee4 with delete_type TABLET_DATA_DELETED (replaced by tablet abbe0b6179d44ae58da14741c2db3ae9) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:15.964808 1099 consensus_peers.cc:487] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8790d59beb804acb8e4353f862d7f6f8. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.966217 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet cdcc55fb32b14935922e5870819bc266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:15.958570 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9cc5859f49a58a35460e504b3f84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.967455 2233 ts_tablet_manager.cc:1918] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:06:15.974211 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0e34a679010b4b4fa3a76aec5ae05db4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e34a679010b4b4fa3a76aec5ae05db4 already in progress: creating tablet
I20260927 15:06:15.980830 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet cd76c49eda1c4b4ca0edf0f4d2790188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:15.983042 1102 consensus_peers.cc:487] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:15.983121 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet ce566cc49cfe4483b942d2eaa8269acc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:15.983625 2665 raft_consensus.cc:482] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:15.983755 2665 raft_consensus.cc:504] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:15.984347 2665 leader_election.cc:288] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:15.985028 2119 ts_tablet_manager.cc:1905] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:15.986145 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c264c532db8249e5abe1dbef8ee8ffa0" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:15.985029 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c264c532db8249e5abe1dbef8ee8ffa0" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:15.987852 2233 log.cc:1196] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/2c4a123886a847d08b2a94ff5e4e01ca
I20260927 15:06:15.988232 2233 ts_tablet_manager.cc:1939] T 2c4a123886a847d08b2a94ff5e4e01ca P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:15.988283 1238 leader_election.cc:302] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:15.988718 2658 raft_consensus.cc:2726] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:15.996821 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 784) took 3702 ms. Trace:
I20260927 15:06:15.997972 1561 tablet_bootstrap.cc:492] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:15.998173 1561 ts_tablet_manager.cc:1397] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260927 15:06:15.999477 1561 raft_consensus.cc:348] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:15.999753 1561 raft_consensus.cc:374] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:15.999861 1561 raft_consensus.cc:729] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.000154 1561 consensus_queue.cc:260] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.001048 1561 ts_tablet_manager.cc:1428] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:16.001399 1561 tablet_bootstrap.cc:492] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:16.001868 1562 ts_tablet_manager.cc:1918] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.002051 1562 log.cc:1196] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/dc6f179aab784ae4822356e63332532f
I20260927 15:06:16.003530 1562 ts_tablet_manager.cc:1939] T dc6f179aab784ae4822356e63332532f P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.006862 1552 tablet_bootstrap.cc:492] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:16.009397 1305 raft_consensus.cc:3037] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.011613 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 725) took 4717 ms. Trace:
I20260927 15:06:16.011807 2233 rpcz_store.cc:276] 0927 15:06:12.294227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.294288 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:15.933665 (+3639377us) ts_tablet_manager.cc:1145] Deleting tablet 2c4a123886a847d08b2a94ff5e4e01ca
0927 15:06:15.933679 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.939051 (+ 5372us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.967332 (+ 28281us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.996792 (+ 29460us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3639158}
I20260927 15:06:16.014348 1562 rpcz_store.cc:276] 0927 15:06:11.293928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.293989 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:15.935597 (+4641608us) ts_tablet_manager.cc:1145] Deleting tablet dc6f179aab784ae4822356e63332532f
0927 15:06:15.935612 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:15.959901 (+ 24289us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:15.997119 (+ 37218us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.011590 (+ 14471us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4641315}
I20260927 15:06:16.014621 1552 ts_tablet_manager.cc:1397] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.136s user 0.003s sys 0.000s
I20260927 15:06:16.016602 1552 raft_consensus.cc:348] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.019702 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet dc6f179aab784ae4822356e63332532f (table default.Table_2f2bd859db5046c0afc8811df26a404f [id=359e0f2f64c54790a1fbb004164bf090]) successfully deleted
I20260927 15:06:16.014281 1561 tablet_bootstrap.cc:654] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.020377 1552 raft_consensus.cc:374] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.020538 1552 raft_consensus.cc:729] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.021251 1562 tablet_replica.cc:330] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.021497 1562 raft_consensus.cc:2229] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.021646 1552 consensus_queue.cc:260] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.022120 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3683b1582f6747a99a46e5f72b7067d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:16.023145 1562 raft_consensus.cc:2258] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.023126 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4c9e7b68303b480a85dcef02ac6c9c0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.023643 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c9e7b68303b480a85dcef02ac6c9c0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.023715 1562 ts_tablet_manager.cc:1905] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.024178 1552 ts_tablet_manager.cc:1428] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 15:06:16.007225 1556 tablet_bootstrap.cc:654] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.024462 1552 tablet_bootstrap.cc:492] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:16.024914 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9318935079e64e20b6034c64074600a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.025345 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9318935079e64e20b6034c64074600a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:16.026816 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3683b1582f6747a99a46e5f72b7067d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.030714 1556 tablet_bootstrap.cc:492] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.030871 1556 ts_tablet_manager.cc:1397] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.000s
I20260927 15:06:16.031577 1556 raft_consensus.cc:348] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.031785 1556 raft_consensus.cc:374] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.030592 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
I20260927 15:06:16.032873 1556 raft_consensus.cc:729] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.033129 1556 consensus_queue.cc:260] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.035701 2447 raft_consensus.cc:482] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.035823 2447 raft_consensus.cc:504] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.036374 2447 leader_election.cc:288] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.036983 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d6bdc1ac004d889aac36db65afbbbe" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:16.037727 1374 leader_election.cc:341] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.038189 1556 ts_tablet_manager.cc:1428] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 15:06:16.043278 2568 raft_consensus.cc:482] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.043444 2568 raft_consensus.cc:504] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.043642 1556 tablet_bootstrap.cc:492] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.044035 2568 leader_election.cc:288] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.044730 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fc1fc04814147d8843aa734fd1794da" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:16.044977 1298 raft_consensus.cc:2454] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:16.045430 1102 leader_election.cc:302] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:16.045861 2568 raft_consensus.cc:2781] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.045943 2568 raft_consensus.cc:482] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.046003 2568 raft_consensus.cc:3037] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:16.046386 1099 leader_election.cc:341] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 8fc1fc04814147d8843aa734fd1794da
I20260927 15:06:16.046716 1556 tablet_bootstrap.cc:654] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.047525 1552 tablet_bootstrap.cc:654] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.049260 2568 raft_consensus.cc:504] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.050572 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fc1fc04814147d8843aa734fd1794da" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:16.050758 1298 raft_consensus.cc:3037] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.053385 1298 raft_consensus.cc:2454] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:16.054198 1102 leader_election.cc:302] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:16.054500 2365 raft_consensus.cc:2781] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.054600 2365 raft_consensus.cc:686] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:16.054813 2365 consensus_queue.cc:237] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.059468 2568 leader_election.cc:288] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.059633 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d6bdc1ac004d889aac36db65afbbbe" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.060266 1376 leader_election.cc:341] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.060392 1376 leader_election.cc:302] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:16.060446 1099 leader_election.cc:341] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 8fc1fc04814147d8843aa734fd1794da
I20260927 15:06:16.060736 2447 raft_consensus.cc:2726] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.017357 2119 ts_tablet_manager.cc:1918] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.061149 2119 log.cc:1196] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/9cb0ab983a444d26b903a0cec64f15f0
I20260927 15:06:16.061757 2119 ts_tablet_manager.cc:1939] T 9cb0ab983a444d26b903a0cec64f15f0 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.062282 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 759) took 2826 ms. Trace:
I20260927 15:06:16.062428 2119 rpcz_store.cc:276] 0927 15:06:13.236137 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.236204 (+ 67us) service_pool.cc:227] Handling call
0927 15:06:15.943854 (+2707650us) ts_tablet_manager.cc:1145] Deleting tablet 9cb0ab983a444d26b903a0cec64f15f0
0927 15:06:15.943866 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.011127 (+ 67261us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.017241 (+ 6114us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.062266 (+ 45025us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2707392}
I20260927 15:06:16.062888 2119 tablet_replica.cc:330] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.063139 2119 raft_consensus.cc:2229] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.063112 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 9cb0ab983a444d26b903a0cec64f15f0 (table default.Table_9cb03ce349ee4cefa2a1b109f59c75ee [id=8e5ae781d15d48f7924076fea8d3d292]) successfully deleted
I20260927 15:06:16.063520 2119 raft_consensus.cc:2258] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.074672 1562 ts_tablet_manager.cc:1918] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.074816 1562 log.cc:1196] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/9cb0ab983a444d26b903a0cec64f15f0
I20260927 15:06:16.075562 1556 tablet_bootstrap.cc:492] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.075739 1556 ts_tablet_manager.cc:1397] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.002s
I20260927 15:06:16.077966 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fc1fc04814147d8843aa734fd1794da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.078233 1556 raft_consensus.cc:348] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.078593 1556 raft_consensus.cc:374] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.078713 1556 raft_consensus.cc:729] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.078958 1556 consensus_queue.cc:260] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.079561 1556 ts_tablet_manager.cc:1428] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:16.080140 1562 ts_tablet_manager.cc:1939] T 9cb0ab983a444d26b903a0cec64f15f0 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.081048 1552 tablet_bootstrap.cc:492] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:16.081372 1552 ts_tablet_manager.cc:1397] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.057s user 0.007s sys 0.000s
I20260927 15:06:16.082118 1552 raft_consensus.cc:348] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.082417 1552 raft_consensus.cc:374] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.082516 1552 raft_consensus.cc:729] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.083341 913 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet df6d7670381b49bb927943b2ee920c84 (table default.Table_c10827cf92b44050bf8d4dc379b26be3 [id=2125b2fb567a43128346e08a4370ace2]). Expected version 2 got 0
I20260927 15:06:16.087072 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 726) took 4785 ms. Trace:
I20260927 15:06:16.087044 1552 consensus_queue.cc:260] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.089493 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_99f77000d51a4368be6b4cd063f28b8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:16.089929 1552 ts_tablet_manager.cc:1428] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
W20260927 15:06:16.090121 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99f77000d51a4368be6b4cd063f28b8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.090719 1552 tablet_bootstrap.cc:492] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:16.091166 1562 rpcz_store.cc:276] 0927 15:06:11.301427 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.301493 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:16.021192 (+4719699us) ts_tablet_manager.cc:1145] Deleting tablet 9cb0ab983a444d26b903a0cec64f15f0
0927 15:06:16.021205 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.033174 (+ 11969us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.074560 (+ 41386us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.087048 (+ 12488us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4719435}
I20260927 15:06:16.091311 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e0071303c5c7491cb1289e60813891bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.091833 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0071303c5c7491cb1289e60813891bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.091940 1562 tablet_replica.cc:330] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.092161 1562 raft_consensus.cc:2229] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.092311 1562 pending_rounds.cc:62] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:16.092383 1562 pending_rounds.cc:68] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976367769169920 op_type: NO_OP noop_request { }
I20260927 15:06:16.092517 1562 raft_consensus.cc:2866] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:16.094480 1562 raft_consensus.cc:2258] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.095053 1552 tablet_bootstrap.cc:654] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.095212 1556 tablet_bootstrap.cc:492] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.097266 1562 ts_tablet_manager.cc:1905] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.097924 1556 tablet_bootstrap.cc:654] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.099511 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 9cb0ab983a444d26b903a0cec64f15f0 (table default.Table_9cb03ce349ee4cefa2a1b109f59c75ee [id=8e5ae781d15d48f7924076fea8d3d292]) successfully deleted
W20260927 15:06:16.101102 809 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 52195.8us
I20260927 15:06:16.096717 2119 ts_tablet_manager.cc:1905] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.102262 1561 tablet_bootstrap.cc:492] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:16.102473 1561 ts_tablet_manager.cc:1397] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.101s user 0.007s sys 0.004s
I20260927 15:06:16.102795 2568 raft_consensus.cc:482] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.102955 2568 raft_consensus.cc:504] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.103556 2568 leader_election.cc:288] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.104637 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce566cc49cfe4483b942d2eaa8269acc" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.106900 1102 leader_election.cc:341] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:16.107939 1099 leader_election.cc:341] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ce566cc49cfe4483b942d2eaa8269acc
I20260927 15:06:16.108062 1099 leader_election.cc:302] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:16.108508 2569 raft_consensus.cc:2726] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.109339 1561 raft_consensus.cc:348] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.109658 1561 raft_consensus.cc:374] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.109786 1561 raft_consensus.cc:729] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.110150 1561 consensus_queue.cc:260] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.111873 1556 tablet_bootstrap.cc:492] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.112012 1556 ts_tablet_manager.cc:1397] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20260927 15:06:16.112749 1556 raft_consensus.cc:348] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.112952 1556 raft_consensus.cc:374] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.113013 1556 raft_consensus.cc:729] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.113186 1556 consensus_queue.cc:260] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.113718 1556 ts_tablet_manager.cc:1428] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:16.113996 1556 tablet_bootstrap.cc:492] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.115365 912 master_service.cc:946] ReplaceTablet: received request to replace tablet fd225f6127ed4c4ea4bbea41aeb0521f from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:16.116591 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f8744e2349e49d3a821eca42c7f89a2 consensus state has no leader
I20260927 15:06:16.116904 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bb7abc219f5145b8b5530fbc0aa97af1" } modify_external_catalogs: true
I20260927 15:06:16.117022 1305 raft_consensus.cc:3037] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.117090 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bb7abc219f5145b8b5530fbc0aa97af1" } modify_external_catalogs: true
I20260927 15:06:16.119079 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 01b7e017ead242849585679873a69b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.122220 2568 consensus_queue.cc:1035] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:16.124943 1561 ts_tablet_manager.cc:1428] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260927 15:06:16.126904 1561 tablet_bootstrap.cc:492] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:16.128981 2119 ts_tablet_manager.cc:1918] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.133224 1556 tablet_bootstrap.cc:654] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.130921 1552 tablet_bootstrap.cc:492] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:16.135650 2119 log.cc:1196] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/c49913b1763c4a7b9413a801aff93b30
I20260927 15:06:16.135828 1552 ts_tablet_manager.cc:1397] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.001s
I20260927 15:06:16.136045 2119 ts_tablet_manager.cc:1939] T c49913b1763c4a7b9413a801aff93b30 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.136405 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 760) took 2795 ms. Trace:
I20260927 15:06:16.136502 2119 rpcz_store.cc:276] 0927 15:06:13.340482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.340546 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:16.062845 (+2722299us) ts_tablet_manager.cc:1145] Deleting tablet c49913b1763c4a7b9413a801aff93b30
0927 15:06:16.062856 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.119867 (+ 57011us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.128880 (+ 9013us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.136386 (+ 7506us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2722054}
I20260927 15:06:16.136909 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 761) took 2696 ms. Trace:
I20260927 15:06:16.136992 2119 rpcz_store.cc:276] 0927 15:06:13.440250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.440298 (+ 48us) service_pool.cc:227] Handling call
0927 15:06:16.136784 (+2696486us) ts_tablet_manager.cc:1145] Deleting tablet 8f2843bf6dbf4117b3f44cd39c328b99
0927 15:06:16.136795 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.136893 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2696308}
I20260927 15:06:16.137072 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet c49913b1763c4a7b9413a801aff93b30 (table default.Table_6cc665540fb24e17b9284fc911758626 [id=31cb67e2dcb54a029ecdc3457b6139c1]) successfully deleted
I20260927 15:06:16.137260 2119 tablet_replica.cc:330] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.137441 2119 raft_consensus.cc:2229] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.137621 2119 raft_consensus.cc:2258] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:16.137665 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8f2843bf6dbf4117b3f44cd39c328b99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f2843bf6dbf4117b3f44cd39c328b99 already in progress: creating tablet
I20260927 15:06:16.137949 1552 raft_consensus.cc:348] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.138293 2119 ts_tablet_manager.cc:1905] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.138320 1552 raft_consensus.cc:374] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.138506 1552 raft_consensus.cc:729] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.138847 1552 consensus_queue.cc:260] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.139394 1561 tablet_bootstrap.cc:654] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.140440 1552 ts_tablet_manager.cc:1428] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:16.141327 1552 tablet_bootstrap.cc:492] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:16.142379 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81fe6e6be98b4478bc328f61651f191a" } modify_external_catalogs: true
I20260927 15:06:16.142606 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81fe6e6be98b4478bc328f61651f191a" } modify_external_catalogs: true
I20260927 15:06:16.143497 1552 tablet_bootstrap.cc:654] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.143450 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2a22022572e44dea85461bc93ef993cd" } modify_external_catalogs: true
I20260927 15:06:16.143604 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2a22022572e44dea85461bc93ef993cd" } modify_external_catalogs: true
I20260927 15:06:16.145090 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a4042b50ce5049eab1c96114c73daee3" } modify_external_catalogs: true
I20260927 15:06:16.145252 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a4042b50ce5049eab1c96114c73daee3" } modify_external_catalogs: true
I20260927 15:06:16.146598 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_25e39a1524f9443bada5d1bb6c74b002" } modify_external_catalogs: true
I20260927 15:06:16.146785 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_25e39a1524f9443bada5d1bb6c74b002" } modify_external_catalogs: true
I20260927 15:06:16.147656 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4b000705b3ae4cca9dcf80f96bc1757c" } new_table_name: "default.Table_8aaf9520012f4c6db78e09311c703996" modify_external_catalogs: true
I20260927 15:06:16.149713 2569 raft_consensus.cc:482] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.149892 2569 raft_consensus.cc:504] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.150502 2569 leader_election.cc:288] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.151041 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63] alter complete (version 1)
I20260927 15:06:16.151067 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b1f2143af1142eb9f3dbc777299c186" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.151671 1102 leader_election.cc:341] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.152244 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b1f2143af1142eb9f3dbc777299c186" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:16.152453 1435 raft_consensus.cc:2454] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:16.152720 2698 tablet.cc:1722] T 373b6e6c03614b78a8343c84095bd347 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:16.152985 1099 leader_election.cc:302] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.153440 2569 raft_consensus.cc:2781] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.153534 2569 raft_consensus.cc:482] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.153656 2569 raft_consensus.cc:3037] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.157158 2569 raft_consensus.cc:504] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.157768 2233 tablet_replica.cc:330] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:16.158180 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 568ba79ea795403cba76fb6632efd7e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 925d256cb28f496889ad7b3c6b1f6f10) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.158241 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b1f2143af1142eb9f3dbc777299c186" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:16.158455 2233 raft_consensus.cc:2229] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.158579 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 2c4a123886a847d08b2a94ff5e4e01ca (table default.Table_862695dd435f415a9be8f6394105e76a [id=3415aea6aba444339a381ccdde11e18c]) successfully deleted
W20260927 15:06:16.158783 1102 leader_election.cc:341] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.159454 2233 raft_consensus.cc:2258] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.159953 2233 ts_tablet_manager.cc:1905] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.162370 2431 raft_consensus.cc:482] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.162525 2431 raft_consensus.cc:504] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.163234 2431 leader_election.cc:288] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.163268 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b1f2143af1142eb9f3dbc777299c186" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:16.163436 1435 raft_consensus.cc:3037] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.165814 1435 raft_consensus.cc:2454] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:16.166898 1099 leader_election.cc:302] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.167187 2431 raft_consensus.cc:2781] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.167358 2431 raft_consensus.cc:686] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:16.167637 2431 consensus_queue.cc:237] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:16.168296 1099 leader_election.cc:341] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 0d4ca19b492c4df1b31c78f1629c50b5
I20260927 15:06:16.168715 2569 leader_election.cc:288] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.173903 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f799583600634a8e8c2b4fe9d5aa1e55
I20260927 15:06:16.175865 911 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 373b6e6c03614b78a8343c84095bd347 (table default.Table_e5b4923d6799470bbe254277f66e23e5 [id=2bbf143085ef4c7e8d039b230baffa63]). Expected version 1 got 0
I20260927 15:06:16.177646 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7e960dd56c394b6f9171078af38cee79" } new_table_name: "default.Table_5c913630119e42cd96e6d768fe24d5fe" modify_external_catalogs: true
I20260927 15:06:16.178938 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet f799583600634a8e8c2b4fe9d5aa1e55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:16.180258 1102 consensus_peers.cc:487] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.178144 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c74dfa20ed9a4eb197a846b62d859146
I20260927 15:06:16.181121 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ca19b492c4df1b31c78f1629c50b5" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.181710 1102 leader_election.cc:341] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.181874 1102 leader_election.cc:302] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:16.182243 2365 raft_consensus.cc:2726] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.183959 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet c74dfa20ed9a4eb197a846b62d859146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.184159 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c73e813bb594a5e871718b73fe61fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:05:59 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.184336 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1ff7507743144d8e9f46996174bc8e85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.185068 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ff7507743144d8e9f46996174bc8e85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.186173 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cb01b40008664904bb98fdf1526b779f" } new_table_name: "default.Table_18a2c296caf745228b0882b1913ee0f8" modify_external_catalogs: true
I20260927 15:06:16.180693 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cb75c7fd08964949ad4edf0b46b8cfa6
I20260927 15:06:16.188282 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet cb75c7fd08964949ad4edf0b46b8cfa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.189069 1552 tablet_bootstrap.cc:492] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:16.189604 1552 ts_tablet_manager.cc:1397] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.000s
I20260927 15:06:16.190413 1561 tablet_bootstrap.cc:492] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:16.190593 1561 ts_tablet_manager.cc:1397] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.064s user 0.000s sys 0.003s
I20260927 15:06:16.191372 1561 raft_consensus.cc:348] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.191644 1561 raft_consensus.cc:374] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.191736 1561 raft_consensus.cc:729] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.192131 2119 ts_tablet_manager.cc:1918] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.192490 2119 log.cc:1196] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/fe7816e099094d13887650fc223097c7
I20260927 15:06:16.192912 2119 ts_tablet_manager.cc:1939] T fe7816e099094d13887650fc223097c7 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.193594 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fd225f6127ed4c4ea4bbea41aeb0521f
I20260927 15:06:16.194180 912 catalog_manager.cc:6565] ReplaceTablet: tablet fd225f6127ed4c4ea4bbea41aeb0521f deleted and replaced by tablet 1490ce55cc194e31a8983f710c008073
I20260927 15:06:16.194442 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 762) took 2667 ms. Trace:
I20260927 15:06:16.194533 2119 rpcz_store.cc:276] 0927 15:06:13.526592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.526650 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:16.137220 (+2610570us) ts_tablet_manager.cc:1145] Deleting tablet fe7816e099094d13887650fc223097c7
0927 15:06:16.137229 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.152181 (+ 14952us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.192035 (+ 39854us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.194429 (+ 2394us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2610348}
I20260927 15:06:16.194799 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet fd225f6127ed4c4ea4bbea41aeb0521f with delete_type TABLET_DATA_DELETED (replaced by tablet 1490ce55cc194e31a8983f710c008073) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.190404 1552 raft_consensus.cc:348] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.195075 1552 raft_consensus.cc:374] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.195055 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet fe7816e099094d13887650fc223097c7 (table default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]) successfully deleted
I20260927 15:06:16.195199 1552 raft_consensus.cc:729] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.195477 1552 consensus_queue.cc:260] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.197093 2544 raft_consensus.cc:482] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.197283 2544 raft_consensus.cc:504] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.197681 912 master_service.cc:946] ReplaceTablet: received request to replace tablet fd225f6127ed4c4ea4bbea41aeb0521f from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:16.197849 2544 leader_election.cc:288] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.198531 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c73e813bb594a5e871718b73fe61fc9" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:16.200941 1238 leader_election.cc:341] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6c73e813bb594a5e871718b73fe61fc9
I20260927 15:06:16.201342 1552 ts_tablet_manager.cc:1428] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260927 15:06:16.203624 1552 tablet_bootstrap.cc:492] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:16.203274 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 763) took 2468 ms. Trace:
I20260927 15:06:16.204725 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 434e9390f1fd4a3ebb65924c37b85bd4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6de2fca4b792491993fcf23ce6db61e0) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.204567 2119 rpcz_store.cc:276] 0927 15:06:13.734386 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.734456 (+ 70us) service_pool.cc:227] Handling call
0927 15:06:16.203142 (+2468686us) ts_tablet_manager.cc:1145] Deleting tablet b5ee2d7382d647cba4f3d55098e437c7
0927 15:06:16.203154 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.203253 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2468437}
W20260927 15:06:16.206887 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b5ee2d7382d647cba4f3d55098e437c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ee2d7382d647cba4f3d55098e437c7 already in progress: creating tablet
I20260927 15:06:16.207783 2119 tablet_replica.cc:330] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.208014 2119 raft_consensus.cc:2229] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.208284 2119 raft_consensus.cc:2258] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.209097 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet c74dfa20ed9a4eb197a846b62d859146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.209311 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet cb75c7fd08964949ad4edf0b46b8cfa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.209470 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet fd225f6127ed4c4ea4bbea41aeb0521f with delete_type TABLET_DATA_DELETED (replaced by tablet 1490ce55cc194e31a8983f710c008073) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.209609 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet f799583600634a8e8c2b4fe9d5aa1e55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.209755 2119 ts_tablet_manager.cc:1905] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:16.210009 1102 consensus_peers.cc:487] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.210747 1164 raft_consensus.cc:2454] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:16.211335 1239 leader_election.cc:302] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:16.211639 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet f799583600634a8e8c2b4fe9d5aa1e55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.211776 2544 raft_consensus.cc:2781] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.211836 2544 raft_consensus.cc:482] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.211889 2544 raft_consensus.cc:3037] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.212133 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet c74dfa20ed9a4eb197a846b62d859146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.212615 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet cb75c7fd08964949ad4edf0b46b8cfa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.213016 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet fd225f6127ed4c4ea4bbea41aeb0521f with delete_type TABLET_DATA_DELETED (replaced by tablet 1490ce55cc194e31a8983f710c008073) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.215088 2544 raft_consensus.cc:504] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.215561 913 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet fd8a53f3c95c4cb7bce21d23f79af28c (table default.Table_e08ec6e011ab4bf586420eaf92cfe107 [id=a51d9c4b701c4c639d904aef0ac3a2cb]). Expected version 1 got 0
I20260927 15:06:16.216150 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c73e813bb594a5e871718b73fe61fc9" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:16.216398 2544 leader_election.cc:288] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.216744 1164 raft_consensus.cc:3037] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.217743 1562 ts_tablet_manager.cc:1918] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.217880 1562 log.cc:1196] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/48e7eac8753f425d90302360d228ee54
I20260927 15:06:16.218269 1562 ts_tablet_manager.cc:1939] T 48e7eac8753f425d90302360d228ee54 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.218529 1561 consensus_queue.cc:260] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.219123 1561 ts_tablet_manager.cc:1428] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.028s user 0.000s sys 0.003s
W20260927 15:06:16.220291 1238 leader_election.cc:341] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6c73e813bb594a5e871718b73fe61fc9
I20260927 15:06:16.226035 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 81e0be77dff645f795237ffe779ed684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.226557 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f6bef5f000441090f73eb842450362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.206540 1552 tablet_bootstrap.cc:654] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.225069 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 727) took 4923 ms. Trace:
I20260927 15:06:16.228186 1562 rpcz_store.cc:276] 0927 15:06:11.301596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.301796 (+ 200us) service_pool.cc:227] Handling call
0927 15:06:16.091892 (+4790096us) ts_tablet_manager.cc:1145] Deleting tablet 48e7eac8753f425d90302360d228ee54
0927 15:06:16.091905 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.135259 (+ 43354us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.208424 (+ 73165us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.225050 (+ 16626us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4789901}
I20260927 15:06:16.225455 1561 tablet_bootstrap.cc:492] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:16.228762 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 48e7eac8753f425d90302360d228ee54 (table default.Table_336bf4e2b65f4a6ea300b83b198b1b4f [id=56f6b3596fe64d17a0b2fcf2c187eb02]) successfully deleted
I20260927 15:06:16.229839 1561 tablet_bootstrap.cc:654] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.230898 2233 ts_tablet_manager.cc:1918] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.231022 2233 log.cc:1196] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/610ff6563dc64e73b2b4d7c268468b21
I20260927 15:06:16.231333 2233 ts_tablet_manager.cc:1939] T 610ff6563dc64e73b2b4d7c268468b21 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:16.232051 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 785) took 3937 ms. Trace:
I20260927 15:06:16.232146 2233 rpcz_store.cc:276] 0927 15:06:12.294647 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.294762 (+ 115us) service_pool.cc:227] Handling call
0927 15:06:16.157718 (+3862956us) ts_tablet_manager.cc:1145] Deleting tablet 610ff6563dc64e73b2b4d7c268468b21
0927 15:06:16.157731 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.202820 (+ 45089us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.230758 (+ 27938us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.232034 (+ 1276us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3862742}
I20260927 15:06:16.232544 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 610ff6563dc64e73b2b4d7c268468b21 (table default.Table_5c5b46d2dba044ef8c5bb41023e108ee [id=eb505f5ebaa2482182e05e9b000f35b9]) successfully deleted
I20260927 15:06:16.232874 1562 tablet_replica.cc:330] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.233065 1562 raft_consensus.cc:2229] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.233207 1562 raft_consensus.cc:2258] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.234376 1562 ts_tablet_manager.cc:1905] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.235523 1552 tablet_bootstrap.cc:492] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:16.235698 1552 ts_tablet_manager.cc:1397] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.002s
I20260927 15:06:16.236431 1552 raft_consensus.cc:348] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.236693 1552 raft_consensus.cc:374] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.236791 1552 raft_consensus.cc:729] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.237062 1552 consensus_queue.cc:260] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.238621 1552 ts_tablet_manager.cc:1428] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:16.239750 1552 tablet_bootstrap.cc:492] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:16.240183 2233 tablet_replica.cc:330] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:16.241246 2233 raft_consensus.cc:2229] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.241415 1552 tablet_bootstrap.cc:654] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.241920 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d4ca19b492c4df1b31c78f1629c50b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.242843 2119 ts_tablet_manager.cc:1918] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 15:06:16.242986 2119 log.cc:1196] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/f88b401dc12e451c80abe1b509e2b532
I20260927 15:06:16.243396 2119 ts_tablet_manager.cc:1939] T f88b401dc12e451c80abe1b509e2b532 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.243736 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 764) took 2508 ms. Trace:
I20260927 15:06:16.243861 2119 rpcz_store.cc:276] 0927 15:06:13.735808 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.735873 (+ 65us) service_pool.cc:227] Handling call
0927 15:06:16.207738 (+2471865us) ts_tablet_manager.cc:1145] Deleting tablet f88b401dc12e451c80abe1b509e2b532
0927 15:06:16.207748 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.230272 (+ 22524us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.242734 (+ 12462us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.243722 (+ 988us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2471578}
I20260927 15:06:16.243971 2233 raft_consensus.cc:2258] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.245311 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_d10e6eb8078c475abd696473005670a3 [id=c4ddc66927a94fd2abc8e44012cf69f7]) successfully deleted
I20260927 15:06:16.245679 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 765) took 2509 ms. Trace:
I20260927 15:06:16.245770 2119 rpcz_store.cc:276] 0927 15:06:13.736405 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.736456 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:16.245563 (+2509107us) ts_tablet_manager.cc:1145] Deleting tablet d9a3105b7cca4ac18b2c29c8b9dcda64
0927 15:06:16.245573 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.245663 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2508943}
W20260927 15:06:16.246158 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet d9a3105b7cca4ac18b2c29c8b9dcda64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9a3105b7cca4ac18b2c29c8b9dcda64 already in progress: creating tablet
I20260927 15:06:16.246286 2695 raft_consensus.cc:482] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.246402 2695 raft_consensus.cc:504] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.247079 2695 leader_election.cc:288] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.247648 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6bef5f000441090f73eb842450362" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.247999 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6bef5f000441090f73eb842450362" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:16.248345 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 769) took 2448 ms. Trace:
I20260927 15:06:16.248450 2119 rpcz_store.cc:276] 0927 15:06:13.799814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.799876 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:16.248212 (+2448336us) ts_tablet_manager.cc:1145] Deleting tablet 34308468f31444869011c61da58d30e8
0927 15:06:16.248225 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.248323 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2448092}
I20260927 15:06:16.248718 2233 ts_tablet_manager.cc:1905] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:16.248736 1374 leader_election.cc:341] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.248860 2544 raft_consensus.cc:482] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.248987 2544 raft_consensus.cc:504] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:16.249109 1376 leader_election.cc:341] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.249198 1376 leader_election.cc:302] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:16.249640 2544 leader_election.cc:288] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.249655 2695 raft_consensus.cc:2726] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:16.250248 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 34308468f31444869011c61da58d30e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34308468f31444869011c61da58d30e8 already in progress: creating tablet
I20260927 15:06:16.251003 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet fd8a53f3c95c4cb7bce21d23f79af28c (table default.Table_e08ec6e011ab4bf586420eaf92cfe107 [id=a51d9c4b701c4c639d904aef0ac3a2cb]). Expected version 1 got 0
I20260927 15:06:16.250988 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c0d51b50b414721a255fdde2fe1732f" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.251255 1163 raft_consensus.cc:2454] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:16.252431 1239 leader_election.cc:302] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
W20260927 15:06:16.252751 1238 leader_election.cc:341] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 5c0d51b50b414721a255fdde2fe1732f
I20260927 15:06:16.253055 2544 raft_consensus.cc:2781] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.253121 2544 raft_consensus.cc:482] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.253175 2544 raft_consensus.cc:3037] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.255050 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 772) took 2454 ms. Trace:
I20260927 15:06:16.255141 2119 rpcz_store.cc:276] 0927 15:06:13.800798 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.800842 (+ 44us) service_pool.cc:227] Handling call
0927 15:06:16.254929 (+2454087us) ts_tablet_manager.cc:1145] Deleting tablet 0ac2df48cabc467195f4986238519fb2
0927 15:06:16.254940 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.255032 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2453923}
I20260927 15:06:16.256065 2544 raft_consensus.cc:504] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.257395 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c0d51b50b414721a255fdde2fe1732f" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:16.257608 1163 raft_consensus.cc:3037] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:16.259117 1238 leader_election.cc:341] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 5c0d51b50b414721a255fdde2fe1732f
I20260927 15:06:16.259384 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 774) took 2457 ms. Trace:
W20260927 15:06:16.255679 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0ac2df48cabc467195f4986238519fb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ac2df48cabc467195f4986238519fb2 already in progress: creating tablet
I20260927 15:06:16.259481 2119 rpcz_store.cc:276] 0927 15:06:13.801666 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.801711 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:16.255842 (+2454131us) ts_tablet_manager.cc:1145] Deleting tablet 3540982dd7544e60af6c153fc41a412c
0927 15:06:16.259266 (+ 3424us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.259365 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2453983}
W20260927 15:06:16.259922 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3540982dd7544e60af6c153fc41a412c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3540982dd7544e60af6c153fc41a412c already in progress: creating tablet
I20260927 15:06:16.260661 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 780) took 2456 ms. Trace:
I20260927 15:06:16.260743 2119 rpcz_store.cc:276] 0927 15:06:13.804268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.804321 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:16.260556 (+2456235us) ts_tablet_manager.cc:1145] Deleting tablet 714f59ebe9cf4568a9aa4d5058200106
0927 15:06:16.260566 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.260644 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2456062}
W20260927 15:06:16.261113 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 714f59ebe9cf4568a9aa4d5058200106 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 714f59ebe9cf4568a9aa4d5058200106 already in progress: creating tablet
I20260927 15:06:16.262398 2695 raft_consensus.cc:482] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.262554 2695 raft_consensus.cc:504] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.263052 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 781) took 2458 ms. Trace:
I20260927 15:06:16.263181 2695 leader_election.cc:288] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.263130 2119 rpcz_store.cc:276] 0927 15:06:13.804827 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.804870 (+ 43us) service_pool.cc:227] Handling call
0927 15:06:16.262956 (+2458086us) ts_tablet_manager.cc:1145] Deleting tablet e2c276b721a74822a5275c5924de20b6
0927 15:06:16.262965 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.263037 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2457912}
W20260927 15:06:16.263255 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a19a13469f46417fa46f655effecf6b1 consensus state has no leader
W20260927 15:06:16.263656 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e2c276b721a74822a5275c5924de20b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2c276b721a74822a5275c5924de20b6 already in progress: creating tablet
W20260927 15:06:16.263726 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98af26391d6c4093b7e727efd7067000 consensus state has no leader
W20260927 15:06:16.264155 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd1da3a0f4594b8884dd54497f7169ed consensus state has no leader
I20260927 15:06:16.264591 1552 tablet_bootstrap.cc:492] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:16.264714 1552 ts_tablet_manager.cc:1397] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260927 15:06:16.265197 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef93a120f00423d91664ce4eaf03803" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:16.265868 1374 leader_election.cc:341] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.266077 1552 raft_consensus.cc:348] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.266280 1552 raft_consensus.cc:374] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.266333 1552 raft_consensus.cc:729] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.266510 1552 consensus_queue.cc:260] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.266521 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef93a120f00423d91664ce4eaf03803" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.267151 1376 leader_election.cc:341] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.267266 1376 leader_election.cc:302] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:16.267647 2695 raft_consensus.cc:2726] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.268113 1552 ts_tablet_manager.cc:1428] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:16.269091 1552 tablet_bootstrap.cc:492] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:16.269788 1163 raft_consensus.cc:2454] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:16.270300 1239 leader_election.cc:302] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:16.270510 2119 tablet_replica.cc:330] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.270728 2119 raft_consensus.cc:2229] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.271036 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 424b66c69254487f932894516d570204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.270509 2661 raft_consensus.cc:2781] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.271222 2661 raft_consensus.cc:686] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:16.271440 2661 consensus_queue.cc:237] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.272527 2544 leader_election.cc:288] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.276384 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0de786b8335e40d7b02555750495ff59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.277170 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0de786b8335e40d7b02555750495ff59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.281752 1561 tablet_bootstrap.cc:492] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:16.281899 1561 ts_tablet_manager.cc:1397] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.057s user 0.004s sys 0.003s
I20260927 15:06:16.282195 1562 ts_tablet_manager.cc:1918] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.270933 2119 raft_consensus.cc:2258] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.294034 2119 ts_tablet_manager.cc:1905] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.287693 1561 raft_consensus.cc:348] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.296849 1561 raft_consensus.cc:374] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.296924 1561 raft_consensus.cc:729] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.296754 1562 log.cc:1196] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/c41cd38355e64590b43b2e1271c43e91
I20260927 15:06:16.297550 1562 ts_tablet_manager.cc:1939] T c41cd38355e64590b43b2e1271c43e91 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.297168 1561 consensus_queue.cc:260] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.299173 1561 ts_tablet_manager.cc:1428] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260927 15:06:16.299638 1552 tablet_bootstrap.cc:654] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.300523 2544 raft_consensus.cc:482] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.301005 1561 tablet_bootstrap.cc:492] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:16.301749 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ba5ccbc1e5b84ade984b1ddd16f7c7e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.302512 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba5ccbc1e5b84ade984b1ddd16f7c7e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.304095 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 728) took 4963 ms. Trace:
I20260927 15:06:16.304406 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_47bb2cc8986c43588be2aae5774b41bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:16.304926 2658 raft_consensus.cc:482] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.305064 2658 raft_consensus.cc:504] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.305172 1562 rpcz_store.cc:276] 0927 15:06:11.340372 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.340437 (+ 65us) service_pool.cc:227] Handling call
0927 15:06:16.232831 (+4892394us) ts_tablet_manager.cc:1145] Deleting tablet c41cd38355e64590b43b2e1271c43e91
0927 15:06:16.232842 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.254392 (+ 21550us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.282081 (+ 27689us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.304075 (+ 21994us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3436,"tablet-delete.queue_time_us":4892123}
I20260927 15:06:16.305634 2658 leader_election.cc:288] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.306216 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ca19b492c4df1b31c78f1629c50b5" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.306362 2233 ts_tablet_manager.cc:1918] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.306411 1163 raft_consensus.cc:2454] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:16.306471 2233 log.cc:1196] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/4b9e88c3679d412cac7603f200cf899b
I20260927 15:06:16.306740 2233 ts_tablet_manager.cc:1939] T 4b9e88c3679d412cac7603f200cf899b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:16.306977 1239 leader_election.cc:302] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:16.307353 2658 raft_consensus.cc:2781] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.307430 2658 raft_consensus.cc:482] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.307489 2658 raft_consensus.cc:3037] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.307464 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 729) took 4911 ms. Trace:
I20260927 15:06:16.307541 1562 rpcz_store.cc:276] 0927 15:06:11.396033 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.396871 (+ 838us) service_pool.cc:227] Handling call
0927 15:06:16.307338 (+4910467us) ts_tablet_manager.cc:1145] Deleting tablet fd6a824a5a504c92992ceec1cd3eb2e7
0927 15:06:16.307350 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.307446 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4910239}
I20260927 15:06:16.309754 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 731) took 4910 ms. Trace:
I20260927 15:06:16.309823 1562 rpcz_store.cc:276] 0927 15:06:11.399680 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.399735 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:16.309646 (+4909911us) ts_tablet_manager.cc:1145] Deleting tablet 921db5dbe31a4d0381bdd823cb497424
0927 15:06:16.309657 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.309739 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4909699}
W20260927 15:06:16.311221 1238 leader_election.cc:341] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 0d4ca19b492c4df1b31c78f1629c50b5
I20260927 15:06:16.308696 1556 tablet_bootstrap.cc:492] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.311641 1556 ts_tablet_manager.cc:1397] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.198s user 0.001s sys 0.019s
I20260927 15:06:16.312873 1556 raft_consensus.cc:348] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:16.313112 1102 consensus_peers.cc:487] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.313169 1556 raft_consensus.cc:374] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.313247 1556 raft_consensus.cc:729] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.313457 1556 consensus_queue.cc:260] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.313970 1556 ts_tablet_manager.cc:1428] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 15:06:16.314543 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 730) took 4915 ms. Trace:
I20260927 15:06:16.314628 1562 rpcz_store.cc:276] 0927 15:06:11.399545 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.402446 (+ 2901us) service_pool.cc:227] Handling call
0927 15:06:16.314434 (+4911988us) ts_tablet_manager.cc:1145] Deleting tablet 9f07d07b63834b368930d34956e7d6df
0927 15:06:16.314445 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.314524 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4911758}
I20260927 15:06:16.300668 2544 raft_consensus.cc:504] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.316306 1561 tablet_bootstrap.cc:654] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.310045 2658 raft_consensus.cc:504] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.318406 2544 leader_election.cc:288] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.318799 2658 leader_election.cc:288] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.319695 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 786) took 4016 ms. Trace:
I20260927 15:06:16.319799 2233 rpcz_store.cc:276] 0927 15:06:12.303120 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.303170 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:16.240136 (+3936966us) ts_tablet_manager.cc:1145] Deleting tablet 4b9e88c3679d412cac7603f200cf899b
0927 15:06:16.240149 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.264738 (+ 24589us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.306261 (+ 41523us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.319672 (+ 13411us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1408,"tablet-delete.queue_time_us":3936764}
I20260927 15:06:16.320983 1556 tablet_bootstrap.cc:492] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.322502 1556 tablet_bootstrap.cc:654] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:16.322974 1238 leader_election.cc:341] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 434e9390f1fd4a3ebb65924c37b85bd4
W20260927 15:06:16.323168 1238 leader_election.cc:341] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 0d4ca19b492c4df1b31c78f1629c50b5
I20260927 15:06:16.323371 1562 tablet_replica.cc:330] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.323567 1562 raft_consensus.cc:2229] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.323848 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 800) took 3722 ms. Trace:
I20260927 15:06:16.323969 2233 rpcz_store.cc:276] 0927 15:06:12.601610 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.601718 (+ 108us) service_pool.cc:227] Handling call
0927 15:06:16.323737 (+3722019us) ts_tablet_manager.cc:1145] Deleting tablet 10b19de22dd74d74bdf619c75fc17762
0927 15:06:16.323747 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.323830 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3721771}
I20260927 15:06:16.324425 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 801) took 3722 ms. Trace:
I20260927 15:06:16.324506 2233 rpcz_store.cc:276] 0927 15:06:12.601787 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.602028 (+ 241us) service_pool.cc:227] Handling call
0927 15:06:16.324332 (+3722304us) ts_tablet_manager.cc:1145] Deleting tablet 0ae30595912943aaa58f1ebe9dc965e6
0927 15:06:16.324343 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.324412 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3722151}
I20260927 15:06:16.324856 2233 tablet_replica.cc:330] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:16.325054 2233 raft_consensus.cc:2229] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.325218 2233 raft_consensus.cc:2258] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.325989 2233 ts_tablet_manager.cc:1905] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.305665 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet c41cd38355e64590b43b2e1271c43e91 (table default.Table_4239cd3219fb4e32827288ef7222bf2f [id=d49a20ec0aac4d799662a64a906d62f0]) successfully deleted
W20260927 15:06:16.328814 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47bb2cc8986c43588be2aae5774b41bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.329463 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ea141cf06d87453b9f5a4a68d8bfc5e8" } new_table_name: "default.Table_ef6ec660265c4fcfbcf2fa6ac34bac01" modify_external_catalogs: true
I20260927 15:06:16.330114 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 8f2843bf6dbf4117b3f44cd39c328b99 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:16.330960 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet fd6a824a5a504c92992ceec1cd3eb2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd6a824a5a504c92992ceec1cd3eb2e7 already in progress: creating tablet
W20260927 15:06:16.331349 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 921db5dbe31a4d0381bdd823cb497424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 921db5dbe31a4d0381bdd823cb497424 already in progress: creating tablet
W20260927 15:06:16.331653 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9f07d07b63834b368930d34956e7d6df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f07d07b63834b368930d34956e7d6df already in progress: creating tablet
I20260927 15:06:16.332980 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fb02ad6ad0ce454e9c2678bf69fe98da" } new_table_name: "default.Table_a4de8512043d4aa3a9b7c793179a96d9" modify_external_catalogs: true
I20260927 15:06:16.333185 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "434e9390f1fd4a3ebb65924c37b85bd4" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.333367 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4ca19b492c4df1b31c78f1629c50b5" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:16.333526 1166 raft_consensus.cc:3037] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.333537 2568 raft_consensus.cc:482] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.333706 2568 raft_consensus.cc:504] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.334227 2568 leader_election.cc:288] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.335059 1562 raft_consensus.cc:2258] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.335668 1562 ts_tablet_manager.cc:1905] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.320773 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 4b9e88c3679d412cac7603f200cf899b (table default.Table_1a0416550bbc4a05bc617171ed8c1504 [id=286509b6ce63492cbdc1ddea9374115c]) successfully deleted
I20260927 15:06:16.336345 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 3042c17580d54082971b761433a7dca9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:16.336906 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 10b19de22dd74d74bdf619c75fc17762 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10b19de22dd74d74bdf619c75fc17762 already in progress: creating tablet
W20260927 15:06:16.337275 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0ae30595912943aaa58f1ebe9dc965e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ae30595912943aaa58f1ebe9dc965e6 already in progress: creating tablet
I20260927 15:06:16.337949 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278205071701447e8ee7457b2ee84be4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:16.336198 1166 raft_consensus.cc:2454] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:16.338197 1433 raft_consensus.cc:2454] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:16.338696 1099 leader_election.cc:302] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:16.339005 2568 raft_consensus.cc:2781] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.339107 2568 raft_consensus.cc:482] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.339196 2568 raft_consensus.cc:3037] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.341470 1239 leader_election.cc:302] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:16.341884 1239 leader_election.cc:302] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:16.342449 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278205071701447e8ee7457b2ee84be4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.343111 1102 leader_election.cc:341] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.342504 2568 raft_consensus.cc:504] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.344909 2568 leader_election.cc:288] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.344868 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278205071701447e8ee7457b2ee84be4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:16.345118 2658 raft_consensus.cc:2726] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.345273 2658 raft_consensus.cc:2781] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.345623 2658 raft_consensus.cc:686] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:16.345713 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278205071701447e8ee7457b2ee84be4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:16.345885 1433 raft_consensus.cc:3037] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.345850 2658 consensus_queue.cc:237] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:16.347081 1102 leader_election.cc:341] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.349397 1433 raft_consensus.cc:2454] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:16.350157 1099 leader_election.cc:302] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.350941 2568 raft_consensus.cc:2781] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.351552 2568 raft_consensus.cc:686] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:16.352303 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b99a341ee9cd40969b19a6c799a3ee74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:16.352406 2568 consensus_queue.cc:237] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:16.354282 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b99a341ee9cd40969b19a6c799a3ee74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.354918 1164 raft_consensus.cc:2454] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:16.355603 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a8cba3f530e84e4684b52d7098f44dde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.356236 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8cba3f530e84e4684b52d7098f44dde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:16.358844 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79f98202a2004a3caf95c768d7f7095c consensus state has no leader
I20260927 15:06:16.360704 2695 raft_consensus.cc:482] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.360837 2695 raft_consensus.cc:504] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.360874 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e97674d6a4af430f80eb42916ccbaae6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.361362 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e97674d6a4af430f80eb42916ccbaae6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.361505 2695 leader_election.cc:288] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.362142 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f05da432f041378c5ab808536e6b6f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:16.362777 1374 leader_election.cc:341] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.363168 1239 leader_election.cc:302] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:16.363183 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dc3aebebe1c247758fe1662d344f0ab7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:16.363401 2661 raft_consensus.cc:2781] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
W20260927 15:06:16.363677 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc3aebebe1c247758fe1662d344f0ab7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.363767 2661 raft_consensus.cc:686] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:16.364051 2661 consensus_queue.cc:237] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.369246 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f05da432f041378c5ab808536e6b6f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.369823 1376 leader_election.cc:341] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.369947 1376 leader_election.cc:302] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:16.370200 2695 raft_consensus.cc:2726] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.371440 2675 tablet.cc:1722] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:16.372570 2698 tablet.cc:1722] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:16.378028 2674 tablet.cc:1722] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:16.352844 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a75c1bff99d44d8aa0a19f7efd59f579"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.353443 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8eeb4f55d0c6431cb1cff629cced4562 consensus state has no leader
W20260927 15:06:16.384653 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a75c1bff99d44d8aa0a19f7efd59f579 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.388535 2119 ts_tablet_manager.cc:1918] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:06:16.388659 2119 log.cc:1196] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/9a7989e2b91044dab1d3e327958a051a
I20260927 15:06:16.388988 2119 ts_tablet_manager.cc:1939] T 9a7989e2b91044dab1d3e327958a051a P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.389292 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 782) took 2543 ms. Trace:
I20260927 15:06:16.389379 2119 rpcz_store.cc:276] 0927 15:06:13.845804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.846672 (+ 868us) service_pool.cc:227] Handling call
0927 15:06:16.270472 (+2423800us) ts_tablet_manager.cc:1145] Deleting tablet 9a7989e2b91044dab1d3e327958a051a
0927 15:06:16.270481 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.384880 (+114399us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.388449 (+ 3569us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.389276 (+ 827us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2423575}
I20260927 15:06:16.389787 2119 tablet_replica.cc:330] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.389930 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_aa05ab0cb98542a4b84901b5dcd86aee [id=b1106aee6c804da4a603364cee1c1116]) successfully deleted
I20260927 15:06:16.389978 2119 raft_consensus.cc:2229] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.390118 2119 raft_consensus.cc:2258] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.390636 2119 ts_tablet_manager.cc:1905] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.404167 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dd8f1d71fa7d4665b96954a6d766c9ce" } modify_external_catalogs: true
I20260927 15:06:16.404512 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dd8f1d71fa7d4665b96954a6d766c9ce" } modify_external_catalogs: true
I20260927 15:06:16.404994 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b899d4e7001546fca9ea2952ad36dbd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.405697 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b899d4e7001546fca9ea2952ad36dbd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.407142 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e3fac64ab4014a83baf665b86a27a0e0" } modify_external_catalogs: true
I20260927 15:06:16.407320 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e3fac64ab4014a83baf665b86a27a0e0" } modify_external_catalogs: true
I20260927 15:06:16.408248 1561 tablet_bootstrap.cc:492] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:16.408388 1561 ts_tablet_manager.cc:1397] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.109s user 0.012s sys 0.004s
I20260927 15:06:16.409067 1561 raft_consensus.cc:348] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.409274 1561 raft_consensus.cc:374] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.409322 1561 raft_consensus.cc:729] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.409722 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1e91076e42b04629abc3a91b3b7ecd50" } modify_external_catalogs: true
I20260927 15:06:16.409974 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1e91076e42b04629abc3a91b3b7ecd50" } modify_external_catalogs: true
I20260927 15:06:16.410233 1556 tablet_bootstrap.cc:492] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.410356 1556 ts_tablet_manager.cc:1397] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.000s
I20260927 15:06:16.410967 1556 raft_consensus.cc:348] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.411157 1556 raft_consensus.cc:374] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.411217 1556 raft_consensus.cc:729] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.411583 1561 consensus_queue.cc:260] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.412636 1561 ts_tablet_manager.cc:1428] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:16.412817 1556 consensus_queue.cc:260] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.413544 1561 tablet_bootstrap.cc:492] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:16.414291 2568 raft_consensus.cc:482] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.414405 2568 raft_consensus.cc:504] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.414983 2568 leader_election.cc:288] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.416199 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb859b43634c420382da5c201ce24dfc" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:16.416395 1433 raft_consensus.cc:2454] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:16.416606 2119 ts_tablet_manager.cc:1918] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.416733 2119 log.cc:1196] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/dc6f179aab784ae4822356e63332532f
I20260927 15:06:16.417030 2119 ts_tablet_manager.cc:1939] T dc6f179aab784ae4822356e63332532f P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.416983 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb859b43634c420382da5c201ce24dfc" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:16.417075 1099 leader_election.cc:302] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:16.417307 2431 consensus_queue.cc:1035] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:16.417405 2568 raft_consensus.cc:2781] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.417484 2568 raft_consensus.cc:482] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260927 15:06:16.417538 1102 leader_election.cc:341] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.417548 2568 raft_consensus.cc:3037] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.418118 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 786) took 2474 ms. Trace:
I20260927 15:06:16.418253 2119 rpcz_store.cc:276] 0927 15:06:13.943931 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.943980 (+ 49us) service_pool.cc:227] Handling call
0927 15:06:16.389747 (+2445767us) ts_tablet_manager.cc:1145] Deleting tablet dc6f179aab784ae4822356e63332532f
0927 15:06:16.389757 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.393653 (+ 3896us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.416517 (+ 22864us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.418100 (+ 1583us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2445605}
I20260927 15:06:16.418812 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet dc6f179aab784ae4822356e63332532f (table default.Table_2f2bd859db5046c0afc8811df26a404f [id=359e0f2f64c54790a1fbb004164bf090]) successfully deleted
I20260927 15:06:16.419250 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 788) took 2473 ms. Trace:
W20260927 15:06:16.419420 1099 consensus_peers.cc:487] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c4a123886a847d08b2a94ff5e4e01ca. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.419373 2119 rpcz_store.cc:276] 0927 15:06:13.945542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.945598 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:16.419137 (+2473539us) ts_tablet_manager.cc:1145] Deleting tablet 1a05574f0f734e6d912b375137482a21
0927 15:06:16.419148 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.419233 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2473357}
W20260927 15:06:16.419966 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1a05574f0f734e6d912b375137482a21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a05574f0f734e6d912b375137482a21 already in progress: creating tablet
I20260927 15:06:16.420337 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 789) took 2474 ms. Trace:
I20260927 15:06:16.420418 2568 raft_consensus.cc:504] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.420480 2119 rpcz_store.cc:276] 0927 15:06:13.945894 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.945935 (+ 41us) service_pool.cc:227] Handling call
0927 15:06:16.420239 (+2474304us) ts_tablet_manager.cc:1145] Deleting tablet 29c5d4cfb0d84d30896c0c7913c4d82b
0927 15:06:16.420249 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.420321 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2474147}
I20260927 15:06:16.420681 1562 ts_tablet_manager.cc:1918] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:16.420794 1562 log.cc:1196] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/765b3ee3323846c5ba598f47478fd367
I20260927 15:06:16.421135 1562 ts_tablet_manager.cc:1939] T 765b3ee3323846c5ba598f47478fd367 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:06:16.421093 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 29c5d4cfb0d84d30896c0c7913c4d82b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29c5d4cfb0d84d30896c0c7913c4d82b already in progress: creating tablet
I20260927 15:06:16.421422 2119 tablet_replica.cc:330] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.421495 2568 leader_election.cc:288] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.421715 2119 raft_consensus.cc:2229] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.421851 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 734) took 5010 ms. Trace:
I20260927 15:06:16.421732 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb859b43634c420382da5c201ce24dfc" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:16.421918 2119 raft_consensus.cc:2258] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.421934 1562 rpcz_store.cc:276] 0927 15:06:11.411848 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.411930 (+ 82us) service_pool.cc:227] Handling call
0927 15:06:16.323319 (+4911389us) ts_tablet_manager.cc:1145] Deleting tablet 765b3ee3323846c5ba598f47478fd367
0927 15:06:16.323331 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.381451 (+ 58120us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.420587 (+ 39136us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.421834 (+ 1247us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11288,"tablet-delete.queue_time_us":4911114}
I20260927 15:06:16.422273 1562 tablet_replica.cc:330] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:06:16.422312 1102 leader_election.cc:341] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.422464 1562 raft_consensus.cc:2229] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.422442 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb859b43634c420382da5c201ce24dfc" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:16.422528 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 765b3ee3323846c5ba598f47478fd367 (table default.Table_abdaaacde40f42b095135b70046aa5a5 [id=91249093cae2422b8ec06c14cf5fdae5]) successfully deleted
I20260927 15:06:16.422614 1435 raft_consensus.cc:3037] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.422767 1562 raft_consensus.cc:2258] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.423295 2119 ts_tablet_manager.cc:1905] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.425125 1435 raft_consensus.cc:2454] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:16.426638 2661 raft_consensus.cc:482] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.426878 2661 raft_consensus.cc:504] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.427800 2661 leader_election.cc:288] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:16.428464 1238 leader_election.cc:341] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 424b66c69254487f932894516d570204
I20260927 15:06:16.430297 1556 ts_tablet_manager.cc:1428] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260927 15:06:16.430581 1556 tablet_bootstrap.cc:492] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.431203 2119 ts_tablet_manager.cc:1918] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.431306 2119 log.cc:1196] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/1b045b82515540e8813f9250726479e5
I20260927 15:06:16.431591 2119 ts_tablet_manager.cc:1939] T 1b045b82515540e8813f9250726479e5 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.432015 1556 tablet_bootstrap.cc:654] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.432274 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 793) took 2481 ms. Trace:
I20260927 15:06:16.432364 2119 rpcz_store.cc:276] 0927 15:06:13.950536 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.950810 (+ 274us) service_pool.cc:227] Handling call
0927 15:06:16.421385 (+2470575us) ts_tablet_manager.cc:1145] Deleting tablet 1b045b82515540e8813f9250726479e5
0927 15:06:16.421394 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.427352 (+ 5958us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.431122 (+ 3770us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.432257 (+ 1135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2470315}
I20260927 15:06:16.432792 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 1b045b82515540e8813f9250726479e5 (table default.Table_e301f5a5aea64583a20cf58c548d0934 [id=0268289149d14fd5abd1abecf14a43bb]) successfully deleted
I20260927 15:06:16.433223 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 795) took 2196 ms. Trace:
I20260927 15:06:16.433346 2119 rpcz_store.cc:276] 0927 15:06:14.237251 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.237304 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:16.433102 (+2195798us) ts_tablet_manager.cc:1145] Deleting tablet bcbaed2bd9224a0c867cb8804ce8478e
0927 15:06:16.433116 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.433208 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195542}
W20260927 15:06:16.433873 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bcbaed2bd9224a0c867cb8804ce8478e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcbaed2bd9224a0c867cb8804ce8478e already in progress: creating tablet
I20260927 15:06:16.434199 2119 tablet_replica.cc:330] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.434425 2119 raft_consensus.cc:2229] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.434755 2119 raft_consensus.cc:2258] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.435531 2695 raft_consensus.cc:482] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.435654 2695 raft_consensus.cc:504] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.436239 2695 leader_election.cc:288] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.437413 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d7670381b49bb927943b2ee920c84" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.437911 1376 leader_election.cc:341] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.438297 2119 ts_tablet_manager.cc:1905] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.438719 2233 ts_tablet_manager.cc:1918] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.438858 2233 log.cc:1196] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/80a8563c77484a1ebbbe7dab9a652aeb
I20260927 15:06:16.440599 2233 ts_tablet_manager.cc:1939] T 80a8563c77484a1ebbbe7dab9a652aeb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:16.426333 1099 leader_election.cc:302] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.442600 2568 raft_consensus.cc:2781] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.442723 2568 raft_consensus.cc:686] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:16.442950 2568 consensus_queue.cc:237] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.443856 2431 consensus_queue.cc:1035] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:16.444613 1562 ts_tablet_manager.cc:1905] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.445626 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 802) took 3843 ms. Trace:
I20260927 15:06:16.445729 2233 rpcz_store.cc:276] 0927 15:06:12.601912 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.602211 (+ 299us) service_pool.cc:227] Handling call
0927 15:06:16.324824 (+3722613us) ts_tablet_manager.cc:1145] Deleting tablet 80a8563c77484a1ebbbe7dab9a652aeb
0927 15:06:16.324832 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.416167 (+ 91335us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.438624 (+ 22457us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.445607 (+ 6983us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4264,"tablet-delete.queue_time_us":3722471}
I20260927 15:06:16.446126 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 804) took 3843 ms. Trace:
I20260927 15:06:16.446213 2233 rpcz_store.cc:276] 0927 15:06:12.602200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.602390 (+ 190us) service_pool.cc:227] Handling call
0927 15:06:16.446012 (+3843622us) ts_tablet_manager.cc:1145] Deleting tablet 95c8178680ea4b6b8794150188320ea9
0927 15:06:16.446023 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.446112 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3843473}
I20260927 15:06:16.446533 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 803) took 3844 ms. Trace:
I20260927 15:06:16.446314 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 80a8563c77484a1ebbbe7dab9a652aeb (table default.Table_60ea7e4921ff40728d6a8b84c9b494c8 [id=f76efa8048524aa9a343ed0912a15500]) successfully deleted
I20260927 15:06:16.446609 2233 rpcz_store.cc:276] 0927 15:06:12.602029 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.602569 (+ 540us) service_pool.cc:227] Handling call
0927 15:06:16.446441 (+3843872us) ts_tablet_manager.cc:1145] Deleting tablet 6f3bdfede5744513aeadb22da73b6f8a
0927 15:06:16.446450 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.446520 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3843756}
I20260927 15:06:16.446923 2233 tablet_replica.cc:330] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:16.447104 2233 raft_consensus.cc:2229] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.447254 2233 raft_consensus.cc:2258] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:16.447378 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 95c8178680ea4b6b8794150188320ea9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95c8178680ea4b6b8794150188320ea9 already in progress: creating tablet
I20260927 15:06:16.447768 2233 ts_tablet_manager.cc:1905] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:16.447790 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6f3bdfede5744513aeadb22da73b6f8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f3bdfede5744513aeadb22da73b6f8a already in progress: creating tablet
I20260927 15:06:16.455557 2119 ts_tablet_manager.cc:1918] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.455698 2119 log.cc:1196] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/c41cd38355e64590b43b2e1271c43e91
I20260927 15:06:16.456058 2119 ts_tablet_manager.cc:1939] T c41cd38355e64590b43b2e1271c43e91 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.456346 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 796) took 2218 ms. Trace:
I20260927 15:06:16.456429 2119 rpcz_store.cc:276] 0927 15:06:14.237768 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.237811 (+ 43us) service_pool.cc:227] Handling call
0927 15:06:16.434156 (+2196345us) ts_tablet_manager.cc:1145] Deleting tablet c41cd38355e64590b43b2e1271c43e91
0927 15:06:16.434168 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.452193 (+ 18025us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.455477 (+ 3284us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.456329 (+ 852us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2196122}
I20260927 15:06:16.456887 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet c41cd38355e64590b43b2e1271c43e91 (table default.Table_4239cd3219fb4e32827288ef7222bf2f [id=d49a20ec0aac4d799662a64a906d62f0]) successfully deleted
I20260927 15:06:16.457130 2431 consensus_queue.cc:1035] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:16.458027 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 808) took 2152 ms. Trace:
I20260927 15:06:16.458113 2119 rpcz_store.cc:276] 0927 15:06:14.305666 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.305711 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:16.457914 (+2152203us) ts_tablet_manager.cc:1145] Deleting tablet 073b995a22304b0aaf8cfd61ffd5722a
0927 15:06:16.457925 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.458009 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2151973}
W20260927 15:06:16.458580 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 073b995a22304b0aaf8cfd61ffd5722a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 073b995a22304b0aaf8cfd61ffd5722a already in progress: creating tablet
I20260927 15:06:16.461918 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 809) took 2155 ms. Trace:
I20260927 15:06:16.426414 1561 tablet_bootstrap.cc:654] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.462021 2119 rpcz_store.cc:276] 0927 15:06:14.306120 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.306166 (+ 46us) service_pool.cc:227] Handling call
0927 15:06:16.461790 (+2155624us) ts_tablet_manager.cc:1145] Deleting tablet 1a7f84a178ab4cd6b7deeae02e1e52ec
0927 15:06:16.461805 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.461900 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2155402}
I20260927 15:06:16.427985 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424b66c69254487f932894516d570204" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.462395 1164 raft_consensus.cc:2379] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate c4264874db964ff2830b7894c2b3d61c in this term.
I20260927 15:06:16.436991 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d7670381b49bb927943b2ee920c84" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.463075 1239 leader_election.cc:302] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:16.463225 1374 leader_election.cc:341] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.463366 1374 leader_election.cc:302] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:16.463585 2695 raft_consensus.cc:2726] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.463670 2661 raft_consensus.cc:3037] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:16.464038 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a7f84a178ab4cd6b7deeae02e1e52ec already in progress: creating tablet
I20260927 15:06:16.464468 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 810) took 2157 ms. Trace:
I20260927 15:06:16.464576 2119 rpcz_store.cc:276] 0927 15:06:14.306522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.306561 (+ 39us) service_pool.cc:227] Handling call
0927 15:06:16.464326 (+2157765us) ts_tablet_manager.cc:1145] Deleting tablet c5de1bf320ca4043b31154380710ad79
0927 15:06:16.464341 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.464445 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2157571}
W20260927 15:06:16.465116 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c5de1bf320ca4043b31154380710ad79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5de1bf320ca4043b31154380710ad79 already in progress: creating tablet
I20260927 15:06:16.465431 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 805) took 2160 ms. Trace:
I20260927 15:06:16.465498 2119 rpcz_store.cc:276] 0927 15:06:14.305391 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.309388 (+ 3997us) service_pool.cc:227] Handling call
0927 15:06:16.465337 (+2155949us) ts_tablet_manager.cc:1145] Deleting tablet 8d059dff614841a79674d17dfc8870cb
0927 15:06:16.465347 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.465417 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2155681}
W20260927 15:06:16.465857 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8d059dff614841a79674d17dfc8870cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d059dff614841a79674d17dfc8870cb already in progress: creating tablet
I20260927 15:06:16.466152 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 811) took 2140 ms. Trace:
I20260927 15:06:16.466228 2119 rpcz_store.cc:276] 0927 15:06:14.325685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.327869 (+ 2184us) service_pool.cc:227] Handling call
0927 15:06:16.466054 (+2138185us) ts_tablet_manager.cc:1145] Deleting tablet e9f171fd62d644f38262a2257d47fafe
0927 15:06:16.466064 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.466137 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2137910}
I20260927 15:06:16.466451 2661 raft_consensus.cc:2726] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:16.466619 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e9f171fd62d644f38262a2257d47fafe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9f171fd62d644f38262a2257d47fafe already in progress: creating tablet
I20260927 15:06:16.466976 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 807) took 2161 ms. Trace:
I20260927 15:06:16.467051 2119 rpcz_store.cc:276] 0927 15:06:14.305596 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.386904 (+ 81308us) service_pool.cc:227] Handling call
0927 15:06:16.466864 (+2079960us) ts_tablet_manager.cc:1145] Deleting tablet bc2974e11cf1446895607b4ccec16386
0927 15:06:16.466873 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.466942 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2079612}
W20260927 15:06:16.467392 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bc2974e11cf1446895607b4ccec16386 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc2974e11cf1446895607b4ccec16386 already in progress: creating tablet
I20260927 15:06:16.467701 2119 tablet_replica.cc:330] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.467936 2119 raft_consensus.cc:2229] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.468648 2233 ts_tablet_manager.cc:1918] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.468925 2119 raft_consensus.cc:2258] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.469693 2119 ts_tablet_manager.cc:1905] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.469897 2233 log.cc:1196] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/b3cc37a97bc145bdaa654bcc193fe93b
I20260927 15:06:16.470325 2233 ts_tablet_manager.cc:1939] T b3cc37a97bc145bdaa654bcc193fe93b P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:16.471268 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 805) took 3803 ms. Trace:
I20260927 15:06:16.471442 2233 rpcz_store.cc:276] 0927 15:06:12.668132 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.669341 (+ 1209us) service_pool.cc:227] Handling call
0927 15:06:16.446883 (+3777542us) ts_tablet_manager.cc:1145] Deleting tablet b3cc37a97bc145bdaa654bcc193fe93b
0927 15:06:16.446895 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.450663 (+ 3768us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.468561 (+ 17898us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.471245 (+ 2684us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3777336}
I20260927 15:06:16.472023 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet b3cc37a97bc145bdaa654bcc193fe93b (table default.Table_2597f21341574a599cce741248f402e9 [id=fad65497755c45c0b8ba4c338f3712c3]) successfully deleted
I20260927 15:06:16.468711 1556 tablet_bootstrap.cc:492] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.473419 2695 raft_consensus.cc:482] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.473631 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 807) took 3735 ms. Trace:
I20260927 15:06:16.473546 2695 raft_consensus.cc:504] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.473704 2233 rpcz_store.cc:276] 0927 15:06:12.738155 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.738817 (+ 662us) service_pool.cc:227] Handling call
0927 15:06:16.473524 (+3734707us) ts_tablet_manager.cc:1145] Deleting tablet 7fd8311955974e1cbcdda1961c318588
0927 15:06:16.473534 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.473618 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3734321}
I20260927 15:06:16.474074 2695 leader_election.cc:288] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
W20260927 15:06:16.474074 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7fd8311955974e1cbcdda1961c318588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fd8311955974e1cbcdda1961c318588 already in progress: creating tablet
I20260927 15:06:16.473416 1556 ts_tablet_manager.cc:1397] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260927 15:06:16.474876 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3042c17580d54082971b761433a7dca9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.475020 1556 raft_consensus.cc:348] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.475194 1556 raft_consensus.cc:374] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.475248 1556 raft_consensus.cc:729] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
W20260927 15:06:16.475545 1374 leader_election.cc:341] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.475502 1556 consensus_queue.cc:260] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.475937 2233 tablet_replica.cc:330] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:16.476058 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3042c17580d54082971b761433a7dca9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.476468 1376 leader_election.cc:341] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.476560 1376 leader_election.cc:302] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:16.476719 1556 ts_tablet_manager.cc:1428] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:16.476929 2233 raft_consensus.cc:2229] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.476985 2695 raft_consensus.cc:2726] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.477288 2233 raft_consensus.cc:2258] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.477835 2233 ts_tablet_manager.cc:1905] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.478229 1556 tablet_bootstrap.cc:492] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.480118 2695 raft_consensus.cc:482] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.480235 2695 raft_consensus.cc:504] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.480711 2695 leader_election.cc:288] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.481359 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214229a8283b43c4916a5db7ba120e03" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:16.481986 1374 leader_election.cc:341] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.482414 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214229a8283b43c4916a5db7ba120e03" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.482899 1376 leader_election.cc:341] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.482988 1376 leader_election.cc:302] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:16.483328 2695 raft_consensus.cc:2726] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:16.485189 1102 consensus_peers.cc:487] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f88b401dc12e451c80abe1b509e2b532. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.488708 1556 tablet_bootstrap.cc:654] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.491276 2119 ts_tablet_manager.cc:1918] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.493059 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e08ec6e011ab4bf586420eaf92cfe107" } new_table_name: "default.Table_599d4864bb504fa98740493c10df01f0" modify_external_catalogs: true
I20260927 15:06:16.493719 1562 ts_tablet_manager.cc:1918] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.493815 1562 log.cc:1196] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/c65bc09865bc4a0283eaa4af9f860bdd
I20260927 15:06:16.494215 1562 ts_tablet_manager.cc:1939] T c65bc09865bc4a0283eaa4af9f860bdd P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.495405 2119 log.cc:1196] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/70cc2e16bd6c40bf99ed4436f17d7096
I20260927 15:06:16.495849 2119 ts_tablet_manager.cc:1939] T 70cc2e16bd6c40bf99ed4436f17d7096 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.496227 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 812) took 2059 ms. Trace:
W20260927 15:06:16.496513 2369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260927 15:06:16.496311 2119 rpcz_store.cc:276] 0927 15:06:14.436778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.446294 (+ 9516us) service_pool.cc:227] Handling call
0927 15:06:16.467652 (+2021358us) ts_tablet_manager.cc:1145] Deleting tablet 70cc2e16bd6c40bf99ed4436f17d7096
0927 15:06:16.467661 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.486518 (+ 18857us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.491195 (+ 4677us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.496209 (+ 5014us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2020999}
I20260927 15:06:16.497440 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 70cc2e16bd6c40bf99ed4436f17d7096 (table default.Table_f20e18689ad245c5872112d6f987abb1 [id=2f01e95ae3994ed8aaf98bc5743e267d]) successfully deleted
I20260927 15:06:16.497720 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 735) took 5050 ms. Trace:
I20260927 15:06:16.497808 1562 rpcz_store.cc:276] 0927 15:06:11.447485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.449013 (+ 1528us) service_pool.cc:227] Handling call
0927 15:06:16.422236 (+4973223us) ts_tablet_manager.cc:1145] Deleting tablet c65bc09865bc4a0283eaa4af9f860bdd
0927 15:06:16.422247 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.452493 (+ 30246us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.493633 (+ 41140us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.497699 (+ 4066us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4973049}
I20260927 15:06:16.498101 1562 tablet_replica.cc:330] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.498190 1561 tablet_bootstrap.cc:492] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:16.498304 1562 raft_consensus.cc:2229] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.498287 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet c65bc09865bc4a0283eaa4af9f860bdd (table default.Table_5b7e58750e9a481cab2abf34e5753a5e [id=ed34d1e88ae54c6086ae3a7cbfdf7861]) successfully deleted
I20260927 15:06:16.498338 1561 ts_tablet_manager.cc:1397] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.085s user 0.001s sys 0.004s
I20260927 15:06:16.498592 1562 raft_consensus.cc:2258] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.499099 1562 ts_tablet_manager.cc:1905] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:16.499428 2369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260927 15:06:16.499595 2369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260927 15:06:16.500137 2233 ts_tablet_manager.cc:1918] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.500334 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 831) took 1643 ms. Trace:
I20260927 15:06:16.500442 2119 rpcz_store.cc:276] 0927 15:06:14.856411 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.856466 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:16.497916 (+1641450us) ts_tablet_manager.cc:1145] Deleting tablet 2bbb2131b0f54a7eb74c5d3cba962860
0927 15:06:16.497926 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.500318 (+ 2392us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1641255}
W20260927 15:06:16.501036 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2bbb2131b0f54a7eb74c5d3cba962860 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bbb2131b0f54a7eb74c5d3cba962860 already in progress: creating tablet
I20260927 15:06:16.501838 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 833) took 1617 ms. Trace:
I20260927 15:06:16.502091 2119 rpcz_store.cc:276] 0927 15:06:14.884837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.885292 (+ 455us) service_pool.cc:227] Handling call
0927 15:06:16.501385 (+1616093us) ts_tablet_manager.cc:1145] Deleting tablet bb348ff23de548fca4156a8533579a0e
0927 15:06:16.501399 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.501822 (+ 423us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1615880}
W20260927 15:06:16.502714 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bb348ff23de548fca4156a8533579a0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb348ff23de548fca4156a8533579a0e already in progress: creating tablet
I20260927 15:06:16.503139 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 832) took 1618 ms. Trace:
I20260927 15:06:16.503489 2119 rpcz_store.cc:276] 0927 15:06:14.884715 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.885536 (+ 821us) service_pool.cc:227] Handling call
0927 15:06:16.503043 (+1617507us) ts_tablet_manager.cc:1145] Deleting tablet ba9f24239ae14eaf80b96a711596b00a
0927 15:06:16.503055 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.503125 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1617219}
W20260927 15:06:16.504029 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ba9f24239ae14eaf80b96a711596b00a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba9f24239ae14eaf80b96a711596b00a already in progress: creating tablet
I20260927 15:06:16.504405 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 834) took 1619 ms. Trace:
W20260927 15:06:16.502470 1102 consensus_peers.cc:487] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.504721 2233 log.cc:1196] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/278205071701447e8ee7457b2ee84be4
I20260927 15:06:16.505367 2233 ts_tablet_manager.cc:1939] T 278205071701447e8ee7457b2ee84be4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:16.505460 2119 rpcz_store.cc:276] 0927 15:06:14.884952 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.885946 (+ 994us) service_pool.cc:227] Handling call
0927 15:06:16.504308 (+1618362us) ts_tablet_manager.cc:1145] Deleting tablet 534a74d9f8e648168b87e26fb73c8b3a
0927 15:06:16.504317 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.504390 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618229}
I20260927 15:06:16.505827 2653 raft_consensus.cc:482] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:16.505923 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 534a74d9f8e648168b87e26fb73c8b3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 534a74d9f8e648168b87e26fb73c8b3a already in progress: creating tablet
I20260927 15:06:16.505949 2653 raft_consensus.cc:504] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.506563 2653 leader_election.cc:288] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.507393 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 824) took 3571 ms. Trace:
I20260927 15:06:16.506575 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 830) took 1650 ms. Trace:
I20260927 15:06:16.507306 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b54ee47e424aacb7f53fd95b0ce889" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:16.508201 2119 rpcz_store.cc:276] 0927 15:06:14.856289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.904091 (+ 47802us) service_pool.cc:227] Handling call
0927 15:06:16.506478 (+1602387us) ts_tablet_manager.cc:1145] Deleting tablet 1d2404a81332466c93429fbe550527f6
0927 15:06:16.506489 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.506561 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1602142}
W20260927 15:06:16.508579 1102 leader_election.cc:341] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.504384 1561 raft_consensus.cc:348] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:16.508661 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1d2404a81332466c93429fbe550527f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d2404a81332466c93429fbe550527f6 already in progress: creating tablet
I20260927 15:06:16.508736 1561 raft_consensus.cc:374] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.508792 1561 raft_consensus.cc:729] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.509090 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 835) took 1580 ms. Trace:
I20260927 15:06:16.508985 1561 consensus_queue.cc:260] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.509231 2119 rpcz_store.cc:276] 0927 15:06:14.928336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.928388 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:16.509000 (+1580612us) ts_tablet_manager.cc:1145] Deleting tablet 796eef27ca8341b1a1ccc95770892e04
0927 15:06:16.509012 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.509077 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1580428}
W20260927 15:06:16.509644 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 796eef27ca8341b1a1ccc95770892e04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 796eef27ca8341b1a1ccc95770892e04 already in progress: creating tablet
I20260927 15:06:16.509974 2119 tablet_replica.cc:330] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.510064 2233 rpcz_store.cc:276] 0927 15:06:12.935909 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.935968 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:16.475896 (+3539928us) ts_tablet_manager.cc:1145] Deleting tablet 278205071701447e8ee7457b2ee84be4
0927 15:06:16.475906 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.481312 (+ 5406us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.500040 (+ 18728us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.507375 (+ 7335us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3539720}
I20260927 15:06:16.508051 1556 tablet_bootstrap.cc:492] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.510771 1556 ts_tablet_manager.cc:1397] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260927 15:06:16.511497 1556 raft_consensus.cc:348] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.511750 1556 raft_consensus.cc:374] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.511848 1556 raft_consensus.cc:729] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.512120 1556 consensus_queue.cc:260] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.507872 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b54ee47e424aacb7f53fd95b0ce889" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:16.512550 1435 raft_consensus.cc:2454] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:16.513222 1556 ts_tablet_manager.cc:1428] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:16.513517 1556 tablet_bootstrap.cc:492] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.511823 1561 ts_tablet_manager.cc:1428] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260927 15:06:16.514577 1561 tablet_bootstrap.cc:492] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:16.515234 1556 tablet_bootstrap.cc:654] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.515852 1099 leader_election.cc:302] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.516129 2568 raft_consensus.cc:2781] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.516286 2568 raft_consensus.cc:482] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.516402 2568 raft_consensus.cc:3037] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.517160 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 278205071701447e8ee7457b2ee84be4 (table default.Table_b3d8c342ab564cf8a14311ab99ac9615 [id=550aebac3b894a95ae6482fd0b422a8c]) successfully deleted
I20260927 15:06:16.517270 2233 tablet_replica.cc:330] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:16.517457 2233 raft_consensus.cc:2229] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.510433 2119 raft_consensus.cc:2229] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.518132 2119 raft_consensus.cc:2258] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.517637 2233 raft_consensus.cc:2258] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.519325 2119 ts_tablet_manager.cc:1905] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.519317 2568 raft_consensus.cc:504] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.520318 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b54ee47e424aacb7f53fd95b0ce889" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:16.520826 1102 leader_election.cc:341] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.521234 2568 leader_election.cc:288] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.521692 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66b54ee47e424aacb7f53fd95b0ce889" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:16.521948 1435 raft_consensus.cc:3037] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.523591 1561 tablet_bootstrap.cc:654] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.524562 2233 ts_tablet_manager.cc:1905] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.524740 1435 raft_consensus.cc:2454] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:16.525166 1099 leader_election.cc:302] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.526232 2653 raft_consensus.cc:2781] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.526340 2653 raft_consensus.cc:686] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:16.526528 2653 consensus_queue.cc:237] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.529805 1552 tablet_bootstrap.cc:492] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:16.529947 1552 ts_tablet_manager.cc:1397] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.262s user 0.005s sys 0.007s
I20260927 15:06:16.530645 1552 raft_consensus.cc:348] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.530875 1552 raft_consensus.cc:374] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.530946 1552 raft_consensus.cc:729] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.531198 910 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_dd8f1d71fa7d4665b96954a6d766c9ce [id=672533238895472b9bfb06706e4b41bb] alter complete (version 2)
I20260927 15:06:16.531694 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_10d1055ef5fa4b4394ec82c6ee4b1e01" } new_table_name: "default.Table_6107c32d572944a0aafc76ab7111a7aa" modify_external_catalogs: true
W20260927 15:06:16.532323 1102 consensus_peers.cc:487] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a7989e2b91044dab1d3e327958a051a. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.532522 1552 consensus_queue.cc:260] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.533064 1552 ts_tablet_manager.cc:1428] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260927 15:06:16.533320 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b940bc9596784c36a9dffa12ac026b33" } new_table_name: "default.Table_d430acf08a154178b69c4d6f2f4cce5c" modify_external_catalogs: true
I20260927 15:06:16.533708 1552 tablet_bootstrap.cc:492] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:16.536584 2119 ts_tablet_manager.cc:1918] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.536726 2119 log.cc:1196] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/0aec677006ab4407bd7ae4c0078d6b7f
I20260927 15:06:16.537164 2119 ts_tablet_manager.cc:1939] T 0aec677006ab4407bd7ae4c0078d6b7f P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.537439 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 836) took 1581 ms. Trace:
I20260927 15:06:16.537503 2119 rpcz_store.cc:276] 0927 15:06:14.956204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.956264 (+ 60us) service_pool.cc:227] Handling call
0927 15:06:16.509936 (+1553672us) ts_tablet_manager.cc:1145] Deleting tablet 0aec677006ab4407bd7ae4c0078d6b7f
0927 15:06:16.509946 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.522305 (+ 12359us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.536462 (+ 14157us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.537425 (+ 963us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1553484}
I20260927 15:06:16.539367 2569 consensus_queue.cc:1035] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:16.539795 2569 raft_consensus.cc:482] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:16.539919 2569 raft_consensus.cc:504] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.540450 2569 leader_election.cc:288] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.544629 2233 ts_tablet_manager.cc:1918] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.545112 2233 log.cc:1196] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/6b1f2143af1142eb9f3dbc777299c186
I20260927 15:06:16.545743 2233 ts_tablet_manager.cc:1939] T 6b1f2143af1142eb9f3dbc777299c186 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:16.547572 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 823) took 3611 ms. Trace:
I20260927 15:06:16.547914 2233 rpcz_store.cc:276] 0927 15:06:12.935771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.936089 (+ 318us) service_pool.cc:227] Handling call
0927 15:06:16.517224 (+3581135us) ts_tablet_manager.cc:1145] Deleting tablet 6b1f2143af1142eb9f3dbc777299c186
0927 15:06:16.517234 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.528010 (+ 10776us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.544520 (+ 16510us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.547552 (+ 3032us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3580936}
I20260927 15:06:16.548470 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 0aec677006ab4407bd7ae4c0078d6b7f (table default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]) successfully deleted
I20260927 15:06:16.548928 2119 tablet_replica.cc:330] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.549299 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 6b1f2143af1142eb9f3dbc777299c186 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]) successfully deleted
I20260927 15:06:16.549393 2233 tablet_replica.cc:330] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:16.549575 2233 raft_consensus.cc:2229] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.541049 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd55e22d8254ea8b1dab989517148ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:16.549896 1562 ts_tablet_manager.cc:1918] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.549925 2119 raft_consensus.cc:2229] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.549891 1305 raft_consensus.cc:2454] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:16.550001 1562 log.cc:1196] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/a90039faff27436db7b50fa4c4643d3b
I20260927 15:06:16.550098 2119 raft_consensus.cc:2258] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.550377 1562 ts_tablet_manager.cc:1939] T a90039faff27436db7b50fa4c4643d3b P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.550665 2233 raft_consensus.cc:2258] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.551652 2119 ts_tablet_manager.cc:1905] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.558527 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cad4605da5e045e7969da2d6f56a7e70
I20260927 15:06:16.550631 1102 leader_election.cc:302] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:16.559113 2653 raft_consensus.cc:2781] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 15:06:16.559222 2653 raft_consensus.cc:482] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:16.559286 2653 raft_consensus.cc:3037] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Advancing to term 2
I20260927 15:06:16.559502 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet cad4605da5e045e7969da2d6f56a7e70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.559389 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fa283539fbf84091ba86f819f675b7c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.559937 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa283539fbf84091ba86f819f675b7c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.561535 911 master_service.cc:946] ReplaceTablet: received request to replace tablet af25950fd08043f18a6eaaf46ded4378 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:16.562204 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_58db51a88dc7411b9037dce22c825e3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:16.562325 2653 raft_consensus.cc:504] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.562578 2119 ts_tablet_manager.cc:1918] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.562685 2119 log.cc:1196] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/c65bc09865bc4a0283eaa4af9f860bdd
W20260927 15:06:16.562786 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58db51a88dc7411b9037dce22c825e3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.563082 2119 ts_tablet_manager.cc:1939] T c65bc09865bc4a0283eaa4af9f860bdd P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.563313 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cd55e22d8254ea8b1dab989517148ca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:16.563529 1305 raft_consensus.cc:3037] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 2
I20260927 15:06:16.565750 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet cad4605da5e045e7969da2d6f56a7e70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.566941 1305 raft_consensus.cc:2454] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 2.
I20260927 15:06:16.567055 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 837) took 1610 ms. Trace:
I20260927 15:06:16.567044 2675 tablet.cc:1722] T fd8a53f3c95c4cb7bce21d23f79af28c P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:16.567124 2119 rpcz_store.cc:276] 0927 15:06:14.956499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.956535 (+ 36us) service_pool.cc:227] Handling call
0927 15:06:16.548882 (+1592347us) ts_tablet_manager.cc:1145] Deleting tablet c65bc09865bc4a0283eaa4af9f860bdd
0927 15:06:16.548894 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.557853 (+ 8959us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.562490 (+ 4637us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.567042 (+ 4552us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1592219}
I20260927 15:06:16.567364 1102 leader_election.cc:302] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:16.567593 2365 raft_consensus.cc:2781] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 2 FOLLOWER]: Leader election won for term 2
I20260927 15:06:16.567617 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet c65bc09865bc4a0283eaa4af9f860bdd (table default.Table_5b7e58750e9a481cab2abf34e5753a5e [id=ed34d1e88ae54c6086ae3a7cbfdf7861]) successfully deleted
I20260927 15:06:16.567708 2365 raft_consensus.cc:686] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 2 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:16.567934 2365 consensus_queue.cc:237] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.568944 1552 tablet_bootstrap.cc:654] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.569695 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet cad4605da5e045e7969da2d6f56a7e70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:16.570896 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d4c717419864473b7cd47ece4ffd805 consensus state has no leader
I20260927 15:06:16.571465 2653 leader_election.cc:288] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.573119 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 9049d003d787403f80aa0c08872dd3b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.573105 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_083f55ec5dae45c1bbb7305ac554f75e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.573001 1099 leader_election.cc:341] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 2cd55e22d8254ea8b1dab989517148ca
I20260927 15:06:16.573611 2674 tablet.cc:1722] T fd8a53f3c95c4cb7bce21d23f79af28c P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:16.573762 2119 tablet_replica.cc:330] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
W20260927 15:06:16.573734 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_083f55ec5dae45c1bbb7305ac554f75e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.573930 2119 raft_consensus.cc:2229] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.574081 2119 raft_consensus.cc:2258] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:16.574883 1099 consensus_peers.cc:487] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5cd55de34d249bc8d3adcf4690f0414. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:16.575047 1099 leader_election.cc:341] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 2cd55e22d8254ea8b1dab989517148ca
I20260927 15:06:16.573187 1561 tablet_bootstrap.cc:492] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:16.579236 1561 ts_tablet_manager.cc:1397] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.065s user 0.004s sys 0.000s
W20260927 15:06:16.579638 1102 consensus_peers.cc:487] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.580081 2119 ts_tablet_manager.cc:1905] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:16.581204 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87b54364a63b48e9981463d1019dad59 consensus state has no leader
I20260927 15:06:16.581147 1561 raft_consensus.cc:348] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.581346 1561 raft_consensus.cc:374] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.581393 1561 raft_consensus.cc:729] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.581578 1561 consensus_queue.cc:260] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.581635 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_837e903d5fe544adba9c254a905a1ab3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.582252 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_837e903d5fe544adba9c254a905a1ab3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.582304 1561 ts_tablet_manager.cc:1428] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:16.582623 1561 tablet_bootstrap.cc:492] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:16.584784 1561 tablet_bootstrap.cc:654] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.586809 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 742) took 5109 ms. Trace:
I20260927 15:06:16.586979 1562 rpcz_store.cc:276] 0927 15:06:11.477776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.477850 (+ 74us) service_pool.cc:227] Handling call
0927 15:06:16.498059 (+5020209us) ts_tablet_manager.cc:1145] Deleting tablet a90039faff27436db7b50fa4c4643d3b
0927 15:06:16.498069 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.517444 (+ 19375us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.549797 (+ 32353us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.586792 (+ 36995us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5015507}
I20260927 15:06:16.587572 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet a90039faff27436db7b50fa4c4643d3b (table default.Table_a97f9c79720e40e48b56f0dd4c7441cc [id=e15024fd65bf43fcadd4253d7f2e991c]) successfully deleted
I20260927 15:06:16.588109 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 743) took 5029 ms. Trace:
I20260927 15:06:16.588249 1562 rpcz_store.cc:276] 0927 15:06:11.559119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.559170 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:16.587957 (+5028787us) ts_tablet_manager.cc:1145] Deleting tablet 0a64059ef2234ad6adbdfd8d3576f2a6
0927 15:06:16.587973 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.588090 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5028565}
W20260927 15:06:16.588719 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0a64059ef2234ad6adbdfd8d3576f2a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a64059ef2234ad6adbdfd8d3576f2a6 already in progress: creating tablet
I20260927 15:06:16.589072 1562 tablet_replica.cc:330] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.589418 1562 raft_consensus.cc:2229] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.589728 1562 raft_consensus.cc:2258] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.590248 2119 ts_tablet_manager.cc:1918] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.590370 2119 log.cc:1196] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/a90039faff27436db7b50fa4c4643d3b
I20260927 15:06:16.590597 1562 ts_tablet_manager.cc:1905] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.590761 2119 ts_tablet_manager.cc:1939] T a90039faff27436db7b50fa4c4643d3b P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.591085 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 838) took 1539 ms. Trace:
I20260927 15:06:16.591172 2119 rpcz_store.cc:276] 0927 15:06:15.051203 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.051259 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:16.573718 (+1522459us) ts_tablet_manager.cc:1145] Deleting tablet a90039faff27436db7b50fa4c4643d3b
0927 15:06:16.573729 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.583159 (+ 9430us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.590151 (+ 6992us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.591067 (+ 916us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1522272}
I20260927 15:06:16.592141 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet a90039faff27436db7b50fa4c4643d3b (table default.Table_a97f9c79720e40e48b56f0dd4c7441cc [id=e15024fd65bf43fcadd4253d7f2e991c]) successfully deleted
I20260927 15:06:16.593367 2233 ts_tablet_manager.cc:1905] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.593761 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 849) took 1405 ms. Trace:
I20260927 15:06:16.593858 2119 rpcz_store.cc:276] 0927 15:06:15.188480 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.189673 (+ 1193us) service_pool.cc:227] Handling call
0927 15:06:16.593637 (+1403964us) ts_tablet_manager.cc:1145] Deleting tablet 1e0508139d3f403a94638c6a7cfb6a35
0927 15:06:16.593649 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.593744 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1403739}
W20260927 15:06:16.594719 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1e0508139d3f403a94638c6a7cfb6a35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e0508139d3f403a94638c6a7cfb6a35 already in progress: creating tablet
I20260927 15:06:16.594858 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 856) took 1405 ms. Trace:
I20260927 15:06:16.594929 2119 rpcz_store.cc:276] 0927 15:06:15.189199 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.190958 (+ 1759us) service_pool.cc:227] Handling call
0927 15:06:16.594738 (+1403780us) ts_tablet_manager.cc:1145] Deleting tablet b5e418f9ce5e41128b17f01e9e909ecb
0927 15:06:16.594749 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.594841 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1403648}
I20260927 15:06:16.595731 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 853) took 1406 ms. Trace:
I20260927 15:06:16.595803 2119 rpcz_store.cc:276] 0927 15:06:15.188898 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.195279 (+ 6381us) service_pool.cc:227] Handling call
0927 15:06:16.595630 (+1400351us) ts_tablet_manager.cc:1145] Deleting tablet 771ce4b9675742bc88306e4d099cbb82
0927 15:06:16.595640 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.595716 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1400201}
I20260927 15:06:16.596705 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 855) took 1407 ms. Trace:
I20260927 15:06:16.596772 2119 rpcz_store.cc:276] 0927 15:06:15.189104 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.190881 (+ 1777us) service_pool.cc:227] Handling call
0927 15:06:16.596591 (+1405710us) ts_tablet_manager.cc:1145] Deleting tablet 7f2a9378aa46462b97906be25df8d90f
0927 15:06:16.596600 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.596664 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1401034}
I20260927 15:06:16.596984 2653 raft_consensus.cc:482] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.597126 2653 raft_consensus.cc:504] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.597563 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 863) took 1407 ms. Trace:
I20260927 15:06:16.597635 2119 rpcz_store.cc:276] 0927 15:06:15.189875 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.393313 (+203438us) service_pool.cc:227] Handling call
0927 15:06:16.597474 (+1204161us) ts_tablet_manager.cc:1145] Deleting tablet 0ddca178f38e46b28fc1b5ed6416b990
0927 15:06:16.597483 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.597548 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1203965}
W20260927 15:06:16.597787 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b5e418f9ce5e41128b17f01e9e909ecb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e418f9ce5e41128b17f01e9e909ecb already in progress: creating tablet
I20260927 15:06:16.597831 2653 leader_election.cc:288] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:16.598029 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 771ce4b9675742bc88306e4d099cbb82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 771ce4b9675742bc88306e4d099cbb82 already in progress: creating tablet
W20260927 15:06:16.598222 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7f2a9378aa46462b97906be25df8d90f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f2a9378aa46462b97906be25df8d90f already in progress: creating tablet
I20260927 15:06:16.598141 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f271c76b5f2447239d3d014fbde4e8b2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:16.598366 2119 tablet_replica.cc:330] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
W20260927 15:06:16.598436 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0ddca178f38e46b28fc1b5ed6416b990 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ddca178f38e46b28fc1b5ed6416b990 already in progress: creating tablet
I20260927 15:06:16.598541 2119 raft_consensus.cc:2229] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 2 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:16.598608 1102 leader_election.cc:341] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.598663 2119 raft_consensus.cc:2258] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.599155 2119 ts_tablet_manager.cc:1905] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.601186 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f271c76b5f2447239d3d014fbde4e8b2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:16.601480 1435 raft_consensus.cc:2454] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:16.601562 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2d6610dc3caa4d0994e8402046407009"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.602164 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d6610dc3caa4d0994e8402046407009 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.602499 1099 leader_election.cc:302] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.602725 2365 raft_consensus.cc:2781] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.602788 2365 raft_consensus.cc:482] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.602870 2365 raft_consensus.cc:3037] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.605782 2365 raft_consensus.cc:504] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.606338 2365 leader_election.cc:288] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.606765 2661 raft_consensus.cc:482] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.606920 2661 raft_consensus.cc:504] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.607467 2661 leader_election.cc:288] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.607965 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9049d003d787403f80aa0c08872dd3b5" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.608175 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f271c76b5f2447239d3d014fbde4e8b2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:16.608630 1102 leader_election.cc:341] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.610167 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ee124d45bf99401ea1d62efd5d0bb634"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.610898 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee124d45bf99401ea1d62efd5d0bb634 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.612157 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_21609103889c418684f1607150049aba" } new_table_name: "default.Table_d97095af85ba4bc5942b0a5491c5b44e" modify_external_catalogs: true
I20260927 15:06:16.614207 2119 ts_tablet_manager.cc:1918] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.614318 2119 log.cc:1196] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/2cd55e22d8254ea8b1dab989517148ca
I20260927 15:06:16.614594 2119 ts_tablet_manager.cc:1939] T 2cd55e22d8254ea8b1dab989517148ca P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.614936 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 866) took 1225 ms. Trace:
I20260927 15:06:16.615288 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9f2536cafc334a929cbe3bc5508f705a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.615769 1099 consensus_peers.cc:487] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3cc37a97bc145bdaa654bcc193fe93b. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:16.616398 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f2536cafc334a929cbe3bc5508f705a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:16.615393 1238 leader_election.cc:341] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9049d003d787403f80aa0c08872dd3b5
I20260927 15:06:16.615036 2119 rpcz_store.cc:276] 0927 15:06:15.389426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.398141 (+ 8715us) service_pool.cc:227] Handling call
0927 15:06:16.598325 (+1200184us) ts_tablet_manager.cc:1145] Deleting tablet 2cd55e22d8254ea8b1dab989517148ca
0927 15:06:16.598335 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.606000 (+ 7665us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.614107 (+ 8107us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.614919 (+ 812us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1199993}
I20260927 15:06:16.618556 1238 leader_election.cc:302] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:16.618806 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 867) took 1229 ms. Trace:
I20260927 15:06:16.618912 2119 rpcz_store.cc:276] 0927 15:06:15.389506 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.398350 (+ 8844us) service_pool.cc:227] Handling call
0927 15:06:16.618685 (+1220335us) ts_tablet_manager.cc:1145] Deleting tablet 1024b38f06bb4387bd24e98f0dee038c
0927 15:06:16.618700 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.618790 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1220194}
I20260927 15:06:16.619050 2661 raft_consensus.cc:2726] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:16.619288 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83d8ff4f407245e881c2ffed3a4727bd consensus state has no leader
I20260927 15:06:16.619359 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 2cd55e22d8254ea8b1dab989517148ca (table default.Table_0f6a6192da2f4f05af0cad71e5b85ef2 [id=e104421aa3634f9b9868449439d50362]) successfully deleted
W20260927 15:06:16.619628 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1024b38f06bb4387bd24e98f0dee038c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1024b38f06bb4387bd24e98f0dee038c already in progress: creating tablet
I20260927 15:06:16.619835 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bb70418fb7a04a5ab0b3b114e8c4fb6d" } new_table_name: "default.Table_fdea0120fed042269da5dbb5a13eeb7d" modify_external_catalogs: true
I20260927 15:06:16.619989 2119 tablet_replica.cc:330] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.620175 2119 raft_consensus.cc:2229] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.620306 2119 raft_consensus.cc:2258] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.620771 2119 ts_tablet_manager.cc:1905] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.622009 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_35e15f0ba6ae4f98a02b20bd26a65003"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:16.622403 2233 ts_tablet_manager.cc:1918] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:16.606806 2369 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260927 15:06:16.622663 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35e15f0ba6ae4f98a02b20bd26a65003 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:16.622767 2369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260927 15:06:16.622929 2369 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260927 15:06:16.623131 2369 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260927 15:06:16.629475 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f9c7849817c4157916905216ad6b632 consensus state has no leader
W20260927 15:06:16.630115 1099 consensus_peers.cc:487] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b9e88c3679d412cac7603f200cf899b. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.630559 2119 ts_tablet_manager.cc:1918] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.630686 2119 log.cc:1196] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/75537edf83a040cba4da502c726bf456
I20260927 15:06:16.631021 2119 ts_tablet_manager.cc:1939] T 75537edf83a040cba4da502c726bf456 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.631319 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 868) took 1241 ms. Trace:
I20260927 15:06:16.631399 1561 tablet_bootstrap.cc:492] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:16.631410 2119 rpcz_store.cc:276] 0927 15:06:15.389562 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.398491 (+ 8929us) service_pool.cc:227] Handling call
0927 15:06:16.619950 (+1221459us) ts_tablet_manager.cc:1145] Deleting tablet 75537edf83a040cba4da502c726bf456
0927 15:06:16.619960 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.625208 (+ 5248us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.630464 (+ 5256us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.631303 (+ 839us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1221338}
I20260927 15:06:16.631536 1561 ts_tablet_manager.cc:1397] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20260927 15:06:16.631817 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 75537edf83a040cba4da502c726bf456 (table default.Table_8472d420763f4fd59e6814326d75b8d7 [id=2637a7b31e84469c82b01a83a6edc97d]) successfully deleted
I20260927 15:06:16.632498 1561 raft_consensus.cc:348] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.632750 1561 raft_consensus.cc:374] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.632833 1561 raft_consensus.cc:729] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.633083 1561 consensus_queue.cc:260] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.634066 1561 ts_tablet_manager.cc:1428] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260927 15:06:16.634457 1561 tablet_bootstrap.cc:492] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:16.636778 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 869) took 1034 ms. Trace:
I20260927 15:06:16.637024 2119 rpcz_store.cc:276] 0927 15:06:15.602505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.608289 (+ 5784us) service_pool.cc:227] Handling call
0927 15:06:16.636023 (+1027734us) ts_tablet_manager.cc:1145] Deleting tablet ee27f67bc245495a9e29bcac3e7d3846
0927 15:06:16.636036 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.636759 (+ 723us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1027540}
W20260927 15:06:16.637562 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ee27f67bc245495a9e29bcac3e7d3846 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee27f67bc245495a9e29bcac3e7d3846 already in progress: creating tablet
I20260927 15:06:16.637668 2119 tablet_replica.cc:330] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.637856 2119 raft_consensus.cc:2229] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.638072 2119 pending_rounds.cc:62] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:16.638124 2119 pending_rounds.cc:68] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976376410386432 op_type: NO_OP noop_request { }
I20260927 15:06:16.638236 2119 raft_consensus.cc:2866] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:16.638314 2119 raft_consensus.cc:2258] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.639662 1561 tablet_bootstrap.cc:654] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.641707 2119 ts_tablet_manager.cc:1905] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.629055 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f271c76b5f2447239d3d014fbde4e8b2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:16.640312 1556 tablet_bootstrap.cc:492] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.643810 1556 ts_tablet_manager.cc:1397] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.130s user 0.018s sys 0.026s
I20260927 15:06:16.643762 1438 raft_consensus.cc:3037] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.643736 2233 log.cc:1196] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/033e71f60c3e47fd9647db090d4d6cd5
I20260927 15:06:16.644615 1556 raft_consensus.cc:348] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.644807 1556 raft_consensus.cc:374] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.644850 1556 raft_consensus.cc:729] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.645074 1556 consensus_queue.cc:260] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.646646 1438 raft_consensus.cc:2454] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:16.647447 2233 ts_tablet_manager.cc:1939] T 033e71f60c3e47fd9647db090d4d6cd5 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:16.648532 1556 ts_tablet_manager.cc:1428] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:16.648814 1556 tablet_bootstrap.cc:492] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.649161 1562 ts_tablet_manager.cc:1918] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.649310 1562 log.cc:1196] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/70cc2e16bd6c40bf99ed4436f17d7096
I20260927 15:06:16.649840 1562 ts_tablet_manager.cc:1939] T 70cc2e16bd6c40bf99ed4436f17d7096 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.650442 1556 tablet_bootstrap.cc:654] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.650769 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 744) took 5091 ms. Trace:
I20260927 15:06:16.650885 1562 rpcz_store.cc:276] 0927 15:06:11.559224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.559422 (+ 198us) service_pool.cc:227] Handling call
0927 15:06:16.589019 (+5029597us) ts_tablet_manager.cc:1145] Deleting tablet 70cc2e16bd6c40bf99ed4436f17d7096
0927 15:06:16.589033 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.615113 (+ 26080us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.649016 (+ 33903us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.650744 (+ 1728us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5029398}
I20260927 15:06:16.651433 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 745) took 5092 ms. Trace:
I20260927 15:06:16.651510 1562 rpcz_store.cc:276] 0927 15:06:11.559348 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:11.560090 (+ 742us) service_pool.cc:227] Handling call
0927 15:06:16.651285 (+5091195us) ts_tablet_manager.cc:1145] Deleting tablet 955461f27b6444d4b4c3f9a9f629d5e3
0927 15:06:16.651296 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.651417 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5090971}
I20260927 15:06:16.651569 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 70cc2e16bd6c40bf99ed4436f17d7096 (table default.Table_f20e18689ad245c5872112d6f987abb1 [id=2f01e95ae3994ed8aaf98bc5743e267d]) successfully deleted
I20260927 15:06:16.651775 1562 tablet_replica.cc:330] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.651944 1562 raft_consensus.cc:2229] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:06:16.651993 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 955461f27b6444d4b4c3f9a9f629d5e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 955461f27b6444d4b4c3f9a9f629d5e3 already in progress: creating tablet
I20260927 15:06:16.652238 1562 raft_consensus.cc:2258] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.652503 1099 leader_election.cc:302] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.652748 2365 raft_consensus.cc:2781] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.652858 2365 raft_consensus.cc:686] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:16.653053 2365 consensus_queue.cc:237] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.659232 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 822) took 3723 ms. Trace:
I20260927 15:06:16.659361 2233 rpcz_store.cc:276] 0927 15:06:12.935646 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.936207 (+ 561us) service_pool.cc:227] Handling call
0927 15:06:16.549356 (+3613149us) ts_tablet_manager.cc:1145] Deleting tablet 033e71f60c3e47fd9647db090d4d6cd5
0927 15:06:16.549367 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.618918 (+ 69551us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.622291 (+ 3373us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.659206 (+ 36915us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3613035}
I20260927 15:06:16.659793 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 033e71f60c3e47fd9647db090d4d6cd5 (table default.Table_c6d23c73ae904261ac5ed42420c0eaab [id=0fa527ae49b1486f955fef21e0b35e7a]) successfully deleted
I20260927 15:06:16.662305 2695 raft_consensus.cc:482] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.662425 2695 raft_consensus.cc:504] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.662983 2695 leader_election.cc:288] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.663504 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e2c5c3d0f574422be80b318395f199a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:16.664037 1374 leader_election.cc:341] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.664568 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e2c5c3d0f574422be80b318395f199a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.665208 1376 leader_election.cc:341] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.665320 1376 leader_election.cc:302] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:16.665779 2695 raft_consensus.cc:2726] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.667301 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 825) took 3538 ms. Trace:
I20260927 15:06:16.652854 1562 ts_tablet_manager.cc:1905] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.677762 1562 ts_tablet_manager.cc:1918] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.677724 907 catalog_manager.cc:5495] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:16.678239 907 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 595c84453cd84c3bb5a4d444892bf5e6 (table default.Table_c33713f5f5d841b1a1f9e687db26c2e6 [id=06ca630052694f10aebe6f8b7aaa81d9]). Expected version 1 got 0
I20260927 15:06:16.678872 2233 rpcz_store.cc:276] 0927 15:06:13.128803 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.152487 (+ 23684us) service_pool.cc:227] Handling call
0927 15:06:16.667181 (+3514694us) ts_tablet_manager.cc:1145] Deleting tablet 1defd5bba3c34cae8893559ccfc8b5cd
0927 15:06:16.667193 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.667285 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3514378}
I20260927 15:06:16.679621 2233 tablet_replica.cc:330] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:16.679796 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1defd5bba3c34cae8893559ccfc8b5cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1defd5bba3c34cae8893559ccfc8b5cd already in progress: creating tablet
I20260927 15:06:16.679976 2233 raft_consensus.cc:2229] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.680133 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1d25749db81f4631bbc1e5581bcc666e
I20260927 15:06:16.680281 2233 raft_consensus.cc:2258] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.680796 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d25749db81f4631bbc1e5581bcc666e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.680969 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d25749db81f4631bbc1e5581bcc666e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.681746 2233 ts_tablet_manager.cc:1905] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.681248 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d25749db81f4631bbc1e5581bcc666e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.682080 1562 log.cc:1196] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/9049d003d787403f80aa0c08872dd3b5
I20260927 15:06:16.682562 1562 ts_tablet_manager.cc:1939] T 9049d003d787403f80aa0c08872dd3b5 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.683691 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 752) took 4616 ms. Trace:
I20260927 15:06:16.685554 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 476d3f3762a04acaa10f7b910984bec7
I20260927 15:06:16.686465 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 476d3f3762a04acaa10f7b910984bec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:16.685389 1102 consensus_peers.cc:487] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.686506 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 476d3f3762a04acaa10f7b910984bec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.687142 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 476d3f3762a04acaa10f7b910984bec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.687285 1562 rpcz_store.cc:276] 0927 15:06:12.066982 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.067048 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:16.651735 (+4584687us) ts_tablet_manager.cc:1145] Deleting tablet 9049d003d787403f80aa0c08872dd3b5
0927 15:06:16.651747 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.673284 (+ 21537us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.677684 (+ 4400us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.683671 (+ 5987us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4584466}
I20260927 15:06:16.687983 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 9049d003d787403f80aa0c08872dd3b5 (table default.Table_75127a34541e4a979aace6aa029d396e [id=67ad7f9c36834f09a601dbf2841ebc48]) successfully deleted
I20260927 15:06:16.688416 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 753) took 4621 ms. Trace:
I20260927 15:06:16.688767 1562 rpcz_store.cc:276] 0927 15:06:12.067096 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.067146 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:16.688305 (+4621159us) ts_tablet_manager.cc:1145] Deleting tablet 7afe7ec3929649a8b647eca15e3b7514
0927 15:06:16.688317 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.688401 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4620971}
W20260927 15:06:16.689405 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 7afe7ec3929649a8b647eca15e3b7514 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7afe7ec3929649a8b647eca15e3b7514 already in progress: creating tablet
I20260927 15:06:16.689788 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 754) took 4622 ms. Trace:
I20260927 15:06:16.690167 1562 rpcz_store.cc:276] 0927 15:06:12.067446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.067491 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:16.689692 (+4622201us) ts_tablet_manager.cc:1145] Deleting tablet 6b4beb4112734b9c91e32b300fd266d7
0927 15:06:16.689702 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.689775 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4622029}
W20260927 15:06:16.690876 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6b4beb4112734b9c91e32b300fd266d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b4beb4112734b9c91e32b300fd266d7 already in progress: creating tablet
I20260927 15:06:16.691213 1562 tablet_replica.cc:330] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.691581 1562 raft_consensus.cc:2229] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.691974 1562 raft_consensus.cc:2258] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.693205 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 214229a8283b43c4916a5db7ba120e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.693260 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet a8de6246f7904f6c80df624f3631db17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.693205 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.693090 1562 ts_tablet_manager.cc:1905] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.694229 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 4c230b306aa24570ba1b6c8a6d90b24f (DEFAULT_TABLE table=default.Table_ad7e667a8ad34ec0982da6f0d22e165d [id=07127021215f4f0dbf985bdc6408d20d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.696662 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 917b445477c4403980f2fdfeaeab0854
I20260927 15:06:16.697244 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_266fb85b088a4364861ec604df33d892"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.697853 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_266fb85b088a4364861ec604df33d892 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.698360 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 917b445477c4403980f2fdfeaeab0854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.698558 913 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
I20260927 15:06:16.698735 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 5ca21f240d8d4252b9cf0355c69f7166
I20260927 15:06:16.699339 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca21f240d8d4252b9cf0355c69f7166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.699692 2119 ts_tablet_manager.cc:1918] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.699816 2119 log.cc:1196] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/5c0d51b50b414721a255fdde2fe1732f
I20260927 15:06:16.700186 2119 ts_tablet_manager.cc:1939] T 5c0d51b50b414721a255fdde2fe1732f P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.700373 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet c65bc09865bc4a0283eaa4af9f860bdd with delete_type TABLET_DATA_DELETED (replaced by tablet db09498a395b4570a34d32fbfc71e8ed) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.700469 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet c41cd38355e64590b43b2e1271c43e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.700683 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 9049d003d787403f80aa0c08872dd3b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.700644 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 70cc2e16bd6c40bf99ed4436f17d7096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.700852 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 66b54ee47e424aacb7f53fd95b0ce889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.700632 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 917b445477c4403980f2fdfeaeab0854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.700619 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca21f240d8d4252b9cf0355c69f7166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.701566 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 832bf0ee6cbf4c639d2ea569c565ca20 (DEFAULT_TABLE table=default.Table_a407bc25637a4990bf7860f31e2efbc8 [id=c91b129c15c54e508aa6291e7b859563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.702028 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 4c230b306aa24570ba1b6c8a6d90b24f (DEFAULT_TABLE table=default.Table_ad7e667a8ad34ec0982da6f0d22e165d [id=07127021215f4f0dbf985bdc6408d20d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.702373 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c230b306aa24570ba1b6c8a6d90b24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.703197 1270 tablet_service.cc:1467] Processing CreateTablet for tablet a4430aa799314fc2a2b4acc3fdd1df7a (DEFAULT_TABLE table=default.Table_79a73a988c8143c9b9b339591b234581 [id=5c070e90774c4c51a53bf8dad90b25e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.704198 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 917b445477c4403980f2fdfeaeab0854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.704396 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ca21f240d8d4252b9cf0355c69f7166 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.704697 1404 tablet_service.cc:1467] Processing CreateTablet for tablet a4430aa799314fc2a2b4acc3fdd1df7a (DEFAULT_TABLE table=default.Table_79a73a988c8143c9b9b339591b234581 [id=5c070e90774c4c51a53bf8dad90b25e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.705031 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4430aa799314fc2a2b4acc3fdd1df7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.705216 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 4c230b306aa24570ba1b6c8a6d90b24f (DEFAULT_TABLE table=default.Table_ad7e667a8ad34ec0982da6f0d22e165d [id=07127021215f4f0dbf985bdc6408d20d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.705490 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c230b306aa24570ba1b6c8a6d90b24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.708482 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 66df460a34ce496ba21e0d9bcd31e74f (DEFAULT_TABLE table=default.Table_068b8f93e2ef411b871c5550785e4ecc [id=20f5c84f30634def96423c00a7e7a761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.708801 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66df460a34ce496ba21e0d9bcd31e74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.708920 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 47ca8470f8894375ac3b67b315ab7805 (DEFAULT_TABLE table=default.Table_49701096d396411d89d8c88cc143c535 [id=8383d76149bf4461b871fed5a26d8e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.709435 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 7508e8c3438649c69daabac7a2a11efc (DEFAULT_TABLE table=default.Table_19cff94cd880489087101b1fb339fc27 [id=759121511fef4a4eba1cc5122117d81d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.709717 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7508e8c3438649c69daabac7a2a11efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.710532 1275 tablet_service.cc:1467] Processing CreateTablet for tablet afd31e5d011b40c7bfda173a7331ed90 (DEFAULT_TABLE table=default.Table_437d2682e5f7473fa0056683c1d8babc [id=b365a95b5ca04401b6efbe9f6c6fad04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.711071 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 832bf0ee6cbf4c639d2ea569c565ca20 (DEFAULT_TABLE table=default.Table_a407bc25637a4990bf7860f31e2efbc8 [id=c91b129c15c54e508aa6291e7b859563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.711380 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 832bf0ee6cbf4c639d2ea569c565ca20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.713670 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 6481b87f90c7482b9c7598fb3ffd39dc (DEFAULT_TABLE table=default.Table_2804c8e3cffa4b3db7b87ebed56475b3 [id=2595f260df274de7bcf538439646cf63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.714709 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 6481b87f90c7482b9c7598fb3ffd39dc (DEFAULT_TABLE table=default.Table_2804c8e3cffa4b3db7b87ebed56475b3 [id=2595f260df274de7bcf538439646cf63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.715045 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 47ca8470f8894375ac3b67b315ab7805 (DEFAULT_TABLE table=default.Table_49701096d396411d89d8c88cc143c535 [id=8383d76149bf4461b871fed5a26d8e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.715045 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 66df460a34ce496ba21e0d9bcd31e74f (DEFAULT_TABLE table=default.Table_068b8f93e2ef411b871c5550785e4ecc [id=20f5c84f30634def96423c00a7e7a761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.715109 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 7508e8c3438649c69daabac7a2a11efc (DEFAULT_TABLE table=default.Table_19cff94cd880489087101b1fb339fc27 [id=759121511fef4a4eba1cc5122117d81d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.715521 1146 tablet_service.cc:1467] Processing CreateTablet for tablet afd31e5d011b40c7bfda173a7331ed90 (DEFAULT_TABLE table=default.Table_437d2682e5f7473fa0056683c1d8babc [id=b365a95b5ca04401b6efbe9f6c6fad04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.715610 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 832bf0ee6cbf4c639d2ea569c565ca20 (DEFAULT_TABLE table=default.Table_a407bc25637a4990bf7860f31e2efbc8 [id=c91b129c15c54e508aa6291e7b859563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.715054 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6481b87f90c7482b9c7598fb3ffd39dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.715977 1138 tablet_service.cc:1467] Processing CreateTablet for tablet a4430aa799314fc2a2b4acc3fdd1df7a (DEFAULT_TABLE table=default.Table_79a73a988c8143c9b9b339591b234581 [id=5c070e90774c4c51a53bf8dad90b25e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.716259 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4430aa799314fc2a2b4acc3fdd1df7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.718797 1130 tablet_service.cc:1467] Processing CreateTablet for tablet e14ebb879d714c61b4d7343137b00e42 (DEFAULT_TABLE table=default.Table_878d06515f18478389e9e413449a06e8 [id=b7d1bcafc56a481c9baddbd7552ee33e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.719159 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14ebb879d714c61b4d7343137b00e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.719566 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 832bf0ee6cbf4c639d2ea569c565ca20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.720808 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 3fbba7193922433199275eaac003f9ce (DEFAULT_TABLE table=default.Table_551c1ec5b4f142ce8a709cc61e04ff56 [id=5c923e0f49384426acc04873fe75a792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.722061 1269 tablet_service.cc:1467] Processing CreateTablet for tablet e14ebb879d714c61b4d7343137b00e42 (DEFAULT_TABLE table=default.Table_878d06515f18478389e9e413449a06e8 [id=b7d1bcafc56a481c9baddbd7552ee33e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.722470 1283 tablet_service.cc:1467] Processing CreateTablet for tablet cc91a17a72de4ced8d3f7519430d44b5 (DEFAULT_TABLE table=default.Table_d3fb059bc4dc4e9da4b50184855ddc9a [id=21b4622d9b8f4530843a563f3febffb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.722929 1139 tablet_service.cc:1467] Processing CreateTablet for tablet cc91a17a72de4ced8d3f7519430d44b5 (DEFAULT_TABLE table=default.Table_d3fb059bc4dc4e9da4b50184855ddc9a [id=21b4622d9b8f4530843a563f3febffb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.723237 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc91a17a72de4ced8d3f7519430d44b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:16.724040 1102 consensus_peers.cc:487] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.724856 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (table default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8]). Expected version 3 got 0
I20260927 15:06:16.726480 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 3fbba7193922433199275eaac003f9ce (DEFAULT_TABLE table=default.Table_551c1ec5b4f142ce8a709cc61e04ff56 [id=5c923e0f49384426acc04873fe75a792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.726794 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fbba7193922433199275eaac003f9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.730063 1272 tablet_service.cc:1467] Processing CreateTablet for tablet c050ca0f1f19416484f4e326de13005e (DEFAULT_TABLE table=default.Table_3efa50b5970d4c598a6ea55a5273f07c [id=2b6bf0324d8847c2aff2a7be96e018df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.730139 1279 tablet_service.cc:1467] Processing CreateTablet for tablet a593985d1968440e90bda26faa098445 (DEFAULT_TABLE table=default.Table_fb7c213a3fc9488a9108413667662865 [id=acbd92ce628d4d67928cc561eb733f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.727077 1135 tablet_service.cc:1467] Processing CreateTablet for tablet a593985d1968440e90bda26faa098445 (DEFAULT_TABLE table=default.Table_fb7c213a3fc9488a9108413667662865 [id=acbd92ce628d4d67928cc561eb733f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.730615 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a593985d1968440e90bda26faa098445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.730959 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47ca8470f8894375ac3b67b315ab7805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.733963 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afd31e5d011b40c7bfda173a7331ed90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.736253 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 6481b87f90c7482b9c7598fb3ffd39dc (DEFAULT_TABLE table=default.Table_2804c8e3cffa4b3db7b87ebed56475b3 [id=2595f260df274de7bcf538439646cf63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.736465 1285 tablet_service.cc:1467] Processing CreateTablet for tablet a5f3b6517dc947168c42b2eaa764a710 (DEFAULT_TABLE table=default.Table_6652d48cff0e433f9269a620c82cb64a [id=7828e9e7051741928c802835d29d599b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.736617 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6481b87f90c7482b9c7598fb3ffd39dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.738162 1131 tablet_service.cc:1467] Processing CreateTablet for tablet a5f3b6517dc947168c42b2eaa764a710 (DEFAULT_TABLE table=default.Table_6652d48cff0e433f9269a620c82cb64a [id=7828e9e7051741928c802835d29d599b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.738494 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5f3b6517dc947168c42b2eaa764a710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.739066 1420 tablet_service.cc:1467] Processing CreateTablet for tablet e14ebb879d714c61b4d7343137b00e42 (DEFAULT_TABLE table=default.Table_878d06515f18478389e9e413449a06e8 [id=b7d1bcafc56a481c9baddbd7552ee33e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.739372 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14ebb879d714c61b4d7343137b00e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.740036 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c230b306aa24570ba1b6c8a6d90b24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.740042 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d8f9b77c8863469da1afa6de376a291c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.740576 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8f9b77c8863469da1afa6de376a291c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.742467 1556 tablet_bootstrap.cc:492] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.742576 1556 ts_tablet_manager.cc:1397] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.000s
I20260927 15:06:16.743072 1136 tablet_service.cc:1467] Processing CreateTablet for tablet c050ca0f1f19416484f4e326de13005e (DEFAULT_TABLE table=default.Table_3efa50b5970d4c598a6ea55a5273f07c [id=2b6bf0324d8847c2aff2a7be96e018df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.743357 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c050ca0f1f19416484f4e326de13005e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.743376 1556 raft_consensus.cc:348] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.743558 1556 raft_consensus.cc:374] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.743602 1556 raft_consensus.cc:729] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.743777 1556 consensus_queue.cc:260] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.744272 1556 ts_tablet_manager.cc:1428] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 15:06:16.744510 1556 tablet_bootstrap.cc:492] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.745946 1556 tablet_bootstrap.cc:654] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.746991 1406 tablet_service.cc:1467] Processing CreateTablet for tablet cc91a17a72de4ced8d3f7519430d44b5 (DEFAULT_TABLE table=default.Table_d3fb059bc4dc4e9da4b50184855ddc9a [id=21b4622d9b8f4530843a563f3febffb2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:16.747226 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet a19a13469f46417fa46f655effecf6b1 (table default.Table_8aaf9520012f4c6db78e09311c703996 [id=dbf6b00bba534e9aa884b741bb5f2d7c], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a19a13469f46417fa46f655effecf6b1 consensus state has no leader
I20260927 15:06:16.747359 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc91a17a72de4ced8d3f7519430d44b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:16.750484 1099 consensus_peers.cc:487] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 610ff6563dc64e73b2b4d7c268468b21. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.751102 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 3fbba7193922433199275eaac003f9ce (DEFAULT_TABLE table=default.Table_551c1ec5b4f142ce8a709cc61e04ff56 [id=5c923e0f49384426acc04873fe75a792]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.751165 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_599d4864bb504fa98740493c10df01f0 [id=a51d9c4b701c4c639d904aef0ac3a2cb] alter complete (version 2)
I20260927 15:06:16.751446 1401 tablet_service.cc:1467] Processing CreateTablet for tablet a593985d1968440e90bda26faa098445 (DEFAULT_TABLE table=default.Table_fb7c213a3fc9488a9108413667662865 [id=acbd92ce628d4d67928cc561eb733f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.751729 1402 tablet_service.cc:1467] Processing CreateTablet for tablet c050ca0f1f19416484f4e326de13005e (DEFAULT_TABLE table=default.Table_3efa50b5970d4c598a6ea55a5273f07c [id=2b6bf0324d8847c2aff2a7be96e018df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.752832 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 47ca8470f8894375ac3b67b315ab7805 (DEFAULT_TABLE table=default.Table_49701096d396411d89d8c88cc143c535 [id=8383d76149bf4461b871fed5a26d8e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.753697 1403 tablet_service.cc:1467] Processing CreateTablet for tablet afd31e5d011b40c7bfda173a7331ed90 (DEFAULT_TABLE table=default.Table_437d2682e5f7473fa0056683c1d8babc [id=b365a95b5ca04401b6efbe9f6c6fad04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.754043 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fbba7193922433199275eaac003f9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.756836 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet cb859b43634c420382da5c201ce24dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.757081 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet f271c76b5f2447239d3d014fbde4e8b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.757243 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 with delete_type TABLET_DATA_DELETED (replaced by tablet b2d2501a9f764790818426665e7f0340) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.757421 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.757571 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4cff4a06db44269defca578af289d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.757882 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 with delete_type TABLET_DATA_DELETED (replaced by tablet 99d4707e599840b3bdc2ab13c348ea80) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.758059 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 278205071701447e8ee7457b2ee84be4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.759375 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_59427058129c43e293490854f6f7ec86" } new_table_name: "default.Table_ca22b3d8b52e426da257b1fa8cf1e9fa" modify_external_catalogs: true
I20260927 15:06:16.750505 1562 ts_tablet_manager.cc:1918] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.763600 1562 log.cc:1196] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/0aec677006ab4407bd7ae4c0078d6b7f
I20260927 15:06:16.764168 1562 ts_tablet_manager.cc:1939] T 0aec677006ab4407bd7ae4c0078d6b7f P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.767477 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a593985d1968440e90bda26faa098445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.775691 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c050ca0f1f19416484f4e326de13005e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.778192 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d107a6a7fa684882b689e8797efe6667" } modify_external_catalogs: true
I20260927 15:06:16.778375 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d107a6a7fa684882b689e8797efe6667" } modify_external_catalogs: true
I20260927 15:06:16.779284 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47ca8470f8894375ac3b67b315ab7805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.782898 2695 raft_consensus.cc:482] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.783020 2695 raft_consensus.cc:504] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.783629 2695 leader_election.cc:288] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:16.783740 2695 raft_consensus.cc:482] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.783844 2695 raft_consensus.cc:504] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.784315 2695 leader_election.cc:288] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:16.785115 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f2ab9677c4598b0b8d9a93a6a23c7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.785329 2569 raft_consensus.cc:482] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.785483 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568ba79ea795403cba76fb6632efd7e2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:16.785439 2569 raft_consensus.cc:504] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.785935 2569 leader_election.cc:288] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:16.786262 1374 leader_election.cc:341] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:16.786455 1374 leader_election.cc:341] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.786907 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4cff4a06db44269defca578af289d8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:16.787945 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_101d63978331408d8eaeb799e410ebe9" } new_table_name: "default.Table_8b7f79a08f8c4535bb8cb6b24b2466ab" modify_external_catalogs: true
W20260927 15:06:16.788125 1102 leader_election.cc:341] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.788882 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568ba79ea795403cba76fb6632efd7e2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:16.789248 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f2ab9677c4598b0b8d9a93a6a23c7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.790035 1376 leader_election.cc:341] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.790144 1376 leader_election.cc:302] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:16.790472 1376 leader_election.cc:341] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.790553 1376 leader_election.cc:302] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:16.790995 2695 raft_consensus.cc:2726] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.791169 2695 raft_consensus.cc:2726] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.791980 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4cff4a06db44269defca578af289d8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:16.791904 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3028fb3d99c84685ad117fb942f070a9" } new_table_name: "default.Table_364502146dc94d29ad5dfeee8614488e" modify_external_catalogs: true
I20260927 15:06:16.792182 1438 raft_consensus.cc:2454] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:16.792698 1099 leader_election.cc:302] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.792924 2569 raft_consensus.cc:2781] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.792991 2569 raft_consensus.cc:482] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.793058 2569 raft_consensus.cc:3037] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.795917 2569 raft_consensus.cc:504] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.799677 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 757) took 4688 ms. Trace:
I20260927 15:06:16.799767 1562 rpcz_store.cc:276] 0927 15:06:12.111047 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.111105 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:16.691162 (+4580057us) ts_tablet_manager.cc:1145] Deleting tablet 0aec677006ab4407bd7ae4c0078d6b7f
0927 15:06:16.691183 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.732797 (+ 41614us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.750432 (+ 17635us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.799658 (+ 49226us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4579815}
I20260927 15:06:16.800074 1562 tablet_replica.cc:330] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.800256 1562 raft_consensus.cc:2229] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 2 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.800233 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3aad9ee115dc400a9be8c6b0449f7090"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:16.800446 1562 pending_rounds.cc:62] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:16.800483 1562 pending_rounds.cc:68] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7333976377624309760 op_type: NO_OP noop_request { }
I20260927 15:06:16.800572 1562 raft_consensus.cc:2866] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:16.800642 1562 raft_consensus.cc:2258] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:16.800843 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3aad9ee115dc400a9be8c6b0449f7090 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.803166 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4cff4a06db44269defca578af289d8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:16.804965 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 0aec677006ab4407bd7ae4c0078d6b7f (table default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]) successfully deleted
W20260927 15:06:16.805955 1102 leader_election.cc:341] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.806870 2569 leader_election.cc:288] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.808140 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0510f4e87b194a98a364979d009cbb88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.808697 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0510f4e87b194a98a364979d009cbb88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.809804 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4ce6fd0cda7248eab6a6c5a419209994"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.810348 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ce6fd0cda7248eab6a6c5a419209994 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.811733 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fcc32fa123dc46a4a9043db78118ff70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.812551 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcc32fa123dc46a4a9043db78118ff70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.813318 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 7508e8c3438649c69daabac7a2a11efc (DEFAULT_TABLE table=default.Table_19cff94cd880489087101b1fb339fc27 [id=759121511fef4a4eba1cc5122117d81d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.817335 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_46acdac56c074e8aad7df2d4af2a5528"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.817807 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46acdac56c074e8aad7df2d4af2a5528 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.818604 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 66df460a34ce496ba21e0d9bcd31e74f (DEFAULT_TABLE table=default.Table_068b8f93e2ef411b871c5550785e4ecc [id=20f5c84f30634def96423c00a7e7a761]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.818796 1305 raft_consensus.cc:3037] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.823493 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4cff4a06db44269defca578af289d8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:16.823691 1438 raft_consensus.cc:3037] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.826686 1438 raft_consensus.cc:2454] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:16.827246 1099 leader_election.cc:302] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.828059 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afd31e5d011b40c7bfda173a7331ed90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.829504 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66df460a34ce496ba21e0d9bcd31e74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.830283 2653 raft_consensus.cc:2781] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.830405 2653 raft_consensus.cc:686] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:16.830614 2653 consensus_queue.cc:237] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.831050 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7508e8c3438649c69daabac7a2a11efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.836333 1562 ts_tablet_manager.cc:1905] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.838637 2653 raft_consensus.cc:482] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.838804 2653 raft_consensus.cc:504] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.839339 2653 leader_election.cc:288] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.841610 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc20a62bbd484c4e9e25cf1c15e1dde0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.842312 1102 leader_election.cc:341] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.843035 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 832bf0ee6cbf4c639d2ea569c565ca20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.843255 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14ebb879d714c61b4d7343137b00e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.843425 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7508e8c3438649c69daabac7a2a11efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.843560 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c050ca0f1f19416484f4e326de13005e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.843729 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66df460a34ce496ba21e0d9bcd31e74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.843904 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc91a17a72de4ced8d3f7519430d44b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.844048 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6481b87f90c7482b9c7598fb3ffd39dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.844198 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a593985d1968440e90bda26faa098445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.844352 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47ca8470f8894375ac3b67b315ab7805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.847052 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4430aa799314fc2a2b4acc3fdd1df7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.847397 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fbba7193922433199275eaac003f9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.850144 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 870) took 1191 ms. Trace:
I20260927 15:06:16.850257 2119 rpcz_store.cc:276] 0927 15:06:15.659109 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.659161 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:16.637626 (+978465us) ts_tablet_manager.cc:1145] Deleting tablet 5c0d51b50b414721a255fdde2fe1732f
0927 15:06:16.637636 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.676303 (+ 38667us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.699572 (+ 23269us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.850126 (+150554us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":978189}
I20260927 15:06:16.851140 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afd31e5d011b40c7bfda173a7331ed90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.852670 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 5c0d51b50b414721a255fdde2fe1732f (table default.Table_52dfae347a16444d9d03a84c7a88721d [id=60be603d0c3844e8925f32c3553e8d56]) successfully deleted
W20260927 15:06:16.852978 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 72f87499645e4f55bc3d6edeba50eb64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72f87499645e4f55bc3d6edeba50eb64 already in progress: creating tablet
W20260927 15:06:16.853173 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 already in progress: creating tablet
W20260927 15:06:16.853358 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 75b4abbc451b44a2af08e17f49f570f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75b4abbc451b44a2af08e17f49f570f1 already in progress: creating tablet
W20260927 15:06:16.853564 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6d167c390ed546e09f31f1e08988500c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d167c390ed546e09f31f1e08988500c already in progress: creating tablet
I20260927 15:06:16.856355 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc20a62bbd484c4e9e25cf1c15e1dde0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:16.856591 1438 raft_consensus.cc:2454] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:16.857079 1099 leader_election.cc:302] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.857424 2653 raft_consensus.cc:2781] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:16.857487 2653 raft_consensus.cc:482] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:16.857538 2653 raft_consensus.cc:3037] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.858960 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5f3b6517dc947168c42b2eaa764a710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.859977 2653 raft_consensus.cc:504] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:16.860589 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2bb9540030834895ac069a0d516d7ee4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bb9540030834895ac069a0d516d7ee4 already in progress: creating tablet
I20260927 15:06:16.861297 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc20a62bbd484c4e9e25cf1c15e1dde0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:16.861617 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet cdcc55fb32b14935922e5870819bc266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdcc55fb32b14935922e5870819bc266 already in progress: creating tablet
I20260927 15:06:16.861665 2653 leader_election.cc:288] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:16.861925 1102 leader_election.cc:341] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.862994 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc20a62bbd484c4e9e25cf1c15e1dde0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:16.863204 1438 raft_consensus.cc:3037] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.863353 2233 ts_tablet_manager.cc:1918] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.863447 2233 log.cc:1196] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/cb859b43634c420382da5c201ce24dfc
I20260927 15:06:16.863731 2233 ts_tablet_manager.cc:1939] T cb859b43634c420382da5c201ce24dfc P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:16.864543 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 826) took 3702 ms. Trace:
I20260927 15:06:16.864648 2233 rpcz_store.cc:276] 0927 15:06:13.161995 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.162069 (+ 74us) service_pool.cc:227] Handling call
0927 15:06:16.679552 (+3517483us) ts_tablet_manager.cc:1145] Deleting tablet cb859b43634c420382da5c201ce24dfc
0927 15:06:16.679569 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.685010 (+ 5441us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.863275 (+178265us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.864523 (+ 1248us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3517138}
I20260927 15:06:16.865060 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 827) took 3690 ms. Trace:
I20260927 15:06:16.865139 2233 rpcz_store.cc:276] 0927 15:06:13.174407 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.177192 (+ 2785us) service_pool.cc:227] Handling call
0927 15:06:16.864949 (+3687757us) ts_tablet_manager.cc:1145] Deleting tablet 79a3125723034cb48bc1a05fc4abbb82
0927 15:06:16.864961 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.865046 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3687455}
I20260927 15:06:16.865446 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 828) took 3637 ms. Trace:
I20260927 15:06:16.865516 2233 rpcz_store.cc:276] 0927 15:06:13.228009 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.229308 (+ 1299us) service_pool.cc:227] Handling call
0927 15:06:16.865353 (+3636045us) ts_tablet_manager.cc:1145] Deleting tablet e7051277b0324331a28168eb387c770c
0927 15:06:16.865362 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.865433 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3635696}
I20260927 15:06:16.865825 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 829) took 3637 ms. Trace:
I20260927 15:06:16.865896 2233 rpcz_store.cc:276] 0927 15:06:13.228147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.229703 (+ 1556us) service_pool.cc:227] Handling call
0927 15:06:16.865734 (+3636031us) ts_tablet_manager.cc:1145] Deleting tablet 0e34a679010b4b4fa3a76aec5ae05db4
0927 15:06:16.865744 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.865812 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3635797}
I20260927 15:06:16.866118 1438 raft_consensus.cc:2454] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:16.867123 2119 tablet_replica.cc:330] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.867417 2119 raft_consensus.cc:2229] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.867600 2119 raft_consensus.cc:2258] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.868129 2119 ts_tablet_manager.cc:1905] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:16.871798 1102 consensus_peers.cc:487] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.874447 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:16.876269 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet cb859b43634c420382da5c201ce24dfc (table default.Table_d30c425670fb48e8b23a840865bee28b [id=0303fc8be5ae400a87d56696b7b75994]) successfully deleted
W20260927 15:06:16.876720 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 79a3125723034cb48bc1a05fc4abbb82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79a3125723034cb48bc1a05fc4abbb82 already in progress: creating tablet
W20260927 15:06:16.877120 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e7051277b0324331a28168eb387c770c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e7051277b0324331a28168eb387c770c already in progress: creating tablet
W20260927 15:06:16.877444 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0e34a679010b4b4fa3a76aec5ae05db4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e34a679010b4b4fa3a76aec5ae05db4 already in progress: creating tablet
I20260927 15:06:16.878051 1408 tablet_service.cc:1467] Processing CreateTablet for tablet a5f3b6517dc947168c42b2eaa764a710 (DEFAULT_TABLE table=default.Table_6652d48cff0e433f9269a620c82cb64a [id=7828e9e7051741928c802835d29d599b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:16.878630 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5f3b6517dc947168c42b2eaa764a710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:16.879346 1099 leader_election.cc:302] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:16.880409 2653 raft_consensus.cc:2781] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:16.879549 2742 raft_consensus.cc:482] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.880544 2653 raft_consensus.cc:686] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:16.880725 2742 raft_consensus.cc:504] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.880756 2653 consensus_queue.cc:237] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.881717 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e0be77dff645f795237ffe779ed684" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:16.882047 2569 consensus_queue.cc:1035] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:06:16.882419 1376 leader_election.cc:341] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.884224 1562 ts_tablet_manager.cc:1918] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260927 15:06:16.884361 2742 leader_election.cc:288] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:16.887897 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e0be77dff645f795237ffe779ed684" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:16.888638 1374 leader_election.cc:341] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.888788 1374 leader_election.cc:302] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:16.889295 2742 raft_consensus.cc:2726] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:16.887878 1562 log.cc:1196] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/2cd55e22d8254ea8b1dab989517148ca
I20260927 15:06:16.890688 1562 ts_tablet_manager.cc:1939] T 2cd55e22d8254ea8b1dab989517148ca P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.891722 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 758) took 4780 ms. Trace:
I20260927 15:06:16.895745 1562 rpcz_store.cc:276] 0927 15:06:12.111486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.111523 (+ 37us) service_pool.cc:227] Handling call
0927 15:06:16.800032 (+4688509us) ts_tablet_manager.cc:1145] Deleting tablet 2cd55e22d8254ea8b1dab989517148ca
0927 15:06:16.800042 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.856329 (+ 56287us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.884123 (+ 27794us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.891696 (+ 7573us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4688382}
I20260927 15:06:16.896517 2365 raft_consensus.cc:482] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:16.896916 2365 raft_consensus.cc:504] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:16.897698 2365 leader_election.cc:288] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:16.898324 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 759) took 4769 ms. Trace:
I20260927 15:06:16.898366 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 2cd55e22d8254ea8b1dab989517148ca (table default.Table_0f6a6192da2f4f05af0cad71e5b85ef2 [id=e104421aa3634f9b9868449439d50362]) successfully deleted
I20260927 15:06:16.898447 1562 rpcz_store.cc:276] 0927 15:06:12.129197 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.129271 (+ 74us) service_pool.cc:227] Handling call
0927 15:06:16.898197 (+4768926us) ts_tablet_manager.cc:1145] Deleting tablet 89783d26db9e49f0ae5171f929fcf1df
0927 15:06:16.898210 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.898306 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4768707}
I20260927 15:06:16.898988 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9b07ea3ec9457399e2b765580d06e7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:16.899626 1102 leader_election.cc:341] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:16.901664 2369 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.201.20:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.201.62:41167,127.0.201.61:43763,127.0.201.60:46799
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.201.60:46799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.201.60
--webserver_port=39943
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 27 Sep 2026 13:46:26 UTC on ccycloud.quasar-xkqhuq.root.comops.site
build id 4676080
ASAN enabled
I20260927 15:06:16.900405 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 760) took 4770 ms. Trace:
I20260927 15:06:16.902864 1562 rpcz_store.cc:276] 0927 15:06:12.129713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.129758 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:16.900272 (+4770514us) ts_tablet_manager.cc:1145] Deleting tablet 63fbd388210d4a1aabfcf27c7533efbf
0927 15:06:16.900287 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.900385 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4770371}
W20260927 15:06:16.903806 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 63fbd388210d4a1aabfcf27c7533efbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63fbd388210d4a1aabfcf27c7533efbf already in progress: creating tablet
I20260927 15:06:16.904115 1562 tablet_replica.cc:330] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.904322 1562 raft_consensus.cc:2229] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.906422 2119 ts_tablet_manager.cc:1918] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.906728 1562 pending_rounds.cc:62] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:16.906810 1562 pending_rounds.cc:68] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976375523045376 op_type: NO_OP noop_request { }
I20260927 15:06:16.908488 1556 tablet_bootstrap.cc:492] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.908684 1556 ts_tablet_manager.cc:1397] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.164s user 0.011s sys 0.017s
I20260927 15:06:16.909446 1556 raft_consensus.cc:348] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.909729 1556 raft_consensus.cc:374] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.909834 1556 raft_consensus.cc:729] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.910185 1556 consensus_queue.cc:260] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.911060 1556 ts_tablet_manager.cc:1428] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:16.911516 1556 tablet_bootstrap.cc:492] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:16.912609 1562 raft_consensus.cc:2866] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:16.912773 1562 raft_consensus.cc:2258] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.914415 1562 ts_tablet_manager.cc:1905] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.915817 2369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260927 15:06:16.916451 1556 tablet_bootstrap.cc:654] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:16.916688 2119 log.cc:1196] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/8fc1fc04814147d8843aa734fd1794da
I20260927 15:06:16.918216 2119 ts_tablet_manager.cc:1939] T 8fc1fc04814147d8843aa734fd1794da P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.920503 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bed9c25eb1f14b99b1f2f4b70e466715" } new_table_name: "default.Table_967379b2ad1446769b622a56fcd7dd65" modify_external_catalogs: true
I20260927 15:06:16.923847 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 8fc1fc04814147d8843aa734fd1794da (table default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]) successfully deleted
W20260927 15:06:16.924177 1102 consensus_peers.cc:487] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.924468 2119 tablet_replica.cc:330] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.924543 1298 raft_consensus.cc:3037] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:16.924741 2119 raft_consensus.cc:2229] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.924886 2119 raft_consensus.cc:2258] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.925452 2119 ts_tablet_manager.cc:1905] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.933266 2369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260927 15:06:16.938160 1556 tablet_bootstrap.cc:492] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:16.938310 1556 ts_tablet_manager.cc:1397] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20260927 15:06:16.939118 1556 raft_consensus.cc:348] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.939338 1556 raft_consensus.cc:374] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:16.939392 1556 raft_consensus.cc:729] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:16.939585 1556 consensus_queue.cc:260] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:16.940150 1556 ts_tablet_manager.cc:1428] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260927 15:06:16.941103 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9e541ad12fd470986eb82b4855db498 consensus state has no leader
I20260927 15:06:16.942028 1562 ts_tablet_manager.cc:1918] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:16.943463 1562 log.cc:1196] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/8fc1fc04814147d8843aa734fd1794da
I20260927 15:06:16.944841 1562 ts_tablet_manager.cc:1939] T 8fc1fc04814147d8843aa734fd1794da P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:16.945750 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 761) took 4764 ms. Trace:
I20260927 15:06:16.950950 1562 rpcz_store.cc:276] 0927 15:06:12.181541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.181605 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:16.904078 (+4722473us) ts_tablet_manager.cc:1145] Deleting tablet 8fc1fc04814147d8843aa734fd1794da
0927 15:06:16.904088 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.931902 (+ 27814us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.941941 (+ 10039us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.945731 (+ 3790us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4703276}
I20260927 15:06:16.951465 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 8fc1fc04814147d8843aa734fd1794da (table default.Table_83c5d552eb044e369bac27b9e1aac15c [id=433e2c99fb354775ab79febbd9bd8be5]) successfully deleted
I20260927 15:06:16.951498 1562 tablet_replica.cc:330] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:16.951725 1562 raft_consensus.cc:2229] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:16.951911 1562 raft_consensus.cc:2258] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.952425 1562 ts_tablet_manager.cc:1905] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:16.952827 2119 ts_tablet_manager.cc:1918] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.953011 2119 log.cc:1196] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/01b7e017ead242849585679873a69b43
I20260927 15:06:16.956460 2119 ts_tablet_manager.cc:1939] T 01b7e017ead242849585679873a69b43 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:16.957207 2119 tablet_replica.cc:330] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:16.957182 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 01b7e017ead242849585679873a69b43 (table default.Table_fac248ae4718435c9ec9d479beaaeae4 [id=b28d0e08cf944e17a720641dab1f23f5]) successfully deleted
W20260927 15:06:16.957641 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f799583600634a8e8c2b4fe9d5aa1e55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f799583600634a8e8c2b4fe9d5aa1e55 already in progress: creating tablet
W20260927 15:06:16.957875 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c74dfa20ed9a4eb197a846b62d859146 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c74dfa20ed9a4eb197a846b62d859146 already in progress: creating tablet
I20260927 15:06:16.960794 2119 raft_consensus.cc:2229] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:16.961133 2119 pending_rounds.cc:62] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:16.961207 2119 pending_rounds.cc:68] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976376790495232 op_type: NO_OP noop_request { }
I20260927 15:06:16.961642 913 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
I20260927 15:06:16.964653 2119 raft_consensus.cc:2866] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:16.964792 2119 raft_consensus.cc:2258] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:16.954552 1552 tablet_bootstrap.cc:492] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:16.965061 1552 ts_tablet_manager.cc:1397] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.432s user 0.002s sys 0.009s
I20260927 15:06:16.965968 913 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
I20260927 15:06:16.966053 2119 ts_tablet_manager.cc:1905] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:16.974107 1102 consensus_peers.cc:487] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:16.975566 1562 ts_tablet_manager.cc:1918] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:16.973982 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_060f4ec20a184438a46ffcbee7e408d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.980350 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_060f4ec20a184438a46ffcbee7e408d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.974793 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e0091676d0fb46d3a93ec6c2fc515c73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.981762 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0091676d0fb46d3a93ec6c2fc515c73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:16.975672 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da2cdd6c478a4c0989b9317d0206550c consensus state has no leader
I20260927 15:06:16.983229 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6cb64cf8db1549f4aabddd9904aaa1d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:16.983678 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cb64cf8db1549f4aabddd9904aaa1d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:16.976734 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 611e63080dcb474c8dde370c54a0e777
I20260927 15:06:16.985008 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_05a4f0b59b034d37ad273d442100793d" } modify_external_catalogs: true
I20260927 15:06:16.985175 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_05a4f0b59b034d37ad273d442100793d" } modify_external_catalogs: true
I20260927 15:06:16.987891 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 611e63080dcb474c8dde370c54a0e777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:16.988093 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 611e63080dcb474c8dde370c54a0e777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:16.977180 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_837e903d5fe544adba9c254a905a1ab3" } new_table_name: "default.Table_6fbb7bd4420e424590f43b5cafe2b02e" modify_external_catalogs: true
I20260927 15:06:16.989231 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 611e63080dcb474c8dde370c54a0e777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:16.978814 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd3eb83597ef4aae9bf00fcfc2517ea6 consensus state has no leader
I20260927 15:06:16.990602 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ee20f4e8d38543c38d6f044d132b3a27" } modify_external_catalogs: true
I20260927 15:06:16.990792 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ee20f4e8d38543c38d6f044d132b3a27" } modify_external_catalogs: true
I20260927 15:06:16.866129 2233 tablet_replica.cc:330] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:17.001108 1556 tablet_bootstrap.cc:492] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.002712 1556 tablet_bootstrap.cc:654] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.004407 2233 raft_consensus.cc:2229] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.007140 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_99f77000d51a4368be6b4cd063f28b8d" } modify_external_catalogs: true
I20260927 15:06:17.007424 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_99f77000d51a4368be6b4cd063f28b8d" } modify_external_catalogs: true
I20260927 15:06:17.013298 2742 raft_consensus.cc:482] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.013481 2742 raft_consensus.cc:504] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.014133 2742 leader_election.cc:288] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.014603 2119 ts_tablet_manager.cc:1918] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.014755 2119 log.cc:1196] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/6c73e813bb594a5e871718b73fe61fc9
I20260927 15:06:17.015121 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8de6246f7904f6c80df624f3631db17" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:17.015270 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8de6246f7904f6c80df624f3631db17" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.015682 1374 leader_election.cc:341] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:17.015818 1376 leader_election.cc:341] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.015945 1376 leader_election.cc:302] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.016052 2233 raft_consensus.cc:2258] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.016294 2742 raft_consensus.cc:2726] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.017012 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9b07ea3ec9457399e2b765580d06e7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:17.017289 1438 raft_consensus.cc:2454] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:17.018472 2233 ts_tablet_manager.cc:1905] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.019619 1556 tablet_bootstrap.cc:492] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.019742 1556 ts_tablet_manager.cc:1397] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.000s
I20260927 15:06:17.020368 1556 raft_consensus.cc:348] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.020560 1556 raft_consensus.cc:374] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.020608 1556 raft_consensus.cc:729] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.020771 1556 consensus_queue.cc:260] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:17.021009 1099 consensus_peers.cc:487] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b1f2143af1142eb9f3dbc777299c186. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.021220 1556 ts_tablet_manager.cc:1428] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 15:06:17.021451 1556 tablet_bootstrap.cc:492] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.022296 1552 raft_consensus.cc:348] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.022529 1552 raft_consensus.cc:374] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.022598 1552 raft_consensus.cc:729] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.022924 1556 tablet_bootstrap.cc:654] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.022852 1552 consensus_queue.cc:260] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.023504 1552 ts_tablet_manager.cc:1428] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.058s user 0.000s sys 0.002s
I20260927 15:06:17.024032 1552 tablet_bootstrap.cc:492] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:17.025359 1552 tablet_bootstrap.cc:654] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.025980 1099 leader_election.cc:302] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.026247 2431 raft_consensus.cc:2781] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.026324 2431 raft_consensus.cc:482] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.026458 2431 raft_consensus.cc:3037] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.029462 2431 raft_consensus.cc:504] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.030529 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9b07ea3ec9457399e2b765580d06e7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:17.031024 1102 leader_election.cc:341] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.031325 2431 leader_election.cc:288] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.032552 1552 tablet_bootstrap.cc:492] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:17.032745 1552 ts_tablet_manager.cc:1397] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260927 15:06:17.033563 1552 raft_consensus.cc:348] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.033836 1552 raft_consensus.cc:374] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.033964 1552 raft_consensus.cc:729] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.034231 1552 consensus_queue.cc:260] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.035143 1552 ts_tablet_manager.cc:1428] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:17.035561 1552 tablet_bootstrap.cc:492] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:17.036659 1099 consensus_peers.cc:487] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80a8563c77484a1ebbbe7dab9a652aeb. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.037761 1552 tablet_bootstrap.cc:654] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.039915 1556 tablet_bootstrap.cc:492] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.040045 1556 ts_tablet_manager.cc:1397] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.004s
I20260927 15:06:17.041430 2119 ts_tablet_manager.cc:1939] T 6c73e813bb594a5e871718b73fe61fc9 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:17.041730 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9b07ea3ec9457399e2b765580d06e7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:17.042007 1435 raft_consensus.cc:3037] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.041951 1556 raft_consensus.cc:348] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.042434 1556 raft_consensus.cc:374] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.042490 1556 raft_consensus.cc:729] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.043889 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 6c73e813bb594a5e871718b73fe61fc9 (table default.Table_00334dfc32284d7fbda19999dd7ad94f [id=a5be5daa955846b58970402702de73f9]) successfully deleted
I20260927 15:06:17.043889 1556 consensus_queue.cc:260] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:17.044185 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet cb75c7fd08964949ad4edf0b46b8cfa6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb75c7fd08964949ad4edf0b46b8cfa6 already in progress: creating tablet
W20260927 15:06:17.044433 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet fd225f6127ed4c4ea4bbea41aeb0521f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd225f6127ed4c4ea4bbea41aeb0521f already in progress: creating tablet
I20260927 15:06:17.045204 2119 tablet_replica.cc:330] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:17.045396 2119 raft_consensus.cc:2229] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.045562 2119 raft_consensus.cc:2258] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.045991 1556 ts_tablet_manager.cc:1428] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260927 15:06:17.048864 1435 raft_consensus.cc:2454] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:17.051249 1102 consensus_peers.cc:487] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.052424 1556 tablet_bootstrap.cc:492] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.053222 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 595c84453cd84c3bb5a4d444892bf5e6 (table default.Table_c33713f5f5d841b1a1f9e687db26c2e6 [id=06ca630052694f10aebe6f8b7aaa81d9]). Expected version 1 got 0
I20260927 15:06:17.054415 1556 tablet_bootstrap.cc:654] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.059965 2119 ts_tablet_manager.cc:1905] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.072275 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet adf68ba5020446bf8b522ac6db0e21e7 (table default.Table_9d78b6648ac548e586c621d86d1938ba [id=3fc04b4c774144dd85bbb92d05883018]). Expected version 1 got 0
I20260927 15:06:17.072606 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet bd5b041a4274477895e88d4822b91cca (table default.Table_215f907352cd4345ae56604d6322ded9 [id=1f51698c91d64bb38f760d13529935b6]). Expected version 1 got 0
I20260927 15:06:17.072873 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 595c84453cd84c3bb5a4d444892bf5e6 (table default.Table_c33713f5f5d841b1a1f9e687db26c2e6 [id=06ca630052694f10aebe6f8b7aaa81d9]). Expected version 1 got 0
I20260927 15:06:17.072256 1556 tablet_bootstrap.cc:492] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.073406 1556 ts_tablet_manager.cc:1397] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260927 15:06:17.074718 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 541147938d864cd9ad7208d96533b0f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.075894 1556 raft_consensus.cc:348] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.076167 1556 raft_consensus.cc:374] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.076239 1556 raft_consensus.cc:729] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.076365 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_37218c1a7b094f29ab2a481292650fb5" } modify_external_catalogs: true
I20260927 15:06:17.076678 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_37218c1a7b094f29ab2a481292650fb5" } modify_external_catalogs: true
I20260927 15:06:17.076481 1556 consensus_queue.cc:260] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.078424 1556 ts_tablet_manager.cc:1428] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:17.079278 1556 tablet_bootstrap.cc:492] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.082592 1556 tablet_bootstrap.cc:654] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.086807 1099 leader_election.cc:302] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.087281 2431 raft_consensus.cc:2781] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:17.087432 2431 raft_consensus.cc:686] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:17.087649 2759 tablet.cc:1722] T 595c84453cd84c3bb5a4d444892bf5e6 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:17.087687 2431 consensus_queue.cc:237] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.096868 1556 tablet_bootstrap.cc:492] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.097024 1556 ts_tablet_manager.cc:1397] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260927 15:06:17.102869 1552 tablet_bootstrap.cc:492] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:17.103081 1552 ts_tablet_manager.cc:1397] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.068s user 0.005s sys 0.002s
I20260927 15:06:17.105226 1552 raft_consensus.cc:348] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.105496 1552 raft_consensus.cc:374] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.105589 1552 raft_consensus.cc:729] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.105839 1552 consensus_queue.cc:260] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.106700 1552 ts_tablet_manager.cc:1428] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:17.107348 1552 tablet_bootstrap.cc:492] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:17.114671 1556 raft_consensus.cc:348] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.115700 1556 raft_consensus.cc:374] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.115778 1556 raft_consensus.cc:729] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.116004 1556 consensus_queue.cc:260] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.118249 1556 ts_tablet_manager.cc:1428] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260927 15:06:17.118556 1556 tablet_bootstrap.cc:492] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.120119 1556 tablet_bootstrap.cc:654] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.122287 2233 ts_tablet_manager.cc:1918] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:17.122794 2233 log.cc:1196] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/0f4cff4a06db44269defca578af289d8
I20260927 15:06:17.123383 2233 ts_tablet_manager.cc:1939] T 0f4cff4a06db44269defca578af289d8 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:17.124951 1562 log.cc:1196] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/0d4ca19b492c4df1b31c78f1629c50b5
I20260927 15:06:17.129582 1561 tablet_bootstrap.cc:492] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.129792 1561 ts_tablet_manager.cc:1397] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.495s user 0.065s sys 0.051s
I20260927 15:06:17.130530 1561 raft_consensus.cc:348] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.131335 1561 raft_consensus.cc:374] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.131425 1561 raft_consensus.cc:729] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.131770 1561 consensus_queue.cc:260] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.132776 1561 ts_tablet_manager.cc:1428] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:17.133152 1561 tablet_bootstrap.cc:492] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.135243 1561 tablet_bootstrap.cc:654] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.135149 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_52fd5fb5caf84459a481612b86651b15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.135764 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52fd5fb5caf84459a481612b86651b15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.137058 911 master_service.cc:946] ReplaceTablet: received request to replace tablet a4a48e08f69a4727924d006dc19b6ed1 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:17.138294 908 master_service.cc:946] ReplaceTablet: received request to replace tablet 033e71f60c3e47fd9647db090d4d6cd5 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:17.138923 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b1ff6438778e4789966eb1e2dd2f9225"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.131227 1562 ts_tablet_manager.cc:1939] T 0d4ca19b492c4df1b31c78f1629c50b5 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:06:17.139520 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1ff6438778e4789966eb1e2dd2f9225 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.140241 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 762) took 4837 ms. Trace:
I20260927 15:06:17.140631 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e67cf0526f3c45718312508b306d7089
I20260927 15:06:17.140323 1562 rpcz_store.cc:276] 0927 15:06:12.302653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.302709 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:16.951451 (+4648742us) ts_tablet_manager.cc:1145] Deleting tablet 0d4ca19b492c4df1b31c78f1629c50b5
0927 15:06:16.951463 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:16.959352 (+ 7889us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:16.975482 (+ 16130us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.140223 (+164741us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4648527}
I20260927 15:06:17.143071 909 master_service.cc:946] ReplaceTablet: received request to replace tablet e1770acc612f4924ba62ee20767a31c1 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:17.143422 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2b02006875534bdb86ffccee52bca32b consensus state has no leader
I20260927 15:06:17.144104 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 775) took 4563 ms. Trace:
I20260927 15:06:17.144621 1562 rpcz_store.cc:276] 0927 15:06:12.581001 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.581083 (+ 82us) service_pool.cc:227] Handling call
0927 15:06:17.143586 (+4562503us) ts_tablet_manager.cc:1145] Deleting tablet 10b19de22dd74d74bdf619c75fc17762
0927 15:06:17.143597 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.144087 (+ 490us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4562259}
I20260927 15:06:17.145097 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 0d4ca19b492c4df1b31c78f1629c50b5 (table default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]) successfully deleted
I20260927 15:06:17.145408 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 776) took 4560 ms. Trace:
I20260927 15:06:17.145587 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet e67cf0526f3c45718312508b306d7089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.145810 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_124db11735d04945ad242967db096475" } new_table_name: "default.Table_494cc901cfea41ac870c2ab69ac3d54b" modify_external_catalogs: true
I20260927 15:06:17.145473 1562 rpcz_store.cc:276] 0927 15:06:12.584824 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.584880 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:17.145310 (+4560430us) ts_tablet_manager.cc:1145] Deleting tablet 0ae30595912943aaa58f1ebe9dc965e6
0927 15:06:17.145320 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.145394 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4560227}
I20260927 15:06:17.128809 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet d463a481cb8c4243961e9b0d2b11822c with delete_type TABLET_DATA_DELETED (replaced by tablet 1c018f11de9842bc883409f8af35fb5f) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.147184 1562 tablet_replica.cc:330] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.147372 1562 raft_consensus.cc:2229] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.148514 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 547f5f0f1d444f348cf7efbbdf95523c
I20260927 15:06:17.149613 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet e67cf0526f3c45718312508b306d7089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:17.150483 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05e9d55c164d4d35a9886c5fdc1c7949 has no consensus state
W20260927 15:06:17.151211 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 10b19de22dd74d74bdf619c75fc17762 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10b19de22dd74d74bdf619c75fc17762 already in progress: creating tablet
I20260927 15:06:17.151458 1562 raft_consensus.cc:2258] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:17.151464 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0ae30595912943aaa58f1ebe9dc965e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ae30595912943aaa58f1ebe9dc965e6 already in progress: creating tablet
I20260927 15:06:17.151866 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 547f5f0f1d444f348cf7efbbdf95523c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.152695 1556 tablet_bootstrap.cc:492] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.152837 1556 ts_tablet_manager.cc:1397] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.000s
I20260927 15:06:17.153031 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 63fbd388210d4a1aabfcf27c7533efbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.153208 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 547f5f0f1d444f348cf7efbbdf95523c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.153744 1562 ts_tablet_manager.cc:1905] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.154073 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet e67cf0526f3c45718312508b306d7089 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.155488 1556 raft_consensus.cc:348] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.155685 1556 raft_consensus.cc:374] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.155726 1556 raft_consensus.cc:729] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.155898 1556 consensus_queue.cc:260] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.156180 2431 raft_consensus.cc:482] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.156286 2431 raft_consensus.cc:504] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.156802 2431 leader_election.cc:288] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.158250 1561 tablet_bootstrap.cc:492] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.158432 1561 ts_tablet_manager.cc:1397] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.004s
I20260927 15:06:17.159098 1561 raft_consensus.cc:348] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.159335 1561 raft_consensus.cc:374] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.159416 1561 raft_consensus.cc:729] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.159618 1561 consensus_queue.cc:260] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.160624 1561 ts_tablet_manager.cc:1428] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:17.161288 1561 tablet_bootstrap.cc:492] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.162715 1561 tablet_bootstrap.cc:654] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.163292 2742 raft_consensus.cc:482] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.164685 2742 raft_consensus.cc:504] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.165295 2742 leader_election.cc:288] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.166354 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541147938d864cd9ad7208d96533b0f4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:17.166965 1374 leader_election.cc:341] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.163160 1556 ts_tablet_manager.cc:1428] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 15:06:17.172701 1562 ts_tablet_manager.cc:1918] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:17.173085 2763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:06:17.173862 2765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260927 15:06:17.177047 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e1770acc612f4924ba62ee20767a31c1
I20260927 15:06:17.177484 909 catalog_manager.cc:6565] ReplaceTablet: tablet e1770acc612f4924ba62ee20767a31c1 deleted and replaced by tablet 9ca7b6f8953e4429a5b8fe4ccc3e1837
I20260927 15:06:17.177830 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a4a48e08f69a4727924d006dc19b6ed1
I20260927 15:06:17.178272 911 catalog_manager.cc:6565] ReplaceTablet: tablet a4a48e08f69a4727924d006dc19b6ed1 deleted and replaced by tablet 98d01c884edf41948027e083f1f29651
I20260927 15:06:17.179281 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet e1770acc612f4924ba62ee20767a31c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ca7b6f8953e4429a5b8fe4ccc3e1837) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.179979 1562 log.cc:1196] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/80a8563c77484a1ebbbe7dab9a652aeb
W20260927 15:06:17.179977 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda consensus state has no leader
I20260927 15:06:17.180016 1301 raft_consensus.cc:3037] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.179574 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a48e08f69a4727924d006dc19b6ed1 with delete_type TABLET_DATA_DELETED (replaced by tablet 98d01c884edf41948027e083f1f29651) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.180380 1562 ts_tablet_manager.cc:1939] T 80a8563c77484a1ebbbe7dab9a652aeb P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.180454 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c01ee9ea5ffc4f1788c1fdc2944d6170"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.180626 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_584fc2c2806641fd8fea5aaba0903ea1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.181061 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c01ee9ea5ffc4f1788c1fdc2944d6170 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:17.181092 2754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260927 15:06:17.181296 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_584fc2c2806641fd8fea5aaba0903ea1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.182349 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6253f595e22742e38b668e0662427dd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.182853 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6253f595e22742e38b668e0662427dd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.185163 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a48e08f69a4727924d006dc19b6ed1 with delete_type TABLET_DATA_DELETED (replaced by tablet 98d01c884edf41948027e083f1f29651) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.185490 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet e1770acc612f4924ba62ee20767a31c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ca7b6f8953e4429a5b8fe4ccc3e1837) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.189059 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_09d8cf7dce6a4b2f80ff871b85bfff29" } modify_external_catalogs: true
I20260927 15:06:17.189350 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_09d8cf7dce6a4b2f80ff871b85bfff29" } modify_external_catalogs: true
I20260927 15:06:17.189472 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_066bd6c1063544008f82fa386dd2e5a1" } new_table_name: "default.Table_3e1e307a7d7b4b18b5bd6c7912667eba" modify_external_catalogs: true
I20260927 15:06:17.192234 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ef6ec660265c4fcfbcf2fa6ac34bac01" } new_table_name: "default.Table_e7f545c51a8d47b2bb41bc12421e8d47" modify_external_catalogs: true
I20260927 15:06:17.192338 2369 server_base.cc:1034] running on GCE node
I20260927 15:06:17.193681 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 777) took 4607 ms. Trace:
I20260927 15:06:17.193733 2369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260927 15:06:17.193882 1562 rpcz_store.cc:276] 0927 15:06:12.586369 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.586421 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:17.147147 (+4560726us) ts_tablet_manager.cc:1145] Deleting tablet 80a8563c77484a1ebbbe7dab9a652aeb
0927 15:06:17.147157 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.169565 (+ 22408us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.172611 (+ 3046us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.193649 (+ 21038us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4560548}
I20260927 15:06:17.194572 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 80a8563c77484a1ebbbe7dab9a652aeb (table default.Table_60ea7e4921ff40728d6a8b84c9b494c8 [id=f76efa8048524aa9a343ed0912a15500]) successfully deleted
I20260927 15:06:17.195022 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 778) took 4594 ms. Trace:
I20260927 15:06:17.195115 1562 rpcz_store.cc:276] 0927 15:06:12.600801 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.601343 (+ 542us) service_pool.cc:227] Handling call
0927 15:06:17.194868 (+4593525us) ts_tablet_manager.cc:1145] Deleting tablet 6f3bdfede5744513aeadb22da73b6f8a
0927 15:06:17.194883 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.195003 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4593304}
W20260927 15:06:17.195624 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6f3bdfede5744513aeadb22da73b6f8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f3bdfede5744513aeadb22da73b6f8a already in progress: creating tablet
I20260927 15:06:17.196738 1561 tablet_bootstrap.cc:492] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.196871 1561 ts_tablet_manager.cc:1397] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.005s
I20260927 15:06:17.197830 1561 raft_consensus.cc:348] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.198092 1561 raft_consensus.cc:374] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.198159 1561 raft_consensus.cc:729] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.198442 1561 consensus_queue.cc:260] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.199107 1561 ts_tablet_manager.cc:1428] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260927 15:06:17.199404 1561 tablet_bootstrap.cc:492] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.198943 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:17.201701 1561 tablet_bootstrap.cc:654] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.202893 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 779) took 4601 ms. Trace:
I20260927 15:06:17.203074 1562 rpcz_store.cc:276] 0927 15:06:12.600974 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.601579 (+ 605us) service_pool.cc:227] Handling call
0927 15:06:17.202695 (+4601116us) ts_tablet_manager.cc:1145] Deleting tablet 95c8178680ea4b6b8794150188320ea9
0927 15:06:17.202707 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.202868 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4600979}
W20260927 15:06:17.203708 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 95c8178680ea4b6b8794150188320ea9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95c8178680ea4b6b8794150188320ea9 already in progress: creating tablet
I20260927 15:06:17.204094 1562 tablet_replica.cc:330] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.205523 1562 raft_consensus.cc:2229] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.205747 1562 raft_consensus.cc:2258] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.206946 1562 ts_tablet_manager.cc:1905] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.208137 905 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_c33713f5f5d841b1a1f9e687db26c2e6 [id=06ca630052694f10aebe6f8b7aaa81d9] alter complete (version 1)
I20260927 15:06:17.208700 2369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260927 15:06:17.210084 2369 hybrid_clock.cc:648] HybridClock initialized: now 1790521577209976 us; error 81 us; skew 500 ppm
I20260927 15:06:17.210726 2369 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260927 15:06:17.209416 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet d4f05da432f041378c5ab808536e6b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.216959 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_792cb69ae8ff4b6597aea2d034ef5ede"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.217705 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_792cb69ae8ff4b6597aea2d034ef5ede in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.221092 2742 raft_consensus.cc:482] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.221240 2742 raft_consensus.cc:504] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.221874 2742 leader_election.cc:288] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.222433 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d463a481cb8c4243961e9b0d2b11822c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:17.223030 1374 leader_election.cc:341] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.224787 1561 tablet_bootstrap.cc:492] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.224920 1561 ts_tablet_manager.cc:1397] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.001s
I20260927 15:06:17.225723 1562 ts_tablet_manager.cc:1918] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:17.225837 1562 log.cc:1196] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/6c73e813bb594a5e871718b73fe61fc9
I20260927 15:06:17.225776 1561 raft_consensus.cc:348] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.225972 1561 raft_consensus.cc:374] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.226039 1561 raft_consensus.cc:729] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.226148 1562 ts_tablet_manager.cc:1939] T 6c73e813bb594a5e871718b73fe61fc9 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.226253 1561 consensus_queue.cc:260] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.226760 1561 ts_tablet_manager.cc:1428] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:17.227043 1561 tablet_bootstrap.cc:492] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.228509 1561 tablet_bootstrap.cc:654] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.231103 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.234499 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 780) took 4561 ms. Trace:
I20260927 15:06:17.235549 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 831) took 3823 ms. Trace:
I20260927 15:06:17.235646 2233 rpcz_store.cc:276] 0927 15:06:13.411823 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.412690 (+ 867us) service_pool.cc:227] Handling call
0927 15:06:16.866091 (+3453401us) ts_tablet_manager.cc:1145] Deleting tablet 0f4cff4a06db44269defca578af289d8
0927 15:06:16.866101 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.022305 (+156204us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.122182 (+ 99877us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.235528 (+113346us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11141,"tablet-delete.queue_time_us":3453179}
I20260927 15:06:17.236052 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 832) took 3823 ms. Trace:
I20260927 15:06:17.236130 2233 rpcz_store.cc:276] 0927 15:06:13.412082 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.412954 (+ 872us) service_pool.cc:227] Handling call
0927 15:06:17.235932 (+3822978us) ts_tablet_manager.cc:1145] Deleting tablet 8f2843bf6dbf4117b3f44cd39c328b99
0927 15:06:17.235943 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.236033 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3799238}
I20260927 15:06:17.236449 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 844) took 3596 ms. Trace:
I20260927 15:06:17.236519 2233 rpcz_store.cc:276] 0927 15:06:13.639857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.639907 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:17.236348 (+3596441us) ts_tablet_manager.cc:1145] Deleting tablet 3540982dd7544e60af6c153fc41a412c
0927 15:06:17.236357 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.236435 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3596284}
I20260927 15:06:17.236799 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 833) took 3676 ms. Trace:
I20260927 15:06:17.236819 1297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d463a481cb8c4243961e9b0d2b11822c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.236862 2233 rpcz_store.cc:276] 0927 15:06:13.560524 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.560578 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:17.236709 (+3676131us) ts_tablet_manager.cc:1145] Deleting tablet b5ee2d7382d647cba4f3d55098e437c7
0927 15:06:17.236719 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.236786 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3596166}
I20260927 15:06:17.237073 2233 tablet_replica.cc:330] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:17.237293 2233 raft_consensus.cc:2229] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.237498 2233 raft_consensus.cc:2258] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:17.237762 1376 leader_election.cc:341] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.237865 1376 leader_election.cc:302] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.237998 2233 ts_tablet_manager.cc:1905] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.238184 2742 raft_consensus.cc:2726] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:17.238405 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8eeb4f55d0c6431cb1cff629cced4562 consensus state has no leader
I20260927 15:06:17.239048 1556 tablet_bootstrap.cc:492] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:17.239974 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d9562d917b74db9aa4a9678b9d32841 consensus state has no leader
I20260927 15:06:17.240691 1556 tablet_bootstrap.cc:654] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.241355 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541147938d864cd9ad7208d96533b0f4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.241621 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet e1770acc612f4924ba62ee20767a31c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ca7b6f8953e4429a5b8fe4ccc3e1837) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.241775 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 0129eaa5636544e696076e439d713b1b with delete_type TABLET_DATA_DELETED (replaced by tablet 7fd8311955974e1cbcdda1961c318588) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.241788 906 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 98d01c884edf41948027e083f1f29651
I20260927 15:06:17.241855 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 547f5f0f1d444f348cf7efbbdf95523c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.241928 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f05da432f041378c5ab808536e6b6f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.242637 1102 leader_election.cc:341] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:17.242951 1376 leader_election.cc:341] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.243047 1376 leader_election.cc:302] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.243412 2742 raft_consensus.cc:2726] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.247071 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 0f4cff4a06db44269defca578af289d8 (table default.Table_1b1639fc47724907a79f94e34f6b9469 [id=8be5c577dcb3490d883bede28c6b73ea]) successfully deleted
W20260927 15:06:17.247390 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8f2843bf6dbf4117b3f44cd39c328b99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f2843bf6dbf4117b3f44cd39c328b99 already in progress: creating tablet
W20260927 15:06:17.247709 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3540982dd7544e60af6c153fc41a412c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3540982dd7544e60af6c153fc41a412c already in progress: creating tablet
W20260927 15:06:17.247961 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b5ee2d7382d647cba4f3d55098e437c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ee2d7382d647cba4f3d55098e437c7 already in progress: creating tablet
I20260927 15:06:17.249854 913 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet ed65552c0627441db266612397e211a2
I20260927 15:06:17.252132 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 80a8563c77484a1ebbbe7dab9a652aeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.252346 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a48e08f69a4727924d006dc19b6ed1 with delete_type TABLET_DATA_DELETED (replaced by tablet 98d01c884edf41948027e083f1f29651) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.252847 1552 tablet_bootstrap.cc:654] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.256273 2233 ts_tablet_manager.cc:1918] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 15:06:17.258244 2233 log.cc:1196] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/f88b401dc12e451c80abe1b509e2b532
I20260927 15:06:17.259528 2233 ts_tablet_manager.cc:1939] T f88b401dc12e451c80abe1b509e2b532 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:17.260749 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet d9fecfb2325046f98e69797ff8342892
I20260927 15:06:17.261893 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fecfb2325046f98e69797ff8342892 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.262023 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fecfb2325046f98e69797ff8342892 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.262379 2119 ts_tablet_manager.cc:1918] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.262509 2119 log.cc:1196] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/434e9390f1fd4a3ebb65924c37b85bd4
I20260927 15:06:17.262617 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fecfb2325046f98e69797ff8342892 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.263378 2119 ts_tablet_manager.cc:1939] T 434e9390f1fd4a3ebb65924c37b85bd4 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:17.263675 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 897) took 1059 ms. Trace:
I20260927 15:06:17.263765 2119 rpcz_store.cc:276] 0927 15:06:16.204636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.204680 (+ 44us) service_pool.cc:227] Handling call
0927 15:06:17.043619 (+838939us) ts_tablet_manager.cc:1145] Deleting tablet 434e9390f1fd4a3ebb65924c37b85bd4
0927 15:06:17.043625 (+ 6us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.103137 (+ 59512us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.255475 (+152338us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.263662 (+ 8187us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":838796}
I20260927 15:06:17.264305 2119 tablet_replica.cc:330] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:17.264480 2119 raft_consensus.cc:2229] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.264683 2119 pending_rounds.cc:62] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:17.264737 2119 pending_rounds.cc:68] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976376715104256 op_type: NO_OP noop_request { }
I20260927 15:06:17.264848 2119 raft_consensus.cc:2866] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:17.264968 2119 raft_consensus.cc:2258] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.265288 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 434e9390f1fd4a3ebb65924c37b85bd4 (table default.Table_53f5b1728e4947fca524ecea11ae3d37 [id=fe47ea48cef44035b7d9df3be08eabb1]) successfully deleted
I20260927 15:06:17.265610 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 9576d1a36d7547bf81faabe9c362e3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.268560 2119 ts_tablet_manager.cc:1905] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.270413 1298 raft_consensus.cc:3037] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.279712 2369 webserver.cc:460] Webserver started at http://127.0.201.60:39943/ using document root <none> and password file <none>
I20260927 15:06:17.281301 2369 fs_manager.cc:359] Metadata directory not provided
I20260927 15:06:17.282414 913 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:17.283780 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 834) took 3721 ms. Trace:
I20260927 15:06:17.284886 2233 rpcz_store.cc:276] 0927 15:06:13.562572 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.564949 (+ 2377us) service_pool.cc:227] Handling call
0927 15:06:17.237033 (+3672084us) ts_tablet_manager.cc:1145] Deleting tablet f88b401dc12e451c80abe1b509e2b532
0927 15:06:17.237041 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.245352 (+ 8311us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.256183 (+ 10831us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.283761 (+ 27578us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2394,"tablet-delete.queue_time_us":3596423}
I20260927 15:06:17.285691 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 835) took 3716 ms. Trace:
I20260927 15:06:17.286125 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f05da432f041378c5ab808536e6b6f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:17.286966 1438 raft_consensus.cc:2454] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:17.287374 2233 rpcz_store.cc:276] 0927 15:06:13.568930 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.568998 (+ 68us) service_pool.cc:227] Handling call
0927 15:06:17.285552 (+3716554us) ts_tablet_manager.cc:1145] Deleting tablet d9a3105b7cca4ac18b2c29c8b9dcda64
0927 15:06:17.285566 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.285671 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3644891}
I20260927 15:06:17.234638 1562 rpcz_store.cc:276] 0927 15:06:12.673833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.673888 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:17.204040 (+4530152us) ts_tablet_manager.cc:1145] Deleting tablet 6c73e813bb594a5e871718b73fe61fc9
0927 15:06:17.204053 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.214222 (+ 10169us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.225626 (+ 11404us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.234482 (+ 8856us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7634,"tablet-delete.queue_time_us":4529947}
I20260927 15:06:17.291671 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 839) took 3687 ms. Trace:
I20260927 15:06:17.291774 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 781) took 4546 ms. Trace:
I20260927 15:06:17.291909 1562 rpcz_store.cc:276] 0927 15:06:12.745107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:12.745194 (+ 87us) service_pool.cc:227] Handling call
0927 15:06:17.291655 (+4546461us) ts_tablet_manager.cc:1145] Deleting tablet 7fd8311955974e1cbcdda1961c318588
0927 15:06:17.291667 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.291754 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4546250}
I20260927 15:06:17.292029 2369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260927 15:06:17.292074 1099 consensus_peers.cc:487] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f88b401dc12e451c80abe1b509e2b532. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.292374 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 795) took 4153 ms. Trace:
I20260927 15:06:17.292506 1562 rpcz_store.cc:276] 0927 15:06:13.139314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.145694 (+ 6380us) service_pool.cc:227] Handling call
0927 15:06:17.292288 (+4146594us) ts_tablet_manager.cc:1145] Deleting tablet 1defd5bba3c34cae8893559ccfc8b5cd
0927 15:06:17.292297 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.292361 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4127114}
I20260927 15:06:17.292932 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 797) took 4116 ms. Trace:
I20260927 15:06:17.293159 1562 rpcz_store.cc:276] 0927 15:06:13.176451 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.178905 (+ 2454us) service_pool.cc:227] Handling call
0927 15:06:17.292846 (+4113941us) ts_tablet_manager.cc:1145] Deleting tablet 79a3125723034cb48bc1a05fc4abbb82
0927 15:06:17.292854 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.292920 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4113597}
I20260927 15:06:17.293720 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 799) took 4068 ms. Trace:
I20260927 15:06:17.293929 1562 rpcz_store.cc:276] 0927 15:06:13.225204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.226921 (+ 1717us) service_pool.cc:227] Handling call
0927 15:06:17.293591 (+4066670us) ts_tablet_manager.cc:1145] Deleting tablet 0e34a679010b4b4fa3a76aec5ae05db4
0927 15:06:17.293603 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.293703 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4066478}
I20260927 15:06:17.295586 1552 tablet_bootstrap.cc:492] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:17.296409 1552 ts_tablet_manager.cc:1397] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.189s user 0.003s sys 0.007s
I20260927 15:06:17.297734 1552 raft_consensus.cc:348] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.297992 1552 raft_consensus.cc:374] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.298079 1552 raft_consensus.cc:729] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.285823 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_d10e6eb8078c475abd696473005670a3 [id=c4ddc66927a94fd2abc8e44012cf69f7]) successfully deleted
I20260927 15:06:17.291297 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 6c73e813bb594a5e871718b73fe61fc9 (table default.Table_00334dfc32284d7fbda19999dd7ad94f [id=a5be5daa955846b58970402702de73f9]) successfully deleted
W20260927 15:06:17.298493 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet d9a3105b7cca4ac18b2c29c8b9dcda64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9a3105b7cca4ac18b2c29c8b9dcda64 already in progress: creating tablet
W20260927 15:06:17.298593 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 7fd8311955974e1cbcdda1961c318588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fd8311955974e1cbcdda1961c318588 already in progress: creating tablet
W20260927 15:06:17.298816 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1defd5bba3c34cae8893559ccfc8b5cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1defd5bba3c34cae8893559ccfc8b5cd already in progress: creating tablet
W20260927 15:06:17.299064 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 79a3125723034cb48bc1a05fc4abbb82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79a3125723034cb48bc1a05fc4abbb82 already in progress: creating tablet
W20260927 15:06:17.299258 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0e34a679010b4b4fa3a76aec5ae05db4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e34a679010b4b4fa3a76aec5ae05db4 already in progress: creating tablet
I20260927 15:06:17.299538 2233 rpcz_store.cc:276] 0927 15:06:13.604238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.605229 (+ 991us) service_pool.cc:227] Handling call
0927 15:06:17.291547 (+3686318us) ts_tablet_manager.cc:1145] Deleting tablet 34308468f31444869011c61da58d30e8
0927 15:06:17.291559 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.291649 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3636614}
I20260927 15:06:17.300161 2119 ts_tablet_manager.cc:1918] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.300272 2119 log.cc:1196] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/0d4ca19b492c4df1b31c78f1629c50b5
I20260927 15:06:17.296298 1099 leader_election.cc:302] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:17.300271 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 34308468f31444869011c61da58d30e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34308468f31444869011c61da58d30e8 already in progress: creating tablet
I20260927 15:06:17.300560 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 841) took 3696 ms. Trace:
I20260927 15:06:17.300628 2119 ts_tablet_manager.cc:1939] T 0d4ca19b492c4df1b31c78f1629c50b5 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:17.300721 2365 raft_consensus.cc:2781] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.300661 2233 rpcz_store.cc:276] 0927 15:06:13.604403 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.605672 (+ 1269us) service_pool.cc:227] Handling call
0927 15:06:17.299977 (+3694305us) ts_tablet_manager.cc:1145] Deleting tablet 0ac2df48cabc467195f4986238519fb2
0927 15:06:17.300426 (+ 449us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.300541 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3641045}
I20260927 15:06:17.300796 2365 raft_consensus.cc:482] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.300865 2365 raft_consensus.cc:3037] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.301366 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 898) took 1059 ms. Trace:
I20260927 15:06:17.301440 2119 rpcz_store.cc:276] 0927 15:06:16.241818 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.241870 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:17.264264 (+1022394us) ts_tablet_manager.cc:1145] Deleting tablet 0d4ca19b492c4df1b31c78f1629c50b5
0927 15:06:17.264275 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.279866 (+ 15591us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.300064 (+ 20198us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.301344 (+ 1280us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1022229}
I20260927 15:06:17.301708 2119 tablet_replica.cc:330] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:17.301856 2119 raft_consensus.cc:2229] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.301977 2119 raft_consensus.cc:2258] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.302415 2119 ts_tablet_manager.cc:1905] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.303340 2365 raft_consensus.cc:504] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.299664 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 3efc44686be2407cbcdca61909301539 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:17.303946 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0ac2df48cabc467195f4986238519fb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ac2df48cabc467195f4986238519fb2 already in progress: creating tablet
I20260927 15:06:17.304836 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f05da432f041378c5ab808536e6b6f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:17.305286 1102 leader_election.cc:341] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.305467 2431 raft_consensus.cc:482] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.305557 2431 raft_consensus.cc:504] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.306011 2431 leader_election.cc:288] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.306406 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 850) took 3597 ms. Trace:
I20260927 15:06:17.306461 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d6bdc1ac004d889aac36db65afbbbe" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.306491 2233 rpcz_store.cc:276] 0927 15:06:13.709142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.709195 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:17.306282 (+3597087us) ts_tablet_manager.cc:1145] Deleting tablet 714f59ebe9cf4568a9aa4d5058200106
0927 15:06:17.306295 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.306386 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3596903}
W20260927 15:06:17.306896 1102 leader_election.cc:341] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:17.307451 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 714f59ebe9cf4568a9aa4d5058200106 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 714f59ebe9cf4568a9aa4d5058200106 already in progress: creating tablet
I20260927 15:06:17.307999 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 0d4ca19b492c4df1b31c78f1629c50b5 (table default.Table_4e02ea20ad894ef6b1ea82884cfdf529 [id=fb946e044fa149ebb52128ea5c3577a3]) successfully deleted
I20260927 15:06:17.303841 1561 tablet_bootstrap.cc:492] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.303861 2365 leader_election.cc:288] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.309937 1561 ts_tablet_manager.cc:1397] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.083s user 0.003s sys 0.000s
I20260927 15:06:17.300172 1552 consensus_queue.cc:260] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.310750 1561 raft_consensus.cc:348] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.311002 1561 raft_consensus.cc:374] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.311070 1561 raft_consensus.cc:729] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.311269 1561 consensus_queue.cc:260] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.317327 1561 ts_tablet_manager.cc:1428] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 15:06:17.317631 1561 tablet_bootstrap.cc:492] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.320529 1561 tablet_bootstrap.cc:654] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.322072 1552 ts_tablet_manager.cc:1428] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.026s user 0.000s sys 0.001s
I20260927 15:06:17.323927 2369 fs_manager.cc:709] Time spent opening directory manager: real 0.028s user 0.001s sys 0.003s
I20260927 15:06:17.326180 1552 tablet_bootstrap.cc:492] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:17.294920 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 798) took 4069 ms. Trace:
I20260927 15:06:17.329537 1552 tablet_bootstrap.cc:654] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.326805 1562 rpcz_store.cc:276] 0927 15:06:13.225088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.229990 (+ 4902us) service_pool.cc:227] Handling call
0927 15:06:17.294784 (+4064794us) ts_tablet_manager.cc:1145] Deleting tablet e7051277b0324331a28168eb387c770c
0927 15:06:17.294794 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.294905 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4064492}
W20260927 15:06:17.330066 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e7051277b0324331a28168eb387c770c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e7051277b0324331a28168eb387c770c already in progress: creating tablet
I20260927 15:06:17.330482 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 801) took 4015 ms. Trace:
I20260927 15:06:17.330593 1562 rpcz_store.cc:276] 0927 15:06:13.315465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.315903 (+ 438us) service_pool.cc:227] Handling call
0927 15:06:17.330392 (+4014489us) ts_tablet_manager.cc:1145] Deleting tablet 42baac8b7d47433e826eb3bc1980acaa
0927 15:06:17.330403 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.330466 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4014326}
W20260927 15:06:17.331059 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 42baac8b7d47433e826eb3bc1980acaa because the tablet was not found. No further retry: Not found: Tablet not found: 42baac8b7d47433e826eb3bc1980acaa
I20260927 15:06:17.331389 1562 tablet_replica.cc:330] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.331632 1562 raft_consensus.cc:2229] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.295910 2762 tablet.cc:1722] T 595c84453cd84c3bb5a4d444892bf5e6 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:17.299434 1556 tablet_bootstrap.cc:492] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.335325 1556 ts_tablet_manager.cc:1397] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.096s user 0.005s sys 0.004s
I20260927 15:06:17.336243 1556 raft_consensus.cc:348] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.336452 1556 raft_consensus.cc:374] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.336499 1556 raft_consensus.cc:729] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.336686 1556 consensus_queue.cc:260] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.337209 1556 ts_tablet_manager.cc:1428] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:17.337476 1556 tablet_bootstrap.cc:492] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.339200 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4294efdda96b4df0964d41be475b81a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.339519 1556 tablet_bootstrap.cc:654] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:17.343981 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4294efdda96b4df0964d41be475b81a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.350193 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c01ee9ea5ffc4f1788c1fdc2944d6170" } new_table_name: "default.Table_e7da400da0844237be49eb47322f6f64" modify_external_catalogs: true
I20260927 15:06:17.351058 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_188aafdea09e48319c0cdf8b390d1e3f" } modify_external_catalogs: true
I20260927 15:06:17.352389 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_188aafdea09e48319c0cdf8b390d1e3f" } modify_external_catalogs: true
I20260927 15:06:17.353971 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ea53750c96144ad8ae86526f847057aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.354509 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea53750c96144ad8ae86526f847057aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.355338 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5abc77ef4a9c4301a05fca21efd0c59d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.356034 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5abc77ef4a9c4301a05fca21efd0c59d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.357790 1556 tablet_bootstrap.cc:492] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.357993 1556 ts_tablet_manager.cc:1397] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
I20260927 15:06:17.358996 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1ea5ac72d6cf4e4fb24f58b2152fb8e8" } modify_external_catalogs: true
I20260927 15:06:17.359192 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1ea5ac72d6cf4e4fb24f58b2152fb8e8" } modify_external_catalogs: true
I20260927 15:06:17.359853 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_31dca477abed4b759a1ba843dc46238a" } new_table_name: "default.Table_1b7d8a5621484fb7bd0ca283901aaaf8" modify_external_catalogs: true
W20260927 15:06:17.346961 1102 consensus_peers.cc:487] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.357105 1561 tablet_bootstrap.cc:492] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.361675 1561 ts_tablet_manager.cc:1397] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.004s
I20260927 15:06:17.362054 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4038b63a0be146fdb47df34d335533ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.362401 1561 raft_consensus.cc:348] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.362582 1561 raft_consensus.cc:374] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:17.362576 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4038b63a0be146fdb47df34d335533ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.362443 1556 raft_consensus.cc:348] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.362625 1561 raft_consensus.cc:729] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.362672 1556 raft_consensus.cc:374] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.362728 1556 raft_consensus.cc:729] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.362816 1561 consensus_queue.cc:260] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.363011 1556 consensus_queue.cc:260] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.363412 1562 raft_consensus.cc:2258] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.363919 1562 ts_tablet_manager.cc:1905] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.364302 1556 ts_tablet_manager.cc:1428] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 15:06:17.364600 1556 tablet_bootstrap.cc:492] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.366499 1556 tablet_bootstrap.cc:654] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.345674 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 566aa5caa012443ea63fcb7389c8b7c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.369383 1561 ts_tablet_manager.cc:1428] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260927 15:06:17.372426 1556 tablet_bootstrap.cc:492] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.373091 1556 ts_tablet_manager.cc:1397] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260927 15:06:17.373755 1561 tablet_bootstrap.cc:492] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.375005 1556 raft_consensus.cc:348] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.375303 1561 tablet_bootstrap.cc:654] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.377051 2119 ts_tablet_manager.cc:1918] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:17.377163 2119 log.cc:1196] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/424b66c69254487f932894516d570204
I20260927 15:06:17.377440 2119 ts_tablet_manager.cc:1939] T 424b66c69254487f932894516d570204 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:17.377744 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 899) took 1106 ms. Trace:
I20260927 15:06:17.377826 2119 rpcz_store.cc:276] 0927 15:06:16.270944 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.270991 (+ 47us) service_pool.cc:227] Handling call
0927 15:06:17.301660 (+1030669us) ts_tablet_manager.cc:1145] Deleting tablet 424b66c69254487f932894516d570204
0927 15:06:17.301670 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.323553 (+ 21883us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.376958 (+ 53405us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.377730 (+ 772us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1030524}
I20260927 15:06:17.378147 2119 tablet_replica.cc:330] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:17.377892 1556 raft_consensus.cc:374] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.378295 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 424b66c69254487f932894516d570204 (table default.Table_af3d6c72bfa14a6d8f04be3fb4a72235 [id=45ff9a80d85b49fc8f74596b7f1dd1ca]) successfully deleted
I20260927 15:06:17.378338 2119 raft_consensus.cc:2229] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.378402 1556 raft_consensus.cc:729] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.378499 2119 raft_consensus.cc:2258] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:17.383729 2778 log.cc:924] Time spent T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: Append to log took a long time: real 0.088s user 0.000s sys 0.000s
I20260927 15:06:17.383980 1562 ts_tablet_manager.cc:1918] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:17.384086 1562 log.cc:1196] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/5c0d51b50b414721a255fdde2fe1732f
I20260927 15:06:17.384366 1562 ts_tablet_manager.cc:1939] T 5c0d51b50b414721a255fdde2fe1732f P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.386474 2119 ts_tablet_manager.cc:1905] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.389689 1561 tablet_bootstrap.cc:492] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.389825 1561 ts_tablet_manager.cc:1397] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260927 15:06:17.389850 910 master_service.cc:946] ReplaceTablet: received request to replace tablet fb2a8e788b71451da4a18f52b643e5e2 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:17.390512 1561 raft_consensus.cc:348] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.390714 1561 raft_consensus.cc:374] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.390766 1561 raft_consensus.cc:729] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.391038 1561 consensus_queue.cc:260] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.394642 1561 ts_tablet_manager.cc:1428] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:17.394928 1561 tablet_bootstrap.cc:492] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.402908 2783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260927 15:06:17.404141 1561 tablet_bootstrap.cc:654] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.405651 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 800) took 4086 ms. Trace:
I20260927 15:06:17.413779 1562 rpcz_store.cc:276] 0927 15:06:13.315311 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.320344 (+ 5033us) service_pool.cc:227] Handling call
0927 15:06:17.331347 (+4011003us) ts_tablet_manager.cc:1145] Deleting tablet 5c0d51b50b414721a255fdde2fe1732f
0927 15:06:17.331357 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.381024 (+ 49667us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.383902 (+ 2878us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.402067 (+ 18165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11408,"tablet-delete.queue_time_us":3996154}
I20260927 15:06:17.414300 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 802) took 4025 ms. Trace:
I20260927 15:06:17.414422 1562 rpcz_store.cc:276] 0927 15:06:13.389360 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.389426 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:17.414158 (+4024732us) ts_tablet_manager.cc:1145] Deleting tablet 8f2843bf6dbf4117b3f44cd39c328b99
0927 15:06:17.414168 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.414280 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4024386}
I20260927 15:06:17.414781 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 803) took 3862 ms. Trace:
I20260927 15:06:17.414922 1562 rpcz_store.cc:276] 0927 15:06:13.552664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.553036 (+ 372us) service_pool.cc:227] Handling call
0927 15:06:17.414687 (+3861651us) ts_tablet_manager.cc:1145] Deleting tablet b5ee2d7382d647cba4f3d55098e437c7
0927 15:06:17.414705 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.414768 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3861394}
I20260927 15:06:17.414996 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 5c0d51b50b414721a255fdde2fe1732f (table default.Table_52dfae347a16444d9d03a84c7a88721d [id=60be603d0c3844e8925f32c3553e8d56]) successfully deleted
I20260927 15:06:17.415167 1562 tablet_replica.cc:330] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.415406 1562 raft_consensus.cc:2229] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:06:17.415386 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8f2843bf6dbf4117b3f44cd39c328b99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f2843bf6dbf4117b3f44cd39c328b99 already in progress: creating tablet
I20260927 15:06:17.415686 1562 raft_consensus.cc:2258] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:17.415700 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b5ee2d7382d647cba4f3d55098e437c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ee2d7382d647cba4f3d55098e437c7 already in progress: creating tablet
I20260927 15:06:17.416205 1562 ts_tablet_manager.cc:1905] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.423353 2119 ts_tablet_manager.cc:1918] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:17.423484 2119 log.cc:1196] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/cad4605da5e045e7969da2d6f56a7e70
I20260927 15:06:17.423859 2119 ts_tablet_manager.cc:1939] T cad4605da5e045e7969da2d6f56a7e70 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:17.424302 2119 tablet_replica.cc:330] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:17.424466 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet cad4605da5e045e7969da2d6f56a7e70 (table default.Table_dd8f1d71fa7d4665b96954a6d766c9ce [id=672533238895472b9bfb06706e4b41bb]) successfully deleted
I20260927 15:06:17.424494 2119 raft_consensus.cc:2229] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.424639 2119 raft_consensus.cc:2258] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.425257 2119 ts_tablet_manager.cc:1905] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.427816 1561 tablet_bootstrap.cc:492] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
W20260927 15:06:17.427806 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da8d5ee1ed414a94b9c2f5c7edfcaffa has no consensus state
I20260927 15:06:17.428016 1561 ts_tablet_manager.cc:1397] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.006s
I20260927 15:06:17.428360 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_042148816cc64c47b850ec48a69b9eb1" } new_table_name: "default.Table_759abb041bb145f8957dce2f2b9a7cbe" modify_external_catalogs: true
I20260927 15:06:17.428789 1561 raft_consensus.cc:348] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.429090 1561 raft_consensus.cc:374] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.429143 1561 raft_consensus.cc:729] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.429371 1561 consensus_queue.cc:260] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.429894 1561 ts_tablet_manager.cc:1428] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:17.430099 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9a695b4fd5294f32a6644154487c1486
I20260927 15:06:17.430155 1561 tablet_bootstrap.cc:492] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.430732 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3d9fa71f47d84da197dfc19b5e479d1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.431360 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d9fa71f47d84da197dfc19b5e479d1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.432722 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b468e75aff2a4632ae34f00837213565"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.433173 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b468e75aff2a4632ae34f00837213565 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.434917 1561 tablet_bootstrap.cc:654] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.434888 2369 fs_manager.cc:725] Time spent opening block manager: real 0.109s user 0.005s sys 0.004s
I20260927 15:06:17.434937 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 51f0744f9d804b84a958916c2dd04503 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:17.435325 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d83cf0b359b45299f5cdebdc7dee7d4 consensus state has no leader
I20260927 15:06:17.435691 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b6288d683c3e4dc6bdf763e1f6431234"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.436128 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6288d683c3e4dc6bdf763e1f6431234 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.435091 2369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data,/tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
uuid: "2a122de3662f485f8f44b0a5e4b29862"
format_stamp: "Formatted at 2026-09-27 15:05:53 on dist-test-slave-65dj"
I20260927 15:06:17.436523 2369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260927 15:06:17.440814 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a695b4fd5294f32a6644154487c1486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.441530 1552 tablet_bootstrap.cc:492] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:17.441655 1552 ts_tablet_manager.cc:1397] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.116s user 0.002s sys 0.001s
I20260927 15:06:17.378620 1556 consensus_queue.cc:260] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:17.384650 1373 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.201.62:41167, user_credentials={real_user=slave}} blocked reactor thread for 85307us
I20260927 15:06:17.389143 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 851) took 3649 ms. Trace:
I20260927 15:06:17.443689 2233 rpcz_store.cc:276] 0927 15:06:13.740149 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.740225 (+ 76us) service_pool.cc:227] Handling call
0927 15:06:17.388981 (+3648756us) ts_tablet_manager.cc:1145] Deleting tablet e2c276b721a74822a5275c5924de20b6
0927 15:06:17.388998 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.389117 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3648559}
I20260927 15:06:17.444092 2233 tablet_replica.cc:330] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:17.444324 2233 raft_consensus.cc:2229] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.444538 2233 raft_consensus.cc:2258] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.445151 2233 ts_tablet_manager.cc:1905] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.447134 1562 ts_tablet_manager.cc:1918] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 15:06:17.447237 1562 log.cc:1196] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/f88b401dc12e451c80abe1b509e2b532
I20260927 15:06:17.404911 2742 raft_consensus.cc:482] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.447381 2742 raft_consensus.cc:504] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.447584 1562 ts_tablet_manager.cc:1939] T f88b401dc12e451c80abe1b509e2b532 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.447989 2742 leader_election.cc:288] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.448282 1561 tablet_bootstrap.cc:492] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.448396 1561 ts_tablet_manager.cc:1397] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260927 15:06:17.448496 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e8e0487c58624bf591f79173d0ffcc48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.448782 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63fbd388210d4a1aabfcf27c7533efbf" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:17.449074 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8e0487c58624bf591f79173d0ffcc48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.449060 1561 raft_consensus.cc:348] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.449342 1561 raft_consensus.cc:374] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.449385 1561 raft_consensus.cc:729] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
W20260927 15:06:17.449651 1374 leader_election.cc:341] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.449534 1561 consensus_queue.cc:260] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.450585 1561 ts_tablet_manager.cc:1428] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:17.451926 1561 tablet_bootstrap.cc:492] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.452621 2119 ts_tablet_manager.cc:1918] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:17.452756 2119 log.cc:1196] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/9049d003d787403f80aa0c08872dd3b5
I20260927 15:06:17.453066 2119 ts_tablet_manager.cc:1939] T 9049d003d787403f80aa0c08872dd3b5 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:17.453620 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 9049d003d787403f80aa0c08872dd3b5 (table default.Table_75127a34541e4a979aace6aa029d396e [id=67ad7f9c36834f09a601dbf2841ebc48]) successfully deleted
I20260927 15:06:17.454375 1561 tablet_bootstrap.cc:654] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.455706 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63fbd388210d4a1aabfcf27c7533efbf" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.459633 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a695b4fd5294f32a6644154487c1486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.448297 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 804) took 3888 ms. Trace:
I20260927 15:06:17.463902 1562 rpcz_store.cc:276] 0927 15:06:13.560073 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.560146 (+ 73us) service_pool.cc:227] Handling call
0927 15:06:17.415132 (+3854986us) ts_tablet_manager.cc:1145] Deleting tablet f88b401dc12e451c80abe1b509e2b532
0927 15:06:17.415140 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.442744 (+ 27604us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.447044 (+ 4300us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.448281 (+ 1237us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3854750}
W20260927 15:06:17.464385 1102 consensus_peers.cc:487] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.465106 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet f88b401dc12e451c80abe1b509e2b532 (table default.Table_d10e6eb8078c475abd696473005670a3 [id=c4ddc66927a94fd2abc8e44012cf69f7]) successfully deleted
I20260927 15:06:17.464380 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 805) took 3899 ms. Trace:
I20260927 15:06:17.465269 1562 rpcz_store.cc:276] 0927 15:06:13.564764 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.564833 (+ 69us) service_pool.cc:227] Handling call
0927 15:06:17.464266 (+3899433us) ts_tablet_manager.cc:1145] Deleting tablet d9a3105b7cca4ac18b2c29c8b9dcda64
0927 15:06:17.464278 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.464363 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3899188}
I20260927 15:06:17.465385 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f05da432f041378c5ab808536e6b6f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:17.465569 1435 raft_consensus.cc:3037] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.465689 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 809) took 3863 ms. Trace:
I20260927 15:06:17.465803 1562 rpcz_store.cc:276] 0927 15:06:13.602683 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.602736 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:17.465597 (+3862861us) ts_tablet_manager.cc:1145] Deleting tablet 34308468f31444869011c61da58d30e8
0927 15:06:17.465606 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.465673 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3862623}
I20260927 15:06:17.466246 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 811) took 3862 ms. Trace:
I20260927 15:06:17.466323 1562 rpcz_store.cc:276] 0927 15:06:13.603675 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.603721 (+ 46us) service_pool.cc:227] Handling call
0927 15:06:17.466170 (+3862449us) ts_tablet_manager.cc:1145] Deleting tablet 0ac2df48cabc467195f4986238519fb2
0927 15:06:17.466179 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.466235 (+ 56us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3862293}
W20260927 15:06:17.467113 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet d9a3105b7cca4ac18b2c29c8b9dcda64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9a3105b7cca4ac18b2c29c8b9dcda64 already in progress: creating tablet
I20260927 15:06:17.467319 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 814) took 3808 ms. Trace:
I20260927 15:06:17.467386 1562 rpcz_store.cc:276] 0927 15:06:13.659172 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.659698 (+ 526us) service_pool.cc:227] Handling call
0927 15:06:17.467230 (+3807532us) ts_tablet_manager.cc:1145] Deleting tablet 3540982dd7544e60af6c153fc41a412c
0927 15:06:17.467239 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.467304 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3807326}
W20260927 15:06:17.467782 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.62:41167, user_credentials={real_user=slave}} blocked reactor thread for 44432.8us
W20260927 15:06:17.468163 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1d25749db81f4631bbc1e5581bcc666e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d25749db81f4631bbc1e5581bcc666e already in progress: creating tablet
I20260927 15:06:17.468242 1435 raft_consensus.cc:2454] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:17.468173 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 34308468f31444869011c61da58d30e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34308468f31444869011c61da58d30e8 already in progress: creating tablet
I20260927 15:06:17.468503 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d6bdc1ac004d889aac36db65afbbbe" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:17.468676 1438 raft_consensus.cc:2454] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:17.468690 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 476d3f3762a04acaa10f7b910984bec7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 476d3f3762a04acaa10f7b910984bec7 already in progress: creating tablet
I20260927 15:06:17.469102 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 820) took 3773 ms. Trace:
I20260927 15:06:17.469170 1562 rpcz_store.cc:276] 0927 15:06:13.695697 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.695751 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:17.469014 (+3773263us) ts_tablet_manager.cc:1145] Deleting tablet 714f59ebe9cf4568a9aa4d5058200106
0927 15:06:17.469023 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.469088 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3773035}
W20260927 15:06:17.469532 1099 consensus_peers.cc:487] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb859b43634c420382da5c201ce24dfc. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:17.470019 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 917b445477c4403980f2fdfeaeab0854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 917b445477c4403980f2fdfeaeab0854 already in progress: creating tablet
I20260927 15:06:17.470638 1099 leader_election.cc:302] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:17.470669 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 5ca21f240d8d4252b9cf0355c69f7166 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ca21f240d8d4252b9cf0355c69f7166 already in progress: creating tablet
I20260927 15:06:17.470881 2431 raft_consensus.cc:2781] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:17.470985 1562 tablet_replica.cc:330] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.471081 1099 leader_election.cc:302] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.471154 1562 raft_consensus.cc:2229] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.470992 2431 raft_consensus.cc:686] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:17.471406 2568 raft_consensus.cc:2781] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.471458 2568 raft_consensus.cc:482] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.471514 2568 raft_consensus.cc:3037] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.471483 2431 consensus_queue.cc:237] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:17.472888 1376 leader_election.cc:341] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.473063 1376 leader_election.cc:302] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.473513 2742 raft_consensus.cc:2726] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:17.468765 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0ac2df48cabc467195f4986238519fb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ac2df48cabc467195f4986238519fb2 already in progress: creating tablet
W20260927 15:06:17.474154 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 3540982dd7544e60af6c153fc41a412c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3540982dd7544e60af6c153fc41a412c already in progress: creating tablet
W20260927 15:06:17.474432 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 714f59ebe9cf4568a9aa4d5058200106 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 714f59ebe9cf4568a9aa4d5058200106 already in progress: creating tablet
I20260927 15:06:17.474527 2568 raft_consensus.cc:504] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.476315 2568 leader_election.cc:288] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.476286 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d6bdc1ac004d889aac36db65afbbbe" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:17.476814 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58d6bdc1ac004d889aac36db65afbbbe" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
W20260927 15:06:17.476850 1102 leader_election.cc:341] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.476979 1438 raft_consensus.cc:3037] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:17.477607 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 611e63080dcb474c8dde370c54a0e777 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 611e63080dcb474c8dde370c54a0e777 already in progress: creating tablet
W20260927 15:06:17.478219 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e67cf0526f3c45718312508b306d7089 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e67cf0526f3c45718312508b306d7089 already in progress: creating tablet
I20260927 15:06:17.478499 1562 pending_rounds.cc:62] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:17.478554 1562 pending_rounds.cc:68] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976368306786304 op_type: NO_OP noop_request { }
I20260927 15:06:17.478677 1562 raft_consensus.cc:2866] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:17.478785 1562 raft_consensus.cc:2258] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:17.479565 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e1770acc612f4924ba62ee20767a31c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1770acc612f4924ba62ee20767a31c1 already in progress: creating tablet
I20260927 15:06:17.479848 1438 raft_consensus.cc:2454] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:17.479911 2119 tablet_replica.cc:330] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:17.480661 1562 ts_tablet_manager.cc:1905] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.480794 1099 leader_election.cc:302] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.481336 2568 raft_consensus.cc:2781] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:17.481448 2568 raft_consensus.cc:686] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:17.481629 2568 consensus_queue.cc:237] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.481915 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a695b4fd5294f32a6644154487c1486 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.485966 2365 raft_consensus.cc:482] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.486076 2365 raft_consensus.cc:504] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.486553 2365 leader_election.cc:288] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.486776 1562 ts_tablet_manager.cc:1918] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.486889 1562 log.cc:1196] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/04007cd4bd214b88a4664e23daf4b790
I20260927 15:06:17.487119 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3939bfd903d42e9bfaaf6ecdf50b8d4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.487236 1562 ts_tablet_manager.cc:1939] T 04007cd4bd214b88a4664e23daf4b790 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:06:17.487607 1102 leader_election.cc:341] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.491108 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3939bfd903d42e9bfaaf6ecdf50b8d4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:17.491326 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e2c276b721a74822a5275c5924de20b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2c276b721a74822a5275c5924de20b6 already in progress: creating tablet
I20260927 15:06:17.491379 1438 raft_consensus.cc:2454] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:17.491745 1099 leader_election.cc:302] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.491956 2431 raft_consensus.cc:2781] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.492075 2431 raft_consensus.cc:482] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.492180 2431 raft_consensus.cc:3037] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.494551 2233 ts_tablet_manager.cc:1918] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:06:17.494679 2233 log.cc:1196] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/9a7989e2b91044dab1d3e327958a051a
I20260927 15:06:17.494921 2431 raft_consensus.cc:504] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.495071 2233 ts_tablet_manager.cc:1939] T 9a7989e2b91044dab1d3e327958a051a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:17.495824 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3939bfd903d42e9bfaaf6ecdf50b8d4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:17.496261 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 852) took 3671 ms. Trace:
W20260927 15:06:17.496287 1102 leader_election.cc:341] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.496408 2233 rpcz_store.cc:276] 0927 15:06:13.824334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.824401 (+ 67us) service_pool.cc:227] Handling call
0927 15:06:17.444030 (+3619629us) ts_tablet_manager.cc:1145] Deleting tablet 9a7989e2b91044dab1d3e327958a051a
0927 15:06:17.444046 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.454417 (+ 10371us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.494457 (+ 40040us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.496244 (+ 1787us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3619445}
I20260927 15:06:17.496533 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fb2a8e788b71451da4a18f52b643e5e2
I20260927 15:06:17.496572 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3939bfd903d42e9bfaaf6ecdf50b8d4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:17.496699 2431 leader_election.cc:288] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.496853 1438 raft_consensus.cc:3037] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.496951 910 catalog_manager.cc:6565] ReplaceTablet: tablet fb2a8e788b71451da4a18f52b643e5e2 deleted and replaced by tablet 8d6f44391d6147ddb221c35205a2c335
I20260927 15:06:17.497339 2119 raft_consensus.cc:2229] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.497537 2119 raft_consensus.cc:2258] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.497735 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_13065d568bf54acfb39a7faea9986554"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.498301 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13065d568bf54acfb39a7faea9986554 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:17.499042 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 048a1713b6054024959a9bdc245f71a4 consensus state has no leader
I20260927 15:06:17.499459 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c83fd3da9f48466c93f466016033cd56" } new_table_name: "default.Table_515f136ead0e4616b67cf687feeb61d8" modify_external_catalogs: true
I20260927 15:06:17.500304 2119 ts_tablet_manager.cc:1905] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.500996 1438 raft_consensus.cc:2454] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:17.439780 2789 raft_consensus.cc:482] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.501219 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d0c335be286f4131aa7cf4428ffa5c5c" } new_table_name: "default.Table_8736d1567dfd4f92bb69b6323fc1bf39" modify_external_catalogs: true
I20260927 15:06:17.501243 2789 raft_consensus.cc:504] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.501353 1099 leader_election.cc:302] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.501592 2568 raft_consensus.cc:2781] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:17.501706 2568 raft_consensus.cc:686] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:17.502602 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a07263485f554aceb3f5fd8f1ef8d033" } modify_external_catalogs: true
I20260927 15:06:17.501929 2568 consensus_queue.cc:237] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.503235 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9e1c88622f89474285f6bdb98faffffb" } modify_external_catalogs: true
I20260927 15:06:17.503412 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9e1c88622f89474285f6bdb98faffffb" } modify_external_catalogs: true
I20260927 15:06:17.504032 2431 raft_consensus.cc:482] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.504176 2431 raft_consensus.cc:504] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.504822 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ab505d59db4043ba95787c44da9d494f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.505041 2431 leader_election.cc:288] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.505098 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d7670381b49bb927943b2ee920c84" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:17.505086 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d7670381b49bb927943b2ee920c84" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.505261 1435 raft_consensus.cc:2454] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:17.505402 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab505d59db4043ba95787c44da9d494f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:17.505501 1102 leader_election.cc:341] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.505606 1102 leader_election.cc:302] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.506263 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75645963963e4091af0edfcbc794fb2d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:17.506327 2431 raft_consensus.cc:2781] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.506421 2431 raft_consensus.cc:482] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.506498 2431 raft_consensus.cc:3037] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:17.506755 1374 leader_election.cc:341] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.507471 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75645963963e4091af0edfcbc794fb2d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.508160 1376 leader_election.cc:341] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.508270 1376 leader_election.cc:302] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.508832 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 822) took 3785 ms. Trace:
I20260927 15:06:17.508904 1562 rpcz_store.cc:276] 0927 15:06:13.723423 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.723767 (+ 344us) service_pool.cc:227] Handling call
0927 15:06:17.470946 (+3747179us) ts_tablet_manager.cc:1145] Deleting tablet 04007cd4bd214b88a4664e23daf4b790
0927 15:06:17.470957 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.484111 (+ 13154us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.486691 (+ 2580us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.508814 (+ 22123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3746940}
I20260927 15:06:17.509212 2431 raft_consensus.cc:504] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.510130 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d7670381b49bb927943b2ee920c84" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:17.510609 1102 leader_election.cc:341] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.510931 1562 tablet_replica.cc:330] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.511094 1562 raft_consensus.cc:2229] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.511169 2791 raft_consensus.cc:482] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.511379 1562 raft_consensus.cc:2258] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.511274 2791 raft_consensus.cc:504] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.512118 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf68ba5020446bf8b522ac6db0e21e7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:17.512459 2791 leader_election.cc:288] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:17.512645 1374 leader_election.cc:341] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.513823 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf68ba5020446bf8b522ac6db0e21e7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.514348 1376 leader_election.cc:341] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.514467 1376 leader_election.cc:302] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.502774 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a07263485f554aceb3f5fd8f1ef8d033" } modify_external_catalogs: true
I20260927 15:06:17.514788 2791 raft_consensus.cc:2726] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.515112 2791 raft_consensus.cc:2726] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.515841 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet fb2a8e788b71451da4a18f52b643e5e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d6f44391d6147ddb221c35205a2c335) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.516026 1562 ts_tablet_manager.cc:1905] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.516484 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d7670381b49bb927943b2ee920c84" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:17.516634 1438 raft_consensus.cc:3037] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.517822 2431 leader_election.cc:288] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.520015 1556 ts_tablet_manager.cc:1428] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.147s user 0.002s sys 0.000s
I20260927 15:06:17.520464 1556 tablet_bootstrap.cc:492] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.522150 1556 tablet_bootstrap.cc:654] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.523742 1438 raft_consensus.cc:2454] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:17.527084 1099 leader_election.cc:302] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.527556 2431 raft_consensus.cc:2781] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:17.527742 2431 raft_consensus.cc:686] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:17.528016 2789 leader_election.cc:288] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.528568 2431 consensus_queue.cc:237] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.529435 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet fb2a8e788b71451da4a18f52b643e5e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d6f44391d6147ddb221c35205a2c335) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.530944 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 858) took 3653 ms. Trace:
I20260927 15:06:17.531081 2233 rpcz_store.cc:276] 0927 15:06:13.877082 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.877223 (+ 141us) service_pool.cc:227] Handling call
0927 15:06:17.530796 (+3653573us) ts_tablet_manager.cc:1145] Deleting tablet 1a05574f0f734e6d912b375137482a21
0927 15:06:17.530810 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.530926 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3653314}
I20260927 15:06:17.531458 1562 ts_tablet_manager.cc:1918] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.531486 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 04007cd4bd214b88a4664e23daf4b790 (table default.Table_1363eb0bffb8454a9bfbc067762dad9c [id=ff900aafe4f94663a9633fc0fbec0a06]) successfully deleted
I20260927 15:06:17.531560 1562 log.cc:1196] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/434e9390f1fd4a3ebb65924c37b85bd4
I20260927 15:06:17.531710 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 859) took 3654 ms. Trace:
I20260927 15:06:17.531826 2233 rpcz_store.cc:276] 0927 15:06:13.877223 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.877285 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:17.531591 (+3654306us) ts_tablet_manager.cc:1145] Deleting tablet 29c5d4cfb0d84d30896c0c7913c4d82b
0927 15:06:17.531605 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.531695 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3654062}
I20260927 15:06:17.531927 1562 ts_tablet_manager.cc:1939] T 434e9390f1fd4a3ebb65924c37b85bd4 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.532263 2233 tablet_replica.cc:330] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:17.532506 2233 raft_consensus.cc:2229] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.532655 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 823) took 3809 ms. Trace:
I20260927 15:06:17.532691 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet fb2a8e788b71451da4a18f52b643e5e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d6f44391d6147ddb221c35205a2c335) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.532717 2233 raft_consensus.cc:2258] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.532744 1562 rpcz_store.cc:276] 0927 15:06:13.723504 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.724035 (+ 531us) service_pool.cc:227] Handling call
0927 15:06:17.510889 (+3786854us) ts_tablet_manager.cc:1145] Deleting tablet 434e9390f1fd4a3ebb65924c37b85bd4
0927 15:06:17.510900 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.523213 (+ 12313us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.531369 (+ 8156us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.532637 (+ 1268us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3786720}
I20260927 15:06:17.533138 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 434e9390f1fd4a3ebb65924c37b85bd4 (table default.Table_53f5b1728e4947fca524ecea11ae3d37 [id=fe47ea48cef44035b7d9df3be08eabb1]) successfully deleted
I20260927 15:06:17.533427 2233 ts_tablet_manager.cc:1905] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.535260 2119 ts_tablet_manager.cc:1918] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.535372 2119 log.cc:1196] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/0129eaa5636544e696076e439d713b1b
I20260927 15:06:17.535712 2119 ts_tablet_manager.cc:1939] T 0129eaa5636544e696076e439d713b1b P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:17.536649 1099 consensus_peers.cc:487] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 033e71f60c3e47fd9647db090d4d6cd5. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.537302 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 0129eaa5636544e696076e439d713b1b (table default.Table_0393b69c63dc4c42b67201f634d5c6fa [id=3d369788b9e44a0b9befbbb44303d24e]) successfully deleted
W20260927 15:06:17.538021 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 547f5f0f1d444f348cf7efbbdf95523c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 547f5f0f1d444f348cf7efbbdf95523c already in progress: creating tablet
I20260927 15:06:17.538363 2119 tablet_replica.cc:330] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:17.538683 2119 raft_consensus.cc:2229] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.539881 2119 raft_consensus.cc:2258] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.540701 1562 tablet_replica.cc:330] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.540941 1562 raft_consensus.cc:2229] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.541244 1562 raft_consensus.cc:2258] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.542395 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_aa05ab0cb98542a4b84901b5dcd86aee [id=b1106aee6c804da4a603364cee1c1116]) successfully deleted
W20260927 15:06:17.542757 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1a05574f0f734e6d912b375137482a21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a05574f0f734e6d912b375137482a21 already in progress: creating tablet
I20260927 15:06:17.542870 1562 ts_tablet_manager.cc:1905] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:17.543076 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 29c5d4cfb0d84d30896c0c7913c4d82b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29c5d4cfb0d84d30896c0c7913c4d82b already in progress: creating tablet
W20260927 15:06:17.546593 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ccf0780e10445c9ac9a91cbd4052e88 consensus state has no leader
I20260927 15:06:17.547029 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c10827cf92b44050bf8d4dc379b26be3" } modify_external_catalogs: true
I20260927 15:06:17.547282 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c10827cf92b44050bf8d4dc379b26be3" } modify_external_catalogs: true
I20260927 15:06:17.547901 1552 raft_consensus.cc:348] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.548060 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a04caae16db84d8ea9050b648c1ba354
I20260927 15:06:17.548123 1552 raft_consensus.cc:374] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.548175 1552 raft_consensus.cc:729] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.548406 1552 consensus_queue.cc:260] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.548944 1552 ts_tablet_manager.cc:1428] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.107s user 0.001s sys 0.001s
I20260927 15:06:17.549165 1552 tablet_bootstrap.cc:492] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:17.550698 1552 tablet_bootstrap.cc:654] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.550853 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet a04caae16db84d8ea9050b648c1ba354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:17.551820 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 467cda952ec4492f9206ee4847abc3bc consensus state has no leader
I20260927 15:06:17.552631 906 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 9ca7b6f8953e4429a5b8fe4ccc3e1837
I20260927 15:06:17.557431 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 58d7e01486e941f9a6a5f691ae6c7d68 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:17.557591 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet a04caae16db84d8ea9050b648c1ba354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.559787 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet a04caae16db84d8ea9050b648c1ba354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:17.560773 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 46429.5us
I20260927 15:06:17.563935 1562 ts_tablet_manager.cc:1918] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.564054 1562 log.cc:1196] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/0129eaa5636544e696076e439d713b1b
I20260927 15:06:17.564424 1562 ts_tablet_manager.cc:1939] T 0129eaa5636544e696076e439d713b1b P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.565142 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 824) took 3841 ms. Trace:
I20260927 15:06:17.565264 1562 rpcz_store.cc:276] 0927 15:06:13.723586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.725662 (+ 2076us) service_pool.cc:227] Handling call
0927 15:06:17.540649 (+3814987us) ts_tablet_manager.cc:1145] Deleting tablet 0129eaa5636544e696076e439d713b1b
0927 15:06:17.540663 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.554260 (+ 13597us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.563833 (+ 9573us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.565123 (+ 1290us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3814823}
I20260927 15:06:17.565682 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 0129eaa5636544e696076e439d713b1b (table default.Table_0393b69c63dc4c42b67201f634d5c6fa [id=3d369788b9e44a0b9befbbb44303d24e]) successfully deleted
I20260927 15:06:17.567256 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 04007cd4bd214b88a4664e23daf4b790 with delete_type TABLET_DATA_DELETED (replaced by tablet 79c983d3119f4754a33a1ec3a84665c1) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.571295 1562 tablet_replica.cc:330] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.571497 1562 raft_consensus.cc:2229] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.571758 1562 pending_rounds.cc:62] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:17.571808 1562 pending_rounds.cc:68] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976365196242944 op_type: NO_OP noop_request { }
I20260927 15:06:17.571916 1562 raft_consensus.cc:2866] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:17.572000 1562 raft_consensus.cc:2258] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.572568 1562 ts_tablet_manager.cc:1905] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.573426 2119 ts_tablet_manager.cc:1905] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.574466 1556 tablet_bootstrap.cc:492] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.574581 1556 ts_tablet_manager.cc:1397] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.000s
I20260927 15:06:17.575361 1556 raft_consensus.cc:348] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.575805 1556 raft_consensus.cc:374] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.575868 1556 raft_consensus.cc:729] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.576220 1556 consensus_queue.cc:260] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.576767 1556 ts_tablet_manager.cc:1428] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:17.576990 1556 tablet_bootstrap.cc:492] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.578616 1556 tablet_bootstrap.cc:654] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:17.585052 1099 consensus_peers.cc:487] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 278205071701447e8ee7457b2ee84be4. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.586086 2797 raft_consensus.cc:482] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.597041 1562 ts_tablet_manager.cc:1918] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.597204 1562 log.cc:1196] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/566aa5caa012443ea63fcb7389c8b7c0
I20260927 15:06:17.598628 1562 ts_tablet_manager.cc:1939] T 566aa5caa012443ea63fcb7389c8b7c0 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.599701 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 825) took 3876 ms. Trace:
I20260927 15:06:17.599843 1562 rpcz_store.cc:276] 0927 15:06:13.723713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.725867 (+ 2154us) service_pool.cc:227] Handling call
0927 15:06:17.571243 (+3845376us) ts_tablet_manager.cc:1145] Deleting tablet 566aa5caa012443ea63fcb7389c8b7c0
0927 15:06:17.571255 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.586304 (+ 15049us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.596913 (+ 10609us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.599674 (+ 2761us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3845254}
I20260927 15:06:17.600245 1562 tablet_replica.cc:330] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.600405 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 566aa5caa012443ea63fcb7389c8b7c0 (table default.Table_166945d9ee0740f2b92a0138063f8891 [id=cad1448cfd5a4e76afe95e544d8a30b0]) successfully deleted
I20260927 15:06:17.600478 1562 raft_consensus.cc:2229] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.600610 1562 raft_consensus.cc:2258] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.601116 1562 ts_tablet_manager.cc:1905] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.603000 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7156da92993b44a09d20d69c14974466"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.603686 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7156da92993b44a09d20d69c14974466 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.613900 1562 ts_tablet_manager.cc:1918] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:17.614042 1562 log.cc:1196] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/424b66c69254487f932894516d570204
I20260927 15:06:17.614440 1562 ts_tablet_manager.cc:1939] T 424b66c69254487f932894516d570204 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.615300 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 821) took 3892 ms. Trace:
I20260927 15:06:17.615404 1562 rpcz_store.cc:276] 0927 15:06:13.723313 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.726024 (+ 2711us) service_pool.cc:227] Handling call
0927 15:06:17.600200 (+3874176us) ts_tablet_manager.cc:1145] Deleting tablet 424b66c69254487f932894516d570204
0927 15:06:17.600211 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.609914 (+ 9703us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.613783 (+ 3869us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.615280 (+ 1497us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3874069}
I20260927 15:06:17.615760 1562 tablet_replica.cc:330] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.615913 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 424b66c69254487f932894516d570204 (table default.Table_af3d6c72bfa14a6d8f04be3fb4a72235 [id=45ff9a80d85b49fc8f74596b7f1dd1ca]) successfully deleted
I20260927 15:06:17.615959 1562 raft_consensus.cc:2229] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.616245 1562 raft_consensus.cc:2258] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.616735 1561 tablet_bootstrap.cc:492] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.616911 1561 ts_tablet_manager.cc:1397] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.165s user 0.030s sys 0.029s
I20260927 15:06:17.617647 1561 raft_consensus.cc:348] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.617923 1561 raft_consensus.cc:374] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.618063 1561 raft_consensus.cc:729] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.618289 1561 consensus_queue.cc:260] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.619748 2119 ts_tablet_manager.cc:1918] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:17.619891 2119 log.cc:1196] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/80a8563c77484a1ebbbe7dab9a652aeb
I20260927 15:06:17.620224 2119 ts_tablet_manager.cc:1939] T 80a8563c77484a1ebbbe7dab9a652aeb P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:17.620878 1561 ts_tablet_manager.cc:1428] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:17.616746 1562 ts_tablet_manager.cc:1905] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.621096 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 80a8563c77484a1ebbbe7dab9a652aeb (table default.Table_60ea7e4921ff40728d6a8b84c9b494c8 [id=f76efa8048524aa9a343ed0912a15500]) successfully deleted
I20260927 15:06:17.621254 1561 tablet_bootstrap.cc:492] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.622879 1561 tablet_bootstrap.cc:654] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.625726 1552 tablet_bootstrap.cc:492] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:17.625979 1552 ts_tablet_manager.cc:1397] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.003s
W20260927 15:06:17.626621 1099 consensus_peers.cc:487] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f4cff4a06db44269defca578af289d8. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.626734 1552 raft_consensus.cc:348] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.626959 1552 raft_consensus.cc:374] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.627090 1552 raft_consensus.cc:729] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.586257 2797 raft_consensus.cc:504] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.627806 2797 leader_election.cc:288] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.628536 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a89ce4434ad4171bf613d4bbb3337a8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:17.629122 1374 leader_election.cc:341] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:17.629258 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet d9fecfb2325046f98e69797ff8342892 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fecfb2325046f98e69797ff8342892 already in progress: creating tablet
I20260927 15:06:17.629786 2233 ts_tablet_manager.cc:1918] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:17.629925 2233 log.cc:1196] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/5e9b07ea3ec9457399e2b765580d06e7
I20260927 15:06:17.629886 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a89ce4434ad4171bf613d4bbb3337a8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.630306 2233 ts_tablet_manager.cc:1939] T 5e9b07ea3ec9457399e2b765580d06e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:17.630414 2661 raft_consensus.cc:482] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:17.630450 1376 leader_election.cc:341] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.630537 1376 leader_election.cc:302] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.630527 2661 raft_consensus.cc:504] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.630997 2797 raft_consensus.cc:2726] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.631101 2661 leader_election.cc:288] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.631160 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 863) took 3704 ms. Trace:
I20260927 15:06:17.631258 2233 rpcz_store.cc:276] 0927 15:06:13.926235 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.929265 (+ 3030us) service_pool.cc:227] Handling call
0927 15:06:17.532223 (+3602958us) ts_tablet_manager.cc:1145] Deleting tablet 5e9b07ea3ec9457399e2b765580d06e7
0927 15:06:17.532233 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.605660 (+ 73427us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.629672 (+ 24012us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.631142 (+ 1470us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3602700}
I20260927 15:06:17.631423 1562 ts_tablet_manager.cc:1918] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.631518 1562 log.cc:1196] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/c5cd55de34d249bc8d3adcf4690f0414
I20260927 15:06:17.631647 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 865) took 3674 ms. Trace:
I20260927 15:06:17.631729 2233 rpcz_store.cc:276] 0927 15:06:13.957624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.957681 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:17.631532 (+3673851us) ts_tablet_manager.cc:1145] Deleting tablet bcbaed2bd9224a0c867cb8804ce8478e
0927 15:06:17.631543 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.631629 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3673626}
I20260927 15:06:17.631973 1562 ts_tablet_manager.cc:1939] T c5cd55de34d249bc8d3adcf4690f0414 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.632025 2233 tablet_replica.cc:330] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:17.632023 1239 leader_election.cc:341] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 566aa5caa012443ea63fcb7389c8b7c0
I20260927 15:06:17.632211 2233 raft_consensus.cc:2229] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.632351 2233 raft_consensus.cc:2258] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.632507 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 5e9b07ea3ec9457399e2b765580d06e7 (table default.Table_e09fcea174c647adb26c6caeacda55a6 [id=450ecac4fd094088b06f5d3add7acd2b]) successfully deleted
I20260927 15:06:17.632751 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 826) took 3895 ms. Trace:
W20260927 15:06:17.632769 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bcbaed2bd9224a0c867cb8804ce8478e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcbaed2bd9224a0c867cb8804ce8478e already in progress: creating tablet
I20260927 15:06:17.632866 2233 ts_tablet_manager.cc:1905] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.632828 1562 rpcz_store.cc:276] 0927 15:06:13.737192 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.737250 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:17.615679 (+3878429us) ts_tablet_manager.cc:1145] Deleting tablet c5cd55de34d249bc8d3adcf4690f0414
0927 15:06:17.615689 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.624391 (+ 8702us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.631338 (+ 6947us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.632645 (+ 1307us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3878241}
I20260927 15:06:17.633255 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet c5cd55de34d249bc8d3adcf4690f0414 (table default.Table_4e746f160fe7481ea3947c59c33ed5ee [id=1b056b1df8b440a7a49989039998313c]) successfully deleted
W20260927 15:06:17.633548 1238 leader_election.cc:341] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 566aa5caa012443ea63fcb7389c8b7c0
I20260927 15:06:17.633638 1238 leader_election.cc:302] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:17.634042 2661 raft_consensus.cc:2726] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.634087 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 827) took 3893 ms. Trace:
I20260927 15:06:17.634159 1562 rpcz_store.cc:276] 0927 15:06:13.740460 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.740515 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:17.633990 (+3893475us) ts_tablet_manager.cc:1145] Deleting tablet e2c276b721a74822a5275c5924de20b6
0927 15:06:17.634000 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.634072 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3893301}
W20260927 15:06:17.634544 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e2c276b721a74822a5275c5924de20b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2c276b721a74822a5275c5924de20b6 already in progress: creating tablet
I20260927 15:06:17.634557 905 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 078ba40ca56745b2a2b86402a1519011 (table default.Table_4e61792c99664faca894de841edc089d [id=f8a991083fb74bfc9d9969214ac7108f]). Expected version 2 got 0
I20260927 15:06:17.635151 1562 tablet_replica.cc:330] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.635354 1562 raft_consensus.cc:2229] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.635627 1562 pending_rounds.cc:62] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:17.635665 1562 pending_rounds.cc:68] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976370371297280 op_type: NO_OP noop_request { }
I20260927 15:06:17.635737 2119 tablet_replica.cc:330] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:17.635761 1562 raft_consensus.cc:2866] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:17.635828 1562 raft_consensus.cc:2258] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.635905 2119 raft_consensus.cc:2229] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.636300 1562 ts_tablet_manager.cc:1905] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.638028 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 03ce4e8370634ff4967865be6caafab2
I20260927 15:06:17.639259 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ce4e8370634ff4967865be6caafab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.639319 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ce4e8370634ff4967865be6caafab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.640839 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ce4e8370634ff4967865be6caafab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.642913 1561 tablet_bootstrap.cc:492] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.643044 1561 ts_tablet_manager.cc:1397] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.006s
I20260927 15:06:17.643416 2568 consensus_queue.cc:1035] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:17.643688 1561 raft_consensus.cc:348] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.643911 1561 raft_consensus.cc:374] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.643970 1561 raft_consensus.cc:729] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.644131 1561 consensus_queue.cc:260] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.644619 1561 ts_tablet_manager.cc:1428] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:17.646727 1561 tablet_bootstrap.cc:492] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.647228 1552 consensus_queue.cc:260] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.647815 1552 ts_tablet_manager.cc:1428] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260927 15:06:17.648102 1552 tablet_bootstrap.cc:492] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:17.649986 1552 tablet_bootstrap.cc:654] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.654464 1562 ts_tablet_manager.cc:1918] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.654562 1562 log.cc:1196] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/6cc8bd2079f84da39e13113e6699bf5e
I20260927 15:06:17.655102 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f4bd8182c9d48c7b6e6175ab98d405a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.656275 1562 ts_tablet_manager.cc:1939] T 6cc8bd2079f84da39e13113e6699bf5e P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.658422 1561 tablet_bootstrap.cc:654] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.659464 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 828) took 3918 ms. Trace:
I20260927 15:06:17.659612 1562 rpcz_store.cc:276] 0927 15:06:13.741222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.741605 (+ 383us) service_pool.cc:227] Handling call
0927 15:06:17.635114 (+3893509us) ts_tablet_manager.cc:1145] Deleting tablet 6cc8bd2079f84da39e13113e6699bf5e
0927 15:06:17.635123 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.651368 (+ 16245us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.654379 (+ 3011us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.659447 (+ 5068us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3893343}
I20260927 15:06:17.660140 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 6cc8bd2079f84da39e13113e6699bf5e (table default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388]) successfully deleted
I20260927 15:06:17.660358 2568 raft_consensus.cc:482] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.660514 1562 tablet_replica.cc:330] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.660490 2568 raft_consensus.cc:504] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.660775 1562 raft_consensus.cc:2229] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.660929 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2ad5d2ac920c40f197a7134129b64442" } modify_external_catalogs: true
I20260927 15:06:17.661101 2568 leader_election.cc:288] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.661144 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2ad5d2ac920c40f197a7134129b64442" } modify_external_catalogs: true
I20260927 15:06:17.661054 1562 pending_rounds.cc:62] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:17.661355 1562 pending_rounds.cc:68] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976369471156224 op_type: NO_OP noop_request { }
I20260927 15:06:17.661492 1562 raft_consensus.cc:2866] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:17.661602 1562 raft_consensus.cc:2258] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.661521 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3042c17580d54082971b761433a7dca9" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.662535 1102 leader_election.cc:341] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.662688 1562 ts_tablet_manager.cc:1905] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.663188 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3042c17580d54082971b761433a7dca9" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:17.663429 1435 raft_consensus.cc:2454] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:17.663825 1099 leader_election.cc:302] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.664091 2568 raft_consensus.cc:2781] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.664162 2568 raft_consensus.cc:482] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.664240 2568 raft_consensus.cc:3037] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.665290 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_16300d973fed4a26a7baa92b0de64def"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.665963 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16300d973fed4a26a7baa92b0de64def in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.666553 2568 raft_consensus.cc:504] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.666721 2233 ts_tablet_manager.cc:1918] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.667232 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_06d412d20ce24d15a63273b739332b4a" } new_table_name: "default.Table_1a1cf4d2adeb43519e6e611cf1795278" modify_external_catalogs: true
I20260927 15:06:17.668040 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bfc372718370477fa7a545e5b93f01c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.670364 1552 tablet_bootstrap.cc:492] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:17.670498 1552 ts_tablet_manager.cc:1397] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20260927 15:06:17.671250 1552 raft_consensus.cc:348] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.671448 1552 raft_consensus.cc:374] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.671501 1552 raft_consensus.cc:729] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.671718 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3042c17580d54082971b761433a7dca9" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:17.672916 1102 leader_election.cc:341] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.673239 2568 leader_election.cc:288] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.666816 2233 log.cc:1196] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/a19c9cc5859f49a58a35460e504b3f84
I20260927 15:06:17.673804 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3042c17580d54082971b761433a7dca9" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:17.673976 1435 raft_consensus.cc:3037] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.674067 2233 ts_tablet_manager.cc:1939] T a19c9cc5859f49a58a35460e504b3f84 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:17.667670 1556 tablet_bootstrap.cc:492] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.674965 1556 ts_tablet_manager.cc:1397] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.098s user 0.001s sys 0.003s
I20260927 15:06:17.675635 1556 raft_consensus.cc:348] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.675864 1556 raft_consensus.cc:374] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.675909 1556 raft_consensus.cc:729] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.676070 1556 consensus_queue.cc:260] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.676517 1435 raft_consensus.cc:2454] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:17.677043 1552 consensus_queue.cc:260] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.677618 1552 ts_tablet_manager.cc:1428] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260927 15:06:17.673630 1561 tablet_bootstrap.cc:492] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.678627 1561 ts_tablet_manager.cc:1397] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260927 15:06:17.677583 1099 leader_election.cc:302] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.679509 2653 raft_consensus.cc:2781] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:17.679617 2653 raft_consensus.cc:686] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:17.679800 2653 consensus_queue.cc:237] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.680128 1552 tablet_bootstrap.cc:492] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:17.674762 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 866) took 3701 ms. Trace:
W20260927 15:06:17.681303 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5ffe51b1b834bf4af262dc70b9206f8 consensus state has no leader
I20260927 15:06:17.680971 1556 ts_tablet_manager.cc:1428] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:06:17.681252 2233 rpcz_store.cc:276] 0927 15:06:13.972964 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.973018 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:17.631986 (+3658968us) ts_tablet_manager.cc:1145] Deleting tablet a19c9cc5859f49a58a35460e504b3f84
0927 15:06:17.631996 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.663755 (+ 31759us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.666623 (+ 2868us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.674745 (+ 8122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3658764}
I20260927 15:06:17.683118 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4663e3db7f2a40ecb39c11ee23a08b97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.683272 1561 raft_consensus.cc:348] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.683449 1561 raft_consensus.cc:374] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.683475 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 875) took 3633 ms. Trace:
I20260927 15:06:17.683504 1561 raft_consensus.cc:729] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.683547 2233 rpcz_store.cc:276] 0927 15:06:14.049724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.066761 (+ 17037us) service_pool.cc:227] Handling call
0927 15:06:17.683353 (+3616592us) ts_tablet_manager.cc:1145] Deleting tablet 8d059dff614841a79674d17dfc8870cb
0927 15:06:17.683363 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.683458 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3616351}
W20260927 15:06:17.683661 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4663e3db7f2a40ecb39c11ee23a08b97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.684178 1561 consensus_queue.cc:260] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.684688 1556 tablet_bootstrap.cc:492] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.684692 1561 ts_tablet_manager.cc:1428] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260927 15:06:17.684933 1561 tablet_bootstrap.cc:492] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.685474 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet a19c9cc5859f49a58a35460e504b3f84 (table default.Table_d824f1399fb8451dad058a93321740ce [id=7fc0363b53f4466f9e6320ea6750aec3]) successfully deleted
W20260927 15:06:17.685696 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8d059dff614841a79674d17dfc8870cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d059dff614841a79674d17dfc8870cb already in progress: creating tablet
I20260927 15:06:17.686228 1556 tablet_bootstrap.cc:654] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.686345 1561 tablet_bootstrap.cc:654] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.687278 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 878) took 3487 ms. Trace:
I20260927 15:06:17.687410 2233 rpcz_store.cc:276] 0927 15:06:14.199628 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.201895 (+ 2267us) service_pool.cc:227] Handling call
0927 15:06:17.687170 (+3485275us) ts_tablet_manager.cc:1145] Deleting tablet bc2974e11cf1446895607b4ccec16386
0927 15:06:17.687179 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.687263 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3476066}
I20260927 15:06:17.687948 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 877) took 3489 ms. Trace:
I20260927 15:06:17.688077 2233 rpcz_store.cc:276] 0927 15:06:14.198756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.202134 (+ 3378us) service_pool.cc:227] Handling call
0927 15:06:17.687844 (+3485710us) ts_tablet_manager.cc:1145] Deleting tablet 073b995a22304b0aaf8cfd61ffd5722a
0927 15:06:17.687854 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.687932 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3476653}
I20260927 15:06:17.688392 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet c5cd55de34d249bc8d3adcf4690f0414 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.688623 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 879) took 3456 ms. Trace:
I20260927 15:06:17.688701 2233 rpcz_store.cc:276] 0927 15:06:14.232664 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.250744 (+ 18080us) service_pool.cc:227] Handling call
0927 15:06:17.688514 (+3437770us) ts_tablet_manager.cc:1145] Deleting tablet 1a7f84a178ab4cd6b7deeae02e1e52ec
0927 15:06:17.688527 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.688612 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3437494}
W20260927 15:06:17.689189 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bc2974e11cf1446895607b4ccec16386 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc2974e11cf1446895607b4ccec16386 already in progress: creating tablet
W20260927 15:06:17.689409 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 073b995a22304b0aaf8cfd61ffd5722a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 073b995a22304b0aaf8cfd61ffd5722a already in progress: creating tablet
W20260927 15:06:17.689597 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a7f84a178ab4cd6b7deeae02e1e52ec already in progress: creating tablet
I20260927 15:06:17.691200 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_92cb4bf60a5c4bbeb19ad542a71d46e4" } new_table_name: "default.Table_e7bf365b01ff44309a205f3ba9ed6d0a" modify_external_catalogs: true
I20260927 15:06:17.691290 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 880) took 3416 ms. Trace:
I20260927 15:06:17.691385 2233 rpcz_store.cc:276] 0927 15:06:14.274611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.274733 (+ 122us) service_pool.cc:227] Handling call
0927 15:06:17.691165 (+3416432us) ts_tablet_manager.cc:1145] Deleting tablet c5de1bf320ca4043b31154380710ad79
0927 15:06:17.691179 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.691270 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3416178}
W20260927 15:06:17.692557 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c5de1bf320ca4043b31154380710ad79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5de1bf320ca4043b31154380710ad79 already in progress: creating tablet
I20260927 15:06:17.692940 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 881) took 3403 ms. Trace:
I20260927 15:06:17.693272 2233 rpcz_store.cc:276] 0927 15:06:14.289826 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.289917 (+ 91us) service_pool.cc:227] Handling call
0927 15:06:17.692834 (+3402917us) ts_tablet_manager.cc:1145] Deleting tablet e9f171fd62d644f38262a2257d47fafe
0927 15:06:17.692843 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.692924 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3401161}
I20260927 15:06:17.695133 2431 raft_consensus.cc:482] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.695297 2431 raft_consensus.cc:504] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.695825 2431 leader_election.cc:288] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.696494 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efc44686be2407cbcdca61909301539" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.697062 1102 leader_election.cc:341] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.705287 1552 tablet_bootstrap.cc:654] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:17.705346 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e9f171fd62d644f38262a2257d47fafe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9f171fd62d644f38262a2257d47fafe already in progress: creating tablet
I20260927 15:06:17.705744 2233 tablet_replica.cc:330] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:17.706076 2233 raft_consensus.cc:2229] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.706337 2233 raft_consensus.cc:2258] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:17.707396 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51f0744f9d804b84a958916c2dd04503 consensus state has no leader
I20260927 15:06:17.697324 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efc44686be2407cbcdca61909301539" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:17.711090 1435 raft_consensus.cc:2454] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:17.712105 2233 ts_tablet_manager.cc:1905] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.713667 1099 leader_election.cc:302] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.713901 2653 raft_consensus.cc:2781] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.714031 2653 raft_consensus.cc:482] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.714169 2653 raft_consensus.cc:3037] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.716775 2653 raft_consensus.cc:504] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.717717 2653 leader_election.cc:288] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.717692 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efc44686be2407cbcdca61909301539" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:17.718151 1102 leader_election.cc:341] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.719841 1552 tablet_bootstrap.cc:492] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:17.719985 1552 ts_tablet_manager.cc:1397] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.003s
I20260927 15:06:17.721122 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efc44686be2407cbcdca61909301539" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:17.721406 1435 raft_consensus.cc:3037] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:17.722312 1102 consensus_peers.cc:487] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.723639 1561 tablet_bootstrap.cc:492] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.723734 1556 tablet_bootstrap.cc:492] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.723861 1556 ts_tablet_manager.cc:1397] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20260927 15:06:17.723948 1561 ts_tablet_manager.cc:1397] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.001s
I20260927 15:06:17.724181 1435 raft_consensus.cc:2454] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:17.724524 1556 raft_consensus.cc:348] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.724702 1556 raft_consensus.cc:374] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.724773 1556 raft_consensus.cc:729] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.724996 1556 consensus_queue.cc:260] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.725172 2797 raft_consensus.cc:482] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.725271 1099 leader_election.cc:302] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.725301 2797 raft_consensus.cc:504] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.725543 1556 ts_tablet_manager.cc:1428] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:17.725811 2797 leader_election.cc:288] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.726084 2653 raft_consensus.cc:2781] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:17.726202 2653 raft_consensus.cc:686] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:17.726275 1556 tablet_bootstrap.cc:492] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.726401 2653 consensus_queue.cc:237] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.726670 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "078ba40ca56745b2a2b86402a1519011" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:17.727294 1562 ts_tablet_manager.cc:1918] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:17.727352 1374 leader_election.cc:341] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.728072 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "078ba40ca56745b2a2b86402a1519011" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.728608 1376 leader_election.cc:341] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.728718 1376 leader_election.cc:302] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.729014 2789 raft_consensus.cc:2726] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.729128 2797 raft_consensus.cc:482] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.729231 2797 raft_consensus.cc:504] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.729732 2797 leader_election.cc:288] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.729005 2568 consensus_queue.cc:1035] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:17.729621 1561 raft_consensus.cc:348] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.731354 1561 raft_consensus.cc:374] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.731472 1561 raft_consensus.cc:729] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.731756 1561 consensus_queue.cc:260] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.732071 1562 log.cc:1196] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/8f4bd8182c9d48c7b6e6175ab98d405a
I20260927 15:06:17.732556 1562 ts_tablet_manager.cc:1939] T 8f4bd8182c9d48c7b6e6175ab98d405a P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.732563 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_470ef5dfe4064ad9a5d188c4e2e888e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.733122 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_470ef5dfe4064ad9a5d188c4e2e888e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.728650 1556 tablet_bootstrap.cc:654] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.734092 2568 raft_consensus.cc:482] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.735016 2568 raft_consensus.cc:504] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.735390 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_54f655e9ce264e7aa23dd5e652ce8e5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.735848 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54f655e9ce264e7aa23dd5e652ce8e5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.735967 2568 leader_election.cc:288] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.735926 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429088342b4743c39fb1e38d235024de" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.736508 1102 leader_election.cc:341] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.736893 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cfd50ce3e28949c6a277273769c7d2e3" } new_table_name: "default.Table_2a51a5a55b3f498a85ecf8938612fa33" modify_external_catalogs: true
I20260927 15:06:17.736927 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429088342b4743c39fb1e38d235024de" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:17.737103 1433 raft_consensus.cc:2454] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:17.737525 1099 leader_election.cc:302] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.737918 2568 raft_consensus.cc:2781] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.737879 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9a97e3e6a5749feb4dd5f835d9c01ac" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:17.738019 2568 raft_consensus.cc:482] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.738098 2568 raft_consensus.cc:3037] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:17.738409 1374 leader_election.cc:341] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.738922 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9a97e3e6a5749feb4dd5f835d9c01ac" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.739408 1376 leader_election.cc:341] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.739500 1376 leader_election.cc:302] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.739853 2789 raft_consensus.cc:2726] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.740830 2568 raft_consensus.cc:504] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.741091 1552 raft_consensus.cc:348] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.741309 1552 raft_consensus.cc:374] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.741380 1552 raft_consensus.cc:729] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.741624 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429088342b4743c39fb1e38d235024de" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:17.742069 1102 leader_election.cc:341] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.734755 1561 ts_tablet_manager.cc:1428] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260927 15:06:17.742447 1561 tablet_bootstrap.cc:492] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.743472 2568 leader_election.cc:288] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.743924 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429088342b4743c39fb1e38d235024de" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:17.743937 1552 consensus_queue.cc:260] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.744103 1433 raft_consensus.cc:3037] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.744477 1552 ts_tablet_manager.cc:1428] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260927 15:06:17.746073 2233 ts_tablet_manager.cc:1918] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.748063 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 829) took 4006 ms. Trace:
W20260927 15:06:17.749032 898 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 05e9d55c164d4d35a9886c5fdc1c7949 (table default.Table_6fbb7bd4420e424590f43b5cafe2b02e [id=bd0624dd172944c8bb7839cc063472c0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 05e9d55c164d4d35a9886c5fdc1c7949 consensus state has no leader
I20260927 15:06:17.750424 1562 rpcz_store.cc:276] 0927 15:06:13.741668 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.741814 (+ 146us) service_pool.cc:227] Handling call
0927 15:06:17.660418 (+3918604us) ts_tablet_manager.cc:1145] Deleting tablet 8f4bd8182c9d48c7b6e6175ab98d405a
0927 15:06:17.660430 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.711340 (+ 50910us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.727195 (+ 15855us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.748009 (+ 20814us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3918459}
I20260927 15:06:17.750988 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 8f4bd8182c9d48c7b6e6175ab98d405a (table default.Table_f473e7d31ecc4adfbda7d8a1df28ec33 [id=a8244b3e082b4423bdf4d108ee1647b4]) successfully deleted
I20260927 15:06:17.751365 1562 tablet_replica.cc:330] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.752055 1562 raft_consensus.cc:2229] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:06:17.753943 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfc372718370477fa7a545e5b93f01c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.754376 1562 raft_consensus.cc:2258] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.755074 1562 ts_tablet_manager.cc:1905] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.755115 1552 tablet_bootstrap.cc:492] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:17.755566 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 8790d59beb804acb8e4353f862d7f6f8 with delete_type TABLET_DATA_DELETED (replaced by tablet fd5f2ab9677c4598b0b8d9a93a6a23c7) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.746634 1433 raft_consensus.cc:2454] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:17.755885 2233 log.cc:1196] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/cd76c49eda1c4b4ca0edf0f4d2790188
I20260927 15:06:17.756209 1099 leader_election.cc:302] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.756657 2568 raft_consensus.cc:2781] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:17.756667 2233 ts_tablet_manager.cc:1939] T cd76c49eda1c4b4ca0edf0f4d2790188 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:17.756971 2568 raft_consensus.cc:686] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:17.760130 1552 tablet_bootstrap.cc:654] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.760339 2365 consensus_queue.cc:1035] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:17.760831 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 882) took 3339 ms. Trace:
I20260927 15:06:17.760968 2233 rpcz_store.cc:276] 0927 15:06:14.421138 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.421452 (+ 314us) service_pool.cc:227] Handling call
0927 15:06:17.705687 (+3284235us) ts_tablet_manager.cc:1145] Deleting tablet cd76c49eda1c4b4ca0edf0f4d2790188
0927 15:06:17.705702 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.716818 (+ 11116us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.745984 (+ 29166us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.760811 (+ 14827us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3267969}
I20260927 15:06:17.763896 2233 tablet_replica.cc:330] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:17.764358 2568 consensus_queue.cc:237] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:17.767575 1102 consensus_peers.cc:487] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.750347 1561 tablet_bootstrap.cc:654] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.768572 2661 raft_consensus.cc:482] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.768719 2661 raft_consensus.cc:504] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.769276 2661 leader_election.cc:288] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:17.770356 1239 leader_election.cc:341] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 8f4bd8182c9d48c7b6e6175ab98d405a
W20260927 15:06:17.770493 1238 leader_election.cc:341] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 8f4bd8182c9d48c7b6e6175ab98d405a
I20260927 15:06:17.770591 1238 leader_election.cc:302] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:17.771000 2661 raft_consensus.cc:2726] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.754037 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3dcdf32e55c34e18a3fc62ce5baf3000"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.774789 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dcdf32e55c34e18a3fc62ce5baf3000 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.775167 913 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 1ef93a120f00423d91664ce4eaf03803 (table default.Table_69e7da33db594b0494d614660c3525f8 [id=40aeb63abca64c3a8d12f9085fd816d8]). Expected version 3 got 0
I20260927 15:06:17.776156 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c6971a4f48634ff387b85b96b54d0552" } new_table_name: "default.Table_ebe623a52b764344bff82915aa08835f" modify_external_catalogs: true
I20260927 15:06:17.754218 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_aa5bc572b8fd4044bdb2360ac6c72afe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.776665 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa5bc572b8fd4044bdb2360ac6c72afe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.761427 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet cd76c49eda1c4b4ca0edf0f4d2790188 (table default.Table_024037ff57734bfa973dff7fd4f09896 [id=697526af76a54d6597dee1ac56eca889]) successfully deleted
I20260927 15:06:17.780228 2797 raft_consensus.cc:482] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.780387 2797 raft_consensus.cc:504] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.780982 2797 leader_election.cc:288] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:17.781807 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d4707e599840b3bdc2ab13c348ea80" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.782399 1376 leader_election.cc:341] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.783010 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d4707e599840b3bdc2ab13c348ea80" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:17.783901 1374 leader_election.cc:341] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.784003 1374 leader_election.cc:302] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.784492 2797 raft_consensus.cc:2726] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.784808 2365 raft_consensus.cc:482] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.784981 2365 raft_consensus.cc:504] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.785413 2661 raft_consensus.cc:482] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.785673 2365 leader_election.cc:288] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.785557 2661 raft_consensus.cc:504] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.786239 2661 leader_election.cc:288] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.786589 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214229a8283b43c4916a5db7ba120e03" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.786603 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214229a8283b43c4916a5db7ba120e03" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:17.787099 1435 raft_consensus.cc:2454] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:17.787597 1238 leader_election.cc:341] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 04007cd4bd214b88a4664e23daf4b790
W20260927 15:06:17.787814 1239 leader_election.cc:341] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 04007cd4bd214b88a4664e23daf4b790
I20260927 15:06:17.787951 1239 leader_election.cc:302] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:17.788556 1102 leader_election.cc:341] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.790035 2661 raft_consensus.cc:2726] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.793013 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_921a441eef1349e181bf8edd1c83b96b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.793593 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_921a441eef1349e181bf8edd1c83b96b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:17.795228 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5bc2abbed22e4bacb31e11ff60593c20 consensus state has no leader
I20260927 15:06:17.795604 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b899d4e7001546fca9ea2952ad36dbd9" } modify_external_catalogs: true
I20260927 15:06:17.795804 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b899d4e7001546fca9ea2952ad36dbd9" } modify_external_catalogs: true
I20260927 15:06:17.796248 1561 tablet_bootstrap.cc:492] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.796422 1561 ts_tablet_manager.cc:1397] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.002s
I20260927 15:06:17.798573 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e71b1a0c323c48e09d9f20338ddd3f80" } new_table_name: "default.Table_236e4d5c2c9d4770a0cdca9128346360" modify_external_catalogs: true
I20260927 15:06:17.798560 1561 raft_consensus.cc:348] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.798805 1561 raft_consensus.cc:374] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.798925 1561 raft_consensus.cc:729] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.799171 1561 consensus_queue.cc:260] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.799786 1561 ts_tablet_manager.cc:1428] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:17.803375 2365 raft_consensus.cc:482] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.803552 2365 raft_consensus.cc:504] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.804232 2365 leader_election.cc:288] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.804232 1561 tablet_bootstrap.cc:492] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.804903 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75645963963e4091af0edfcbc794fb2d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.805632 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30925f27bf5e45b8a038d0179a6a4439 consensus state has no leader
I20260927 15:06:17.806097 1561 tablet_bootstrap.cc:654] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:17.806298 1102 leader_election.cc:341] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.806444 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2d639925527040ccaebe69b8f7c65b5e" } modify_external_catalogs: true
I20260927 15:06:17.803550 1562 ts_tablet_manager.cc:1918] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260927 15:06:17.807997 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5712683f610a4b13a4581e60061c83b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.808831 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5712683f610a4b13a4581e60061c83b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.806699 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2d639925527040ccaebe69b8f7c65b5e" } modify_external_catalogs: true
I20260927 15:06:17.810055 1562 log.cc:1196] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/9a7989e2b91044dab1d3e327958a051a
I20260927 15:06:17.810567 1562 ts_tablet_manager.cc:1939] T 9a7989e2b91044dab1d3e327958a051a P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.811029 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 830) took 3988 ms. Trace:
I20260927 15:06:17.811221 1562 rpcz_store.cc:276] 0927 15:06:13.822179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.823953 (+ 1774us) service_pool.cc:227] Handling call
0927 15:06:17.751279 (+3927326us) ts_tablet_manager.cc:1145] Deleting tablet 9a7989e2b91044dab1d3e327958a051a
0927 15:06:17.751290 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.797522 (+ 46232us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.803393 (+ 5871us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.810991 (+ 7598us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3878221}
I20260927 15:06:17.811753 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 9a7989e2b91044dab1d3e327958a051a (table default.Table_aa05ab0cb98542a4b84901b5dcd86aee [id=b1106aee6c804da4a603364cee1c1116]) successfully deleted
I20260927 15:06:17.812212 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 834) took 3936 ms. Trace:
I20260927 15:06:17.812604 1562 rpcz_store.cc:276] 0927 15:06:13.876110 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.876165 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:17.812057 (+3935892us) ts_tablet_manager.cc:1145] Deleting tablet 1a05574f0f734e6d912b375137482a21
0927 15:06:17.812070 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.812168 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3935704}
W20260927 15:06:17.813304 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1a05574f0f734e6d912b375137482a21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a05574f0f734e6d912b375137482a21 already in progress: creating tablet
I20260927 15:06:17.813901 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75645963963e4091af0edfcbc794fb2d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:17.814139 1435 raft_consensus.cc:2454] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:17.814188 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 835) took 3937 ms. Trace:
I20260927 15:06:17.814303 1562 rpcz_store.cc:276] 0927 15:06:13.876919 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.876966 (+ 47us) service_pool.cc:227] Handling call
0927 15:06:17.814055 (+3937089us) ts_tablet_manager.cc:1145] Deleting tablet 29c5d4cfb0d84d30896c0c7913c4d82b
0927 15:06:17.814067 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.814152 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3936922}
W20260927 15:06:17.814805 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 29c5d4cfb0d84d30896c0c7913c4d82b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29c5d4cfb0d84d30896c0c7913c4d82b already in progress: creating tablet
I20260927 15:06:17.815024 1099 leader_election.cc:302] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.815340 2365 raft_consensus.cc:2781] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.815488 2365 raft_consensus.cc:482] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.815584 2365 raft_consensus.cc:3037] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.815658 1099 leader_election.cc:302] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.816213 2431 raft_consensus.cc:2781] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:17.818110 2365 raft_consensus.cc:504] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.819188 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d05c98c4fe034773b5a1de0b888eb681"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.819300 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214229a8283b43c4916a5db7ba120e03" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:17.819718 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d05c98c4fe034773b5a1de0b888eb681 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:17.820628 1102 leader_election.cc:341] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.820943 2365 leader_election.cc:288] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:17.821466 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f34ce3980286489c87fdde92fb045607 consensus state has no leader
W20260927 15:06:17.821906 1102 consensus_peers.cc:487] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.815236 1562 tablet_replica.cc:330] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:17.822335 1562 raft_consensus.cc:2229] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.822685 1562 pending_rounds.cc:62] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:17.822789 1562 pending_rounds.cc:68] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976370332155904 op_type: NO_OP noop_request { }
I20260927 15:06:17.823137 1562 raft_consensus.cc:2866] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:17.823288 1562 raft_consensus.cc:2258] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.824573 1562 ts_tablet_manager.cc:1905] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.833709 1562 ts_tablet_manager.cc:1918] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.834025 2661 raft_consensus.cc:482] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.834249 2661 raft_consensus.cc:504] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.834976 2661 leader_election.cc:288] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.835348 1561 tablet_bootstrap.cc:492] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.835541 1561 ts_tablet_manager.cc:1397] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.001s
W20260927 15:06:17.836431 1239 leader_election.cc:341] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: c5cd55de34d249bc8d3adcf4690f0414
I20260927 15:06:17.836342 1561 raft_consensus.cc:348] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.836548 1561 raft_consensus.cc:374] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.836612 1561 raft_consensus.cc:729] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.836831 1561 consensus_queue.cc:260] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.837499 1561 ts_tablet_manager.cc:1428] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:17.837797 1561 tablet_bootstrap.cc:492] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:17.838061 1238 leader_election.cc:341] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c5cd55de34d249bc8d3adcf4690f0414
I20260927 15:06:17.838174 1238 leader_election.cc:302] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:17.838593 2661 raft_consensus.cc:2726] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:17.839947 1561 tablet_bootstrap.cc:654] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.840346 1562 log.cc:1196] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/8790d59beb804acb8e4353f862d7f6f8
I20260927 15:06:17.840422 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b0805950ba34c63a8168418bb62f2ef" } modify_external_catalogs: true
I20260927 15:06:17.840649 2119 raft_consensus.cc:2258] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.840628 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b0805950ba34c63a8168418bb62f2ef" } modify_external_catalogs: true
I20260927 15:06:17.840996 1562 ts_tablet_manager.cc:1939] T 8790d59beb804acb8e4353f862d7f6f8 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:17.841307 2119 ts_tablet_manager.cc:1905] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.842662 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 836) took 3960 ms. Trace:
I20260927 15:06:17.842809 1562 rpcz_store.cc:276] 0927 15:06:13.882083 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.882142 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:17.815109 (+3932967us) ts_tablet_manager.cc:1145] Deleting tablet 8790d59beb804acb8e4353f862d7f6f8
0927 15:06:17.815120 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.827753 (+ 12633us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.833606 (+ 5853us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.842642 (+ 9036us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3932782}
I20260927 15:06:17.843400 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 8790d59beb804acb8e4353f862d7f6f8 (table default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]) successfully deleted
I20260927 15:06:17.843904 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 841) took 3880 ms. Trace:
I20260927 15:06:17.844061 1562 rpcz_store.cc:276] 0927 15:06:13.963170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:13.963222 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:17.843779 (+3880557us) ts_tablet_manager.cc:1145] Deleting tablet bcbaed2bd9224a0c867cb8804ce8478e
0927 15:06:17.843792 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.843887 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3880333}
W20260927 15:06:17.844583 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet bcbaed2bd9224a0c867cb8804ce8478e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcbaed2bd9224a0c867cb8804ce8478e already in progress: creating tablet
I20260927 15:06:17.845329 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 852) took 3780 ms. Trace:
I20260927 15:06:17.845458 1562 rpcz_store.cc:276] 0927 15:06:14.064488 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.064546 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:17.845217 (+3780671us) ts_tablet_manager.cc:1145] Deleting tablet 8d059dff614841a79674d17dfc8870cb
0927 15:06:17.845228 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.845313 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3780469}
W20260927 15:06:17.846176 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 8d059dff614841a79674d17dfc8870cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d059dff614841a79674d17dfc8870cb already in progress: creating tablet
I20260927 15:06:17.846565 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 853) took 3646 ms. Trace:
I20260927 15:06:17.846704 1562 rpcz_store.cc:276] 0927 15:06:14.200473 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.200671 (+ 198us) service_pool.cc:227] Handling call
0927 15:06:17.846461 (+3645790us) ts_tablet_manager.cc:1145] Deleting tablet 073b995a22304b0aaf8cfd61ffd5722a
0927 15:06:17.846472 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.846549 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3645570}
W20260927 15:06:17.847982 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 073b995a22304b0aaf8cfd61ffd5722a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 073b995a22304b0aaf8cfd61ffd5722a already in progress: creating tablet
I20260927 15:06:17.849359 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214229a8283b43c4916a5db7ba120e03" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:17.849555 1433 raft_consensus.cc:3037] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.852638 1433 raft_consensus.cc:2454] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:17.856721 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet db09498a395b4570a34d32fbfc71e8ed (table default.Table_5b7e58750e9a481cab2abf34e5753a5e [id=ed34d1e88ae54c6086ae3a7cbfdf7861]). Expected version 1 got 0
I20260927 15:06:17.861810 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 4ebacc9c2fca45ff92635e41a19e5bd8
I20260927 15:06:17.862380 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 51f0744f9d804b84a958916c2dd04503
I20260927 15:06:17.862669 909 catalog_manager.cc:6565] ReplaceTablet: tablet 51f0744f9d804b84a958916c2dd04503 deleted and replaced by tablet 57580db090ad4e4e94a3d22063e57ad4
I20260927 15:06:17.862957 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 58d7e01486e941f9a6a5f691ae6c7d68
I20260927 15:06:17.863288 910 catalog_manager.cc:6565] ReplaceTablet: tablet 58d7e01486e941f9a6a5f691ae6c7d68 deleted and replaced by tablet 414bb75a756f4549b9d147490344287a
I20260927 15:06:17.863607 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7f8744e2349e49d3a821eca42c7f89a2
I20260927 15:06:17.866674 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 92e5165b00e24374b611c552bc077b81 (DEFAULT_TABLE table=default.Table_266fb85b088a4364861ec604df33d892 [id=afa96ca299de4200a02ab09c22bfb64f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.867117 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92e5165b00e24374b611c552bc077b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.867143 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet e19cd7febe054432899739e21605406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.867725 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ebacc9c2fca45ff92635e41a19e5bd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.867871 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 2268d824f5324cd1b81879e2fe4fd027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.868357 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 0a1e7d78c7154345b33ac78f497d26a4 (DEFAULT_TABLE table=default.Table_ee124d45bf99401ea1d62efd5d0bb634 [id=0bcaf6117a1241f98ecfa4c7b200d17b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.868745 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a1e7d78c7154345b33ac78f497d26a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.868696 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ebacc9c2fca45ff92635e41a19e5bd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.868950 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 51f0744f9d804b84a958916c2dd04503 with delete_type TABLET_DATA_DELETED (replaced by tablet 57580db090ad4e4e94a3d22063e57ad4) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.869167 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d7e01486e941f9a6a5f691ae6c7d68 with delete_type TABLET_DATA_DELETED (replaced by tablet 414bb75a756f4549b9d147490344287a) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.869500 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 0cfd4839cc644d8781ce4908081199f0 (DEFAULT_TABLE table=default.Table_2d6610dc3caa4d0994e8402046407009 [id=af86e1c3dc38472a9946c864553afe62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.869527 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 0cfd4839cc644d8781ce4908081199f0 (DEFAULT_TABLE table=default.Table_2d6610dc3caa4d0994e8402046407009 [id=af86e1c3dc38472a9946c864553afe62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.869846 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cfd4839cc644d8781ce4908081199f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.870133 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cfd4839cc644d8781ce4908081199f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.870934 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 51f0744f9d804b84a958916c2dd04503 with delete_type TABLET_DATA_DELETED (replaced by tablet 57580db090ad4e4e94a3d22063e57ad4) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.871083 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 0a1e7d78c7154345b33ac78f497d26a4 (DEFAULT_TABLE table=default.Table_ee124d45bf99401ea1d62efd5d0bb634 [id=0bcaf6117a1241f98ecfa4c7b200d17b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.871131 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d7e01486e941f9a6a5f691ae6c7d68 with delete_type TABLET_DATA_DELETED (replaced by tablet 414bb75a756f4549b9d147490344287a) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.871281 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f8744e2349e49d3a821eca42c7f89a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.871380 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a1e7d78c7154345b33ac78f497d26a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.875540 2233 raft_consensus.cc:2229] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.875948 2233 pending_rounds.cc:62] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:17.876001 2233 pending_rounds.cc:68] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976377459716096 op_type: NO_OP noop_request { }
I20260927 15:06:17.876014 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 92e5165b00e24374b611c552bc077b81 (DEFAULT_TABLE table=default.Table_266fb85b088a4364861ec604df33d892 [id=afa96ca299de4200a02ab09c22bfb64f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.876127 2233 raft_consensus.cc:2866] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:17.876224 2233 raft_consensus.cc:2258] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.876346 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92e5165b00e24374b611c552bc077b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.876838 1273 tablet_service.cc:1467] Processing CreateTablet for tablet d97993083ab646f2b28dc4c32444bf9c (DEFAULT_TABLE table=default.Table_083f55ec5dae45c1bbb7305ac554f75e [id=d8cf621eea3d411a883b1d8c714928cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.877154 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d97993083ab646f2b28dc4c32444bf9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.877558 1407 tablet_service.cc:1467] Processing CreateTablet for tablet d97993083ab646f2b28dc4c32444bf9c (DEFAULT_TABLE table=default.Table_083f55ec5dae45c1bbb7305ac554f75e [id=d8cf621eea3d411a883b1d8c714928cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.878419 2233 ts_tablet_manager.cc:1905] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.879122 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f8744e2349e49d3a821eca42c7f89a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.879631 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d97993083ab646f2b28dc4c32444bf9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.887050 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 05e9d55c164d4d35a9886c5fdc1c7949 (DEFAULT_TABLE table=default.Table_6fbb7bd4420e424590f43b5cafe2b02e [id=bd0624dd172944c8bb7839cc063472c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.887416 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05e9d55c164d4d35a9886c5fdc1c7949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.887837 1402 tablet_service.cc:1467] Processing CreateTablet for tablet a0925fb692914976b4fb2f978397f3f6 (DEFAULT_TABLE table=default.Table_58db51a88dc7411b9037dce22c825e3c [id=991a607dc3c64ad4b603c653ebf3d498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.888047 1273 tablet_service.cc:1467] Processing CreateTablet for tablet a0925fb692914976b4fb2f978397f3f6 (DEFAULT_TABLE table=default.Table_58db51a88dc7411b9037dce22c825e3c [id=991a607dc3c64ad4b603c653ebf3d498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.888154 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0925fb692914976b4fb2f978397f3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.888366 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0925fb692914976b4fb2f978397f3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.890386 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7bbeb71422fd42a0a370d2ed36b85d17" } new_table_name: "default.Table_7d6318c8cf304d57953dfa5f8cd683fb" modify_external_catalogs: true
I20260927 15:06:17.891812 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1d40be3d810f4846ac0f57752c1d6008"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.892335 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d40be3d810f4846ac0f57752c1d6008 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.894901 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 2fa6ad6816f349d98195e88bcb7ff898 (DEFAULT_TABLE table=default.Table_ba5ccbc1e5b84ade984b1ddd16f7c7e3 [id=69dbe5f973e9495ab19672a5fb6f6d94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.895236 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fa6ad6816f349d98195e88bcb7ff898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.896561 2119 ts_tablet_manager.cc:1918] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:17.897533 2119 log.cc:1196] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/566aa5caa012443ea63fcb7389c8b7c0
I20260927 15:06:17.897893 2119 ts_tablet_manager.cc:1939] T 566aa5caa012443ea63fcb7389c8b7c0 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:17.898524 2119 tablet_replica.cc:330] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:17.898736 2119 raft_consensus.cc:2229] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.898761 2233 ts_tablet_manager.cc:1918] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.898953 2119 raft_consensus.cc:2258] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.901552 909 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 (table default.Table_9f691e4415864362a0a11b7ef69d222c [id=b09765fbcc8e4859b112206dd59e8ee8]). Expected version 1 got 0
I20260927 15:06:17.904309 1552 tablet_bootstrap.cc:492] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:17.904438 1552 ts_tablet_manager.cc:1397] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.149s user 0.003s sys 0.011s
I20260927 15:06:17.899314 1420 tablet_service.cc:1467] Processing CreateTablet for tablet b5f489db1e3640d2bac4e134b487d7ed (DEFAULT_TABLE table=default.Table_0de786b8335e40d7b02555750495ff59 [id=503babdc7fe742cf8904698d719dbb96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.906353 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5f489db1e3640d2bac4e134b487d7ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.906306 1276 tablet_service.cc:1467] Processing CreateTablet for tablet acf4391ff54b4bfb80fe00db3993845f (DEFAULT_TABLE table=default.Table_1ff7507743144d8e9f46996174bc8e85 [id=29147be930084a79bf6b91e124231f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.906499 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 13acfcbc13204b2f9edb0f557a62252e (DEFAULT_TABLE table=default.Table_e0071303c5c7491cb1289e60813891bb [id=6a7fde00643b4784b513f581f54f2e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.906620 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf4391ff54b4bfb80fe00db3993845f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.906849 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13acfcbc13204b2f9edb0f557a62252e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.907438 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 566aa5caa012443ea63fcb7389c8b7c0 (table default.Table_166945d9ee0740f2b92a0138063f8891 [id=cad1448cfd5a4e76afe95e544d8a30b0]) successfully deleted
W20260927 15:06:17.907662 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9a695b4fd5294f32a6644154487c1486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a695b4fd5294f32a6644154487c1486 already in progress: creating tablet
I20260927 15:06:17.909689 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3fbd80102e424c83aeae240c0171ca06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:17.910146 2233 log.cc:1196] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/66b54ee47e424aacb7f53fd95b0ce889
I20260927 15:06:17.910107 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 5b37e436d8d1462d8d2299449b53ce7b (DEFAULT_TABLE table=default.Table_0f0652967878460c8defab6738bc1839 [id=84d3377771ba47f7b6ac06f83a062497]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:17.910274 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fbd80102e424c83aeae240c0171ca06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.910532 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b37e436d8d1462d8d2299449b53ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.910916 1285 tablet_service.cc:1467] Processing CreateTablet for tablet b5f489db1e3640d2bac4e134b487d7ed (DEFAULT_TABLE table=default.Table_0de786b8335e40d7b02555750495ff59 [id=503babdc7fe742cf8904698d719dbb96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.911229 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5f489db1e3640d2bac4e134b487d7ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.911499 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0403b43bad954117a65684b5aeeebe11" } new_table_name: "default.Table_afbe9ff64484483c8622302f8239c274" modify_external_catalogs: true
I20260927 15:06:17.912308 2233 ts_tablet_manager.cc:1939] T 66b54ee47e424aacb7f53fd95b0ce889 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:17.899607 1556 tablet_bootstrap.cc:492] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.900964 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 13acfcbc13204b2f9edb0f557a62252e (DEFAULT_TABLE table=default.Table_e0071303c5c7491cb1289e60813891bb [id=6a7fde00643b4784b513f581f54f2e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.902758 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 5b37e436d8d1462d8d2299449b53ce7b (DEFAULT_TABLE table=default.Table_0f0652967878460c8defab6738bc1839 [id=84d3377771ba47f7b6ac06f83a062497]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.916358 1556 ts_tablet_manager.cc:1397] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.190s user 0.011s sys 0.010s
I20260927 15:06:17.916694 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b37e436d8d1462d8d2299449b53ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.916929 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 883) took 3449 ms. Trace:
I20260927 15:06:17.917037 2233 rpcz_store.cc:276] 0927 15:06:14.467271 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.467547 (+ 276us) service_pool.cc:227] Handling call
0927 15:06:17.763753 (+3296206us) ts_tablet_manager.cc:1145] Deleting tablet 66b54ee47e424aacb7f53fd95b0ce889
0927 15:06:17.763775 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.875865 (+112090us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x61500018f224. stack: 00007f26d729d66e 00007f26d729d430 00007f26d63245ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f26e27d904d 00007f26e3a7d5ec 00007f26e640c2e6 00007f26e643e404 00007f26e641f870 00007f26e641f5fd 00000000009edb7c 00007f26d72e3344 00007f26d72e691b 00007f26d72e6798
0927 15:06:17.895806 (+ 19941us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.898683 (+ 2877us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.916878 (+ 18195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":255802112,"tablet-delete.queue_time_us":3293702}
I20260927 15:06:17.917554 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 66b54ee47e424aacb7f53fd95b0ce889 (table default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]) successfully deleted
I20260927 15:06:17.917861 2233 tablet_replica.cc:330] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:17.918066 2233 raft_consensus.cc:2229] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.918236 2233 raft_consensus.cc:2258] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.919055 2233 ts_tablet_manager.cc:1905] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.919091 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13acfcbc13204b2f9edb0f557a62252e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.919653 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 171ba98418b34aa283b7a7b243678fa9 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:17.902931 1413 tablet_service.cc:1467] Processing CreateTablet for tablet acf4391ff54b4bfb80fe00db3993845f (DEFAULT_TABLE table=default.Table_1ff7507743144d8e9f46996174bc8e85 [id=29147be930084a79bf6b91e124231f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.903658 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet b9a97e3e6a5749feb4dd5f835d9c01ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.923240 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf4391ff54b4bfb80fe00db3993845f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.917146 1556 raft_consensus.cc:348] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.924882 1556 raft_consensus.cc:374] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.924988 1556 raft_consensus.cc:729] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.925235 2797 raft_consensus.cc:482] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.925408 2797 raft_consensus.cc:504] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.925040 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 05e9d55c164d4d35a9886c5fdc1c7949 (DEFAULT_TABLE table=default.Table_6fbb7bd4420e424590f43b5cafe2b02e [id=bd0624dd172944c8bb7839cc063472c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.926059 2797 leader_election.cc:288] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.926143 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05e9d55c164d4d35a9886c5fdc1c7949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.927316 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f95d664f1134ac9bbb62c1a3d4b5617" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.928426 1376 leader_election.cc:341] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.931049 2797 raft_consensus.cc:482] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.931211 2797 raft_consensus.cc:504] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.931809 2797 leader_election.cc:288] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:17.932803 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db09498a395b4570a34d32fbfc71e8ed" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.933475 1376 leader_election.cc:341] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.933835 2797 raft_consensus.cc:482] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.933986 2797 raft_consensus.cc:504] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.934600 2797 leader_election.cc:288] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:17.925220 1556 consensus_queue.cc:260] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.935160 1556 ts_tablet_manager.cc:1428] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260927 15:06:17.935479 1556 tablet_bootstrap.cc:492] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:17.936939 1556 tablet_bootstrap.cc:654] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.936970 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd5b041a4274477895e88d4822b91cca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:17.937608 1376 leader_election.cc:341] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.938020 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 2fa6ad6816f349d98195e88bcb7ff898 (DEFAULT_TABLE table=default.Table_ba5ccbc1e5b84ade984b1ddd16f7c7e3 [id=69dbe5f973e9495ab19672a5fb6f6d94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.939357 2233 ts_tablet_manager.cc:1918] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:17.939486 2233 log.cc:1196] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/bc20a62bbd484c4e9e25cf1c15e1dde0
I20260927 15:06:17.939849 2233 ts_tablet_manager.cc:1939] T bc20a62bbd484c4e9e25cf1c15e1dde0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:17.939870 2119 ts_tablet_manager.cc:1905] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.943471 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet d25d98b148a94de4bba78a6969e81430
I20260927 15:06:17.944917 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet d25d98b148a94de4bba78a6969e81430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.945330 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 12403ee769904d389f180ccb13d86270 (DEFAULT_TABLE table=default.Table_0403b43bad954117a65684b5aeeebe11 [id=0e0b535f11ff435b88a57402493ff2be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.946058 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 4febf85191d04dd98db55c5730232e1c
I20260927 15:06:17.946996 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 4714d536373a4bf2a4be9ebeaebe77c1 with delete_type TABLET_DATA_DELETED (replaced by tablet f0e0d5f68e5b4bccb59ca2c31efdc60f) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.948661 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 4febf85191d04dd98db55c5730232e1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.949512 1272 tablet_service.cc:1467] Processing CreateTablet for tablet dc130e9f46854e738bdd68d51e8cdc00 (DEFAULT_TABLE table=default.Table_3683b1582f6747a99a46e5f72b7067d3 [id=84bd671ffe0b4cbd96c87541d967ff6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.950853 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet d25d98b148a94de4bba78a6969e81430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.951115 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 12403ee769904d389f180ccb13d86270 (DEFAULT_TABLE table=default.Table_0403b43bad954117a65684b5aeeebe11 [id=0e0b535f11ff435b88a57402493ff2be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.951512 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12403ee769904d389f180ccb13d86270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.955983 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ccb90357565c4710b3ca98388c247487"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.956552 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccb90357565c4710b3ca98388c247487 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.960644 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet df6d7670381b49bb927943b2ee920c84
W20260927 15:06:17.961239 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7770c4e004ff47ecbd38f86cf7f6fe74 consensus state has no leader
W20260927 15:06:17.962006 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 12403ee769904d389f180ccb13d86270 consensus state has no leader
I20260927 15:06:17.962286 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 171ba98418b34aa283b7a7b243678fa9
I20260927 15:06:17.962590 909 catalog_manager.cc:6565] ReplaceTablet: tablet 171ba98418b34aa283b7a7b243678fa9 deleted and replaced by tablet 28feaad311b14ea58144fc1417826186
I20260927 15:06:17.963032 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 884) took 3481 ms. Trace:
I20260927 15:06:17.963152 2233 rpcz_store.cc:276] 0927 15:06:14.481614 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.481677 (+ 63us) service_pool.cc:227] Handling call
0927 15:06:17.917795 (+3436118us) ts_tablet_manager.cc:1145] Deleting tablet bc20a62bbd484c4e9e25cf1c15e1dde0
0927 15:06:17.917805 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.922106 (+ 4301us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.939252 (+ 17146us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:17.962983 (+ 23731us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3435916}
I20260927 15:06:17.963521 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 4febf85191d04dd98db55c5730232e1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.963726 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 904) took 3093 ms. Trace:
I20260927 15:06:17.963824 2233 rpcz_store.cc:276] 0927 15:06:14.870673 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.870773 (+ 100us) service_pool.cc:227] Handling call
0927 15:06:17.963561 (+3092788us) ts_tablet_manager.cc:1145] Deleting tablet 1d2404a81332466c93429fbe550527f6
0927 15:06:17.963573 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.963674 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3086793}
I20260927 15:06:17.964324 2233 tablet_replica.cc:330] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:17.964669 2233 raft_consensus.cc:2229] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:17.965058 2233 raft_consensus.cc:2258] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.964177 1552 raft_consensus.cc:348] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.965292 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet bc20a62bbd484c4e9e25cf1c15e1dde0 (table default.Table_565f7d1851f74565b073c0e1c74d9403 [id=3305179f942c4133896ea7b9b1bc898b]) successfully deleted
W20260927 15:06:17.965524 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1d2404a81332466c93429fbe550527f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d2404a81332466c93429fbe550527f6 already in progress: creating tablet
I20260927 15:06:17.965427 1552 raft_consensus.cc:374] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.965659 1552 raft_consensus.cc:729] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.966001 2233 ts_tablet_manager.cc:1905] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.966771 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_688c5a23eb25434ab514d2adfb5fdc51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.967337 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_688c5a23eb25434ab514d2adfb5fdc51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.967859 1556 tablet_bootstrap.cc:492] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:17.968022 1556 ts_tablet_manager.cc:1397] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.001s
I20260927 15:06:17.846805 2431 raft_consensus.cc:482] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:17.847680 1561 tablet_bootstrap.cc:492] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:17.848356 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 854) took 3647 ms. Trace:
I20260927 15:06:17.968536 1562 rpcz_store.cc:276] 0927 15:06:14.200613 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.200924 (+ 311us) service_pool.cc:227] Handling call
0927 15:06:17.848255 (+3647331us) ts_tablet_manager.cc:1145] Deleting tablet bc2974e11cf1446895607b4ccec16386
0927 15:06:17.848266 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.848342 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3647178}
I20260927 15:06:17.861086 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 92e5165b00e24374b611c552bc077b81 (DEFAULT_TABLE table=default.Table_266fb85b088a4364861ec604df33d892 [id=afa96ca299de4200a02ab09c22bfb64f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.968986 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 855) took 3737 ms. Trace:
I20260927 15:06:17.968977 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 3878c448f0ff4fb1bcfdc6f3ba5478dc (DEFAULT_TABLE table=default.Table_47bb2cc8986c43588be2aae5774b41bb [id=94767c5bd216492b8d57de6425ed40f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.853750 1099 leader_election.cc:302] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:17.969152 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92e5165b00e24374b611c552bc077b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.969077 1562 rpcz_store.cc:276] 0927 15:06:14.231778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.232364 (+ 586us) service_pool.cc:227] Handling call
0927 15:06:17.968855 (+3736491us) ts_tablet_manager.cc:1145] Deleting tablet 1a7f84a178ab4cd6b7deeae02e1e52ec
0927 15:06:17.968869 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:17.968967 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3736256}
I20260927 15:06:17.968701 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 171ba98418b34aa283b7a7b243678fa9 with delete_type TABLET_DATA_DELETED (replaced by tablet 28feaad311b14ea58144fc1417826186) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:17.969332 1562 tablet_replica.cc:330] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:06:17.969372 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 115646us
I20260927 15:06:17.968577 2431 raft_consensus.cc:3037] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:17.969539 1562 raft_consensus.cc:2229] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:17.969837 1562 pending_rounds.cc:62] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:17.969898 1562 pending_rounds.cc:68] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976371407097856 op_type: NO_OP noop_request { }
I20260927 15:06:17.970012 1562 raft_consensus.cc:2866] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:17.970117 1562 raft_consensus.cc:2258] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:17.866009 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f8744e2349e49d3a821eca42c7f89a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.970285 2568 raft_consensus.cc:2781] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:17.970527 1143 tablet_service.cc:1467] Processing CreateTablet for tablet dc130e9f46854e738bdd68d51e8cdc00 (DEFAULT_TABLE table=default.Table_3683b1582f6747a99a46e5f72b7067d3 [id=84bd671ffe0b4cbd96c87541d967ff6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.970726 1562 ts_tablet_manager.cc:1905] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.867094 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ebacc9c2fca45ff92635e41a19e5bd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.885833 1144 tablet_service.cc:1467] Processing CreateTablet for tablet d97993083ab646f2b28dc4c32444bf9c (DEFAULT_TABLE table=default.Table_083f55ec5dae45c1bbb7305ac554f75e [id=d8cf621eea3d411a883b1d8c714928cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.876762 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 0cfd4839cc644d8781ce4908081199f0 (DEFAULT_TABLE table=default.Table_2d6610dc3caa4d0994e8402046407009 [id=af86e1c3dc38472a9946c864553afe62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.887820 1133 tablet_service.cc:1467] Processing CreateTablet for tablet a0925fb692914976b4fb2f978397f3f6 (DEFAULT_TABLE table=default.Table_58db51a88dc7411b9037dce22c825e3c [id=991a607dc3c64ad4b603c653ebf3d498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.906014 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 13acfcbc13204b2f9edb0f557a62252e (DEFAULT_TABLE table=default.Table_e0071303c5c7491cb1289e60813891bb [id=6a7fde00643b4784b513f581f54f2e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.905795 1132 tablet_service.cc:1467] Processing CreateTablet for tablet b5f489db1e3640d2bac4e134b487d7ed (DEFAULT_TABLE table=default.Table_0de786b8335e40d7b02555750495ff59 [id=503babdc7fe742cf8904698d719dbb96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.906222 1138 tablet_service.cc:1467] Processing CreateTablet for tablet acf4391ff54b4bfb80fe00db3993845f (DEFAULT_TABLE table=default.Table_1ff7507743144d8e9f46996174bc8e85 [id=29147be930084a79bf6b91e124231f38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.906015 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 2fa6ad6816f349d98195e88bcb7ff898 (DEFAULT_TABLE table=default.Table_ba5ccbc1e5b84ade984b1ddd16f7c7e3 [id=69dbe5f973e9495ab19672a5fb6f6d94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.929391 2365 raft_consensus.cc:482] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.972468 2365 raft_consensus.cc:504] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.973078 2365 leader_election.cc:288] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.973208 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3878c448f0ff4fb1bcfdc6f3ba5478dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.935156 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd5b041a4274477895e88d4822b91cca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:17.941639 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 5b37e436d8d1462d8d2299449b53ce7b (DEFAULT_TABLE table=default.Table_0f0652967878460c8defab6738bc1839 [id=84d3377771ba47f7b6ac06f83a062497]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:17.936851 1102 consensus_peers.cc:487] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:17.947417 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 4febf85191d04dd98db55c5730232e1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.964177 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet df6d7670381b49bb927943b2ee920c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.964177 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 171ba98418b34aa283b7a7b243678fa9 with delete_type TABLET_DATA_DELETED (replaced by tablet 28feaad311b14ea58144fc1417826186) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:17.974601 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet bc2974e11cf1446895607b4ccec16386 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc2974e11cf1446895607b4ccec16386 already in progress: creating tablet
W20260927 15:06:17.974720 1374 leader_election.cc:341] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:17.974931 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1a7f84a178ab4cd6b7deeae02e1e52ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a7f84a178ab4cd6b7deeae02e1e52ec already in progress: creating tablet
I20260927 15:06:17.975422 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9576d1a36d7547bf81faabe9c362e3cb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.858485 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 0a1e7d78c7154345b33ac78f497d26a4 (DEFAULT_TABLE table=default.Table_ee124d45bf99401ea1d62efd5d0bb634 [id=0bcaf6117a1241f98ecfa4c7b200d17b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.865362 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 51f0744f9d804b84a958916c2dd04503 with delete_type TABLET_DATA_DELETED (replaced by tablet 57580db090ad4e4e94a3d22063e57ad4) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.886703 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 05e9d55c164d4d35a9886c5fdc1c7949 (DEFAULT_TABLE table=default.Table_6fbb7bd4420e424590f43b5cafe2b02e [id=bd0624dd172944c8bb7839cc063472c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.865423 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d7e01486e941f9a6a5f691ae6c7d68 with delete_type TABLET_DATA_DELETED (replaced by tablet 414bb75a756f4549b9d147490344287a) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.976671 1374 leader_election.cc:302] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:17.977073 2797 raft_consensus.cc:2726] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:17.977852 1102 consensus_peers.cc:487] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:17.978039 1102 leader_election.cc:341] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.978459 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5f489db1e3640d2bac4e134b487d7ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.968544 1561 ts_tablet_manager.cc:1397] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.131s user 0.004s sys 0.000s
I20260927 15:06:17.978915 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13acfcbc13204b2f9edb0f557a62252e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.979311 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d97993083ab646f2b28dc4c32444bf9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.979573 1561 raft_consensus.cc:348] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.979754 1561 raft_consensus.cc:374] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:17.979801 1561 raft_consensus.cc:729] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:17.979961 1561 consensus_queue.cc:260] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:17.980429 1561 ts_tablet_manager.cc:1428] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 15:06:17.980639 1561 tablet_bootstrap.cc:492] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:17.981813 1561 tablet_bootstrap.cc:654] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:17.916219 2824 raft_consensus.cc:482] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:17.944865 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 12403ee769904d389f180ccb13d86270 (DEFAULT_TABLE table=default.Table_0403b43bad954117a65684b5aeeebe11 [id=0e0b535f11ff435b88a57402493ff2be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.982574 2824 raft_consensus.cc:504] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:17.982903 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12403ee769904d389f180ccb13d86270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.983091 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0925fb692914976b4fb2f978397f3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.983112 2824 leader_election.cc:288] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:17.944824 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet d25d98b148a94de4bba78a6969e81430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:17.983245 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc130e9f46854e738bdd68d51e8cdc00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.983335 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fa6ad6816f349d98195e88bcb7ff898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.932392 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db09498a395b4570a34d32fbfc71e8ed" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:17.928296 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f95d664f1134ac9bbb62c1a3d4b5617" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:17.984037 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05e9d55c164d4d35a9886c5fdc1c7949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.986923 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fa6ad6816f349d98195e88bcb7ff898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.988049 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef93a120f00423d91664ce4eaf03803" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:17.989526 1405 tablet_service.cc:1467] Processing CreateTablet for tablet dc130e9f46854e738bdd68d51e8cdc00 (DEFAULT_TABLE table=default.Table_3683b1582f6747a99a46e5f72b7067d3 [id=84bd671ffe0b4cbd96c87541d967ff6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:17.989941 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc130e9f46854e738bdd68d51e8cdc00. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:17.990584 1102 leader_election.cc:341] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:17.990938 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b37e436d8d1462d8d2299449b53ce7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.992553 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 171ba98418b34aa283b7a7b243678fa9 with delete_type TABLET_DATA_DELETED (replaced by tablet 28feaad311b14ea58144fc1417826186) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:17.994967 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a1e7d78c7154345b33ac78f497d26a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.996300 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d685958bb92c4b3eb8483ad67fecaeec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.996858 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d685958bb92c4b3eb8483ad67fecaeec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:17.998983 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cfd4839cc644d8781ce4908081199f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:17.999311 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8375212a3e50458da359b3328ef24831"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:17.999763 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8375212a3e50458da359b3328ef24831 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.001742 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3ed05ef39f8d4541adb74fb6cfdab68c" } new_table_name: "default.Table_f2e2c330bf5f4e459ae856c9f8b35dd8" modify_external_catalogs: true
I20260927 15:06:18.003014 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acf4391ff54b4bfb80fe00db3993845f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.007424 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_621ab4142aac41ba946d83825752a245" } new_table_name: "default.Table_3c03069c2c6548b4846c99945f2c244f" modify_external_catalogs: true
I20260927 15:06:18.008366 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet df6d7670381b49bb927943b2ee920c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:18.008984 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b36838686d1a4ccabe0659355f8b5f77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.009510 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b36838686d1a4ccabe0659355f8b5f77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.010285 2431 raft_consensus.cc:504] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:18.011132 1374 leader_election.cc:341] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.011296 1374 leader_election.cc:302] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:18.011396 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75645963963e4091af0edfcbc794fb2d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:18.011723 1374 leader_election.cc:341] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.011838 1374 leader_election.cc:302] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:18.012116 1102 leader_election.cc:341] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.012200 2789 raft_consensus.cc:2726] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.012382 2789 raft_consensus.cc:2726] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.017231 2661 raft_consensus.cc:482] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.017392 2661 raft_consensus.cc:504] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.018057 2661 leader_election.cc:288] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.019975 2431 leader_election.cc:288] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.020363 1561 tablet_bootstrap.cc:492] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.020481 1561 ts_tablet_manager.cc:1397] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.004s
W20260927 15:06:18.020442 1239 leader_election.cc:341] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 8790d59beb804acb8e4353f862d7f6f8
W20260927 15:06:18.021086 1238 leader_election.cc:341] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 8790d59beb804acb8e4353f862d7f6f8
I20260927 15:06:18.021217 1238 leader_election.cc:302] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:18.021656 2661 raft_consensus.cc:2726] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.021085 1561 raft_consensus.cc:348] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.022053 909 master_service.cc:946] ReplaceTablet: received request to replace tablet ac64eacc7d924940aacc8779b5bfeae7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:18.022127 1561 raft_consensus.cc:374] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.022192 1561 raft_consensus.cc:729] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.022279 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a13b57205a8b490ab36e73f4b3140397"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:18.022382 1561 consensus_queue.cc:260] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:18.022907 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a13b57205a8b490ab36e73f4b3140397 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.023545 1561 ts_tablet_manager.cc:1428] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:18.023787 1561 tablet_bootstrap.cc:492] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.024674 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_26e580c47f6447e49e838ec66db70015" } new_table_name: "default.Table_1ab8fb0ae9fa4ae1be22b7441b4a6c72" modify_external_catalogs: true
I20260927 15:06:17.974840 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet df6d7670381b49bb927943b2ee920c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:18.026758 1561 tablet_bootstrap.cc:654] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.030462 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2488bbed3604438f94bdeed81e1161e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.031049 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2488bbed3604438f94bdeed81e1161e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.034155 2233 ts_tablet_manager.cc:1918] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.034673 2233 log.cc:1196] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3efc44686be2407cbcdca61909301539
I20260927 15:06:18.035157 2233 ts_tablet_manager.cc:1939] T 3efc44686be2407cbcdca61909301539 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:18.038252 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21da5f76a51045789261e7cfe0feacd3 consensus state has no leader
I20260927 15:06:18.039556 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc130e9f46854e738bdd68d51e8cdc00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.040078 1561 tablet_bootstrap.cc:492] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.040280 1561 ts_tablet_manager.cc:1397] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260927 15:06:18.040874 1561 raft_consensus.cc:348] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.041136 1561 raft_consensus.cc:374] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.041227 1561 raft_consensus.cc:729] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.041473 1561 consensus_queue.cc:260] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.042102 1561 ts_tablet_manager.cc:1428] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:18.042395 1561 tablet_bootstrap.cc:492] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.043958 1561 tablet_bootstrap.cc:654] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.045634 1562 ts_tablet_manager.cc:1918] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:18.045753 1562 log.cc:1196] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/c90e5c66d8564f68b401b3e4280499a7
I20260927 15:06:18.046144 1562 ts_tablet_manager.cc:1939] T c90e5c66d8564f68b401b3e4280499a7 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:18.046983 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 856) took 3796 ms. Trace:
I20260927 15:06:18.047084 1562 rpcz_store.cc:276] 0927 15:06:14.250620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.250681 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:17.969294 (+3718613us) ts_tablet_manager.cc:1145] Deleting tablet c90e5c66d8564f68b401b3e4280499a7
0927 15:06:17.969304 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.000807 (+ 31503us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.045526 (+ 44719us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.046967 (+ 1441us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3718343}
I20260927 15:06:18.047520 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet c90e5c66d8564f68b401b3e4280499a7 (table default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]) successfully deleted
I20260927 15:06:18.052386 1561 tablet_bootstrap.cc:492] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.052551 1561 ts_tablet_manager.cc:1397] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260927 15:06:18.053191 1561 raft_consensus.cc:348] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.053464 1561 raft_consensus.cc:374] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.053552 1561 raft_consensus.cc:729] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.053898 1561 consensus_queue.cc:260] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.054616 1561 ts_tablet_manager.cc:1428] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:18.054937 1561 tablet_bootstrap.cc:492] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.056532 1561 tablet_bootstrap.cc:654] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.064234 1561 tablet_bootstrap.cc:492] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.064407 1561 ts_tablet_manager.cc:1397] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260927 15:06:18.065023 1561 raft_consensus.cc:348] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.065287 1561 raft_consensus.cc:374] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.065375 1561 raft_consensus.cc:729] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.065613 1561 consensus_queue.cc:260] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.066356 1561 ts_tablet_manager.cc:1428] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:18.066632 1561 tablet_bootstrap.cc:492] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.068113 1561 tablet_bootstrap.cc:654] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.069852 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 905) took 3197 ms. Trace:
I20260927 15:06:18.069957 2233 rpcz_store.cc:276] 0927 15:06:14.872074 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.872135 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:17.964205 (+3092070us) ts_tablet_manager.cc:1145] Deleting tablet 3efc44686be2407cbcdca61909301539
0927 15:06:17.964248 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.028392 (+ 64144us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.034034 (+ 5642us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.069828 (+ 35794us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33565,"tablet-delete.queue_time_us":3087252}
I20260927 15:06:18.070487 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 906) took 3189 ms. Trace:
I20260927 15:06:18.070561 2233 rpcz_store.cc:276] 0927 15:06:14.881109 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.881423 (+ 314us) service_pool.cc:227] Handling call
0927 15:06:18.070346 (+3188923us) ts_tablet_manager.cc:1145] Deleting tablet 2bbb2131b0f54a7eb74c5d3cba962860
0927 15:06:18.070358 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.070467 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3181829}
I20260927 15:06:18.070695 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12403ee769904d389f180ccb13d86270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.070901 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 908) took 3181 ms. Trace:
I20260927 15:06:18.070973 2233 rpcz_store.cc:276] 0927 15:06:14.889074 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.889116 (+ 42us) service_pool.cc:227] Handling call
0927 15:06:18.070765 (+3181649us) ts_tablet_manager.cc:1145] Deleting tablet bb348ff23de548fca4156a8533579a0e
0927 15:06:18.070774 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.070882 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3181470}
I20260927 15:06:18.071265 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 907) took 3182 ms. Trace:
I20260927 15:06:18.071339 2233 rpcz_store.cc:276] 0927 15:06:14.888967 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.889436 (+ 469us) service_pool.cc:227] Handling call
0927 15:06:18.071163 (+3181727us) ts_tablet_manager.cc:1145] Deleting tablet ba9f24239ae14eaf80b96a711596b00a
0927 15:06:18.071172 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.071250 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3133323}
I20260927 15:06:18.071602 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 909) took 3182 ms. Trace:
I20260927 15:06:18.071663 2233 rpcz_store.cc:276] 0927 15:06:14.932300 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.936798 (+ 4498us) service_pool.cc:227] Handling call
0927 15:06:18.071516 (+3134718us) ts_tablet_manager.cc:1145] Deleting tablet 534a74d9f8e648168b87e26fb73c8b3a
0927 15:06:18.071527 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.071590 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3132830}
I20260927 15:06:18.071949 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 910) took 3131 ms. Trace:
I20260927 15:06:18.072008 2233 rpcz_store.cc:276] 0927 15:06:14.942492 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.943908 (+ 1416us) service_pool.cc:227] Handling call
0927 15:06:18.071837 (+3127929us) ts_tablet_manager.cc:1145] Deleting tablet 796eef27ca8341b1a1ccc95770892e04
0927 15:06:18.071845 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.071927 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3110557}
I20260927 15:06:18.072217 2233 tablet_replica.cc:330] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.072381 2233 raft_consensus.cc:2229] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.072542 2233 raft_consensus.cc:2258] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.074427 2233 ts_tablet_manager.cc:1905] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:17.967162 1552 consensus_queue.cc:260] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.080296 1552 ts_tablet_manager.cc:1428] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.176s user 0.003s sys 0.000s
I20260927 15:06:18.080936 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 3efc44686be2407cbcdca61909301539 (table default.Table_90059eaac20f42eead7d864d2e91a12e [id=20050d0c476441cc882540df66f162fb]) successfully deleted
W20260927 15:06:18.081283 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2bbb2131b0f54a7eb74c5d3cba962860 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bbb2131b0f54a7eb74c5d3cba962860 already in progress: creating tablet
W20260927 15:06:18.081640 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bb348ff23de548fca4156a8533579a0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb348ff23de548fca4156a8533579a0e already in progress: creating tablet
I20260927 15:06:18.083213 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 3878c448f0ff4fb1bcfdc6f3ba5478dc (DEFAULT_TABLE table=default.Table_47bb2cc8986c43588be2aae5774b41bb [id=94767c5bd216492b8d57de6425ed40f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.083729 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3878c448f0ff4fb1bcfdc6f3ba5478dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.083714 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 4ebacc9c2fca45ff92635e41a19e5bd8 (DEFAULT_TABLE table=default.Table_b899d4e7001546fca9ea2952ad36dbd9 [id=7276d430892e49029468751e0db66531]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.084057 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ebacc9c2fca45ff92635e41a19e5bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.085103 1269 tablet_service.cc:1467] Processing CreateTablet for tablet f8a230f146e74977a7b7b740a6ac770a (DEFAULT_TABLE table=default.Table_cc3a42843c734375a3ab18a970b34402 [id=7638caef736841469e8138c152f9362a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.085429 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8a230f146e74977a7b7b740a6ac770a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.087075 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 4ebacc9c2fca45ff92635e41a19e5bd8 (DEFAULT_TABLE table=default.Table_b899d4e7001546fca9ea2952ad36dbd9 [id=7276d430892e49029468751e0db66531]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.087500 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ebacc9c2fca45ff92635e41a19e5bd8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:18.089862 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ba9f24239ae14eaf80b96a711596b00a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba9f24239ae14eaf80b96a711596b00a already in progress: creating tablet
W20260927 15:06:18.090143 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 534a74d9f8e648168b87e26fb73c8b3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 534a74d9f8e648168b87e26fb73c8b3a already in progress: creating tablet
W20260927 15:06:18.090384 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 796eef27ca8341b1a1ccc95770892e04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 796eef27ca8341b1a1ccc95770892e04 already in progress: creating tablet
I20260927 15:06:18.091238 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 3878c448f0ff4fb1bcfdc6f3ba5478dc (DEFAULT_TABLE table=default.Table_47bb2cc8986c43588be2aae5774b41bb [id=94767c5bd216492b8d57de6425ed40f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.091390 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 4ebacc9c2fca45ff92635e41a19e5bd8 (DEFAULT_TABLE table=default.Table_b899d4e7001546fca9ea2952ad36dbd9 [id=7276d430892e49029468751e0db66531]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.091646 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3878c448f0ff4fb1bcfdc6f3ba5478dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.091838 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ebacc9c2fca45ff92635e41a19e5bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.094005 1552 tablet_bootstrap.cc:492] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:18.094862 2233 ts_tablet_manager.cc:1918] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:18.095007 2233 log.cc:1196] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/f271c76b5f2447239d3d014fbde4e8b2
I20260927 15:06:18.095404 2233 ts_tablet_manager.cc:1939] T f271c76b5f2447239d3d014fbde4e8b2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.095994 1552 tablet_bootstrap.cc:654] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.096170 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 911) took 3039 ms. Trace:
I20260927 15:06:18.096320 2233 rpcz_store.cc:276] 0927 15:06:15.056671 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.056749 (+ 78us) service_pool.cc:227] Handling call
0927 15:06:18.072174 (+3015425us) ts_tablet_manager.cc:1145] Deleting tablet f271c76b5f2447239d3d014fbde4e8b2
0927 15:06:18.072191 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.092126 (+ 19935us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.094759 (+ 2633us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.096152 (+ 1393us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3015197}
I20260927 15:06:18.096837 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet f271c76b5f2447239d3d014fbde4e8b2 (table default.Table_e54284c6f69f46a58add5dfc7c9bec4a [id=6b5a311a2ea347fb8e51feecb8e01b7c]) successfully deleted
I20260927 15:06:18.069971 1556 raft_consensus.cc:348] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.097169 1556 raft_consensus.cc:374] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.097280 1556 raft_consensus.cc:729] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.097509 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 857) took 3824 ms. Trace:
I20260927 15:06:18.097564 1556 consensus_queue.cc:260] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.097687 1562 rpcz_store.cc:276] 0927 15:06:14.273179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.273236 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:18.097231 (+3823995us) ts_tablet_manager.cc:1145] Deleting tablet c5de1bf320ca4043b31154380710ad79
0927 15:06:18.097247 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.097359 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3823738}
I20260927 15:06:18.098104 1556 ts_tablet_manager.cc:1428] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.130s user 0.000s sys 0.002s
W20260927 15:06:18.098390 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c5de1bf320ca4043b31154380710ad79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5de1bf320ca4043b31154380710ad79 already in progress: creating tablet
I20260927 15:06:18.098627 2233 tablet_replica.cc:330] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.098876 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 858) took 3808 ms. Trace:
I20260927 15:06:18.098899 2233 raft_consensus.cc:2229] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.099030 2233 raft_consensus.cc:2258] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.099541 2233 ts_tablet_manager.cc:1905] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.103063 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 20290f1c40804ffe9ff6f1168f053899 (DEFAULT_TABLE table=default.Table_9318935079e64e20b6034c64074600a3 [id=89be799027de4c28867cbc648cf3ad9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.103400 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20290f1c40804ffe9ff6f1168f053899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.103660 1405 tablet_service.cc:1467] Processing CreateTablet for tablet f8a230f146e74977a7b7b740a6ac770a (DEFAULT_TABLE table=default.Table_cc3a42843c734375a3ab18a970b34402 [id=7638caef736841469e8138c152f9362a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.103982 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8a230f146e74977a7b7b740a6ac770a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.111632 1556 tablet_bootstrap.cc:492] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.113029 1556 tablet_bootstrap.cc:654] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.114600 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 20290f1c40804ffe9ff6f1168f053899 (DEFAULT_TABLE table=default.Table_9318935079e64e20b6034c64074600a3 [id=89be799027de4c28867cbc648cf3ad9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.115051 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20290f1c40804ffe9ff6f1168f053899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.110627 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 20290f1c40804ffe9ff6f1168f053899 (DEFAULT_TABLE table=default.Table_9318935079e64e20b6034c64074600a3 [id=89be799027de4c28867cbc648cf3ad9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.116725 1562 rpcz_store.cc:276] 0927 15:06:14.290500 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.290568 (+ 68us) service_pool.cc:227] Handling call
0927 15:06:18.098710 (+3808142us) ts_tablet_manager.cc:1145] Deleting tablet e9f171fd62d644f38262a2257d47fafe
0927 15:06:18.098722 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.098858 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3807213}
I20260927 15:06:18.116940 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20290f1c40804ffe9ff6f1168f053899. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:18.117308 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e9f171fd62d644f38262a2257d47fafe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9f171fd62d644f38262a2257d47fafe already in progress: creating tablet
I20260927 15:06:18.119120 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 880) took 3287 ms. Trace:
I20260927 15:06:18.119230 1562 rpcz_store.cc:276] 0927 15:06:14.831259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.831821 (+ 562us) service_pool.cc:227] Handling call
0927 15:06:18.118992 (+3287171us) ts_tablet_manager.cc:1145] Deleting tablet 1d2404a81332466c93429fbe550527f6
0927 15:06:18.119004 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.119099 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3286970}
W20260927 15:06:18.119661 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1d2404a81332466c93429fbe550527f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d2404a81332466c93429fbe550527f6 already in progress: creating tablet
I20260927 15:06:18.121590 1556 tablet_bootstrap.cc:492] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.111124 1138 tablet_service.cc:1467] Processing CreateTablet for tablet f8a230f146e74977a7b7b740a6ac770a (DEFAULT_TABLE table=default.Table_cc3a42843c734375a3ab18a970b34402 [id=7638caef736841469e8138c152f9362a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.123065 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8a230f146e74977a7b7b740a6ac770a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.123732 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 881) took 3283 ms. Trace:
I20260927 15:06:18.124320 1556 ts_tablet_manager.cc:1397] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.003s
I20260927 15:06:18.124632 1562 rpcz_store.cc:276] 0927 15:06:14.840552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.840932 (+ 380us) service_pool.cc:227] Handling call
0927 15:06:18.123009 (+3282077us) ts_tablet_manager.cc:1145] Deleting tablet 2bbb2131b0f54a7eb74c5d3cba962860
0927 15:06:18.123017 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.123714 (+ 697us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3281886}
I20260927 15:06:18.125069 1556 raft_consensus.cc:348] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.125283 1556 raft_consensus.cc:374] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.125329 1556 raft_consensus.cc:729] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.125802 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 491329dfaafc4951863c8b5241845630 (DEFAULT_TABLE table=default.Table_fa283539fbf84091ba86f819f675b7c6 [id=5749d8a9ef8e4a28953c1f068c748af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.126166 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 491329dfaafc4951863c8b5241845630. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:18.127604 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 2bbb2131b0f54a7eb74c5d3cba962860 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bbb2131b0f54a7eb74c5d3cba962860 already in progress: creating tablet
I20260927 15:06:18.128489 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 884) took 3248 ms. Trace:
I20260927 15:06:18.129362 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 491329dfaafc4951863c8b5241845630 (DEFAULT_TABLE table=default.Table_fa283539fbf84091ba86f819f675b7c6 [id=5749d8a9ef8e4a28953c1f068c748af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.129791 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 491329dfaafc4951863c8b5241845630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.130226 1562 rpcz_store.cc:276] 0927 15:06:14.879855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.879905 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:18.128372 (+3248467us) ts_tablet_manager.cc:1145] Deleting tablet 534a74d9f8e648168b87e26fb73c8b3a
0927 15:06:18.128382 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.128471 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3248237}
I20260927 15:06:18.131836 1556 consensus_queue.cc:260] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.132895 1272 tablet_service.cc:1467] Processing CreateTablet for tablet a45a536f62d74465ab03b1943ce3fb46 (DEFAULT_TABLE table=default.Table_198df37a55574154a04d6ef03a65c140 [id=724cc32bbf8748ecbb67ae0253d4b92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.133137 2797 raft_consensus.cc:482] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.133265 2797 raft_consensus.cc:504] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:18.133649 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 534a74d9f8e648168b87e26fb73c8b3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 534a74d9f8e648168b87e26fb73c8b3a already in progress: creating tablet
I20260927 15:06:18.133801 2797 leader_election.cc:288] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:18.134459 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 882) took 3259 ms. Trace:
I20260927 15:06:18.134429 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d533883e3344eca939cd67644895148" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:18.138521 1562 rpcz_store.cc:276] 0927 15:06:14.874993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.880350 (+ 5357us) service_pool.cc:227] Handling call
0927 15:06:18.134359 (+3254009us) ts_tablet_manager.cc:1145] Deleting tablet ba9f24239ae14eaf80b96a711596b00a
0927 15:06:18.134369 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.134445 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3253852}
I20260927 15:06:18.139058 1556 ts_tablet_manager.cc:1428] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260927 15:06:18.134151 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d533883e3344eca939cd67644895148" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.139117 1374 leader_election.cc:341] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:18.139570 1376 leader_election.cc:341] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.139660 1376 leader_election.cc:302] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:18.140008 2797 raft_consensus.cc:2726] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.140759 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a45a536f62d74465ab03b1943ce3fb46. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:18.144258 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ba9f24239ae14eaf80b96a711596b00a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba9f24239ae14eaf80b96a711596b00a already in progress: creating tablet
I20260927 15:06:18.144855 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef93a120f00423d91664ce4eaf03803" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.145041 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75645963963e4091af0edfcbc794fb2d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:18.124143 2233 ts_tablet_manager.cc:1918] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.145190 1435 raft_consensus.cc:3037] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.145051 1433 raft_consensus.cc:2454] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:18.145387 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9576d1a36d7547bf81faabe9c362e3cb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.147004 2233 log.cc:1196] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/9576d1a36d7547bf81faabe9c362e3cb
I20260927 15:06:18.148231 1561 tablet_bootstrap.cc:492] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.148411 1561 ts_tablet_manager.cc:1397] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.082s user 0.003s sys 0.007s
I20260927 15:06:18.149232 1561 raft_consensus.cc:348] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.149535 1561 raft_consensus.cc:374] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.149669 1561 raft_consensus.cc:729] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.149968 1561 consensus_queue.cc:260] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.151077 1561 ts_tablet_manager.cc:1428] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:18.151675 1561 tablet_bootstrap.cc:492] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.149430 1435 raft_consensus.cc:2454] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:18.152128 2233 ts_tablet_manager.cc:1939] T 9576d1a36d7547bf81faabe9c362e3cb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.153049 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 912) took 3089 ms. Trace:
I20260927 15:06:18.153162 2233 rpcz_store.cc:276] 0927 15:06:15.063903 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.063960 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:18.098323 (+3034363us) ts_tablet_manager.cc:1145] Deleting tablet 9576d1a36d7547bf81faabe9c362e3cb
0927 15:06:18.098590 (+ 267us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.102284 (+ 3694us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.124055 (+ 21771us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.153027 (+ 28972us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3034142}
I20260927 15:06:18.153570 2233 tablet_replica.cc:330] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.153791 2233 raft_consensus.cc:2229] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.153853 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 9576d1a36d7547bf81faabe9c362e3cb (table default.Table_7c7824484c624468a8ccbd47f7ea4ca8 [id=9c08749b7a9241a9870e1b13ae17aece]) successfully deleted
I20260927 15:06:18.153947 2233 raft_consensus.cc:2258] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.154505 2233 ts_tablet_manager.cc:1905] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.157289 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_587629fe75ba4c53b0146880ced51cfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.157867 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_587629fe75ba4c53b0146880ced51cfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:18.158452 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ee9b3d162764abf9d2754ba5c1382fe consensus state has no leader
I20260927 15:06:18.151360 1556 tablet_bootstrap.cc:492] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.158769 910 master_service.cc:946] ReplaceTablet: received request to replace tablet b0b25e485f3d4e6780cd34d9e13fa807 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:18.160233 1556 tablet_bootstrap.cc:654] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.160156 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a407bc25637a4990bf7860f31e2efbc8" } modify_external_catalogs: true
I20260927 15:06:18.160351 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a407bc25637a4990bf7860f31e2efbc8" } modify_external_catalogs: true
I20260927 15:06:18.162333 1561 tablet_bootstrap.cc:654] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:18.148448 1099 consensus_peers.cc:487] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66b54ee47e424aacb7f53fd95b0ce889. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.163300 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e83eab00b2e44e7f8307f5bde03f48a2" } modify_external_catalogs: true
I20260927 15:06:18.163319 1099 leader_election.cc:302] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.163491 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e83eab00b2e44e7f8307f5bde03f48a2" } modify_external_catalogs: true
I20260927 15:06:18.163735 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet a8659865bf644458b3b5a78eae36a524 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:18.163754 1099 leader_election.cc:341] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: Tablet not RUNNING: STOPPED
I20260927 15:06:18.163868 1099 leader_election.cc:302] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:18.164219 1099 consensus_peers.cc:487] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e9b07ea3ec9457399e2b765580d06e7. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.165791 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3d43a49fe60b43e7920bf4a2da41d743" } modify_external_catalogs: true
I20260927 15:06:18.165974 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3d43a49fe60b43e7920bf4a2da41d743" } modify_external_catalogs: true
I20260927 15:06:18.154923 1128 tablet_service.cc:1467] Processing CreateTablet for tablet a45a536f62d74465ab03b1943ce3fb46 (DEFAULT_TABLE table=default.Table_198df37a55574154a04d6ef03a65c140 [id=724cc32bbf8748ecbb67ae0253d4b92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.167599 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a45a536f62d74465ab03b1943ce3fb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.171265 2824 raft_consensus.cc:2781] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.171356 2824 raft_consensus.cc:482] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.171418 2824 raft_consensus.cc:3037] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.172538 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 883) took 3292 ms. Trace:
I20260927 15:06:18.172627 1562 rpcz_store.cc:276] 0927 15:06:14.879655 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.880543 (+ 888us) service_pool.cc:227] Handling call
0927 15:06:18.172412 (+3291869us) ts_tablet_manager.cc:1145] Deleting tablet bb348ff23de548fca4156a8533579a0e
0927 15:06:18.172423 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.172520 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3291746}
I20260927 15:06:18.172973 2431 raft_consensus.cc:2726] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:18.173079 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet bb348ff23de548fca4156a8533579a0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb348ff23de548fca4156a8533579a0e already in progress: creating tablet
I20260927 15:06:18.170434 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cc8bd2079f84da39e13113e6699bf5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:18.174165 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 256f369571214726a3ef8f9d65040032 (DEFAULT_TABLE table=default.Table_e97674d6a4af430f80eb42916ccbaae6 [id=75a4064277d64df88aa36168db78e988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.174862 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 256f369571214726a3ef8f9d65040032 (DEFAULT_TABLE table=default.Table_e97674d6a4af430f80eb42916ccbaae6 [id=75a4064277d64df88aa36168db78e988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.175009 2824 raft_consensus.cc:504] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.175205 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 256f369571214726a3ef8f9d65040032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.175558 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 256f369571214726a3ef8f9d65040032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.175894 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef93a120f00423d91664ce4eaf03803" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:18.176383 1102 leader_election.cc:341] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.176612 2824 leader_election.cc:288] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.176980 1099 leader_election.cc:302] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.177225 2431 raft_consensus.cc:2781] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.177330 2431 raft_consensus.cc:686] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.177516 2431 consensus_queue.cc:237] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.179138 1556 tablet_bootstrap.cc:492] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.179266 1556 ts_tablet_manager.cc:1397] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.001s
I20260927 15:06:18.180084 1561 tablet_bootstrap.cc:492] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.180194 1561 ts_tablet_manager.cc:1397] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260927 15:06:18.186681 2828 raft_consensus.cc:482] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.186872 2828 raft_consensus.cc:504] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.187678 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 885) took 3286 ms. Trace:
I20260927 15:06:18.187788 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8de6246f7904f6c80df624f3631db17" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:18.187819 1562 rpcz_store.cc:276] 0927 15:06:14.901482 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.901615 (+ 133us) service_pool.cc:227] Handling call
0927 15:06:18.187580 (+3285965us) ts_tablet_manager.cc:1145] Deleting tablet fe7816e099094d13887650fc223097c7
0927 15:06:18.187592 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.187660 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3285595}
W20260927 15:06:18.188341 1102 leader_election.cc:341] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:18.188524 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet fe7816e099094d13887650fc223097c7 because the tablet was not found. No further retry: Not found: Tablet not found: fe7816e099094d13887650fc223097c7
I20260927 15:06:18.188597 2828 leader_election.cc:288] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.158653 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 491329dfaafc4951863c8b5241845630 (DEFAULT_TABLE table=default.Table_fa283539fbf84091ba86f819f675b7c6 [id=5749d8a9ef8e4a28953c1f068c748af4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.191155 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 491329dfaafc4951863c8b5241845630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.191165 1276 tablet_service.cc:1467] Processing CreateTablet for tablet fa143466f2bd4185887d6ccfcbbe8dd8 (DEFAULT_TABLE table=default.Table_a8cba3f530e84e4684b52d7098f44dde [id=975b2dcaf69e49eca6f8d5059eda9f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.191959 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef93a120f00423d91664ce4eaf03803" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:18.192167 1433 raft_consensus.cc:3037] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.192341 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8de6246f7904f6c80df624f3631db17" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.192560 1438 raft_consensus.cc:2454] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:18.193207 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 886) took 3290 ms. Trace:
I20260927 15:06:18.194679 1433 raft_consensus.cc:2454] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:18.195343 1407 tablet_service.cc:1467] Processing CreateTablet for tablet fa143466f2bd4185887d6ccfcbbe8dd8 (DEFAULT_TABLE table=default.Table_a8cba3f530e84e4684b52d7098f44dde [id=975b2dcaf69e49eca6f8d5059eda9f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.195747 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa143466f2bd4185887d6ccfcbbe8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.196149 2797 raft_consensus.cc:482] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.196316 2797 raft_consensus.cc:504] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.192823 2119 ts_tablet_manager.cc:1918] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:18.196818 2119 log.cc:1196] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/fb2a8e788b71451da4a18f52b643e5e2
I20260927 15:06:18.197021 2797 leader_election.cc:288] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:18.193337 1562 rpcz_store.cc:276] 0927 15:06:14.902544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.902606 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:18.193025 (+3290419us) ts_tablet_manager.cc:1145] Deleting tablet 796eef27ca8341b1a1ccc95770892e04
0927 15:06:18.193035 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.193167 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3290071}
I20260927 15:06:18.197691 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2268d824f5324cd1b81879e2fe4fd027" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:18.197770 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 796eef27ca8341b1a1ccc95770892e04 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 796eef27ca8341b1a1ccc95770892e04 already in progress: creating tablet
I20260927 15:06:18.197896 1164 raft_consensus.cc:2454] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:18.198261 1374 leader_election.cc:302] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:18.198477 2797 raft_consensus.cc:2781] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.198535 2797 raft_consensus.cc:482] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.198593 2797 raft_consensus.cc:3037] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.199040 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2268d824f5324cd1b81879e2fe4fd027" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.199527 1376 leader_election.cc:341] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.202136 1273 tablet_service.cc:1467] Processing CreateTablet for tablet a025c52212ec44aba012e9c1403b917d (DEFAULT_TABLE table=default.Table_4c9e7b68303b480a85dcef02ac6c9c0b [id=3431fcdd624f4978b9ad9a94fd322a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.202265 2797 raft_consensus.cc:504] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.202556 1556 raft_consensus.cc:348] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.202718 1556 raft_consensus.cc:374] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.202756 1556 raft_consensus.cc:729] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.203398 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2268d824f5324cd1b81879e2fe4fd027" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:18.203842 1376 leader_election.cc:341] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.203994 1561 raft_consensus.cc:348] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.204192 1561 raft_consensus.cc:374] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.204247 1561 raft_consensus.cc:729] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.204416 1561 consensus_queue.cc:260] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.204800 2119 ts_tablet_manager.cc:1939] T fb2a8e788b71451da4a18f52b643e5e2 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:18.204877 1561 ts_tablet_manager.cc:1428] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260927 15:06:18.204844 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2268d824f5324cd1b81879e2fe4fd027" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:18.205001 1164 raft_consensus.cc:3037] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.205201 1561 tablet_bootstrap.cc:492] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.198230 1562 tablet_replica.cc:330] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:18.205480 1562 raft_consensus.cc:2229] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:18.206921 2797 leader_election.cc:288] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:18.207070 1413 tablet_service.cc:1467] Processing CreateTablet for tablet a025c52212ec44aba012e9c1403b917d (DEFAULT_TABLE table=default.Table_4c9e7b68303b480a85dcef02ac6c9c0b [id=3431fcdd624f4978b9ad9a94fd322a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.207509 1556 consensus_queue.cc:260] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.207494 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a025c52212ec44aba012e9c1403b917d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.208045 1556 ts_tablet_manager.cc:1428] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.029s user 0.001s sys 0.000s
I20260927 15:06:18.208061 1164 raft_consensus.cc:2454] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:18.208423 1374 leader_election.cc:302] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.208900 2797 raft_consensus.cc:2781] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.209739 2431 raft_consensus.cc:482] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.209933 2847 tablet.cc:1722] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:18.210359 1099 leader_election.cc:302] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.210623 2569 raft_consensus.cc:2781] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.210758 2569 raft_consensus.cc:482] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.210904 2569 raft_consensus.cc:3037] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.211251 1099 leader_election.cc:302] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.212463 2829 raft_consensus.cc:2781] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.212677 2829 raft_consensus.cc:686] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.212910 2829 consensus_queue.cc:237] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.209867 2431 raft_consensus.cc:504] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.213521 2568 raft_consensus.cc:686] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.213946 2568 consensus_queue.cc:237] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.214206 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f2ab9677c4598b0b8d9a93a6a23c7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:18.214548 2849 tablet.cc:1722] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:18.215946 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet fb2a8e788b71451da4a18f52b643e5e2 (table default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e [id=db7af27293544752bbe914164e4e9d3b]) successfully deleted
I20260927 15:06:18.214607 1140 tablet_service.cc:1467] Processing CreateTablet for tablet fa143466f2bd4185887d6ccfcbbe8dd8 (DEFAULT_TABLE table=default.Table_a8cba3f530e84e4684b52d7098f44dde [id=975b2dcaf69e49eca6f8d5059eda9f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.216315 2119 tablet_replica.cc:330] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:18.216511 2119 raft_consensus.cc:2229] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:18.214804 1102 leader_election.cc:341] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.216704 2119 raft_consensus.cc:2258] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.217255 2119 ts_tablet_manager.cc:1905] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.217898 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa143466f2bd4185887d6ccfcbbe8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.218562 1405 tablet_service.cc:1467] Processing CreateTablet for tablet a45a536f62d74465ab03b1943ce3fb46 (DEFAULT_TABLE table=default.Table_198df37a55574154a04d6ef03a65c140 [id=724cc32bbf8748ecbb67ae0253d4b92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.217249 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 256f369571214726a3ef8f9d65040032 (DEFAULT_TABLE table=default.Table_e97674d6a4af430f80eb42916ccbaae6 [id=75a4064277d64df88aa36168db78e988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.217451 2431 leader_election.cc:288] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.220310 2569 raft_consensus.cc:504] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.219548 1556 tablet_bootstrap.cc:492] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.222365 1552 tablet_bootstrap.cc:492] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:18.222535 1552 ts_tablet_manager.cc:1397] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.129s user 0.003s sys 0.003s
I20260927 15:06:18.222623 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a45a536f62d74465ab03b1943ce3fb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.220975 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 256f369571214726a3ef8f9d65040032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.223721 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8de6246f7904f6c80df624f3631db17" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:18.223750 1552 raft_consensus.cc:348] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.223970 1552 raft_consensus.cc:374] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.224020 1552 raft_consensus.cc:729] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:18.224191 1102 leader_election.cc:341] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.224260 1552 consensus_queue.cc:260] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.225242 2569 leader_election.cc:288] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.227473 1552 ts_tablet_manager.cc:1428] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:18.224958 1556 tablet_bootstrap.cc:654] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.206797 1561 tablet_bootstrap.cc:654] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.230391 1552 tablet_bootstrap.cc:492] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:18.232052 2233 ts_tablet_manager.cc:1918] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.221671 1562 pending_rounds.cc:62] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:18.233120 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 04fe5b9e0d7747a185c1666664cb4378 (DEFAULT_TABLE table=default.Table_dc3aebebe1c247758fe1662d344f0ab7 [id=73c13e606d154df8ab259b165006a506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.232375 1131 tablet_service.cc:1467] Processing CreateTablet for tablet a025c52212ec44aba012e9c1403b917d (DEFAULT_TABLE table=default.Table_4c9e7b68303b480a85dcef02ac6c9c0b [id=3431fcdd624f4978b9ad9a94fd322a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.234419 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a025c52212ec44aba012e9c1403b917d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.234223 1562 pending_rounds.cc:68] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976374515101696 op_type: NO_OP noop_request { }
I20260927 15:06:18.235507 1562 raft_consensus.cc:2866] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:18.237277 1562 raft_consensus.cc:2258] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.236425 2789 raft_consensus.cc:482] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.242056 2789 raft_consensus.cc:504] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.242640 2789 leader_election.cc:288] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:18.243227 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae003f1ca76472cbaa8b577b66fe84c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.243778 1376 leader_election.cc:341] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.244542 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae003f1ca76472cbaa8b577b66fe84c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:18.244735 1164 raft_consensus.cc:2454] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:18.244812 2797 raft_consensus.cc:686] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:18.245115 1374 leader_election.cc:302] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.245436 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_85b48f7c2577445481e4ab0d007cf052" } new_table_name: "default.Table_b86a10a930734128a7773763b02d02cc" modify_external_catalogs: true
I20260927 15:06:18.245620 2789 raft_consensus.cc:2781] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.245695 2789 raft_consensus.cc:482] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.245754 2789 raft_consensus.cc:3037] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.245046 2797 consensus_queue.cc:237] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:18.247097 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e32b9870eea4319b84145b46333ec98 consensus state has no leader
I20260927 15:06:18.247510 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6cb64cf8db1549f4aabddd9904aaa1d5" } modify_external_catalogs: true
I20260927 15:06:18.247726 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6cb64cf8db1549f4aabddd9904aaa1d5" } modify_external_catalogs: true
I20260927 15:06:18.248479 2789 raft_consensus.cc:504] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.248992 2789 leader_election.cc:288] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:18.249390 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae003f1ca76472cbaa8b577b66fe84c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:18.249547 1164 raft_consensus.cc:3037] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.249614 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae003f1ca76472cbaa8b577b66fe84c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:18.247128 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_eb88510bf8b741bbad0d2e49ca1a0b7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.250166 1376 leader_election.cc:341] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:18.250361 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb88510bf8b741bbad0d2e49ca1a0b7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.250741 2789 raft_consensus.cc:482] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.250869 2789 raft_consensus.cc:504] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.251688 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19cd7febe054432899739e21605406d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:18.247517 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3fbd80102e424c83aeae240c0171ca06" } new_table_name: "default.Table_38daa156d655475aac34a6d9584fef82" modify_external_catalogs: true
I20260927 15:06:18.252229 1164 raft_consensus.cc:2454] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:18.252799 1374 leader_election.cc:302] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.253088 2789 leader_election.cc:288] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:18.253194 2789 raft_consensus.cc:2781] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.253284 2789 raft_consensus.cc:686] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
W20260927 15:06:18.253307 1376 leader_election.cc:341] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.253510 2789 consensus_queue.cc:237] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.254406 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a076458f952d47618ed11925e13327aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:18.255456 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19cd7febe054432899739e21605406d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:18.255760 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a076458f952d47618ed11925e13327aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:18.255919 1374 leader_election.cc:341] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.256018 1374 leader_election.cc:302] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:18.257788 2850 raft_consensus.cc:2726] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.260974 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 04fe5b9e0d7747a185c1666664cb4378 (DEFAULT_TABLE table=default.Table_dc3aebebe1c247758fe1662d344f0ab7 [id=73c13e606d154df8ab259b165006a506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.261137 2853 tablet.cc:1722] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:18.261507 2233 log.cc:1196] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/429088342b4743c39fb1e38d235024de
I20260927 15:06:18.261580 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04fe5b9e0d7747a185c1666664cb4378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.262389 2233 ts_tablet_manager.cc:1939] T 429088342b4743c39fb1e38d235024de P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.264554 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 913) took 3175 ms. Trace:
I20260927 15:06:18.266505 2233 rpcz_store.cc:276] 0927 15:06:15.088803 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.088862 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:18.153517 (+3064655us) ts_tablet_manager.cc:1145] Deleting tablet 429088342b4743c39fb1e38d235024de
0927 15:06:18.153531 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.157630 (+ 4099us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.231944 (+ 74314us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.264536 (+ 32592us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3064454}
I20260927 15:06:18.267135 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 928) took 3114 ms. Trace:
I20260927 15:06:18.267302 2233 rpcz_store.cc:276] 0927 15:06:15.152309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.152373 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:18.267004 (+3114631us) ts_tablet_manager.cc:1145] Deleting tablet 771ce4b9675742bc88306e4d099cbb82
0927 15:06:18.267014 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.267117 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3114449}
I20260927 15:06:18.268239 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 930) took 3106 ms. Trace:
I20260927 15:06:18.268393 2233 rpcz_store.cc:276] 0927 15:06:15.162070 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.162132 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:18.268122 (+3105990us) ts_tablet_manager.cc:1145] Deleting tablet 7f2a9378aa46462b97906be25df8d90f
0927 15:06:18.268133 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.268213 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3105809}
I20260927 15:06:18.268558 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa143466f2bd4185887d6ccfcbbe8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.268828 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 931) took 3105 ms. Trace:
I20260927 15:06:18.268973 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04fe5b9e0d7747a185c1666664cb4378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.268952 2233 rpcz_store.cc:276] 0927 15:06:15.163028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.163084 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:18.268739 (+3105655us) ts_tablet_manager.cc:1145] Deleting tablet b5e418f9ce5e41128b17f01e9e909ecb
0927 15:06:18.268748 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.268814 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3105497}
I20260927 15:06:18.269315 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 924) took 3138 ms. Trace:
I20260927 15:06:18.269448 2233 rpcz_store.cc:276] 0927 15:06:15.130422 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.130488 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:18.269214 (+3138726us) ts_tablet_manager.cc:1145] Deleting tablet 1e0508139d3f403a94638c6a7cfb6a35
0927 15:06:18.269234 (+ 20us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.269300 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3059843}
I20260927 15:06:18.269877 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 938) took 3029 ms. Trace:
I20260927 15:06:18.270007 2233 rpcz_store.cc:276] 0927 15:06:15.240258 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.262811 (+ 22553us) service_pool.cc:227] Handling call
0927 15:06:18.269787 (+3006976us) ts_tablet_manager.cc:1145] Deleting tablet 0ddca178f38e46b28fc1b5ed6416b990
0927 15:06:18.269797 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.269863 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3006740}
I20260927 15:06:18.270390 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 941) took 2708 ms. Trace:
I20260927 15:06:18.270567 2233 rpcz_store.cc:276] 0927 15:06:15.562170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.562241 (+ 71us) service_pool.cc:227] Handling call
0927 15:06:18.270301 (+2708060us) ts_tablet_manager.cc:1145] Deleting tablet 1024b38f06bb4387bd24e98f0dee038c
0927 15:06:18.270310 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.270375 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2707857}
I20260927 15:06:18.270977 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 942) took 2650 ms. Trace:
I20260927 15:06:18.271101 2233 rpcz_store.cc:276] 0927 15:06:15.620169 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.620240 (+ 71us) service_pool.cc:227] Handling call
0927 15:06:18.270884 (+2650644us) ts_tablet_manager.cc:1145] Deleting tablet ee27f67bc245495a9e29bcac3e7d3846
0927 15:06:18.270893 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.270963 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2650447}
I20260927 15:06:18.271489 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 961) took 2348 ms. Trace:
I20260927 15:06:18.271706 2233 rpcz_store.cc:276] 0927 15:06:15.922649 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.923266 (+ 617us) service_pool.cc:227] Handling call
0927 15:06:18.271397 (+2348131us) ts_tablet_manager.cc:1145] Deleting tablet cdcc55fb32b14935922e5870819bc266
0927 15:06:18.271407 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.271475 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2346750}
I20260927 15:06:18.272087 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 960) took 2349 ms. Trace:
I20260927 15:06:18.272212 2233 rpcz_store.cc:276] 0927 15:06:15.922556 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.923380 (+ 824us) service_pool.cc:227] Handling call
0927 15:06:18.271997 (+2348617us) ts_tablet_manager.cc:1145] Deleting tablet 9f7afa41d7cb4daa89fee5d6036e7cf8
0927 15:06:18.272006 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.272074 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2347284}
I20260927 15:06:18.272593 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 959) took 2350 ms. Trace:
I20260927 15:06:18.272843 2233 rpcz_store.cc:276] 0927 15:06:15.922422 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.923479 (+ 1057us) service_pool.cc:227] Handling call
0927 15:06:18.272503 (+2349024us) ts_tablet_manager.cc:1145] Deleting tablet 75b4abbc451b44a2af08e17f49f570f1
0927 15:06:18.272512 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.272578 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2347737}
I20260927 15:06:18.273245 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 958) took 2350 ms. Trace:
I20260927 15:06:18.273401 2233 rpcz_store.cc:276] 0927 15:06:15.922295 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.923572 (+ 1277us) service_pool.cc:227] Handling call
0927 15:06:18.273135 (+2349563us) ts_tablet_manager.cc:1145] Deleting tablet 72f87499645e4f55bc3d6edeba50eb64
0927 15:06:18.273144 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.273213 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2348325}
I20260927 15:06:18.273734 2233 tablet_replica.cc:330] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.273978 2233 raft_consensus.cc:2229] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.274192 2233 raft_consensus.cc:2258] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.274789 2233 ts_tablet_manager.cc:1905] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.278635 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a025c52212ec44aba012e9c1403b917d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.280972 2233 ts_tablet_manager.cc:1918] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.281178 2233 log.cc:1196] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/58d6bdc1ac004d889aac36db65afbbbe
I20260927 15:06:18.281545 2233 ts_tablet_manager.cc:1939] T 58d6bdc1ac004d889aac36db65afbbbe P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.282486 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 963) took 2359 ms. Trace:
I20260927 15:06:18.282624 2233 rpcz_store.cc:276] 0927 15:06:15.922819 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.923661 (+ 842us) service_pool.cc:227] Handling call
0927 15:06:18.273697 (+2350036us) ts_tablet_manager.cc:1145] Deleting tablet 58d6bdc1ac004d889aac36db65afbbbe
0927 15:06:18.273705 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.277969 (+ 4264us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.280797 (+ 2828us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.282467 (+ 1670us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2348672}
I20260927 15:06:18.283272 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 962) took 2360 ms. Trace:
I20260927 15:06:18.283447 2233 rpcz_store.cc:276] 0927 15:06:15.922732 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.923067 (+ 335us) service_pool.cc:227] Handling call
0927 15:06:18.283155 (+2360088us) ts_tablet_manager.cc:1145] Deleting tablet 2bb9540030834895ac069a0d516d7ee4
0927 15:06:18.283166 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.283256 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2356800}
I20260927 15:06:18.283944 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 957) took 2361 ms. Trace:
I20260927 15:06:18.284265 2233 rpcz_store.cc:276] 0927 15:06:15.922130 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.927735 (+ 5605us) service_pool.cc:227] Handling call
0927 15:06:18.283843 (+2356108us) ts_tablet_manager.cc:1145] Deleting tablet 6d167c390ed546e09f31f1e08988500c
0927 15:06:18.283853 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.283930 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2352695}
I20260927 15:06:18.284740 2233 tablet_replica.cc:330] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.284988 2233 raft_consensus.cc:2229] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.285197 2233 raft_consensus.cc:2258] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.285753 2233 ts_tablet_manager.cc:1905] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.288653 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f2ab9677c4598b0b8d9a93a6a23c7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.288897 1438 raft_consensus.cc:2454] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:18.290342 1284 tablet_service.cc:1467] Processing CreateTablet for tablet e34bb622021e42cc990af0ef3948fd1d (DEFAULT_TABLE table=default.Table_b99a341ee9cd40969b19a6c799a3ee74 [id=e5bb76859e4244968519192ffc2e6554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.291790 2233 ts_tablet_manager.cc:1918] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.291960 2233 log.cc:1196] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/d4f05da432f041378c5ab808536e6b6f
I20260927 15:06:18.292296 2233 ts_tablet_manager.cc:1939] T d4f05da432f041378c5ab808536e6b6f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.292770 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e34bb622021e42cc990af0ef3948fd1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.293066 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 964) took 2370 ms. Trace:
I20260927 15:06:18.293131 1562 ts_tablet_manager.cc:1905] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.293238 2233 rpcz_store.cc:276] 0927 15:06:15.922942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.928199 (+ 5257us) service_pool.cc:227] Handling call
0927 15:06:18.284702 (+2356503us) ts_tablet_manager.cc:1145] Deleting tablet d4f05da432f041378c5ab808536e6b6f
0927 15:06:18.284711 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.289061 (+ 4350us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.291719 (+ 2658us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.293046 (+ 1327us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2353445}
I20260927 15:06:18.293730 2233 tablet_replica.cc:330] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.293959 2233 raft_consensus.cc:2229] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.295043 1556 tablet_bootstrap.cc:492] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.295193 1556 ts_tablet_manager.cc:1397] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.001s
I20260927 15:06:18.295841 1556 raft_consensus.cc:348] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.296025 1556 raft_consensus.cc:374] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.296068 1556 raft_consensus.cc:729] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.296249 1556 consensus_queue.cc:260] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.296726 1556 ts_tablet_manager.cc:1428] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:06:18.296959 1556 tablet_bootstrap.cc:492] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.299448 1561 tablet_bootstrap.cc:492] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.299568 1561 ts_tablet_manager.cc:1397] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.094s user 0.005s sys 0.000s
I20260927 15:06:18.300266 1561 raft_consensus.cc:348] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.300460 1561 raft_consensus.cc:374] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.300515 1561 raft_consensus.cc:729] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.300712 1561 consensus_queue.cc:260] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.301251 1561 ts_tablet_manager.cc:1428] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:18.301297 1141 tablet_service.cc:1467] Processing CreateTablet for tablet e34bb622021e42cc990af0ef3948fd1d (DEFAULT_TABLE table=default.Table_b99a341ee9cd40969b19a6c799a3ee74 [id=e5bb76859e4244968519192ffc2e6554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.301498 1561 tablet_bootstrap.cc:492] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.301717 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e34bb622021e42cc990af0ef3948fd1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.302968 1099 leader_election.cc:302] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.303488 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8de6246f7904f6c80df624f3631db17" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:18.303665 1438 raft_consensus.cc:3037] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.306066 1438 raft_consensus.cc:2454] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:18.306593 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d533883e3344eca939cd67644895148 with delete_type TABLET_DATA_DELETED (replaced by tablet 534a74d9f8e648168b87e26fb73c8b3a) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:18.306939 1418 tablet_service.cc:1467] Processing CreateTablet for tablet e34bb622021e42cc990af0ef3948fd1d (DEFAULT_TABLE table=default.Table_b99a341ee9cd40969b19a6c799a3ee74 [id=e5bb76859e4244968519192ffc2e6554]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.307286 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e34bb622021e42cc990af0ef3948fd1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.307370 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 81cc2d5e281648a49fe109a7a00689b3 (DEFAULT_TABLE table=default.Table_35e15f0ba6ae4f98a02b20bd26a65003 [id=3e09b534eb18491e83b63d8c8d935c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.307504 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 81cc2d5e281648a49fe109a7a00689b3 (DEFAULT_TABLE table=default.Table_35e15f0ba6ae4f98a02b20bd26a65003 [id=3e09b534eb18491e83b63d8c8d935c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.307771 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81cc2d5e281648a49fe109a7a00689b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.307828 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81cc2d5e281648a49fe109a7a00689b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.309942 2431 raft_consensus.cc:2781] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.310010 2431 raft_consensus.cc:482] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.310062 2431 raft_consensus.cc:3037] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.312391 2431 raft_consensus.cc:504] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.312855 1561 tablet_bootstrap.cc:654] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.313334 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f2ab9677c4598b0b8d9a93a6a23c7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:18.313863 2431 leader_election.cc:288] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:18.314134 1102 leader_election.cc:341] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:18.316428 1102 consensus_peers.cc:487] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:18.316618 1102 consensus_peers.cc:487] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb2a8e788b71451da4a18f52b643e5e2. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.318256 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f2ab9677c4598b0b8d9a93a6a23c7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:18.318459 1438 raft_consensus.cc:3037] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.318688 2369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260927 15:06:18.319957 2369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260927 15:06:18.323483 1438 raft_consensus.cc:2454] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:18.323945 1556 tablet_bootstrap.cc:654] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.324972 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 4febf85191d04dd98db55c5730232e1c (DEFAULT_TABLE table=default.Table_5b0805950ba34c63a8168418bb62f2ef [id=64fa8d80492944e89e75ea45e9fc1544]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.325342 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4febf85191d04dd98db55c5730232e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.327184 2369 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260927 15:06:18.327828 1099 consensus_peers.cc:487] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4f05da432f041378c5ab808536e6b6f. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.328003 1099 leader_election.cc:302] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.331944 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 4febf85191d04dd98db55c5730232e1c (DEFAULT_TABLE table=default.Table_5b0805950ba34c63a8168418bb62f2ef [id=64fa8d80492944e89e75ea45e9fc1544]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.332360 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4febf85191d04dd98db55c5730232e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.335060 2431 raft_consensus.cc:2781] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.335193 2431 raft_consensus.cc:686] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.335402 2431 consensus_queue.cc:237] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.337863 2233 raft_consensus.cc:2258] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.338655 2233 ts_tablet_manager.cc:1905] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.344983 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 04fe5b9e0d7747a185c1666664cb4378 (DEFAULT_TABLE table=default.Table_dc3aebebe1c247758fe1662d344f0ab7 [id=73c13e606d154df8ab259b165006a506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.345566 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04fe5b9e0d7747a185c1666664cb4378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.347795 1099 leader_election.cc:302] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.348039 2431 raft_consensus.cc:2781] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.348208 2431 raft_consensus.cc:686] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.348486 2431 consensus_queue.cc:237] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.352958 1556 tablet_bootstrap.cc:492] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
W20260927 15:06:18.353101 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.60:46799, user_credentials={real_user=slave}} blocked reactor thread for 48201.4us
I20260927 15:06:18.353202 1556 ts_tablet_manager.cc:1397] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.056s user 0.006s sys 0.004s
I20260927 15:06:18.353750 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 429088342b4743c39fb1e38d235024de (table default.Table_9a6330b2000f4bb5a7817b924f99ad53 [id=09a85e91664d444eab58b705a3be138d]) successfully deleted
W20260927 15:06:18.354099 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 771ce4b9675742bc88306e4d099cbb82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 771ce4b9675742bc88306e4d099cbb82 already in progress: creating tablet
W20260927 15:06:18.354426 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7f2a9378aa46462b97906be25df8d90f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f2a9378aa46462b97906be25df8d90f already in progress: creating tablet
I20260927 15:06:18.354256 1556 raft_consensus.cc:348] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.354521 1556 raft_consensus.cc:374] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:18.354807 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b5e418f9ce5e41128b17f01e9e909ecb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e418f9ce5e41128b17f01e9e909ecb already in progress: creating tablet
I20260927 15:06:18.356125 1277 tablet_service.cc:1467] Processing CreateTablet for tablet c99d932c64f748b0af0162d415fc4962 (DEFAULT_TABLE table=default.Table_a75c1bff99d44d8aa0a19f7efd59f579 [id=26b0cbbd105d4ccb8f7a955c69807940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.356616 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c99d932c64f748b0af0162d415fc4962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.356621 1128 tablet_service.cc:1467] Processing CreateTablet for tablet c99d932c64f748b0af0162d415fc4962 (DEFAULT_TABLE table=default.Table_a75c1bff99d44d8aa0a19f7efd59f579 [id=26b0cbbd105d4ccb8f7a955c69807940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.356752 1556 raft_consensus.cc:729] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.357079 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c99d932c64f748b0af0162d415fc4962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.357118 1556 consensus_queue.cc:260] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.358101 1561 tablet_bootstrap.cc:492] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.358318 1561 ts_tablet_manager.cc:1397] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.057s user 0.004s sys 0.004s
I20260927 15:06:18.359319 1561 raft_consensus.cc:348] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.359640 1561 raft_consensus.cc:374] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.359762 1561 raft_consensus.cc:729] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.360080 1561 consensus_queue.cc:260] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.360946 1561 ts_tablet_manager.cc:1428] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:18.361155 1562 ts_tablet_manager.cc:1918] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:18.361266 1562 log.cc:1196] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/b3cc37a97bc145bdaa654bcc193fe93b
I20260927 15:06:18.361611 1562 ts_tablet_manager.cc:1939] T b3cc37a97bc145bdaa654bcc193fe93b P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:18.362264 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 887) took 3418 ms. Trace:
I20260927 15:06:18.362349 1562 rpcz_store.cc:276] 0927 15:06:14.943957 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.944408 (+ 451us) service_pool.cc:227] Handling call
0927 15:06:18.198084 (+3253676us) ts_tablet_manager.cc:1145] Deleting tablet b3cc37a97bc145bdaa654bcc193fe93b
0927 15:06:18.198099 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.358559 (+160460us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.361087 (+ 2528us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.362247 (+ 1160us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3253428}
I20260927 15:06:18.362636 1562 tablet_replica.cc:330] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:18.363788 1552 tablet_bootstrap.cc:654] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.364293 1272 tablet_service.cc:1467] Processing CreateTablet for tablet cb59e153e6214a24a1fa550445ae6d50 (DEFAULT_TABLE table=default.Table_9f2536cafc334a929cbe3bc5508f705a [id=07dbba629fa8425aaba06d72346400b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.370026 1131 tablet_service.cc:1467] Processing CreateTablet for tablet cb59e153e6214a24a1fa550445ae6d50 (DEFAULT_TABLE table=default.Table_9f2536cafc334a929cbe3bc5508f705a [id=07dbba629fa8425aaba06d72346400b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.372404 1561 tablet_bootstrap.cc:492] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.367015 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet b3cc37a97bc145bdaa654bcc193fe93b (table default.Table_2597f21341574a599cce741248f402e9 [id=fad65497755c45c0b8ba4c338f3712c3]) successfully deleted
W20260927 15:06:18.372957 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1e0508139d3f403a94638c6a7cfb6a35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e0508139d3f403a94638c6a7cfb6a35 already in progress: creating tablet
W20260927 15:06:18.373195 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0ddca178f38e46b28fc1b5ed6416b990 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ddca178f38e46b28fc1b5ed6416b990 already in progress: creating tablet
W20260927 15:06:18.373409 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1024b38f06bb4387bd24e98f0dee038c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1024b38f06bb4387bd24e98f0dee038c already in progress: creating tablet
I20260927 15:06:18.373513 1279 tablet_service.cc:1467] Processing CreateTablet for tablet abbe0b6179d44ae58da14741c2db3ae9 (DEFAULT_TABLE table=default.Table_c160b8f77fd948d783d82f95625ff38c [id=536558521cdc4bf4b7d815fc912d6895]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:18.373612 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ee27f67bc245495a9e29bcac3e7d3846 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee27f67bc245495a9e29bcac3e7d3846 already in progress: creating tablet
W20260927 15:06:18.373806 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet cdcc55fb32b14935922e5870819bc266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdcc55fb32b14935922e5870819bc266 already in progress: creating tablet
I20260927 15:06:18.373842 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb59e153e6214a24a1fa550445ae6d50. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:18.374007 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 already in progress: creating tablet
I20260927 15:06:18.374070 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbe0b6179d44ae58da14741c2db3ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.374070 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 1490ce55cc194e31a8983f710c008073 (DEFAULT_TABLE table=default.Table_ebfd4efc9ff44240b03a8f680d418512 [id=47b387e918fc4edabad6f65e8a146eee]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:18.374186 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 75b4abbc451b44a2af08e17f49f570f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75b4abbc451b44a2af08e17f49f570f1 already in progress: creating tablet
W20260927 15:06:18.374375 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 72f87499645e4f55bc3d6edeba50eb64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72f87499645e4f55bc3d6edeba50eb64 already in progress: creating tablet
I20260927 15:06:18.374567 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 58d6bdc1ac004d889aac36db65afbbbe (table default.Table_27a7140bf7c847d8acb10f2ac4c04bcf [id=a99492ccd2464bc2b1885ade4a76db9f]) successfully deleted
W20260927 15:06:18.374759 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2bb9540030834895ac069a0d516d7ee4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bb9540030834895ac069a0d516d7ee4 already in progress: creating tablet
I20260927 15:06:18.378584 2119 ts_tablet_manager.cc:1918] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:18.378760 2119 log.cc:1196] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/a04caae16db84d8ea9050b648c1ba354
I20260927 15:06:18.378892 1128 tablet_service.cc:1467] Processing CreateTablet for tablet abbe0b6179d44ae58da14741c2db3ae9 (DEFAULT_TABLE table=default.Table_c160b8f77fd948d783d82f95625ff38c [id=536558521cdc4bf4b7d815fc912d6895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.379381 2119 ts_tablet_manager.cc:1939] T a04caae16db84d8ea9050b648c1ba354 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:18.380056 1102 consensus_peers.cc:487] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.380640 1556 ts_tablet_manager.cc:1428] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260927 15:06:18.382803 2233 ts_tablet_manager.cc:1918] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.382932 2233 log.cc:1196] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/568ba79ea795403cba76fb6632efd7e2
W20260927 15:06:18.383028 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6d167c390ed546e09f31f1e08988500c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d167c390ed546e09f31f1e08988500c already in progress: creating tablet
I20260927 15:06:18.383231 2233 ts_tablet_manager.cc:1939] T 568ba79ea795403cba76fb6632efd7e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.383698 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet a04caae16db84d8ea9050b648c1ba354 (table default.Table_9e1c88622f89474285f6bdb98faffffb [id=32293fa2bff246dba3dfe47a3fcaf310]) successfully deleted
I20260927 15:06:18.383803 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet d4f05da432f041378c5ab808536e6b6f (table default.Table_e8855d7ecbd54e2eb65a1b2dd6addb4c [id=2386e9e051a140358b16dbe3d7add4c1]) successfully deleted
I20260927 15:06:18.383992 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 965) took 2225 ms. Trace:
I20260927 15:06:18.384191 2119 tablet_replica.cc:330] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:18.384109 2233 rpcz_store.cc:276] 0927 15:06:16.158061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.158119 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:18.293691 (+2135572us) ts_tablet_manager.cc:1145] Deleting tablet 568ba79ea795403cba76fb6632efd7e2
0927 15:06:18.293701 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.341749 (+ 48048us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.382719 (+ 40970us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.383965 (+ 1246us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2135356}
I20260927 15:06:18.384383 2119 raft_consensus.cc:2229] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.384541 2119 raft_consensus.cc:2258] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.384929 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 568ba79ea795403cba76fb6632efd7e2 (table default.Table_188cad16a13a4aabb2ce4cd74b0c41a6 [id=f66d759455bb472e9ec7816c859d2811]) successfully deleted
I20260927 15:06:18.385807 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 1490ce55cc194e31a8983f710c008073 (DEFAULT_TABLE table=default.Table_ebfd4efc9ff44240b03a8f680d418512 [id=47b387e918fc4edabad6f65e8a146eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.386183 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1490ce55cc194e31a8983f710c008073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.386906 1556 tablet_bootstrap.cc:492] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.391304 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 81cc2d5e281648a49fe109a7a00689b3 (DEFAULT_TABLE table=default.Table_35e15f0ba6ae4f98a02b20bd26a65003 [id=3e09b534eb18491e83b63d8c8d935c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.391654 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81cc2d5e281648a49fe109a7a00689b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.398329 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 4febf85191d04dd98db55c5730232e1c (DEFAULT_TABLE table=default.Table_5b0805950ba34c63a8168418bb62f2ef [id=64fa8d80492944e89e75ea45e9fc1544]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.398767 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4febf85191d04dd98db55c5730232e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.404618 2119 ts_tablet_manager.cc:1905] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.405233 1556 tablet_bootstrap.cc:654] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.406879 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 966) took 2195 ms. Trace:
I20260927 15:06:18.407197 2233 rpcz_store.cc:276] 0927 15:06:16.211535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.211585 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:18.406601 (+2195016us) ts_tablet_manager.cc:1145] Deleting tablet f799583600634a8e8c2b4fe9d5aa1e55
0927 15:06:18.406642 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.406854 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2194816}
I20260927 15:06:18.408525 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 967) took 2196 ms. Trace:
I20260927 15:06:18.408942 2233 rpcz_store.cc:276] 0927 15:06:16.212052 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.212093 (+ 41us) service_pool.cc:227] Handling call
0927 15:06:18.408110 (+2196017us) ts_tablet_manager.cc:1145] Deleting tablet c74dfa20ed9a4eb197a846b62d859146
0927 15:06:18.408242 (+ 132us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.408508 (+ 266us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195869}
I20260927 15:06:18.410917 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb59e153e6214a24a1fa550445ae6d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.413112 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1490ce55cc194e31a8983f710c008073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.413846 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbe0b6179d44ae58da14741c2db3ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.422433 2797 raft_consensus.cc:482] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.422585 2797 raft_consensus.cc:504] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.423192 2797 leader_election.cc:288] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:18.424160 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4714d536373a4bf2a4be9ebeaebe77c1" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:18.424786 1374 leader_election.cc:341] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.425256 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4714d536373a4bf2a4be9ebeaebe77c1" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.425746 1376 leader_election.cc:341] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.425848 1376 leader_election.cc:302] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:18.426158 2797 raft_consensus.cc:2726] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.428719 1561 tablet_bootstrap.cc:654] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.431581 1562 raft_consensus.cc:2229] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:18.431937 1562 raft_consensus.cc:2258] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.432536 1562 ts_tablet_manager.cc:1905] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.435369 2431 consensus_queue.cc:1035] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:18.410944 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 968) took 2198 ms. Trace:
I20260927 15:06:18.437822 2233 rpcz_store.cc:276] 0927 15:06:16.212534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.212572 (+ 38us) service_pool.cc:227] Handling call
0927 15:06:18.410162 (+2197590us) ts_tablet_manager.cc:1145] Deleting tablet cb75c7fd08964949ad4edf0b46b8cfa6
0927 15:06:18.410178 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.410728 (+ 550us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2197326}
I20260927 15:06:18.438449 1562 ts_tablet_manager.cc:1918] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:18.438586 1562 log.cc:1196] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/033e71f60c3e47fd9647db090d4d6cd5
I20260927 15:06:18.439826 1404 tablet_service.cc:1467] Processing CreateTablet for tablet abbe0b6179d44ae58da14741c2db3ae9 (DEFAULT_TABLE table=default.Table_c160b8f77fd948d783d82f95625ff38c [id=536558521cdc4bf4b7d815fc912d6895]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.439956 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 1490ce55cc194e31a8983f710c008073 (DEFAULT_TABLE table=default.Table_ebfd4efc9ff44240b03a8f680d418512 [id=47b387e918fc4edabad6f65e8a146eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.440269 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abbe0b6179d44ae58da14741c2db3ae9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:18.440979 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f799583600634a8e8c2b4fe9d5aa1e55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f799583600634a8e8c2b4fe9d5aa1e55 already in progress: creating tablet
W20260927 15:06:18.441175 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c74dfa20ed9a4eb197a846b62d859146 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c74dfa20ed9a4eb197a846b62d859146 already in progress: creating tablet
W20260927 15:06:18.441344 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet cb75c7fd08964949ad4edf0b46b8cfa6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb75c7fd08964949ad4edf0b46b8cfa6 already in progress: creating tablet
I20260927 15:06:18.441669 1407 tablet_service.cc:1467] Processing CreateTablet for tablet c99d932c64f748b0af0162d415fc4962 (DEFAULT_TABLE table=default.Table_a75c1bff99d44d8aa0a19f7efd59f579 [id=26b0cbbd105d4ccb8f7a955c69807940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.444388 1556 tablet_bootstrap.cc:492] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.444579 1556 ts_tablet_manager.cc:1397] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20260927 15:06:18.445356 1556 raft_consensus.cc:348] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.445888 1556 raft_consensus.cc:374] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.446010 1556 raft_consensus.cc:729] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.446389 1556 consensus_queue.cc:260] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.447286 1556 ts_tablet_manager.cc:1428] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260927 15:06:18.451411 1102 consensus_peers.cc:487] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.451894 1561 tablet_bootstrap.cc:492] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.452132 1561 ts_tablet_manager.cc:1397] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.003s
I20260927 15:06:18.452500 2568 raft_consensus.cc:482] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.452643 2568 raft_consensus.cc:504] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.453223 2568 leader_election.cc:288] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.453536 1561 raft_consensus.cc:348] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.453939 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568ba79ea795403cba76fb6632efd7e2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:18.453912 1561 raft_consensus.cc:374] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.454161 1561 raft_consensus.cc:729] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.454272 2661 raft_consensus.cc:482] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.454054 912 catalog_manager.cc:5495] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:18.454381 2661 raft_consensus.cc:504] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.454517 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 1ef93a120f00423d91664ce4eaf03803 (table default.Table_69e7da33db594b0494d614660c3525f8 [id=40aeb63abca64c3a8d12f9085fd816d8]). Expected version 3 got 0
I20260927 15:06:18.454512 1561 consensus_queue.cc:260] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.454936 2661 leader_election.cc:288] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:18.456075 1239 leader_election.cc:341] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 6cc8bd2079f84da39e13113e6699bf5e
W20260927 15:06:18.456385 1102 leader_election.cc:341] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.454866 912 catalog_manager.cc:5495] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:18.458419 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (table default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8]). Expected version 3 got 0
I20260927 15:06:18.458777 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
I20260927 15:06:18.459007 912 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]). Expected version 1 got 0
W20260927 15:06:18.462029 1238 leader_election.cc:341] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6cc8bd2079f84da39e13113e6699bf5e
I20260927 15:06:18.462134 1238 leader_election.cc:302] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:18.462661 1561 ts_tablet_manager.cc:1428] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.003s sys 0.001s
I20260927 15:06:18.463078 1561 tablet_bootstrap.cc:492] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:18.463483 1099 leader_election.cc:341] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 568ba79ea795403cba76fb6632efd7e2
I20260927 15:06:18.463610 1099 leader_election.cc:302] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:18.463848 2568 raft_consensus.cc:2726] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.465528 2661 raft_consensus.cc:2726] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.467078 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c99d932c64f748b0af0162d415fc4962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.467944 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1490ce55cc194e31a8983f710c008073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.471098 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 969) took 2258 ms. Trace:
I20260927 15:06:18.471300 2233 rpcz_store.cc:276] 0927 15:06:16.212942 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.212980 (+ 38us) service_pool.cc:227] Handling call
0927 15:06:18.446187 (+2233207us) ts_tablet_manager.cc:1145] Deleting tablet fd225f6127ed4c4ea4bbea41aeb0521f
0927 15:06:18.470916 (+ 24729us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.471070 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2233071}
I20260927 15:06:18.472080 2233 tablet_replica.cc:330] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.472437 2233 raft_consensus.cc:2229] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.473443 2233 raft_consensus.cc:2258] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.475039 2233 ts_tablet_manager.cc:1905] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.473243 1556 tablet_bootstrap.cc:492] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.478736 1556 tablet_bootstrap.cc:654] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:18.478839 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fd225f6127ed4c4ea4bbea41aeb0521f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd225f6127ed4c4ea4bbea41aeb0521f already in progress: creating tablet
I20260927 15:06:18.479368 1405 tablet_service.cc:1467] Processing CreateTablet for tablet cb59e153e6214a24a1fa550445ae6d50 (DEFAULT_TABLE table=default.Table_9f2536cafc334a929cbe3bc5508f705a [id=07dbba629fa8425aaba06d72346400b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:18.484133 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb59e153e6214a24a1fa550445ae6d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:18.484397 2119 ts_tablet_manager.cc:1918] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.484545 2119 log.cc:1196] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/04007cd4bd214b88a4664e23daf4b790
I20260927 15:06:18.484884 2119 ts_tablet_manager.cc:1939] T 04007cd4bd214b88a4664e23daf4b790 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:18.485450 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 04007cd4bd214b88a4664e23daf4b790 (table default.Table_1363eb0bffb8454a9bfbc067762dad9c [id=ff900aafe4f94663a9633fc0fbec0a06]) successfully deleted
W20260927 15:06:18.486980 1099 consensus_peers.cc:487] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58d6bdc1ac004d889aac36db65afbbbe. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.491425 1561 tablet_bootstrap.cc:654] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:18.496439 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 03ce4e8370634ff4967865be6caafab2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03ce4e8370634ff4967865be6caafab2 already in progress: creating tablet
I20260927 15:06:18.499688 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b0b25e485f3d4e6780cd34d9e13fa807
I20260927 15:06:18.500083 910 catalog_manager.cc:6565] ReplaceTablet: tablet b0b25e485f3d4e6780cd34d9e13fa807 deleted and replaced by tablet 75078ead08d24cd3a3930e9c7b7cba91
I20260927 15:06:18.500360 2233 ts_tablet_manager.cc:1918] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.500470 2233 log.cc:1196] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/81e0be77dff645f795237ffe779ed684
I20260927 15:06:18.500808 2233 ts_tablet_manager.cc:1939] T 81e0be77dff645f795237ffe779ed684 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.501065 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 832bf0ee6cbf4c639d2ea569c565ca20
I20260927 15:06:18.501606 1552 tablet_bootstrap.cc:492] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:18.501734 1552 ts_tablet_manager.cc:1397] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.271s user 0.002s sys 0.002s
I20260927 15:06:18.502148 1556 tablet_bootstrap.cc:492] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.502171 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 35a09718f15147f59575a7ea6f24573b
I20260927 15:06:18.502260 1556 ts_tablet_manager.cc:1397] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.001s
I20260927 15:06:18.502516 1552 raft_consensus.cc:348] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.502722 1552 raft_consensus.cc:374] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.502787 1552 raft_consensus.cc:729] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.503012 1556 raft_consensus.cc:348] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.503049 1552 consensus_queue.cc:260] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.503276 1556 raft_consensus.cc:374] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.503355 1556 raft_consensus.cc:729] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.503588 1556 consensus_queue.cc:260] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.503861 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 832bf0ee6cbf4c639d2ea569c565ca20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:18.504062 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 35a09718f15147f59575a7ea6f24573b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:18.504184 1556 ts_tablet_manager.cc:1428] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:18.505194 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 832bf0ee6cbf4c639d2ea569c565ca20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:18.505441 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 35a09718f15147f59575a7ea6f24573b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:18.507030 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet b0b25e485f3d4e6780cd34d9e13fa807 with delete_type TABLET_DATA_DELETED (replaced by tablet 75078ead08d24cd3a3930e9c7b7cba91) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:18.507102 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bc47ec18419c42c5bf64a3a9a414d771
I20260927 15:06:18.508229 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet bc47ec18419c42c5bf64a3a9a414d771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:18.508755 1561 tablet_bootstrap.cc:492] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.508960 1561 ts_tablet_manager.cc:1397] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.001s
I20260927 15:06:18.509505 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet bc47ec18419c42c5bf64a3a9a414d771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:18.509873 1561 raft_consensus.cc:348] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.510147 1552 ts_tablet_manager.cc:1428] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 15:06:18.510196 1561 raft_consensus.cc:374] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.510386 1561 raft_consensus.cc:729] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.510691 1561 consensus_queue.cc:260] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.511684 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet b0b25e485f3d4e6780cd34d9e13fa807 with delete_type TABLET_DATA_DELETED (replaced by tablet 75078ead08d24cd3a3930e9c7b7cba91) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:18.512727 1552 tablet_bootstrap.cc:492] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:18.514058 1552 tablet_bootstrap.cc:654] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.515328 1561 ts_tablet_manager.cc:1428] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 15:06:18.516556 1561 tablet_bootstrap.cc:492] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.517591 2568 raft_consensus.cc:482] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.517740 2568 raft_consensus.cc:504] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.518340 2568 leader_election.cc:288] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.519577 1561 tablet_bootstrap.cc:654] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.519701 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d533883e3344eca939cd67644895148" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.520363 1102 leader_election.cc:341] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.527151 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet b0b25e485f3d4e6780cd34d9e13fa807 with delete_type TABLET_DATA_DELETED (replaced by tablet 75078ead08d24cd3a3930e9c7b7cba91) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:18.528268 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 35a09718f15147f59575a7ea6f24573b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:18.528445 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet bc47ec18419c42c5bf64a3a9a414d771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:18.528621 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 832bf0ee6cbf4c639d2ea569c565ca20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:18.530499 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d533883e3344eca939cd67644895148" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.530771 1433 raft_consensus.cc:2454] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:18.530984 1099 consensus_peers.cc:487] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a19c9cc5859f49a58a35460e504b3f84. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.531418 1099 leader_election.cc:302] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.531670 2568 raft_consensus.cc:2781] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.531800 2568 raft_consensus.cc:482] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.531911 2568 raft_consensus.cc:3037] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.532732 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 970) took 2306 ms. Trace:
I20260927 15:06:18.532857 2233 rpcz_store.cc:276] 0927 15:06:16.225935 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.225982 (+ 47us) service_pool.cc:227] Handling call
0927 15:06:18.471925 (+2245943us) ts_tablet_manager.cc:1145] Deleting tablet 81e0be77dff645f795237ffe779ed684
0927 15:06:18.472037 (+ 112us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.497113 (+ 25076us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.500276 (+ 3163us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.532706 (+ 32430us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2245751}
I20260927 15:06:18.533269 2233 tablet_replica.cc:330] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.533481 2233 raft_consensus.cc:2229] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.533617 2233 raft_consensus.cc:2258] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.534137 2233 ts_tablet_manager.cc:1905] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.534562 2119 tablet_replica.cc:330] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:18.534771 2119 raft_consensus.cc:2229] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.534744 2568 raft_consensus.cc:504] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.535061 2119 raft_consensus.cc:2258] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.535131 1556 tablet_bootstrap.cc:492] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.535589 2119 ts_tablet_manager.cc:1905] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.535758 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d533883e3344eca939cd67644895148" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:18.536257 1102 leader_election.cc:341] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.536494 2568 leader_election.cc:288] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.537039 1556 tablet_bootstrap.cc:654] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.537210 2431 consensus_queue.cc:1035] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:18.537990 1562 ts_tablet_manager.cc:1939] T 033e71f60c3e47fd9647db090d4d6cd5 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:18.538149 2431 raft_consensus.cc:482] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.538307 2431 raft_consensus.cc:504] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.538803 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 888) took 3593 ms. Trace:
I20260927 15:06:18.538856 2431 leader_election.cc:288] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.538940 1562 rpcz_store.cc:276] 0927 15:06:14.945165 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:14.945213 (+ 48us) service_pool.cc:227] Handling call
0927 15:06:18.362580 (+3417367us) ts_tablet_manager.cc:1145] Deleting tablet 033e71f60c3e47fd9647db090d4d6cd5
0927 15:06:18.362589 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.435642 (+ 73053us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.438341 (+ 2699us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.538742 (+100401us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3417203}
I20260927 15:06:18.539374 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 898) took 3369 ms. Trace:
I20260927 15:06:18.539534 2797 raft_consensus.cc:482] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.539474 1562 rpcz_store.cc:276] 0927 15:06:15.170025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.170072 (+ 47us) service_pool.cc:227] Handling call
0927 15:06:18.539212 (+3369140us) ts_tablet_manager.cc:1145] Deleting tablet 1e0508139d3f403a94638c6a7cfb6a35
0927 15:06:18.539223 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.539310 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3368893}
I20260927 15:06:18.539575 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 033e71f60c3e47fd9647db090d4d6cd5 (table default.Table_c6d23c73ae904261ac5ed42420c0eaab [id=0fa527ae49b1486f955fef21e0b35e7a]) successfully deleted
I20260927 15:06:18.539665 2797 raft_consensus.cc:504] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.539837 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 903) took 3369 ms. Trace:
I20260927 15:06:18.539933 1562 rpcz_store.cc:276] 0927 15:06:15.170522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.172853 (+ 2331us) service_pool.cc:227] Handling call
0927 15:06:18.539707 (+3366854us) ts_tablet_manager.cc:1145] Deleting tablet 771ce4b9675742bc88306e4d099cbb82
0927 15:06:18.539716 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.539789 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3366709}
I20260927 15:06:18.540236 2797 leader_election.cc:288] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:18.540251 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 905) took 3369 ms. Trace:
I20260927 15:06:18.540349 2661 raft_consensus.cc:482] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.540343 1562 rpcz_store.cc:276] 0927 15:06:15.170745 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.174004 (+ 3259us) service_pool.cc:227] Handling call
0927 15:06:18.540128 (+3366124us) ts_tablet_manager.cc:1145] Deleting tablet 7f2a9378aa46462b97906be25df8d90f
0927 15:06:18.540137 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.540203 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3365925}
I20260927 15:06:18.540452 2661 raft_consensus.cc:504] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.541025 2661 leader_election.cc:288] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.541492 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "769e9b5c08cd44cc8a0d681500d64f54" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:18.542188 1374 leader_election.cc:341] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.542919 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "769e9b5c08cd44cc8a0d681500d64f54" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.543563 1376 leader_election.cc:341] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:18.543614 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1e0508139d3f403a94638c6a7cfb6a35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e0508139d3f403a94638c6a7cfb6a35 already in progress: creating tablet
I20260927 15:06:18.543706 1376 leader_election.cc:302] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:18.543875 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 771ce4b9675742bc88306e4d099cbb82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 771ce4b9675742bc88306e4d099cbb82 already in progress: creating tablet
W20260927 15:06:18.544057 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 7f2a9378aa46462b97906be25df8d90f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f2a9378aa46462b97906be25df8d90f already in progress: creating tablet
I20260927 15:06:18.545064 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd31ae2ac2e4bc9897724bc9012698d" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:18.546053 1298 raft_consensus.cc:3037] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.546931 2797 raft_consensus.cc:2726] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.547776 1561 tablet_bootstrap.cc:492] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.547945 1561 ts_tablet_manager.cc:1397] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.002s
I20260927 15:06:18.548949 1561 raft_consensus.cc:348] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.550215 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e2c5c3d0f574422be80b318395f199a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:18.549618 2431 raft_consensus.cc:482] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.550660 1561 raft_consensus.cc:374] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.550770 2431 raft_consensus.cc:504] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.551415 2431 leader_election.cc:288] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:18.552132 1102 leader_election.cc:341] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.552772 2233 ts_tablet_manager.cc:1918] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.552893 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6bef5f000441090f73eb842450362" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.553469 1102 leader_election.cc:341] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.553860 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 81e0be77dff645f795237ffe779ed684 (table default.Table_806abc9f7da043179a751515c37b1170 [id=2602f6dfc6ac49a8ac3f4af47b38f21b]) successfully deleted
W20260927 15:06:18.556360 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f45402b4bc648518433809e28f9444d consensus state has no leader
I20260927 15:06:18.555866 1434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e2c5c3d0f574422be80b318395f199a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.557611 1434 raft_consensus.cc:2454] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:18.556334 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6bef5f000441090f73eb842450362" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.556989 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cd31ae2ac2e4bc9897724bc9012698d" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.557273 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d533883e3344eca939cd67644895148" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:18.558102 1435 raft_consensus.cc:3037] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.558125 2233 log.cc:1196] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/28f6bef5f000441090f73eb842450362
I20260927 15:06:18.558286 905 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 9fa429019f244c7cba2b4deba1305ef5
I20260927 15:06:18.558815 2233 ts_tablet_manager.cc:1939] T 28f6bef5f000441090f73eb842450362 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.561266 1435 raft_consensus.cc:2454] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:18.562451 1238 leader_election.cc:302] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:18.563505 1099 leader_election.cc:302] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:18.564028 1099 leader_election.cc:341] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: Tablet not RUNNING: STOPPED
I20260927 15:06:18.564143 1099 leader_election.cc:302] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:18.564839 2431 raft_consensus.cc:2781] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.560565 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 971) took 2334 ms. Trace:
I20260927 15:06:18.564996 2431 raft_consensus.cc:482] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.565086 2431 raft_consensus.cc:3037] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:18.565342 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5520c8eb0be4c7db426d9e22003544f has no consensus state
I20260927 15:06:18.565806 2233 rpcz_store.cc:276] 0927 15:06:16.226476 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.226517 (+ 41us) service_pool.cc:227] Handling call
0927 15:06:18.533231 (+2306714us) ts_tablet_manager.cc:1145] Deleting tablet 28f6bef5f000441090f73eb842450362
0927 15:06:18.533242 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.544930 (+ 11688us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.552659 (+ 7729us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.560500 (+ 7841us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2306562}
I20260927 15:06:18.566391 2233 tablet_replica.cc:330] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.565718 1556 tablet_bootstrap.cc:492] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.566676 1556 ts_tablet_manager.cc:1397] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.000s
I20260927 15:06:18.567677 2431 raft_consensus.cc:504] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.567947 1556 raft_consensus.cc:348] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.568570 2431 leader_election.cc:288] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.568663 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 28f6bef5f000441090f73eb842450362 (table default.Table_083e1ad3d401408dabc1266d11ab2734 [id=77045a2c0b5143e19139d270564a1a27]) successfully deleted
I20260927 15:06:18.568264 1556 raft_consensus.cc:374] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.569056 1556 raft_consensus.cc:729] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.569321 1556 consensus_queue.cc:260] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.569514 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e2c5c3d0f574422be80b318395f199a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:18.568897 2431 raft_consensus.cc:2726] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.570061 2569 raft_consensus.cc:482] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.570993 2569 raft_consensus.cc:504] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.571551 2569 leader_election.cc:288] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:18.570169 1102 leader_election.cc:341] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.571970 1099 leader_election.cc:302] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.572445 2569 raft_consensus.cc:2781] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.572590 2569 raft_consensus.cc:686] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.572889 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e2c5c3d0f574422be80b318395f199a" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:18.572857 2569 consensus_queue.cc:237] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.573117 1435 raft_consensus.cc:3037] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.573731 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f82a62b3d6fa40c5ba2dfd33bb37ee52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.574285 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f82a62b3d6fa40c5ba2dfd33bb37ee52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.575047 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d463a481cb8c4243961e9b0d2b11822c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.575609 1102 consensus_peers.cc:487] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cad4605da5e045e7969da2d6f56a7e70. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:18.575917 1102 leader_election.cc:341] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.577307 1435 raft_consensus.cc:2454] T 4e2c5c3d0f574422be80b318395f199a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:18.574636 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5b7595df893e4227849f96f42e5bc110"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:18.577924 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d463a481cb8c4243961e9b0d2b11822c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.578121 1438 raft_consensus.cc:2454] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:18.578205 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b7595df893e4227849f96f42e5bc110 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.578248 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ae003f1ca76472cbaa8b577b66fe84c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:18.550781 1561 raft_consensus.cc:729] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.570261 1556 ts_tablet_manager.cc:1428] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:18.579311 1561 consensus_queue.cc:260] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.579591 1556 tablet_bootstrap.cc:492] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.581017 1099 leader_election.cc:302] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.575752 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e0e654856c8c4cb4b7982aa734a49bae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.581490 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0e654856c8c4cb4b7982aa734a49bae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.581672 1561 ts_tablet_manager.cc:1428] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.034s user 0.003s sys 0.000s
I20260927 15:06:18.582015 2797 raft_consensus.cc:482] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.582069 1556 tablet_bootstrap.cc:654] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.582175 2797 raft_consensus.cc:504] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.583724 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8659865bf644458b3b5a78eae36a524" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:18.576171 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_582351ce74b84b4b9ba95b4c76aed8a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.584628 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_582351ce74b84b4b9ba95b4c76aed8a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.585383 1561 tablet_bootstrap.cc:492] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.576377 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_88e1ef24cbc841da9c1fdfe81dfb80d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.586710 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88e1ef24cbc841da9c1fdfe81dfb80d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.586975 1561 tablet_bootstrap.cc:654] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.576627 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d22d3d3c2f4845909ca307cd51bb96e3" } modify_external_catalogs: true
I20260927 15:06:18.587843 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d22d3d3c2f4845909ca307cd51bb96e3" } modify_external_catalogs: true
I20260927 15:06:18.588074 2797 leader_election.cc:288] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:18.576757 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d97095af85ba4bc5942b0a5491c5b44e" } new_table_name: "default.Table_72071775d4084a008a75a8fc61178b4c" modify_external_catalogs: true
W20260927 15:06:18.588274 1374 leader_election.cc:341] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.588464 2233 raft_consensus.cc:2229] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.588698 2233 pending_rounds.cc:62] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:18.588775 2233 pending_rounds.cc:68] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976382178631680 op_type: NO_OP noop_request { }
I20260927 15:06:18.588996 2233 raft_consensus.cc:2866] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:18.576949 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_88c0cf4bc1f74871ba507e8bd8ca7cbc" } new_table_name: "default.Table_85532e3f6ba9481c926d342a5081e378" modify_external_catalogs: true
I20260927 15:06:18.589138 2233 raft_consensus.cc:2258] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.590447 2233 ts_tablet_manager.cc:1905] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.591867 2569 raft_consensus.cc:2781] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.592206 2569 raft_consensus.cc:686] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.592514 2569 consensus_queue.cc:237] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.595109 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8659865bf644458b3b5a78eae36a524" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.596083 1376 leader_election.cc:341] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.596257 1376 leader_election.cc:302] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:18.596939 2797 raft_consensus.cc:2726] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.597246 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 906) took 3369 ms. Trace:
I20260927 15:06:18.597355 1562 rpcz_store.cc:276] 0927 15:06:15.170874 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.174738 (+ 3864us) service_pool.cc:227] Handling call
0927 15:06:18.540531 (+3365793us) ts_tablet_manager.cc:1145] Deleting tablet b5e418f9ce5e41128b17f01e9e909ecb
0927 15:06:18.540539 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.540602 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3365569}
W20260927 15:06:18.597842 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b5e418f9ce5e41128b17f01e9e909ecb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5e418f9ce5e41128b17f01e9e909ecb already in progress: creating tablet
I20260927 15:06:18.597965 2661 raft_consensus.cc:2726] T 5cd31ae2ac2e4bc9897724bc9012698d P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.598384 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 913) took 3425 ms. Trace:
I20260927 15:06:18.598554 1562 rpcz_store.cc:276] 0927 15:06:15.173264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.174985 (+ 1721us) service_pool.cc:227] Handling call
0927 15:06:18.598224 (+3423239us) ts_tablet_manager.cc:1145] Deleting tablet 0ddca178f38e46b28fc1b5ed6416b990
0927 15:06:18.598237 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.598329 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3423079}
W20260927 15:06:18.599586 1376 consensus_peers.cc:487] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a04caae16db84d8ea9050b648c1ba354. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.600111 1099 leader_election.cc:302] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:18.603333 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0ddca178f38e46b28fc1b5ed6416b990 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ddca178f38e46b28fc1b5ed6416b990 already in progress: creating tablet
W20260927 15:06:18.603499 1099 consensus_peers.cc:487] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd76c49eda1c4b4ca0edf0f4d2790188. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.603854 2431 raft_consensus.cc:2781] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.604058 2431 raft_consensus.cc:482] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.604668 2431 raft_consensus.cc:3037] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.607656 2119 ts_tablet_manager.cc:1918] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.607788 2119 log.cc:1196] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/8f4bd8182c9d48c7b6e6175ab98d405a
I20260927 15:06:18.607836 1556 tablet_bootstrap.cc:492] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.607601 2431 raft_consensus.cc:504] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.608080 2119 ts_tablet_manager.cc:1939] T 8f4bd8182c9d48c7b6e6175ab98d405a P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:18.608125 1556 ts_tablet_manager.cc:1397] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.002s
I20260927 15:06:18.608376 2431 leader_election.cc:288] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.608935 2119 tablet_replica.cc:330] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:18.609066 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 8f4bd8182c9d48c7b6e6175ab98d405a (table default.Table_f473e7d31ecc4adfbda7d8a1df28ec33 [id=a8244b3e082b4423bdf4d108ee1647b4]) successfully deleted
I20260927 15:06:18.609122 2119 raft_consensus.cc:2229] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.609246 2119 raft_consensus.cc:2258] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.609375 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d463a481cb8c4243961e9b0d2b11822c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:18.610221 1102 leader_election.cc:341] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:18.611371 1102 consensus_peers.cc:487] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.611505 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d463a481cb8c4243961e9b0d2b11822c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:18.611725 1435 raft_consensus.cc:3037] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.614658 1435 raft_consensus.cc:2454] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:18.616400 1099 leader_election.cc:302] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.618116 2431 raft_consensus.cc:2781] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.618395 2431 raft_consensus.cc:686] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.618698 2431 consensus_queue.cc:237] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.621052 1552 tablet_bootstrap.cc:492] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:18.621287 1552 ts_tablet_manager.cc:1397] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.109s user 0.002s sys 0.001s
I20260927 15:06:18.622274 2119 ts_tablet_manager.cc:1905] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.622175 1552 raft_consensus.cc:348] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.622686 1552 raft_consensus.cc:374] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.622785 1552 raft_consensus.cc:729] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.623059 1552 consensus_queue.cc:260] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.624554 1552 ts_tablet_manager.cc:1428] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 15:06:18.624868 1552 tablet_bootstrap.cc:492] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:18.628927 1552 tablet_bootstrap.cc:654] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.630613 1561 tablet_bootstrap.cc:492] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.630868 1561 ts_tablet_manager.cc:1397] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.003s
I20260927 15:06:18.631680 1561 raft_consensus.cc:348] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.631969 1561 raft_consensus.cc:374] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.632130 1561 raft_consensus.cc:729] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.632416 1561 consensus_queue.cc:260] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.633472 1561 ts_tablet_manager.cc:1428] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:18.633841 1561 tablet_bootstrap.cc:492] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:18.635742 1102 consensus_peers.cc:487] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.636178 2568 raft_consensus.cc:482] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.636375 2568 raft_consensus.cc:504] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.637080 2568 leader_election.cc:288] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.637636 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e0be77dff645f795237ffe779ed684" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.638358 1102 leader_election.cc:341] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:18.641084 1099 consensus_peers.cc:487] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.641423 2568 consensus_queue.cc:1035] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:18.603855 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 916) took 3242 ms. Trace:
I20260927 15:06:18.641939 1562 rpcz_store.cc:276] 0927 15:06:15.361808 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.414504 (+ 52696us) service_pool.cc:227] Handling call
0927 15:06:18.603691 (+3189187us) ts_tablet_manager.cc:1145] Deleting tablet 1024b38f06bb4387bd24e98f0dee038c
0927 15:06:18.603703 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.603786 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3188970}
W20260927 15:06:18.642447 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1024b38f06bb4387bd24e98f0dee038c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1024b38f06bb4387bd24e98f0dee038c already in progress: creating tablet
I20260927 15:06:18.647713 1556 raft_consensus.cc:348] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.648198 1556 raft_consensus.cc:374] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.648370 1556 raft_consensus.cc:729] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.649119 1556 consensus_queue.cc:260] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.650133 1556 ts_tablet_manager.cc:1428] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
I20260927 15:06:18.651350 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 917) took 3046 ms. Trace:
I20260927 15:06:18.651513 1562 rpcz_store.cc:276] 0927 15:06:15.604624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.608185 (+ 3561us) service_pool.cc:227] Handling call
0927 15:06:18.642410 (+3034225us) ts_tablet_manager.cc:1145] Deleting tablet ee27f67bc245495a9e29bcac3e7d3846
0927 15:06:18.651148 (+ 8738us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.651285 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3033774}
W20260927 15:06:18.652485 1099 leader_election.cc:341] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 81e0be77dff645f795237ffe779ed684
I20260927 15:06:18.653330 1099 leader_election.cc:302] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:18.653376 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6a5f533041cd4f09be995950a5a4c79b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.654175 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a5f533041cd4f09be995950a5a4c79b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.654815 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7c6727a8c35146bab41c30a0ef2ddd04" } new_table_name: "default.Table_28e8e636179842d8bc64b5a47b5a2ec5" modify_external_catalogs: true
I20260927 15:06:18.655622 2568 raft_consensus.cc:2726] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:18.656209 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83d8ff4f407245e881c2ffed3a4727bd consensus state has no leader
I20260927 15:06:18.656562 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 1a05574f0f734e6d912b375137482a21 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:18.657151 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 85e8909687fb40fdbccad15cd99b6eaf from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:18.657452 906 master_service.cc:946] ReplaceTablet: received request to replace tablet 6cba64a85ff14281a662bb41189a2c5e from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:18.657932 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ae7f349e69914d07b2857d4decf5b8f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:18.657174 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0fb66217d0e64c60927679b2a228d43c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.658466 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae7f349e69914d07b2857d4decf5b8f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:18.658622 1099 consensus_peers.cc:487] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f271c76b5f2447239d3d014fbde4e8b2. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:18.658659 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fb66217d0e64c60927679b2a228d43c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:18.656210 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59cb392e91634113859027d5101620cb consensus state has no leader
W20260927 15:06:18.660681 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet ee27f67bc245495a9e29bcac3e7d3846 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee27f67bc245495a9e29bcac3e7d3846 already in progress: creating tablet
I20260927 15:06:18.664896 1556 tablet_bootstrap.cc:492] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.665263 1562 tablet_replica.cc:330] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:18.665493 1562 raft_consensus.cc:2229] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:18.665825 1562 pending_rounds.cc:62] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:18.665902 1562 pending_rounds.cc:68] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976372598800384 op_type: NO_OP noop_request { }
I20260927 15:06:18.666054 1562 raft_consensus.cc:2866] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:18.666179 1562 raft_consensus.cc:2258] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.666740 1562 ts_tablet_manager.cc:1905] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.674409 1561 tablet_bootstrap.cc:654] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:18.677533 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9c032a06c0b497fa21a3553375978ca consensus state has no leader
I20260927 15:06:18.679721 2233 ts_tablet_manager.cc:1918] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:18.680007 2233 log.cc:1196] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3042c17580d54082971b761433a7dca9
I20260927 15:06:18.680655 2233 ts_tablet_manager.cc:1939] T 3042c17580d54082971b761433a7dca9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.683223 1556 tablet_bootstrap.cc:654] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:18.687222 898 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92 -> Peer 2a122de3662f485f8f44b0a5e4b29862 (127.0.201.60:46799): Couldn't send request to peer 2a122de3662f485f8f44b0a5e4b29862. Status: Network error: Client connection negotiation failed: client connection to 127.0.201.60:46799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260927 15:06:18.687767 2797 raft_consensus.cc:482] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.688024 2797 raft_consensus.cc:504] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.688617 2797 leader_election.cc:288] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:18.689589 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955461f27b6444d4b4c3f9a9f629d5e3" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.690208 1376 leader_election.cc:341] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.692595 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955461f27b6444d4b4c3f9a9f629d5e3" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:18.693223 1374 leader_election.cc:341] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.693379 1374 leader_election.cc:302] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:18.693470 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 972) took 2357 ms. Trace:
I20260927 15:06:18.693919 2797 raft_consensus.cc:2726] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.694866 906 master_service.cc:946] ReplaceTablet: received request to replace tablet 7dccaee87f314cbaa98d66e0bb885a8b from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:18.695446 1552 tablet_bootstrap.cc:492] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:18.695590 1552 ts_tablet_manager.cc:1397] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.003s
I20260927 15:06:18.696944 1552 raft_consensus.cc:348] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.697160 1552 raft_consensus.cc:374] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.697212 1552 raft_consensus.cc:729] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.697402 1552 consensus_queue.cc:260] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.697926 1552 ts_tablet_manager.cc:1428] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:18.698196 1552 tablet_bootstrap.cc:492] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:18.702971 1552 tablet_bootstrap.cc:654] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.703547 1556 tablet_bootstrap.cc:492] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.703744 1556 ts_tablet_manager.cc:1397] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.002s
I20260927 15:06:18.693559 2233 rpcz_store.cc:276] 0927 15:06:16.336224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.336287 (+ 63us) service_pool.cc:227] Handling call
0927 15:06:18.566298 (+2230011us) ts_tablet_manager.cc:1145] Deleting tablet 3042c17580d54082971b761433a7dca9
0927 15:06:18.566309 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.598002 (+ 31693us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.679544 (+ 81542us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.692866 (+ 13322us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x60800148ed50. stack: 00007f26d729d66e 00007f26d729d430 00007f26d63245ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f26e62a9848 00007f26e62af124 00007f26e62aedfd 00000000009edb7c 00007f26d71c77fe 00007f26e3a7783b 00007f26e3a77ca2 00000000009e5d60 00000000009e5cc0 00000000009e5c86
0927 15:06:18.693414 (+ 548us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26403200,"tablet-delete.queue_time_us":2229825}
I20260927 15:06:18.705061 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 3042c17580d54082971b761433a7dca9 (table default.Table_30f44c4820b9415daf4edfe7ea689da3 [id=d80cbbb5881e42f0b5651563d6f60bb5]) successfully deleted
I20260927 15:06:18.705466 2233 tablet_replica.cc:330] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.706815 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_11346dfb3345489f92bad7f598d0192e" } modify_external_catalogs: true
I20260927 15:06:18.707020 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_11346dfb3345489f92bad7f598d0192e" } modify_external_catalogs: true
I20260927 15:06:18.709807 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fcc32fa123dc46a4a9043db78118ff70" } modify_external_catalogs: true
I20260927 15:06:18.709968 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fcc32fa123dc46a4a9043db78118ff70" } modify_external_catalogs: true
I20260927 15:06:18.710789 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_34126485857a4ac3b58dbedcc6d99043" } modify_external_catalogs: true
I20260927 15:06:18.711009 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_34126485857a4ac3b58dbedcc6d99043" } modify_external_catalogs: true
I20260927 15:06:18.712635 2233 raft_consensus.cc:2229] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.713199 2233 raft_consensus.cc:2258] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.714650 2233 ts_tablet_manager.cc:1905] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.705262 1556 raft_consensus.cc:348] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.715368 1556 raft_consensus.cc:374] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.715505 1556 raft_consensus.cc:729] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.716188 1556 consensus_queue.cc:260] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.717779 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f052aaaa3793455bb19d7cceb4e127c4
I20260927 15:06:18.718583 1556 ts_tablet_manager.cc:1428] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260927 15:06:18.718891 1556 tablet_bootstrap.cc:492] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:18.719026 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet f052aaaa3793455bb19d7cceb4e127c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:18.719290 2119 ts_tablet_manager.cc:1918] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.719399 2119 log.cc:1196] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/c5cd55de34d249bc8d3adcf4690f0414
I20260927 15:06:18.719734 2119 ts_tablet_manager.cc:1939] T c5cd55de34d249bc8d3adcf4690f0414 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:18.719995 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 935) took 1031 ms. Trace:
I20260927 15:06:18.719974 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet f052aaaa3793455bb19d7cceb4e127c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:18.720063 2119 rpcz_store.cc:276] 0927 15:06:17.688187 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.688334 (+ 147us) service_pool.cc:227] Handling call
0927 15:06:18.608892 (+920558us) ts_tablet_manager.cc:1145] Deleting tablet c5cd55de34d249bc8d3adcf4690f0414
0927 15:06:18.608903 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.630037 (+ 21134us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.719188 (+ 89151us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.719981 (+ 793us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":920376}
I20260927 15:06:18.720387 2119 tablet_replica.cc:330] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:18.720541 2119 raft_consensus.cc:2229] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.720670 2119 raft_consensus.cc:2258] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.720825 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet c5cd55de34d249bc8d3adcf4690f0414 (table default.Table_4e746f160fe7481ea3947c59c33ed5ee [id=1b056b1df8b440a7a49989039998313c]) successfully deleted
I20260927 15:06:18.721125 2119 ts_tablet_manager.cc:1905] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.726295 908 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f8d0c40b63e74569860350e48717f971
W20260927 15:06:18.728818 1099 consensus_peers.cc:487] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 429088342b4743c39fb1e38d235024de. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:18.735047 1099 consensus_peers.cc:487] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3efc44686be2407cbcdca61909301539. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.735476 2233 ts_tablet_manager.cc:1918] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:18.737238 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet f052aaaa3793455bb19d7cceb4e127c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:18.740818 2661 raft_consensus.cc:482] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.740955 2661 raft_consensus.cc:504] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.741559 2661 leader_election.cc:288] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:18.742583 1238 leader_election.cc:341] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b3cc37a97bc145bdaa654bcc193fe93b
W20260927 15:06:18.744613 1239 leader_election.cc:341] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: b3cc37a97bc145bdaa654bcc193fe93b
I20260927 15:06:18.744725 1239 leader_election.cc:302] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:18.745159 2661 raft_consensus.cc:2726] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.749845 1562 ts_tablet_manager.cc:1918] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:18.752444 2119 ts_tablet_manager.cc:1918] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.752559 2119 log.cc:1196] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/8790d59beb804acb8e4353f862d7f6f8
I20260927 15:06:18.752892 2119 ts_tablet_manager.cc:1939] T 8790d59beb804acb8e4353f862d7f6f8 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:18.755275 1102 consensus_peers.cc:487] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.750665 1561 tablet_bootstrap.cc:492] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.755663 1561 ts_tablet_manager.cc:1397] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.122s user 0.001s sys 0.003s
I20260927 15:06:18.756541 1561 raft_consensus.cc:348] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.756821 1561 raft_consensus.cc:374] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.756906 1561 raft_consensus.cc:729] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.757117 1561 consensus_queue.cc:260] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.748790 1556 tablet_bootstrap.cc:654] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.760396 1562 log.cc:1196] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/2c4a123886a847d08b2a94ff5e4e01ca
I20260927 15:06:18.760327 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_acd9f14d4fb34ccca7258cac39ea7602" } modify_external_catalogs: true
I20260927 15:06:18.760571 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_acd9f14d4fb34ccca7258cac39ea7602" } modify_external_catalogs: true
I20260927 15:06:18.760982 1562 ts_tablet_manager.cc:1939] T 2c4a123886a847d08b2a94ff5e4e01ca P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:18.761152 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_34d1f85060084bebb54e57402ea08b5d" } new_table_name: "default.Table_6415984e90b9420d867c66eae3dabdee" modify_external_catalogs: true
I20260927 15:06:18.763305 2233 log.cc:1196] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/cad4605da5e045e7969da2d6f56a7e70
I20260927 15:06:18.763978 2233 ts_tablet_manager.cc:1939] T cad4605da5e045e7969da2d6f56a7e70 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.764379 1561 ts_tablet_manager.cc:1428] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260927 15:06:18.766000 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet bd0e035cec844fe789fdc815644fc025 (table default.Table_646b4123f3f64322ae6a01a54206087b [id=ae701d98419e4d69a7aa4f5bc4f2be0e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bd0e035cec844fe789fdc815644fc025 consensus state has no leader
I20260927 15:06:18.767491 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_89c2edced1064494a5d6562ecfa933aa" } new_table_name: "default.Table_e3b6937666334bb98cf3be6abec889f6" modify_external_catalogs: true
I20260927 15:06:18.767813 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 973) took 2208 ms. Trace:
I20260927 15:06:18.767956 2233 rpcz_store.cc:276] 0927 15:06:16.559387 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.559444 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:18.705373 (+2145929us) ts_tablet_manager.cc:1145] Deleting tablet cad4605da5e045e7969da2d6f56a7e70
0927 15:06:18.705384 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.732679 (+ 27295us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.735356 (+ 2677us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.767785 (+ 32429us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2145751}
I20260927 15:06:18.768422 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet cad4605da5e045e7969da2d6f56a7e70 (table default.Table_dd8f1d71fa7d4665b96954a6d766c9ce [id=672533238895472b9bfb06706e4b41bb]) successfully deleted
I20260927 15:06:18.770601 1561 tablet_bootstrap.cc:492] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.771999 2661 raft_consensus.cc:482] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.772140 2661 raft_consensus.cc:504] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.772732 2661 leader_election.cc:288] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.772655 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4aa9e57d83634b47ad095defed34668e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.773231 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4aa9e57d83634b47ad095defed34668e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:18.774163 1239 leader_election.cc:341] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 033e71f60c3e47fd9647db090d4d6cd5
W20260927 15:06:18.774837 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet decee14b5d7a4aef9989051dcaeb5a7b consensus state has no leader
W20260927 15:06:18.774942 1238 leader_election.cc:341] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 033e71f60c3e47fd9647db090d4d6cd5
I20260927 15:06:18.774976 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 974) took 2094 ms. Trace:
I20260927 15:06:18.775043 1238 leader_election.cc:302] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:18.775086 2233 rpcz_store.cc:276] 0927 15:06:16.680864 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.680914 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:18.774840 (+2093926us) ts_tablet_manager.cc:1145] Deleting tablet 1d25749db81f4631bbc1e5581bcc666e
0927 15:06:18.774852 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.774939 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2093726}
I20260927 15:06:18.775368 2661 raft_consensus.cc:2726] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:18.775534 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1d25749db81f4631bbc1e5581bcc666e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d25749db81f4631bbc1e5581bcc666e already in progress: creating tablet
I20260927 15:06:18.775530 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fefd3ef9ef60432db2405746db3ece28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.776067 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fefd3ef9ef60432db2405746db3ece28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.778172 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 975) took 2091 ms. Trace:
I20260927 15:06:18.778682 2233 rpcz_store.cc:276] 0927 15:06:16.687045 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.687095 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:18.778044 (+2090949us) ts_tablet_manager.cc:1145] Deleting tablet 476d3f3762a04acaa10f7b910984bec7
0927 15:06:18.778054 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.778132 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2090778}
W20260927 15:06:18.779549 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 476d3f3762a04acaa10f7b910984bec7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 476d3f3762a04acaa10f7b910984bec7 already in progress: creating tablet
I20260927 15:06:18.779930 2233 tablet_replica.cc:330] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.780210 2233 raft_consensus.cc:2229] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.780355 1561 tablet_bootstrap.cc:654] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.780514 2233 raft_consensus.cc:2258] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.781163 2233 ts_tablet_manager.cc:1905] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.781778 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 918) took 3165 ms. Trace:
I20260927 15:06:18.782869 1562 rpcz_store.cc:276] 0927 15:06:15.616278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.617692 (+ 1414us) service_pool.cc:227] Handling call
0927 15:06:18.653112 (+3035420us) ts_tablet_manager.cc:1145] Deleting tablet 2c4a123886a847d08b2a94ff5e4e01ca
0927 15:06:18.665143 (+ 12031us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.682065 (+ 16922us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.749732 (+ 67667us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.781755 (+ 32023us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3023550}
I20260927 15:06:18.792888 1556 tablet_bootstrap.cc:492] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.793081 1556 ts_tablet_manager.cc:1397] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.074s user 0.008s sys 0.000s
I20260927 15:06:18.793557 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 2c4a123886a847d08b2a94ff5e4e01ca (table default.Table_862695dd435f415a9be8f6394105e76a [id=3415aea6aba444339a381ccdde11e18c]) successfully deleted
I20260927 15:06:18.794034 2431 raft_consensus.cc:482] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.794167 2431 raft_consensus.cc:504] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.794351 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 933) took 2905 ms. Trace:
I20260927 15:06:18.794421 1562 rpcz_store.cc:276] 0927 15:06:15.888644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.888798 (+ 154us) service_pool.cc:227] Handling call
0927 15:06:18.794221 (+2905423us) ts_tablet_manager.cc:1145] Deleting tablet 6d167c390ed546e09f31f1e08988500c
0927 15:06:18.794233 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.794334 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2905251}
I20260927 15:06:18.794744 2431 leader_election.cc:288] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:18.794860 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 6d167c390ed546e09f31f1e08988500c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d167c390ed546e09f31f1e08988500c already in progress: creating tablet
I20260927 15:06:18.795611 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf68ba5020446bf8b522ac6db0e21e7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.796458 1102 leader_election.cc:341] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.796877 1556 raft_consensus.cc:348] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.797063 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 934) took 2906 ms. Trace:
I20260927 15:06:18.797335 1556 raft_consensus.cc:374] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.797492 1556 raft_consensus.cc:729] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.797794 1556 consensus_queue.cc:260] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.798924 1562 rpcz_store.cc:276] 0927 15:06:15.890571 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.890618 (+ 47us) service_pool.cc:227] Handling call
0927 15:06:18.796934 (+2906316us) ts_tablet_manager.cc:1145] Deleting tablet 72f87499645e4f55bc3d6edeba50eb64
0927 15:06:18.796946 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.797047 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2906135}
I20260927 15:06:18.800673 1556 ts_tablet_manager.cc:1428] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260927 15:06:18.801008 1556 tablet_bootstrap.cc:492] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:18.801586 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 72f87499645e4f55bc3d6edeba50eb64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72f87499645e4f55bc3d6edeba50eb64 already in progress: creating tablet
I20260927 15:06:18.803041 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf68ba5020446bf8b522ac6db0e21e7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.803277 1433 raft_consensus.cc:2454] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:18.803913 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 935) took 2900 ms. Trace:
I20260927 15:06:18.804601 1562 rpcz_store.cc:276] 0927 15:06:15.903826 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.903885 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:18.803801 (+2899916us) ts_tablet_manager.cc:1145] Deleting tablet 75b4abbc451b44a2af08e17f49f570f1
0927 15:06:18.803812 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.803896 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2899707}
W20260927 15:06:18.805475 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 75b4abbc451b44a2af08e17f49f570f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75b4abbc451b44a2af08e17f49f570f1 already in progress: creating tablet
I20260927 15:06:18.805962 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 936) took 2900 ms. Trace:
I20260927 15:06:18.806321 1099 leader_election.cc:302] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.810190 2431 raft_consensus.cc:2781] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.810272 2431 raft_consensus.cc:482] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.810357 2431 raft_consensus.cc:3037] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.813184 2431 raft_consensus.cc:504] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.814543 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf68ba5020446bf8b522ac6db0e21e7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:18.815097 1102 leader_election.cc:341] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.815428 2431 leader_election.cc:288] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.815865 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf68ba5020446bf8b522ac6db0e21e7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:18.815933 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 936) took 1060 ms. Trace:
I20260927 15:06:18.816097 1433 raft_consensus.cc:3037] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.816016 2119 rpcz_store.cc:276] 0927 15:06:17.755454 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.755510 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:18.720348 (+964838us) ts_tablet_manager.cc:1145] Deleting tablet 8790d59beb804acb8e4353f862d7f6f8
0927 15:06:18.720358 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.749574 (+ 29216us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.752361 (+ 2787us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.815919 (+ 63558us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":964654}
I20260927 15:06:18.816521 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 8790d59beb804acb8e4353f862d7f6f8 (table default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]) successfully deleted
I20260927 15:06:18.817921 2119 tablet_replica.cc:330] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:18.818089 2119 raft_consensus.cc:2229] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.818277 2119 raft_consensus.cc:2258] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.819581 1433 raft_consensus.cc:2454] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:18.819948 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 4ebacc9c2fca45ff92635e41a19e5bd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ebacc9c2fca45ff92635e41a19e5bd8 already in progress: creating tablet
W20260927 15:06:18.820212 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 51f0744f9d804b84a958916c2dd04503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51f0744f9d804b84a958916c2dd04503 already in progress: creating tablet
W20260927 15:06:18.820436 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 58d7e01486e941f9a6a5f691ae6c7d68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d7e01486e941f9a6a5f691ae6c7d68 already in progress: creating tablet
W20260927 15:06:18.820631 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7f8744e2349e49d3a821eca42c7f89a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f8744e2349e49d3a821eca42c7f89a2 already in progress: creating tablet
W20260927 15:06:18.821229 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet d25d98b148a94de4bba78a6969e81430 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d25d98b148a94de4bba78a6969e81430 already in progress: creating tablet
I20260927 15:06:18.821671 2431 raft_consensus.cc:482] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.821849 2431 raft_consensus.cc:504] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.822868 2431 leader_election.cc:288] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.822953 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d4707e599840b3bdc2ab13c348ea80" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.823491 1102 leader_election.cc:341] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.823525 1099 leader_election.cc:302] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.824034 1556 tablet_bootstrap.cc:654] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.824757 2431 raft_consensus.cc:2781] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.825034 2431 raft_consensus.cc:686] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.825438 2431 consensus_queue.cc:237] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.827381 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d4707e599840b3bdc2ab13c348ea80" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:18.827858 1433 raft_consensus.cc:2454] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:18.829152 1099 leader_election.cc:302] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:18.829499 2569 raft_consensus.cc:2781] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:18.829572 2569 raft_consensus.cc:482] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:18.829632 2569 raft_consensus.cc:3037] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.832489 2569 raft_consensus.cc:504] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.833585 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d4707e599840b3bdc2ab13c348ea80" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:18.834064 1102 leader_election.cc:341] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.834280 2569 leader_election.cc:288] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.810307 1562 rpcz_store.cc:276] 0927 15:06:15.905008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.905052 (+ 44us) service_pool.cc:227] Handling call
0927 15:06:18.805859 (+2900807us) ts_tablet_manager.cc:1145] Deleting tablet 9f7afa41d7cb4daa89fee5d6036e7cf8
0927 15:06:18.805870 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.805945 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2900667}
W20260927 15:06:18.835042 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f7afa41d7cb4daa89fee5d6036e7cf8 already in progress: creating tablet
I20260927 15:06:18.835734 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 937) took 2930 ms. Trace:
I20260927 15:06:18.835870 1562 rpcz_store.cc:276] 0927 15:06:15.905675 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.905737 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:18.835382 (+2929645us) ts_tablet_manager.cc:1145] Deleting tablet cdcc55fb32b14935922e5870819bc266
0927 15:06:18.835393 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.835715 (+ 322us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2929507}
W20260927 15:06:18.836410 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet cdcc55fb32b14935922e5870819bc266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdcc55fb32b14935922e5870819bc266 already in progress: creating tablet
I20260927 15:06:18.836824 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 938) took 2930 ms. Trace:
I20260927 15:06:18.836943 1562 rpcz_store.cc:276] 0927 15:06:15.906652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.906708 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:18.836713 (+2930005us) ts_tablet_manager.cc:1145] Deleting tablet 2bb9540030834895ac069a0d516d7ee4
0927 15:06:18.836724 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.836808 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2929874}
I20260927 15:06:18.837021 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99d4707e599840b3bdc2ab13c348ea80" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
W20260927 15:06:18.837512 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 2bb9540030834895ac069a0d516d7ee4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bb9540030834895ac069a0d516d7ee4 already in progress: creating tablet
I20260927 15:06:18.837625 1433 raft_consensus.cc:3037] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:18.837867 1562 tablet_replica.cc:330] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:18.838114 1562 raft_consensus.cc:2229] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:18.838456 1562 pending_rounds.cc:62] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:18.838557 1562 pending_rounds.cc:68] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976373255680000 op_type: NO_OP noop_request { }
I20260927 15:06:18.838732 1562 raft_consensus.cc:2866] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:18.838907 1562 raft_consensus.cc:2258] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.839694 2797 raft_consensus.cc:482] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.839857 2797 raft_consensus.cc:504] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.840459 2797 leader_election.cc:288] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:18.841487 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac64eacc7d924940aacc8779b5bfeae7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.842131 1376 leader_election.cc:341] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.841358 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac64eacc7d924940aacc8779b5bfeae7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:18.842131 1433 raft_consensus.cc:2454] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:18.842926 1099 leader_election.cc:302] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:18.843358 1374 leader_election.cc:341] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.843472 1374 leader_election.cc:302] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:18.843828 2797 raft_consensus.cc:2726] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:18.844405 2569 raft_consensus.cc:2781] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:18.844523 2569 raft_consensus.cc:686] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:18.844748 2569 consensus_queue.cc:237] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.818783 2119 ts_tablet_manager.cc:1905] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:18.852161 1552 tablet_bootstrap.cc:492] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:18.852437 1552 ts_tablet_manager.cc:1397] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.154s user 0.040s sys 0.060s
I20260927 15:06:18.853750 1552 raft_consensus.cc:348] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:18.854135 1552 raft_consensus.cc:374] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.854226 1552 raft_consensus.cc:729] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.860298 1561 tablet_bootstrap.cc:492] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.860570 1561 ts_tablet_manager.cc:1397] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.090s user 0.003s sys 0.003s
W20260927 15:06:18.861409 1102 consensus_peers.cc:487] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.862362 1435 raft_consensus.cc:1261] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Refusing update from remote peer c4264874db964ff2830b7894c2b3d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260927 15:06:18.862315 1561 raft_consensus.cc:348] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.862643 1561 raft_consensus.cc:374] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.862751 1561 raft_consensus.cc:729] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.863844 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7d0fe0f317424922abbcb5c2375a5d6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:18.865726 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_452ab25734dc4aa9a28e08f23eb0d502"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:18.866408 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c7ae3a5600424cf6b72a6a8fb0470378"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:18.863129 1561 consensus_queue.cc:260] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.854749 1552 consensus_queue.cc:260] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:18.875510 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d0fe0f317424922abbcb5c2375a5d6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:18.876725 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_452ab25734dc4aa9a28e08f23eb0d502 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:18.821458 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 4febf85191d04dd98db55c5730232e1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4febf85191d04dd98db55c5730232e1c already in progress: creating tablet
W20260927 15:06:18.877998 901 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 56546us
W20260927 15:06:18.878295 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 171ba98418b34aa283b7a7b243678fa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 171ba98418b34aa283b7a7b243678fa9 already in progress: creating tablet
W20260927 15:06:18.878510 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet df6d7670381b49bb927943b2ee920c84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df6d7670381b49bb927943b2ee920c84 already in progress: creating tablet
W20260927 15:06:18.878688 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7ae3a5600424cf6b72a6a8fb0470378 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.880777 2431 consensus_queue.cc:1035] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:18.881181 1552 ts_tablet_manager.cc:1428] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20260927 15:06:18.881458 1561 ts_tablet_manager.cc:1428] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260927 15:06:18.884342 1561 tablet_bootstrap.cc:492] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:18.886842 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_37bb6ce46e864f588d2f5d01d8c88f9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.887528 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37bb6ce46e864f588d2f5d01d8c88f9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.887655 1552 tablet_bootstrap.cc:492] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:18.890995 1552 tablet_bootstrap.cc:654] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.892072 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_792cb69ae8ff4b6597aea2d034ef5ede" } new_table_name: "default.Table_f098ab1277e443c48a72b330ab75eac4" modify_external_catalogs: true
I20260927 15:06:18.893684 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fb2ab3810f4e4052a01cd9f20f74aab4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:18.894188 2233 ts_tablet_manager.cc:1918] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:06:18.894224 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb2ab3810f4e4052a01cd9f20f74aab4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.895200 1561 tablet_bootstrap.cc:654] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:18.898247 2233 log.cc:1196] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/214229a8283b43c4916a5db7ba120e03
I20260927 15:06:18.898636 2233 ts_tablet_manager.cc:1939] T 214229a8283b43c4916a5db7ba120e03 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.899574 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 978) took 2206 ms. Trace:
I20260927 15:06:18.899703 2233 rpcz_store.cc:276] 0927 15:06:16.693104 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.693154 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:18.779862 (+2086708us) ts_tablet_manager.cc:1145] Deleting tablet 214229a8283b43c4916a5db7ba120e03
0927 15:06:18.779874 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.787858 (+ 7984us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.894044 (+106186us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.899504 (+ 5460us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2086516}
I20260927 15:06:18.900210 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 976) took 2207 ms. Trace:
I20260927 15:06:18.900271 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 214229a8283b43c4916a5db7ba120e03 (table default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce [id=9b5989d83cc345ba90e2adfcc86f3925]) successfully deleted
I20260927 15:06:18.900316 2233 rpcz_store.cc:276] 0927 15:06:16.692889 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.693158 (+ 269us) service_pool.cc:227] Handling call
0927 15:06:18.900053 (+2206895us) ts_tablet_manager.cc:1145] Deleting tablet 033e71f60c3e47fd9647db090d4d6cd5
0927 15:06:18.900067 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.900145 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2206577}
I20260927 15:06:18.900640 2233 tablet_replica.cc:330] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.900887 2233 raft_consensus.cc:2229] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.901069 2233 raft_consensus.cc:2258] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.901357 1556 tablet_bootstrap.cc:492] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:18.901968 2233 ts_tablet_manager.cc:1905] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:18.903246 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 033e71f60c3e47fd9647db090d4d6cd5 because the tablet was not found. No further retry: Not found: Tablet not found: 033e71f60c3e47fd9647db090d4d6cd5
I20260927 15:06:18.908058 2119 ts_tablet_manager.cc:1918] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:18.911818 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4c0f3b014a07445b9a7e9bca831bce19" } new_table_name: "default.Table_9a30f76a2b30461db386e5fc524788be" modify_external_catalogs: true
I20260927 15:06:18.915431 1556 ts_tablet_manager.cc:1397] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.002s
I20260927 15:06:18.916411 1556 raft_consensus.cc:348] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.916772 1556 raft_consensus.cc:374] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.916894 1556 raft_consensus.cc:729] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.908181 2119 log.cc:1196] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/6cc8bd2079f84da39e13113e6699bf5e
W20260927 15:06:18.921187 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dead2d4d5ac243348ecd9eade6ea843f has no consensus state
I20260927 15:06:18.921465 907 master_service.cc:946] ReplaceTablet: received request to replace tablet 769e9b5c08cd44cc8a0d681500d64f54 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:18.921761 2119 ts_tablet_manager.cc:1939] T 6cc8bd2079f84da39e13113e6699bf5e P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:18.922484 1099 consensus_peers.cc:487] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc20a62bbd484c4e9e25cf1c15e1dde0. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:18.923331 1102 consensus_peers.cc:487] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:18.923358 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 6cc8bd2079f84da39e13113e6699bf5e (table default.Table_148b139f16504ddb8e47c777c207685a [id=2ef45e71ca384afdac391f024dc68388]) successfully deleted
W20260927 15:06:18.924163 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 832bf0ee6cbf4c639d2ea569c565ca20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 832bf0ee6cbf4c639d2ea569c565ca20 already in progress: creating tablet
I20260927 15:06:18.924724 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8b7f79a08f8c4535bb8cb6b24b2466ab" } new_table_name: "default.Table_b53965e2c83840f69a3e40fd19021f01" modify_external_catalogs: true
W20260927 15:06:18.925216 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 35a09718f15147f59575a7ea6f24573b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35a09718f15147f59575a7ea6f24573b already in progress: creating tablet
W20260927 15:06:18.926251 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bc47ec18419c42c5bf64a3a9a414d771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc47ec18419c42c5bf64a3a9a414d771 already in progress: creating tablet
W20260927 15:06:18.927569 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b0b25e485f3d4e6780cd34d9e13fa807 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0b25e485f3d4e6780cd34d9e13fa807 already in progress: creating tablet
W20260927 15:06:18.929137 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f052aaaa3793455bb19d7cceb4e127c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f052aaaa3793455bb19d7cceb4e127c4 already in progress: creating tablet
I20260927 15:06:18.839522 1562 ts_tablet_manager.cc:1905] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:18.948001 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af01c554377f414c9efe3451a5aa08fd consensus state has no leader
I20260927 15:06:18.948709 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c93be0971e984cc0a524ef3e04a5b01c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:18.949779 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da2cdd6c478a4c0989b9317d0206550c consensus state has no leader
I20260927 15:06:18.950344 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cce809a4e7644a39b4ee97078ae8fc27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:18.954218 2829 raft_consensus.cc:482] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.954372 2829 raft_consensus.cc:504] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.955001 2829 leader_election.cc:288] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.957000 2829 raft_consensus.cc:482] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:18.957145 2829 raft_consensus.cc:504] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.957787 2829 leader_election.cc:288] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:18.959429 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd5b041a4274477895e88d4822b91cca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:18.959949 2233 ts_tablet_manager.cc:1918] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:06:18.960145 1102 leader_election.cc:341] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.962077 2233 log.cc:1196] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/a8de6246f7904f6c80df624f3631db17
I20260927 15:06:18.962992 2233 ts_tablet_manager.cc:1939] T a8de6246f7904f6c80df624f3631db17 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:18.966897 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 977) took 2273 ms. Trace:
I20260927 15:06:18.969480 2233 rpcz_store.cc:276] 0927 15:06:16.693014 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.693231 (+ 217us) service_pool.cc:227] Handling call
0927 15:06:18.900546 (+2207315us) ts_tablet_manager.cc:1145] Deleting tablet a8de6246f7904f6c80df624f3631db17
0927 15:06:18.900558 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.932422 (+ 31864us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.959829 (+ 27407us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:18.966848 (+ 7019us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":204,"tablet-delete.queue_time_us":2207199}
I20260927 15:06:18.975450 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet a8de6246f7904f6c80df624f3631db17 (table default.Table_e18064a8c28446469b9ea854acda2a65 [id=f4b1254299c64997962c71b810f7cc67]) successfully deleted
I20260927 15:06:18.976364 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 979) took 2272 ms. Trace:
I20260927 15:06:18.978329 2233 rpcz_store.cc:276] 0927 15:06:16.703774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.704134 (+ 360us) service_pool.cc:227] Handling call
0927 15:06:18.976154 (+2272020us) ts_tablet_manager.cc:1145] Deleting tablet 917b445477c4403980f2fdfeaeab0854
0927 15:06:18.976176 (+ 22us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.976325 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2271819}
W20260927 15:06:18.979729 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 917b445477c4403980f2fdfeaeab0854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 917b445477c4403980f2fdfeaeab0854 already in progress: creating tablet
I20260927 15:06:18.980366 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 980) took 2276 ms. Trace:
I20260927 15:06:18.984371 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541147938d864cd9ad7208d96533b0f4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:18.985307 1102 leader_election.cc:341] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:18.987044 2233 rpcz_store.cc:276] 0927 15:06:16.703878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.704364 (+ 486us) service_pool.cc:227] Handling call
0927 15:06:18.980194 (+2275830us) ts_tablet_manager.cc:1145] Deleting tablet 5ca21f240d8d4252b9cf0355c69f7166
0927 15:06:18.980210 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:18.980329 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2275711}
W20260927 15:06:18.987617 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 5ca21f240d8d4252b9cf0355c69f7166 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ca21f240d8d4252b9cf0355c69f7166 already in progress: creating tablet
I20260927 15:06:18.989560 2233 tablet_replica.cc:330] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:18.989848 2233 raft_consensus.cc:2229] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:18.990159 1552 tablet_bootstrap.cc:492] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:18.990371 2233 raft_consensus.cc:2258] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:18.990569 1552 ts_tablet_manager.cc:1397] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.103s user 0.007s sys 0.010s
I20260927 15:06:18.992749 1552 raft_consensus.cc:348] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:18.993191 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cce809a4e7644a39b4ee97078ae8fc27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.993510 1552 raft_consensus.cc:374] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:18.993633 1552 raft_consensus.cc:729] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.993945 1552 consensus_queue.cc:260] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:18.994505 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c93be0971e984cc0a524ef3e04a5b01c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:18.996196 1561 tablet_bootstrap.cc:492] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:18.996403 1561 ts_tablet_manager.cc:1397] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.112s user 0.001s sys 0.014s
I20260927 15:06:18.997375 1561 raft_consensus.cc:348] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.997599 1561 raft_consensus.cc:374] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:18.997498 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 55119.2us
I20260927 15:06:18.997658 1561 raft_consensus.cc:729] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:18.998000 1561 consensus_queue.cc:260] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:18.998670 1561 ts_tablet_manager.cc:1428] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260927 15:06:18.999940 2814 mvcc.cc:205] Tried to move back new op lower bound from 7333976387007172608 to 7333976384365502464. Current Snapshot: MvccSnapshot[applied={T|T < 7333976387007172608}]
I20260927 15:06:19.001893 1552 ts_tablet_manager.cc:1428] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260927 15:06:19.005785 1552 tablet_bootstrap.cc:492] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:19.006788 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd5b041a4274477895e88d4822b91cca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.008170 1435 raft_consensus.cc:2454] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:19.008599 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3f53d3dc29354f54b93bebe7ab2330b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:19.009219 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_19b967b211a94e01a88e59b22de81627" } modify_external_catalogs: true
I20260927 15:06:19.010681 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_19b967b211a94e01a88e59b22de81627" } modify_external_catalogs: true
I20260927 15:06:19.012815 1552 tablet_bootstrap.cc:654] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.013268 2925 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:19.019104 2931 tablet.cc:1722] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:19.014300 2924 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:19.027344 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541147938d864cd9ad7208d96533b0f4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.027602 1433 raft_consensus.cc:2454] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:19.029781 1099 leader_election.cc:302] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.030191 1099 leader_election.cc:302] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.030730 2829 raft_consensus.cc:2781] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.030807 2829 raft_consensus.cc:482] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:19.030890 2829 raft_consensus.cc:3037] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.030851 1556 consensus_queue.cc:260] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.031453 1556 ts_tablet_manager.cc:1428] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.116s user 0.000s sys 0.001s
W20260927 15:06:19.032562 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f53d3dc29354f54b93bebe7ab2330b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.033272 2829 raft_consensus.cc:504] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.036818 2797 raft_consensus.cc:482] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.037016 1561 tablet_bootstrap.cc:492] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:19.036960 2797 raft_consensus.cc:504] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.037176 1556 tablet_bootstrap.cc:492] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.037531 2797 leader_election.cc:288] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:19.039085 2431 raft_consensus.cc:2781] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.039237 2431 raft_consensus.cc:482] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:19.039347 2431 raft_consensus.cc:3037] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.041962 2431 raft_consensus.cc:504] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.042246 1556 tablet_bootstrap.cc:654] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.042658 2431 leader_election.cc:288] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.043085 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541147938d864cd9ad7208d96533b0f4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:19.043334 1561 tablet_bootstrap.cc:654] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:19.044411 1102 leader_election.cc:341] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.045467 2829 leader_election.cc:288] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.049037 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727652500d9a47b68b7a0d0dcf583822" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.050002 1376 leader_election.cc:341] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.051334 1562 ts_tablet_manager.cc:1918] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:19.051474 1562 log.cc:1196] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/4b9e88c3679d412cac7603f200cf899b
I20260927 15:06:19.051863 1562 ts_tablet_manager.cc:1939] T 4b9e88c3679d412cac7603f200cf899b P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:19.052766 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 939) took 3118 ms. Trace:
I20260927 15:06:19.052867 1562 rpcz_store.cc:276] 0927 15:06:15.933837 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.933891 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:18.837827 (+2903936us) ts_tablet_manager.cc:1145] Deleting tablet 4b9e88c3679d412cac7603f200cf899b
0927 15:06:18.837836 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.033439 (+195603us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.051208 (+ 17769us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.052745 (+ 1537us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2902326}
I20260927 15:06:19.053285 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 940) took 3118 ms. Trace:
I20260927 15:06:19.053318 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 4b9e88c3679d412cac7603f200cf899b (table default.Table_1a0416550bbc4a05bc617171ed8c1504 [id=286509b6ce63492cbdc1ddea9374115c]) successfully deleted
I20260927 15:06:19.053387 1562 rpcz_store.cc:276] 0927 15:06:15.935170 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.935229 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:19.053173 (+3117944us) ts_tablet_manager.cc:1145] Deleting tablet 16884c7343be436aa312ec0af40f5e33
0927 15:06:19.053187 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.053269 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3117606}
I20260927 15:06:19.053650 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 941) took 3106 ms. Trace:
I20260927 15:06:19.053715 1562 rpcz_store.cc:276] 0927 15:06:15.947372 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.947424 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:19.053577 (+3106153us) ts_tablet_manager.cc:1145] Deleting tablet c49913b1763c4a7b9413a801aff93b30
0927 15:06:19.053586 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.053636 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3105983}
W20260927 15:06:19.053779 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 16884c7343be436aa312ec0af40f5e33 because the tablet was not found. No further retry: Not found: Tablet not found: 16884c7343be436aa312ec0af40f5e33
I20260927 15:06:19.053946 1562 tablet_replica.cc:330] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:06:19.054109 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c49913b1763c4a7b9413a801aff93b30 because the tablet was not found. No further retry: Not found: Tablet not found: c49913b1763c4a7b9413a801aff93b30
I20260927 15:06:19.054139 1562 raft_consensus.cc:2229] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:19.054431 1562 pending_rounds.cc:62] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:19.054484 1562 pending_rounds.cc:68] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976374953521152 op_type: NO_OP noop_request { }
I20260927 15:06:19.054600 1562 raft_consensus.cc:2866] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:19.054687 1562 raft_consensus.cc:2258] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.013736 2926 tablet.cc:1722] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:19.028151 2927 raft_consensus.cc:482] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.058333 2927 raft_consensus.cc:504] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.058974 2927 leader_election.cc:288] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.062443 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8f7bfb2e0ede422b83a9051c840f1649" } modify_external_catalogs: true
I20260927 15:06:19.063694 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8f7bfb2e0ede422b83a9051c840f1649" } modify_external_catalogs: true
I20260927 15:06:19.063936 2943 tablet.cc:1722] T a260c9d3b8fb4316864e6f986559bef1 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:19.064210 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd5b041a4274477895e88d4822b91cca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:19.065713 1102 leader_election.cc:341] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.067030 1562 ts_tablet_manager.cc:1905] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.066984 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a89ce4434ad4171bf613d4bbb3337a8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.067440 1102 leader_election.cc:341] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.070241 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a89ce4434ad4171bf613d4bbb3337a8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.070472 1436 raft_consensus.cc:2454] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:19.070819 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd5b041a4274477895e88d4822b91cca" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:19.071105 1435 raft_consensus.cc:3037] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.073108 1552 tablet_bootstrap.cc:492] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:19.073256 1552 ts_tablet_manager.cc:1397] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.000s
I20260927 15:06:19.074054 1435 raft_consensus.cc:2454] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:19.074052 1552 raft_consensus.cc:348] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.074259 1552 raft_consensus.cc:374] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.074321 1552 raft_consensus.cc:729] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.074529 1552 consensus_queue.cc:260] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.075032 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541147938d864cd9ad7208d96533b0f4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:19.075207 1552 ts_tablet_manager.cc:1428] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:19.075256 1433 raft_consensus.cc:3037] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.079025 1552 tablet_bootstrap.cc:492] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:19.082875 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727652500d9a47b68b7a0d0dcf583822" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:19.084309 1374 leader_election.cc:341] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.084499 1374 leader_election.cc:302] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:19.084939 2797 raft_consensus.cc:2726] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:19.086066 1562 ts_tablet_manager.cc:1918] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:19.088950 1433 raft_consensus.cc:2454] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:19.090137 1556 tablet_bootstrap.cc:492] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.090341 1556 ts_tablet_manager.cc:1397] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.008s
I20260927 15:06:19.091205 1556 raft_consensus.cc:348] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.091566 1556 raft_consensus.cc:374] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.091683 1556 raft_consensus.cc:729] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.091825 2233 ts_tablet_manager.cc:1905] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.091964 1556 consensus_queue.cc:260] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.092599 1556 ts_tablet_manager.cc:1428] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:19.096622 1556 tablet_bootstrap.cc:492] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.098016 2233 ts_tablet_manager.cc:1918] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:19.098104 1556 tablet_bootstrap.cc:654] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.098210 2233 log.cc:1196] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/fd5f2ab9677c4598b0b8d9a93a6a23c7
I20260927 15:06:19.098519 2233 ts_tablet_manager.cc:1939] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:19.099170 1552 tablet_bootstrap.cc:654] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.099310 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 995) took 2225 ms. Trace:
I20260927 15:06:19.099435 2233 rpcz_store.cc:276] 0927 15:06:16.874154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.874390 (+ 236us) service_pool.cc:227] Handling call
0927 15:06:18.989487 (+2115097us) ts_tablet_manager.cc:1145] Deleting tablet fd5f2ab9677c4598b0b8d9a93a6a23c7
0927 15:06:18.989502 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.095254 (+105752us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.097937 (+ 2683us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.099291 (+ 1354us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2114816}
I20260927 15:06:19.099956 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 (table default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]) successfully deleted
I20260927 15:06:19.100361 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 996) took 2111 ms. Trace:
I20260927 15:06:19.100485 2233 rpcz_store.cc:276] 0927 15:06:16.988847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.989171 (+ 324us) service_pool.cc:227] Handling call
0927 15:06:19.100247 (+2111076us) ts_tablet_manager.cc:1145] Deleting tablet 611e63080dcb474c8dde370c54a0e777
0927 15:06:19.100257 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.100344 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2110874}
W20260927 15:06:19.101009 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 611e63080dcb474c8dde370c54a0e777 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 611e63080dcb474c8dde370c54a0e777 already in progress: creating tablet
I20260927 15:06:19.101329 2233 tablet_replica.cc:330] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:19.101547 2233 raft_consensus.cc:2229] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:19.101729 2233 raft_consensus.cc:2258] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.102252 2233 ts_tablet_manager.cc:1905] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.086858 1561 tablet_bootstrap.cc:492] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:19.107179 1562 log.cc:1196] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/610ff6563dc64e73b2b4d7c268468b21
I20260927 15:06:19.107244 1561 ts_tablet_manager.cc:1397] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.070s user 0.000s sys 0.005s
I20260927 15:06:19.107589 1562 ts_tablet_manager.cc:1939] T 610ff6563dc64e73b2b4d7c268468b21 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:19.107903 1561 raft_consensus.cc:348] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.108088 1561 raft_consensus.cc:374] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.108130 1561 raft_consensus.cc:729] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.108300 1561 consensus_queue.cc:260] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.108385 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 942) took 3160 ms. Trace:
I20260927 15:06:19.108479 1562 rpcz_store.cc:276] 0927 15:06:15.947960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.948015 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:19.053906 (+3105891us) ts_tablet_manager.cc:1145] Deleting tablet 610ff6563dc64e73b2b4d7c268468b21
0927 15:06:19.053916 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.080301 (+ 26385us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.085966 (+ 5665us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.108364 (+ 22398us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3105732}
I20260927 15:06:19.108764 1561 ts_tablet_manager.cc:1428] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260927 15:06:19.108915 1562 tablet_replica.cc:330] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:19.109020 1561 tablet_bootstrap.cc:492] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:19.109097 1562 raft_consensus.cc:2229] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:19.109407 1562 raft_consensus.cc:2258] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.110248 1561 tablet_bootstrap.cc:654] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.110342 1562 ts_tablet_manager.cc:1905] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.086542 1099 leader_election.cc:302] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.111865 1099 leader_election.cc:302] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.112152 1099 leader_election.cc:302] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.113996 2927 raft_consensus.cc:2781] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.114082 2927 raft_consensus.cc:482] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:19.114189 2927 raft_consensus.cc:3037] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.114511 2568 raft_consensus.cc:2781] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:19.114614 2568 raft_consensus.cc:686] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:19.114809 2568 consensus_queue.cc:237] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.115612 1556 tablet_bootstrap.cc:492] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.115684 2569 raft_consensus.cc:2781] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:19.115742 1556 ts_tablet_manager.cc:1397] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.001s
I20260927 15:06:19.115796 2569 raft_consensus.cc:686] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:19.115969 2569 consensus_queue.cc:237] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.116425 1556 raft_consensus.cc:348] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.116623 1556 raft_consensus.cc:374] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.116706 1556 raft_consensus.cc:729] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.116851 2927 raft_consensus.cc:504] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.116916 1556 consensus_queue.cc:260] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.117606 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 610ff6563dc64e73b2b4d7c268468b21 (table default.Table_5c5b46d2dba044ef8c5bb41023e108ee [id=eb505f5ebaa2482182e05e9b000f35b9]) successfully deleted
W20260927 15:06:19.119031 1099 consensus_peers.cc:487] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 214229a8283b43c4916a5db7ba120e03. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.119081 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a89ce4434ad4171bf613d4bbb3337a8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:19.119686 1102 leader_election.cc:341] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.120437 1556 ts_tablet_manager.cc:1428] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:19.120496 2927 leader_election.cc:288] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.120949 1556 tablet_bootstrap.cc:492] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.122480 1556 tablet_bootstrap.cc:654] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.124709 2925 tablet.cc:1717] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c: Skipping requested alter to schema version 3, tablet already version 3
I20260927 15:06:19.125125 2931 tablet.cc:1717] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38: Skipping requested alter to schema version 3, tablet already version 3
I20260927 15:06:19.124316 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a89ce4434ad4171bf613d4bbb3337a8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:19.126147 1433 raft_consensus.cc:3037] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.128988 1433 raft_consensus.cc:2454] T 1a89ce4434ad4171bf613d4bbb3337a8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:19.129565 1099 leader_election.cc:302] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.129964 2569 raft_consensus.cc:2781] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:19.130075 2569 raft_consensus.cc:686] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:19.130337 2569 consensus_queue.cc:237] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.138348 1562 ts_tablet_manager.cc:1918] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:19.141080 1562 log.cc:1196] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/a19c9cc5859f49a58a35460e504b3f84
I20260927 15:06:19.141638 1562 ts_tablet_manager.cc:1939] T a19c9cc5859f49a58a35460e504b3f84 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:19.143507 1556 tablet_bootstrap.cc:492] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.143771 1556 ts_tablet_manager.cc:1397] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260927 15:06:19.144537 1556 raft_consensus.cc:348] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.144886 1556 raft_consensus.cc:374] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.145004 1556 raft_consensus.cc:729] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.146297 1552 tablet_bootstrap.cc:492] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:19.146440 1552 ts_tablet_manager.cc:1397] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.001s
I20260927 15:06:19.147158 1552 raft_consensus.cc:348] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.147363 1552 raft_consensus.cc:374] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.147413 1552 raft_consensus.cc:729] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.147792 1552 consensus_queue.cc:260] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.147792 1556 consensus_queue.cc:260] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.148572 1556 ts_tablet_manager.cc:1428] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260927 15:06:19.148881 1556 tablet_bootstrap.cc:492] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.153748 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69] alter complete (version 1)
I20260927 15:06:19.154258 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1a1cf4d2adeb43519e6e611cf1795278" } new_table_name: "default.Table_4684e67831e24d74947a894ad899f3be" modify_external_catalogs: true
I20260927 15:06:19.155324 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_01c07aa5c93a471881eb298f14cc1d32" } new_table_name: "default.Table_e1ff12b28a334d19ad9258294a011d92" modify_external_catalogs: true
I20260927 15:06:19.156258 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba163e0f6164d65b09da684ee4872e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.157330 2233 ts_tablet_manager.cc:1918] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:19.157434 2233 log.cc:1196] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/541147938d864cd9ad7208d96533b0f4
I20260927 15:06:19.157727 2233 ts_tablet_manager.cc:1939] T 541147938d864cd9ad7208d96533b0f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:19.158082 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet ac64eacc7d924940aacc8779b5bfeae7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.158428 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 997) took 2083 ms. Trace:
I20260927 15:06:19.158502 2233 rpcz_store.cc:276] 0927 15:06:17.074585 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.074661 (+ 76us) service_pool.cc:227] Handling call
0927 15:06:19.101292 (+2026631us) ts_tablet_manager.cc:1145] Deleting tablet 541147938d864cd9ad7208d96533b0f4
0927 15:06:19.101302 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.105049 (+ 3747us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.157230 (+ 52181us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.158413 (+ 1183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2026410}
I20260927 15:06:19.158938 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 541147938d864cd9ad7208d96533b0f4 (table default.Table_2c585ef1be384bbf993054ce07ec28d2 [id=ad01215da9fd4367aff8c096e377eb4e]) successfully deleted
W20260927 15:06:19.158969 912 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.201.1:54519 (request call id 150) took 891 ms (client timeout 1000 ms). Trace:
W20260927 15:06:19.159137 912 rpcz_store.cc:269] 0927 15:06:18.267870 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.446342 (+178472us) service_pool.cc:227] Handling call
0927 15:06:19.158916 (+712574us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:18.459844 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:18.459950 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:18.459956 (+ 6us) write_op.cc:435] Acquired schema lock
0927 15:06:18.459959 (+ 3us) tablet.cc:660] Decoding operations
0927 15:06:18.460078 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:18.460097 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:18.460102 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:18.460212 (+ 110us) tablet.cc:699] Row locks acquired
0927 15:06:18.460215 (+ 3us) write_op.cc:260] PREPARE: finished
0927 15:06:18.460251 (+ 36us) write_op.cc:270] Start()
0927 15:06:18.460284 (+ 33us) write_op.cc:276] Timestamp: P: 1790521578460222 usec, L: 0
0927 15:06:18.460288 (+ 4us) op_driver.cc:331] REPLICATION: starting
0927 15:06:18.460465 (+ 177us) log.cc:842] Serialized 901 byte log entry
0927 15:06:18.631245 (+170780us) op_driver.cc:444] REPLICATION: finished
0927 15:06:18.631392 (+ 147us) write_op.cc:301] APPLY: starting
0927 15:06:18.631415 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:18.631481 (+ 66us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:18.631522 (+ 41us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:18.631692 (+ 170us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:18.631753 (+ 61us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 15:06:18.631764 (+ 11us) write_op.cc:312] APPLY: finished
0927 15:06:18.631883 (+ 119us) log.cc:842] Serialized 29 byte log entry
0927 15:06:18.631991 (+ 108us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:18.632020 (+ 29us) write_op.cc:454] Released schema lock
0927 15:06:18.632049 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:18.632131 (+ 82us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:18.632135 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":80,"apply.run_cpu_time_us":815,"apply.run_wall_time_us":814,"num_ops":2,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":726,"prepare.run_wall_time_us":726,"raft.queue_time_us":383,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":170918}]]}
I20260927 15:06:19.159700 2940 raft_consensus.cc:482] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.159822 2940 raft_consensus.cc:504] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.159983 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6acef4be466846338bef3dfb9ef9cb17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:19.160329 2940 leader_election.cc:288] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:19.160526 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6acef4be466846338bef3dfb9ef9cb17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.161340 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba163e0f6164d65b09da684ee4872e0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:19.161577 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba163e0f6164d65b09da684ee4872e0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:19.161800 1164 raft_consensus.cc:2454] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:19.162173 1374 leader_election.cc:302] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:19.162405 2940 raft_consensus.cc:2781] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.162469 2940 raft_consensus.cc:482] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:19.162528 2940 raft_consensus.cc:3037] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.162555 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 955461f27b6444d4b4c3f9a9f629d5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:19.162788 1376 leader_election.cc:341] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.162916 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 3042c17580d54082971b761433a7dca9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.163254 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0163a49d9a894953905e20941878400b
I20260927 15:06:19.165617 2940 raft_consensus.cc:504] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.167793 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba163e0f6164d65b09da684ee4872e0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:19.168040 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba163e0f6164d65b09da684ee4872e0" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:19.168211 1164 raft_consensus.cc:3037] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:19.168303 1376 leader_election.cc:341] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.169518 1552 ts_tablet_manager.cc:1428] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260927 15:06:19.170454 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.170667 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 429088342b4743c39fb1e38d235024de with delete_type TABLET_DATA_DELETED (replaced by tablet 79a3125723034cb48bc1a05fc4abbb82) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.170871 2940 leader_election.cc:288] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:19.170876 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a7989e2b91044dab1d3e327958a051a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.171025 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 568ba79ea795403cba76fb6632efd7e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 925d256cb28f496889ad7b3c6b1f6f10) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.171195 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 214229a8283b43c4916a5db7ba120e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.171648 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet a8de6246f7904f6c80df624f3631db17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.171813 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 3042c17580d54082971b761433a7dca9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.172459 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 943) took 3214 ms. Trace:
I20260927 15:06:19.172546 1562 rpcz_store.cc:276] 0927 15:06:15.958465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.958521 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:19.108824 (+3150303us) ts_tablet_manager.cc:1145] Deleting tablet a19c9cc5859f49a58a35460e504b3f84
0927 15:06:19.108880 (+ 56us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.135235 (+ 26355us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.138258 (+ 3023us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.172441 (+ 34183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3968,"tablet-delete.queue_time_us":3141384}
I20260927 15:06:19.172986 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet a19c9cc5859f49a58a35460e504b3f84 (table default.Table_d824f1399fb8451dad058a93321740ce [id=7fc0363b53f4466f9e6320ea6750aec3]) successfully deleted
I20260927 15:06:19.174461 1556 tablet_bootstrap.cc:654] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.174695 1562 tablet_replica.cc:330] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:19.175519 1561 tablet_bootstrap.cc:492] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:19.175654 1561 ts_tablet_manager.cc:1397] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.007s
I20260927 15:06:19.175851 1562 raft_consensus.cc:2229] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:19.176600 1552 tablet_bootstrap.cc:492] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:19.176358 1561 raft_consensus.cc:348] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.177623 1561 raft_consensus.cc:374] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.177750 1561 raft_consensus.cc:729] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.178027 1561 consensus_queue.cc:260] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.178277 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1dfbe94faecb4c6a9bea043a4b0f6361
I20260927 15:06:19.178772 1561 ts_tablet_manager.cc:1428] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:19.178205 1562 raft_consensus.cc:2258] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.179352 1562 ts_tablet_manager.cc:1905] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.179664 1561 tablet_bootstrap.cc:492] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:19.184561 1561 tablet_bootstrap.cc:654] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:19.186316 1102 consensus_peers.cc:487] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.187868 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 72862763900249b8a7079fde891d8021
I20260927 15:06:19.188017 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9d8fd588fe344e819f13aadb33e26153
I20260927 15:06:19.170677 1164 raft_consensus.cc:2454] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
W20260927 15:06:19.188602 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5ffe51b1b834bf4af262dc70b9206f8 consensus state has no leader
I20260927 15:06:19.191756 1374 leader_election.cc:302] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.193660 1552 tablet_bootstrap.cc:654] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.194742 1556 tablet_bootstrap.cc:492] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.194783 1561 tablet_bootstrap.cc:492] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:19.194923 1561 ts_tablet_manager.cc:1397] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.005s
I20260927 15:06:19.195015 1556 ts_tablet_manager.cc:1397] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.001s
I20260927 15:06:19.195173 2940 raft_consensus.cc:2781] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:19.195446 2940 raft_consensus.cc:686] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:19.195600 1561 raft_consensus.cc:348] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.195719 2940 consensus_queue.cc:237] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.196415 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet eed526a0500c4f098719c74dd74975c6
I20260927 15:06:19.196745 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 769e9b5c08cd44cc8a0d681500d64f54
I20260927 15:06:19.195804 1561 raft_consensus.cc:374] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.197430 1561 raft_consensus.cc:729] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.197611 1561 consensus_queue.cc:260] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.198066 1556 raft_consensus.cc:348] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.198302 1556 raft_consensus.cc:374] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.198410 1556 raft_consensus.cc:729] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.199082 1556 consensus_queue.cc:260] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.200594 1556 ts_tablet_manager.cc:1428] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:19.201088 1556 tablet_bootstrap.cc:492] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.202353 1561 ts_tablet_manager.cc:1428] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260927 15:06:19.202589 1561 tablet_bootstrap.cc:492] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:19.204203 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 85e8909687fb40fdbccad15cd99b6eaf
I20260927 15:06:19.204743 1556 tablet_bootstrap.cc:654] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.205006 1562 ts_tablet_manager.cc:1918] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:19.206270 1552 tablet_bootstrap.cc:492] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:19.206634 1552 ts_tablet_manager.cc:1397] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.001s
I20260927 15:06:19.211469 1562 log.cc:1196] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/cd76c49eda1c4b4ca0edf0f4d2790188
I20260927 15:06:19.211890 1562 ts_tablet_manager.cc:1939] T cd76c49eda1c4b4ca0edf0f4d2790188 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:19.212608 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 944) took 3231 ms. Trace:
I20260927 15:06:19.212828 1552 raft_consensus.cc:348] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.213104 1552 raft_consensus.cc:374] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.213207 1552 raft_consensus.cc:729] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.213590 1552 consensus_queue.cc:260] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.214031 1562 rpcz_store.cc:276] 0927 15:06:15.980698 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.980753 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:19.174650 (+3193897us) ts_tablet_manager.cc:1145] Deleting tablet cd76c49eda1c4b4ca0edf0f4d2790188
0927 15:06:19.174661 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.191228 (+ 16567us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.204906 (+ 13678us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.212590 (+ 7684us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3193652}
I20260927 15:06:19.216425 912 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet fd8a53f3c95c4cb7bce21d23f79af28c (table default.Table_599d4864bb504fa98740493c10df01f0 [id=a51d9c4b701c4c639d904aef0ac3a2cb]). Expected version 2 got 0
W20260927 15:06:19.217581 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 047fe4ed761642ccbfecdf543900d064 consensus state has no leader
I20260927 15:06:19.220409 1552 ts_tablet_manager.cc:1428] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260927 15:06:19.207942 1561 tablet_bootstrap.cc:654] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.220857 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b9d57ae6df614ca08fee1dc08d3e447e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.221446 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9d57ae6df614ca08fee1dc08d3e447e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.222160 905 master_service.cc:946] ReplaceTablet: received request to replace tablet 512a2f4e3c3f479daba37eb1ca0d463b from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:19.223351 914 catalog_manager.cc:6565] ReplaceTablet: tablet 85e8909687fb40fdbccad15cd99b6eaf deleted and replaced by tablet 5e04612637ac41c0a3b89b642823e9a1
I20260927 15:06:19.223562 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 214229a8283b43c4916a5db7ba120e03 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:19.222414 1562 tablet_replica.cc:330] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:19.223903 2233 tablet_replica.cc:330] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:19.223771 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_004cca1243a74c9688562164253e3789"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:19.224044 1562 raft_consensus.cc:2229] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:19.224120 2233 raft_consensus.cc:2229] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:19.224196 1562 raft_consensus.cc:2258] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.224264 2233 raft_consensus.cc:2258] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:19.224259 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_004cca1243a74c9688562164253e3789 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.224727 1562 ts_tablet_manager.cc:1905] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.224785 2233 ts_tablet_manager.cc:1905] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.224925 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_69a4bed2711242a2be679d44481b97b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.225389 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69a4bed2711242a2be679d44481b97b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.225488 907 catalog_manager.cc:6565] ReplaceTablet: tablet 769e9b5c08cd44cc8a0d681500d64f54 deleted and replaced by tablet 01b31e13faed44088c5ad5e3e9fa6b3f
I20260927 15:06:19.225777 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5928117889194139983a092a6a1d747c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.226158 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5928117889194139983a092a6a1d747c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.227330 911 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49800 (request call id 1297) took 1055 ms. Trace:
I20260927 15:06:19.227468 911 rpcz_store.cc:276] 0927 15:06:18.171415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.502545 (+331130us) service_pool.cc:227] Handling call
0927 15:06:18.576556 (+ 74011us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00007f2c3731827d 00007f2c37318373 00007f2c3413a361 00007f2c3baad66a 00007f2c3bc362e6 00007f2c32f29126 00007f2c32f28e55 00007f2c2f7379be 00007f2c2f73679e 00007f2c2f73cb25 00007f2c2f73d54f
0927 15:06:18.588019 (+ 11463us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0927 15:06:18.588170 (+ 151us) catalog_manager.cc:2752] Modifying in-memory table state
0927 15:06:18.588220 (+ 50us) catalog_manager.cc:2761] Locking tablets
0927 15:06:19.151101 (+562881us) catalog_manager.cc:2775] Removing table and tablets from system table
0927 15:06:19.163089 (+ 11988us) catalog_manager.cc:2793] Removing table from by-name map
0927 15:06:19.163159 (+ 70us) catalog_manager.cc:2809] Committing in-memory state
0927 15:06:19.163199 (+ 40us) catalog_manager.cc:2813] Aborting table tasks
0927 15:06:19.227065 (+ 63866us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x61100010abf0. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f2c2f6a2862 00007f2c322eb059 00007f2c3bb237cc 00007f2c3ba7c085 00007f2c3ba6d89c 00007f2c3ba5169c 00007f2c3ba4e1b2 00007f2c3ba42c70 00007f2c3ba411bf 00007f2c3bc36446
0927 15:06:19.227286 (+ 221us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:19.153236 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:19.153378 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:19.153384 (+ 6us) write_op.cc:435] Acquired schema lock
0927 15:06:19.153387 (+ 3us) tablet.cc:660] Decoding operations
0927 15:06:19.153520 (+ 133us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:19.153534 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:19.153540 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:19.153655 (+ 115us) tablet.cc:699] Row locks acquired
0927 15:06:19.153658 (+ 3us) write_op.cc:260] PREPARE: finished
0927 15:06:19.153694 (+ 36us) write_op.cc:270] Start()
0927 15:06:19.153741 (+ 47us) write_op.cc:276] Timestamp: P: 1790521579153653 usec, L: 0
0927 15:06:19.153745 (+ 4us) op_driver.cc:331] REPLICATION: starting
0927 15:06:19.153934 (+ 189us) log.cc:842] Serialized 725 byte log entry
0927 15:06:19.159553 (+ 5619us) op_driver.cc:444] REPLICATION: finished
0927 15:06:19.160475 (+ 922us) write_op.cc:301] APPLY: starting
0927 15:06:19.160491 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:19.160540 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:19.160564 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:19.160626 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:19.160661 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 15:06:19.160669 (+ 8us) write_op.cc:312] APPLY: finished
0927 15:06:19.160737 (+ 68us) log.cc:842] Serialized 29 byte log entry
0927 15:06:19.160809 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:19.160826 (+ 17us) write_op.cc:454] Released schema lock
0927 15:06:19.160833 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:19.160888 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:19.160894 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":315635840,"child_traces":[["op",{"apply.queue_time_us":865,"apply.run_cpu_time_us":472,"apply.run_wall_time_us":472,"num_ops":2,"prepare.queue_time_us":1303,"prepare.run_cpu_time_us":833,"prepare.run_wall_time_us":1157,"raft.queue_time_us":122,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":246,"replication_time_us":5780}]]}
I20260927 15:06:19.228319 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7922646448e64068a424e80834b4ca50" } new_table_name: "default.Table_f112f4d6034843c095757c716356f20d" modify_external_catalogs: true
I20260927 15:06:19.228754 1552 tablet_bootstrap.cc:492] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:19.230297 1552 tablet_bootstrap.cc:654] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:19.231536 1376 consensus_peers.cc:487] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.232221 1556 tablet_bootstrap.cc:492] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.232378 1556 ts_tablet_manager.cc:1397] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.003s
I20260927 15:06:19.232983 1556 raft_consensus.cc:348] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.233283 1556 raft_consensus.cc:374] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.233402 1556 raft_consensus.cc:729] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.233650 1556 consensus_queue.cc:260] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.234004 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet cd76c49eda1c4b4ca0edf0f4d2790188 (table default.Table_024037ff57734bfa973dff7fd4f09896 [id=697526af76a54d6597dee1ac56eca889]) successfully deleted
I20260927 15:06:19.234346 1556 ts_tablet_manager.cc:1428] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:19.234570 1556 tablet_bootstrap.cc:492] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.235026 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d8fd588fe344e819f13aadb33e26153 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.235479 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 72862763900249b8a7079fde891d8021 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.235426 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 47e6fc0d670940f8842235731c0facd7 (DEFAULT_TABLE table=default.Table_688c5a23eb25434ab514d2adfb5fdc51 [id=1470df1793d648e791ea0b582bb721d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.235639 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 85e8909687fb40fdbccad15cd99b6eaf with delete_type TABLET_DATA_DELETED (replaced by tablet 5e04612637ac41c0a3b89b642823e9a1) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.235795 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47e6fc0d670940f8842235731c0facd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.235924 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 06dbc6029bdd412e91c49d4112feee55 (DEFAULT_TABLE table=default.Table_d685958bb92c4b3eb8483ad67fecaeec [id=d9d9bdad77224374a2bb7de6b1948b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.236162 1556 tablet_bootstrap.cc:654] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.236245 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06dbc6029bdd412e91c49d4112feee55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.237700 1561 tablet_bootstrap.cc:492] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:19.237802 1561 ts_tablet_manager.cc:1397] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.002s
I20260927 15:06:19.238430 1561 raft_consensus.cc:348] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.238656 1561 raft_consensus.cc:374] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.238713 1561 raft_consensus.cc:729] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.238909 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfbe94faecb4c6a9bea043a4b0f6361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.238961 1561 consensus_queue.cc:260] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.239073 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 769e9b5c08cd44cc8a0d681500d64f54 with delete_type TABLET_DATA_DELETED (replaced by tablet 01b31e13faed44088c5ad5e3e9fa6b3f) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.239161 1133 tablet_service.cc:1467] Processing CreateTablet for tablet e465a0ef631b45c3898ce4cca6a48353 (DEFAULT_TABLE table=default.Table_bfc372718370477fa7a545e5b93f01c4 [id=53079171f5bd48e08e0441f62e9628a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.239243 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet 0163a49d9a894953905e20941878400b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.239449 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e465a0ef631b45c3898ce4cca6a48353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.238867 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 55d17784821c4081be845c9e8cf80af3 (DEFAULT_TABLE table=default.Table_ccb90357565c4710b3ca98388c247487 [id=60ef0221099c483f9e03f36a171dd3d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.242376 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 85e8909687fb40fdbccad15cd99b6eaf with delete_type TABLET_DATA_DELETED (replaced by tablet 5e04612637ac41c0a3b89b642823e9a1) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.242414 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 47e6fc0d670940f8842235731c0facd7 (DEFAULT_TABLE table=default.Table_688c5a23eb25434ab514d2adfb5fdc51 [id=1470df1793d648e791ea0b582bb721d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.242491 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 0163a49d9a894953905e20941878400b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.242797 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47e6fc0d670940f8842235731c0facd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.243116 1281 tablet_service.cc:1467] Processing CreateTablet for tablet b26f0d253a7f4df780a1f91ceb7d82b8 (DEFAULT_TABLE table=default.Table_16300d973fed4a26a7baa92b0de64def [id=7caf2dce5b104c209837cecbbaa189ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.243279 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 06dbc6029bdd412e91c49d4112feee55 (DEFAULT_TABLE table=default.Table_d685958bb92c4b3eb8483ad67fecaeec [id=d9d9bdad77224374a2bb7de6b1948b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.243433 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b26f0d253a7f4df780a1f91ceb7d82b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.243606 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet eed526a0500c4f098719c74dd74975c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.243774 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 72862763900249b8a7079fde891d8021 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.243896 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfbe94faecb4c6a9bea043a4b0f6361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.244019 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d8fd588fe344e819f13aadb33e26153 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.244151 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 769e9b5c08cd44cc8a0d681500d64f54 with delete_type TABLET_DATA_DELETED (replaced by tablet 01b31e13faed44088c5ad5e3e9fa6b3f) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.244377 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06dbc6029bdd412e91c49d4112feee55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.247305 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 55d17784821c4081be845c9e8cf80af3 (DEFAULT_TABLE table=default.Table_ccb90357565c4710b3ca98388c247487 [id=60ef0221099c483f9e03f36a171dd3d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.224121 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f032422e891740819ffdfaeade5c0c1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:19.247607 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55d17784821c4081be845c9e8cf80af3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:19.247961 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f032422e891740819ffdfaeade5c0c1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.235430 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet eed526a0500c4f098719c74dd74975c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.242810 1282 tablet_service.cc:1467] Processing CreateTablet for tablet e465a0ef631b45c3898ce4cca6a48353 (DEFAULT_TABLE table=default.Table_bfc372718370477fa7a545e5b93f01c4 [id=53079171f5bd48e08e0441f62e9628a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.250763 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e465a0ef631b45c3898ce4cca6a48353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.251938 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55d17784821c4081be845c9e8cf80af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.253388 913 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (table default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8]). Expected version 3 got 0
W20260927 15:06:19.257459 1099 consensus_peers.cc:487] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cad4605da5e045e7969da2d6f56a7e70. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:19.259743 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 85e8909687fb40fdbccad15cd99b6eaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85e8909687fb40fdbccad15cd99b6eaf already in progress: creating tablet
W20260927 15:06:19.260017 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0163a49d9a894953905e20941878400b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0163a49d9a894953905e20941878400b already in progress: creating tablet
W20260927 15:06:19.260219 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet eed526a0500c4f098719c74dd74975c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eed526a0500c4f098719c74dd74975c6 already in progress: creating tablet
W20260927 15:06:19.260366 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 72862763900249b8a7079fde891d8021 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72862763900249b8a7079fde891d8021 already in progress: creating tablet
W20260927 15:06:19.260527 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1dfbe94faecb4c6a9bea043a4b0f6361 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dfbe94faecb4c6a9bea043a4b0f6361 already in progress: creating tablet
W20260927 15:06:19.260682 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9d8fd588fe344e819f13aadb33e26153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d8fd588fe344e819f13aadb33e26153 already in progress: creating tablet
W20260927 15:06:19.260859 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 769e9b5c08cd44cc8a0d681500d64f54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 769e9b5c08cd44cc8a0d681500d64f54 already in progress: creating tablet
W20260927 15:06:19.266191 1102 consensus_peers.cc:487] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.266464 1561 ts_tablet_manager.cc:1428] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
W20260927 15:06:19.267398 1099 consensus_peers.cc:487] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8de6246f7904f6c80df624f3631db17. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.267724 2940 raft_consensus.cc:482] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.267922 2940 raft_consensus.cc:504] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.269405 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f8744e2349e49d3a821eca42c7f89a2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.270026 1376 leader_election.cc:341] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.270321 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet db09498a395b4570a34d32fbfc71e8ed (table default.Table_5b7e58750e9a481cab2abf34e5753a5e [id=ed34d1e88ae54c6086ae3a7cbfdf7861]). Expected version 1 got 0
I20260927 15:06:19.270815 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f8744e2349e49d3a821eca42c7f89a2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:19.271093 1561 tablet_bootstrap.cc:492] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:19.271298 1374 leader_election.cc:341] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.271390 1374 leader_election.cc:302] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:19.271126 909 catalog_manager.cc:5495] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:19.271610 2797 raft_consensus.cc:2726] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:19.271612 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
I20260927 15:06:19.272008 2940 leader_election.cc:288] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:19.272357 2927 raft_consensus.cc:482] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.272469 2927 raft_consensus.cc:504] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.272986 2927 leader_election.cc:288] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.273411 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19cd7febe054432899739e21605406d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.273824 1102 leader_election.cc:341] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.274123 1561 tablet_bootstrap.cc:654] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.274523 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19cd7febe054432899739e21605406d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.274718 1433 raft_consensus.cc:2454] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:19.275143 1099 leader_election.cc:302] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.275388 2927 raft_consensus.cc:2781] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.275453 2927 raft_consensus.cc:482] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:19.275523 2927 raft_consensus.cc:3037] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.276127 1552 tablet_bootstrap.cc:492] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:19.276276 1552 ts_tablet_manager.cc:1397] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.000s
I20260927 15:06:19.276336 2661 raft_consensus.cc:482] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.276455 2661 raft_consensus.cc:504] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.277029 2661 leader_election.cc:288] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.276999 1552 raft_consensus.cc:348] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.277267 1552 raft_consensus.cc:374] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.277341 1552 raft_consensus.cc:729] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.277587 1552 consensus_queue.cc:260] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.277951 2927 raft_consensus.cc:504] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.271893 909 catalog_manager.cc:5495] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:19.278231 1552 ts_tablet_manager.cc:1428] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:19.278471 1552 tablet_bootstrap.cc:492] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:19.278388 909 catalog_manager.cc:5495] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:19.279076 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 769e9b5c08cd44cc8a0d681500d64f54 with delete_type TABLET_DATA_DELETED (replaced by tablet 01b31e13faed44088c5ad5e3e9fa6b3f) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.279240 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (table default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8]). Expected version 3 got 0
I20260927 15:06:19.279392 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet eed526a0500c4f098719c74dd74975c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.279621 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 85e8909687fb40fdbccad15cd99b6eaf with delete_type TABLET_DATA_DELETED (replaced by tablet 5e04612637ac41c0a3b89b642823e9a1) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.279567 1408 tablet_service.cc:1467] Processing CreateTablet for tablet e465a0ef631b45c3898ce4cca6a48353 (DEFAULT_TABLE table=default.Table_bfc372718370477fa7a545e5b93f01c4 [id=53079171f5bd48e08e0441f62e9628a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.279481 909 catalog_manager.cc:5495] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:19.279858 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:19.279577 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 72862763900249b8a7079fde891d8021 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.280050 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dfbe94faecb4c6a9bea043a4b0f6361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.280050 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 078ba40ca56745b2a2b86402a1519011 (table default.Table_4e61792c99664faca894de841edc089d [id=f8a991083fb74bfc9d9969214ac7108f]). Expected version 2 got 0
I20260927 15:06:19.280253 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d8fd588fe344e819f13aadb33e26153 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.280419 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 0163a49d9a894953905e20941878400b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:18 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.280575 909 catalog_manager.cc:5495] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:19.280720 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 47e6fc0d670940f8842235731c0facd7 (DEFAULT_TABLE table=default.Table_688c5a23eb25434ab514d2adfb5fdc51 [id=1470df1793d648e791ea0b582bb721d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.280941 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet adf68ba5020446bf8b522ac6db0e21e7 (table default.Table_9d78b6648ac548e586c621d86d1938ba [id=3fc04b4c774144dd85bbb92d05883018]). Expected version 1 got 0
I20260927 15:06:19.281121 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 (table default.Table_9f691e4415864362a0a11b7ef69d222c [id=b09765fbcc8e4859b112206dd59e8ee8]). Expected version 1 got 0
I20260927 15:06:19.281193 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 55d17784821c4081be845c9e8cf80af3 (DEFAULT_TABLE table=default.Table_ccb90357565c4710b3ca98388c247487 [id=60ef0221099c483f9e03f36a171dd3d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.279938 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 06dbc6029bdd412e91c49d4112feee55 (DEFAULT_TABLE table=default.Table_d685958bb92c4b3eb8483ad67fecaeec [id=d9d9bdad77224374a2bb7de6b1948b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.281360 909 catalog_manager.cc:5495] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:19.281716 909 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet bd5b041a4274477895e88d4822b91cca (table default.Table_215f907352cd4345ae56604d6322ded9 [id=1f51698c91d64bb38f760d13529935b6]). Expected version 1 got 0
I20260927 15:06:19.281905 1562 ts_tablet_manager.cc:1918] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:19.282003 1562 log.cc:1196] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/ce566cc49cfe4483b942d2eaa8269acc
I20260927 15:06:19.282339 1562 ts_tablet_manager.cc:1939] T ce566cc49cfe4483b942d2eaa8269acc P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:06:19.283002 1239 leader_election.cc:341] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 610ff6563dc64e73b2b4d7c268468b21
I20260927 15:06:19.283918 1556 tablet_bootstrap.cc:492] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.284042 1556 ts_tablet_manager.cc:1397] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.050s user 0.012s sys 0.003s
I20260927 15:06:19.283978 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19cd7febe054432899739e21605406d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:19.279951 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e465a0ef631b45c3898ce4cca6a48353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.284766 1556 raft_consensus.cc:348] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.285024 1556 raft_consensus.cc:374] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.285071 1556 raft_consensus.cc:729] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.285324 1556 consensus_queue.cc:260] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.286945 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55d17784821c4081be845c9e8cf80af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.287402 2569 raft_consensus.cc:482] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.287510 2569 raft_consensus.cc:504] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.287982 2569 leader_election.cc:288] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.288558 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9a97e3e6a5749feb4dd5f835d9c01ac" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.288730 1433 raft_consensus.cc:2454] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:19.289074 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 945) took 3306 ms. Trace:
I20260927 15:06:19.289204 1099 leader_election.cc:302] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:19.289428 2569 raft_consensus.cc:2781] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.289484 2569 raft_consensus.cc:482] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:19.289546 2569 raft_consensus.cc:3037] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.289162 1562 rpcz_store.cc:276] 0927 15:06:15.983011 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:15.983068 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:19.222354 (+3239286us) ts_tablet_manager.cc:1145] Deleting tablet ce566cc49cfe4483b942d2eaa8269acc
0927 15:06:19.222367 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.233314 (+ 10947us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.281811 (+ 48497us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.289053 (+ 7242us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3239067}
I20260927 15:06:19.290220 1556 ts_tablet_manager.cc:1428] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:06:19.290508 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet ce566cc49cfe4483b942d2eaa8269acc (table default.Table_3d65f616a187485eaa9298155971a648 [id=5c5e1b2501064bd5a6df36c4dddda94a]) successfully deleted
I20260927 15:06:19.290639 1556 tablet_bootstrap.cc:492] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.291352 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 949) took 3082 ms. Trace:
I20260927 15:06:19.291884 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47e6fc0d670940f8842235731c0facd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.291986 2569 raft_consensus.cc:504] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.292277 1556 tablet_bootstrap.cc:654] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.292286 1552 tablet_bootstrap.cc:654] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.293478 1562 rpcz_store.cc:276] 0927 15:06:16.208984 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.209036 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:19.291220 (+3082184us) ts_tablet_manager.cc:1145] Deleting tablet c74dfa20ed9a4eb197a846b62d859146
0927 15:06:19.291232 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.291333 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3081979}
I20260927 15:06:19.293579 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9a97e3e6a5749feb4dd5f835d9c01ac" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:19.293736 1433 raft_consensus.cc:3037] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.294677 1561 tablet_bootstrap.cc:492] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:19.294926 2431 raft_consensus.cc:482] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.295032 2431 raft_consensus.cc:504] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.295302 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06dbc6029bdd412e91c49d4112feee55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.295591 2431 leader_election.cc:288] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:19.296500 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c74dfa20ed9a4eb197a846b62d859146 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c74dfa20ed9a4eb197a846b62d859146 already in progress: creating tablet
I20260927 15:06:19.296866 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 950) took 3087 ms. Trace:
I20260927 15:06:19.296895 1433 raft_consensus.cc:2454] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:19.296943 1562 rpcz_store.cc:276] 0927 15:06:16.209076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.209274 (+ 198us) service_pool.cc:227] Handling call
0927 15:06:19.296751 (+3087477us) ts_tablet_manager.cc:1145] Deleting tablet cb75c7fd08964949ad4edf0b46b8cfa6
0927 15:06:19.296763 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.296850 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3087330}
W20260927 15:06:19.297359 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet cb75c7fd08964949ad4edf0b46b8cfa6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb75c7fd08964949ad4edf0b46b8cfa6 already in progress: creating tablet
I20260927 15:06:19.297763 1099 leader_election.cc:302] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:19.297987 2568 raft_consensus.cc:2781] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:19.298085 2568 raft_consensus.cc:686] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:19.298312 2568 consensus_queue.cc:237] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.298566 1561 ts_tablet_manager.cc:1397] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.002s
I20260927 15:06:19.299392 1561 raft_consensus.cc:348] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.299652 1561 raft_consensus.cc:374] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.299703 1561 raft_consensus.cc:729] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.299866 1561 consensus_queue.cc:260] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.300108 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9a97e3e6a5749feb4dd5f835d9c01ac" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:19.300366 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4714d536373a4bf2a4be9ebeaebe77c1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:19.300387 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 951) took 3091 ms. Trace:
W20260927 15:06:19.300441 1102 leader_election.cc:341] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.300491 1562 rpcz_store.cc:276] 0927 15:06:16.209185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.209440 (+ 255us) service_pool.cc:227] Handling call
0927 15:06:19.300240 (+3090800us) ts_tablet_manager.cc:1145] Deleting tablet fd225f6127ed4c4ea4bbea41aeb0521f
0927 15:06:19.300255 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.300365 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3090682}
I20260927 15:06:19.300693 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9a97e3e6a5749feb4dd5f835d9c01ac" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:19.300693 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4714d536373a4bf2a4be9ebeaebe77c1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.300859 1433 raft_consensus.cc:2454] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:19.301054 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet fd225f6127ed4c4ea4bbea41aeb0521f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd225f6127ed4c4ea4bbea41aeb0521f already in progress: creating tablet
I20260927 15:06:19.301244 1099 leader_election.cc:302] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:19.301388 2569 leader_election.cc:288] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.301960 2975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.201.60:46799 every 8 connection(s)
W20260927 15:06:19.305500 1102 leader_election.cc:341] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:19.305841 1102 leader_election.cc:341] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:19.305994 1102 leader_election.cc:341] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.309162 2369 rpc_server.cc:307] RPC server started. Bound to: 127.0.201.60:46799
I20260927 15:06:19.310411 2661 raft_consensus.cc:482] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.310561 2661 raft_consensus.cc:504] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.311293 2661 leader_election.cc:288] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.312420 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 947) took 3103 ms. Trace:
I20260927 15:06:19.312522 1562 rpcz_store.cc:276] 0927 15:06:16.208783 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.209570 (+ 787us) service_pool.cc:227] Handling call
0927 15:06:19.312250 (+3102680us) ts_tablet_manager.cc:1145] Deleting tablet f799583600634a8e8c2b4fe9d5aa1e55
0927 15:06:19.312269 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.312397 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3102497}
W20260927 15:06:19.313112 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet f799583600634a8e8c2b4fe9d5aa1e55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f799583600634a8e8c2b4fe9d5aa1e55 already in progress: creating tablet
I20260927 15:06:19.313508 2661 raft_consensus.cc:482] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.313568 1562 tablet_replica.cc:330] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:19.313621 2661 raft_consensus.cc:504] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.314106 2661 leader_election.cc:288] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.315016 2431 raft_consensus.cc:2781] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.315120 2431 raft_consensus.cc:482] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:19.315218 2431 raft_consensus.cc:3037] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.315793 804 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskiBdsOQ/build/asan/bin/kudu as pid 2369
W20260927 15:06:19.316349 1239 leader_election.cc:341] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: c90e5c66d8564f68b401b3e4280499a7
I20260927 15:06:19.316792 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595c84453cd84c3bb5a4d444892bf5e6" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:19.318181 2431 raft_consensus.cc:504] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.319133 2797 raft_consensus.cc:482] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.319245 2797 raft_consensus.cc:504] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.319710 2797 leader_election.cc:288] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:19.320189 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6a248ec4ee64d0a8d986fdc683d69ba" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.320678 1376 consensus_peers.cc:487] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:19.320834 1376 leader_election.cc:341] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.321168 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6a248ec4ee64d0a8d986fdc683d69ba" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:19.321602 1374 leader_election.cc:341] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.321688 1374 leader_election.cc:302] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:19.318077 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "595c84453cd84c3bb5a4d444892bf5e6" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.322180 2797 raft_consensus.cc:2726] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:19.322362 1238 leader_election.cc:341] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c90e5c66d8564f68b401b3e4280499a7
I20260927 15:06:19.322459 1238 leader_election.cc:302] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:19.322850 2661 raft_consensus.cc:2726] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:19.322782 1238 leader_election.cc:341] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 610ff6563dc64e73b2b4d7c268468b21
I20260927 15:06:19.323352 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4714d536373a4bf2a4be9ebeaebe77c1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:19.323179 1238 leader_election.cc:302] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:19.323841 1102 leader_election.cc:341] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.323923 1238 leader_election.cc:302] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:19.324005 2661 raft_consensus.cc:2726] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:19.324123 2661 raft_consensus.cc:2726] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:19.324311 2927 leader_election.cc:288] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.325878 2797 raft_consensus.cc:482] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.326001 2797 raft_consensus.cc:504] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.326534 2797 leader_election.cc:288] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:19.327462 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5f4a30bac94d72b5265c8a7a0d4d59" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:19.327800 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5f4a30bac94d72b5265c8a7a0d4d59" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:19.327970 912 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_e3b6937666334bb98cf3be6abec889f6 [id=61c39607ad5b482c80883c0e60f0da9c] alter complete (version 4)
W20260927 15:06:19.328295 1376 leader_election.cc:341] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:19.328613 1374 leader_election.cc:341] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.328706 1374 leader_election.cc:302] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:19.329031 2797 raft_consensus.cc:2726] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:19.329393 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_766da62d2f6e4daab98bca846d688515"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.330061 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_766da62d2f6e4daab98bca846d688515 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.332262 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet c90e5c66d8564f68b401b3e4280499a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:00 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.332458 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet b3cc37a97bc145bdaa654bcc193fe93b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.332613 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b9e88c3679d412cac7603f200cf899b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.332700 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 610ff6563dc64e73b2b4d7c268468b21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.332736 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 033e71f60c3e47fd9647db090d4d6cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.333859 2119 tablet_replica.cc:330] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:19.334079 2119 raft_consensus.cc:2229] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:19.334259 2119 raft_consensus.cc:2258] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.334816 2119 ts_tablet_manager.cc:1905] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.335588 1420 tablet_service.cc:1467] Processing CreateTablet for tablet b26f0d253a7f4df780a1f91ceb7d82b8 (DEFAULT_TABLE table=default.Table_16300d973fed4a26a7baa92b0de64def [id=7caf2dce5b104c209837cecbbaa189ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.335994 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b26f0d253a7f4df780a1f91ceb7d82b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.338658 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 54dd4c1c24674440965e247b27c9f717 (DEFAULT_TABLE table=default.Table_584fc2c2806641fd8fea5aaba0903ea1 [id=a80399ac3711411d90dfeaa5f41a24c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.339048 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54dd4c1c24674440965e247b27c9f717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.339284 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 54dd4c1c24674440965e247b27c9f717 (DEFAULT_TABLE table=default.Table_584fc2c2806641fd8fea5aaba0903ea1 [id=a80399ac3711411d90dfeaa5f41a24c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.339643 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54dd4c1c24674440965e247b27c9f717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.340114 2797 consensus_queue.cc:1035] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:19.340777 1279 tablet_service.cc:1467] Processing CreateTablet for tablet da8d5ee1ed414a94b9c2f5c7edfcaffa (DEFAULT_TABLE table=default.Table_e7da400da0844237be49eb47322f6f64 [id=fc68eed6b9a64a62b45dae8d9325f715]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.341187 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da8d5ee1ed414a94b9c2f5c7edfcaffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.342178 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet ce566cc49cfe4483b942d2eaa8269acc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.343289 1135 tablet_service.cc:1467] Processing CreateTablet for tablet b26f0d253a7f4df780a1f91ceb7d82b8 (DEFAULT_TABLE table=default.Table_16300d973fed4a26a7baa92b0de64def [id=7caf2dce5b104c209837cecbbaa189ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.343688 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b26f0d253a7f4df780a1f91ceb7d82b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.348019 2829 raft_consensus.cc:482] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.348209 2829 raft_consensus.cc:504] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.349036 2829 leader_election.cc:288] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.349210 2829 raft_consensus.cc:482] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.349294 2829 raft_consensus.cc:504] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.349305 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:19.349721 2829 leader_election.cc:288] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:19.350381 1102 leader_election.cc:341] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.351179 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e19cd7febe054432899739e21605406d" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:19.351367 1435 raft_consensus.cc:3037] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.354296 2431 leader_election.cc:288] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.354421 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 512a2f4e3c3f479daba37eb1ca0d463b
I20260927 15:06:19.354977 905 catalog_manager.cc:6565] ReplaceTablet: tablet 512a2f4e3c3f479daba37eb1ca0d463b deleted and replaced by tablet e808a583f8c74d8a80ec173eae69f2cc
I20260927 15:06:19.355736 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1ee3f1481e2f48cbae9d666de8d1d7ff" } new_table_name: "default.Table_5ec51454fe9c4889816832e8c8382975" modify_external_catalogs: true
I20260927 15:06:19.356765 905 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet fd8a53f3c95c4cb7bce21d23f79af28c (table default.Table_599d4864bb504fa98740493c10df01f0 [id=a51d9c4b701c4c639d904aef0ac3a2cb]). Expected version 2 got 0
I20260927 15:06:19.357008 905 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 595c84453cd84c3bb5a4d444892bf5e6 (table default.Table_c33713f5f5d841b1a1f9e687db26c2e6 [id=06ca630052694f10aebe6f8b7aaa81d9]). Expected version 1 got 0
W20260927 15:06:19.357161 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db62070ea78b43e69ddd249a71e9ceea consensus state has no leader
I20260927 15:06:19.357535 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c5695d700a0a493787faac8cf1bd52e0" } new_table_name: "default.Table_269883d0a89c455aaf6e17e0fdf083b5" modify_external_catalogs: true
I20260927 15:06:19.358551 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a4e3fc09997845c0b6bfc3a64ad7197f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.359056 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4e3fc09997845c0b6bfc3a64ad7197f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.360191 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9ded0b1246144fb28700872f4ab1e728"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:19.360473 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1a48ee50b8894e3682943009faeabbcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:19.360615 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 512a2f4e3c3f479daba37eb1ca0d463b with delete_type TABLET_DATA_DELETED (replaced by tablet e808a583f8c74d8a80ec173eae69f2cc) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:19.360903 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ded0b1246144fb28700872f4ab1e728 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:19.360981 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a48ee50b8894e3682943009faeabbcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.362519 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_69e7da33db594b0494d614660c3525f8 [id=40aeb63abca64c3a8d12f9085fd816d8] alter complete (version 3)
I20260927 15:06:19.362675 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 512a2f4e3c3f479daba37eb1ca0d463b with delete_type TABLET_DATA_DELETED (replaced by tablet e808a583f8c74d8a80ec173eae69f2cc) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.364249 1561 ts_tablet_manager.cc:1428] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.066s user 0.002s sys 0.000s
I20260927 15:06:19.364506 1561 tablet_bootstrap.cc:492] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:19.313894 1562 raft_consensus.cc:2229] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:19.366025 1562 raft_consensus.cc:2258] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.366585 1562 ts_tablet_manager.cc:1905] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.366873 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 512a2f4e3c3f479daba37eb1ca0d463b with delete_type TABLET_DATA_DELETED (replaced by tablet e808a583f8c74d8a80ec173eae69f2cc) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.367102 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 79a3125723034cb48bc1a05fc4abbb82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.369264 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet d463a481cb8c4243961e9b0d2b11822c with delete_type TABLET_DATA_DELETED (replaced by tablet 1c018f11de9842bc883409f8af35fb5f) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.370574 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f6bef5f000441090f73eb842450362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.373014 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 81e0be77dff645f795237ffe779ed684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.374156 2568 raft_consensus.cc:482] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.374387 2568 raft_consensus.cc:504] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.375726 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db09498a395b4570a34d32fbfc71e8ed" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.376282 1102 leader_election.cc:341] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.376598 2568 leader_election.cc:288] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.376816 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 54dd4c1c24674440965e247b27c9f717 (DEFAULT_TABLE table=default.Table_584fc2c2806641fd8fea5aaba0903ea1 [id=a80399ac3711411d90dfeaa5f41a24c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.377242 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54dd4c1c24674440965e247b27c9f717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.377815 1135 tablet_service.cc:1467] Processing CreateTablet for tablet da8d5ee1ed414a94b9c2f5c7edfcaffa (DEFAULT_TABLE table=default.Table_e7da400da0844237be49eb47322f6f64 [id=fc68eed6b9a64a62b45dae8d9325f715]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.378334 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da8d5ee1ed414a94b9c2f5c7edfcaffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.378795 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 20b1c308e3734951b91dee9cb7c63690 (DEFAULT_TABLE table=default.Table_e0091676d0fb46d3a93ec6c2fc515c73 [id=35a2e17a7c94450d9eb64219c1188d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.379300 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20b1c308e3734951b91dee9cb7c63690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.382453 2119 ts_tablet_manager.cc:1918] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:19.387809 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 906df4eca78d4a1aa37cdc2dfe9388a0 (DEFAULT_TABLE table=default.Table_060f4ec20a184438a46ffcbee7e408d0 [id=057f791b31534680a00a0eeec915c2e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.388293 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 906df4eca78d4a1aa37cdc2dfe9388a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.388669 1130 tablet_service.cc:1467] Processing CreateTablet for tablet e2f6a88f23934740bc433e9303110e94 (DEFAULT_TABLE table=default.Table_46acdac56c074e8aad7df2d4af2a5528 [id=795c864fb1d54c3591a2f6ce059066b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.389047 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2f6a88f23934740bc433e9303110e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.392370 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 1dda8294800f4750839408050e8e7f7a (DEFAULT_TABLE table=default.Table_0510f4e87b194a98a364979d009cbb88 [id=542bbf0daeaa4fa7a8b3ab134e21def7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.392781 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dda8294800f4750839408050e8e7f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.393760 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet efa42545da374ca989199433ce1284c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.393805 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 089b6b5ac39d49fea744240261a8010e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.394043 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0d667472ee4f1481c213e03403461e with delete_type TABLET_DATA_DELETED (replaced by tablet 0a64059ef2234ad6adbdfd8d3576f2a6) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.395848 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 57580db090ad4e4e94a3d22063e57ad4 (DEFAULT_TABLE table=default.Table_e7bf365b01ff44309a205f3ba9ed6d0a [id=da149c34af0947f9be31b90f531305ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.396212 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57580db090ad4e4e94a3d22063e57ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.397113 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (table default.Table_9421c4a3c84e449ea9e86594f7342489 [id=239ff5a7776c4a469e14137b23b6544a]). Expected version 1 got 0
I20260927 15:06:19.398901 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c536d97d54cd4c5295dbce537a19e1b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.399506 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c536d97d54cd4c5295dbce537a19e1b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.400743 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4663e3db7f2a40ecb39c11ee23a08b97" } new_table_name: "default.Table_2c15e29e8a6543c8aa188a5cdb51df2c" modify_external_catalogs: true
I20260927 15:06:19.407902 2369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/master-2/data/info.pb
I20260927 15:06:19.408582 2119 log.cc:1196] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/c90e5c66d8564f68b401b3e4280499a7
I20260927 15:06:19.410585 2927 raft_consensus.cc:482] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.410746 2927 raft_consensus.cc:504] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.411348 2927 leader_election.cc:288] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.411763 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "078ba40ca56745b2a2b86402a1519011" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.412485 1102 leader_election.cc:341] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.415936 1556 tablet_bootstrap.cc:492] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.416102 1556 ts_tablet_manager.cc:1397] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.126s user 0.017s sys 0.012s
I20260927 15:06:19.416558 1132 tablet_service.cc:1514] Processing DeleteTablet for tablet 63fbd388210d4a1aabfcf27c7533efbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.416752 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet e19cd7febe054432899739e21605406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.416985 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 541147938d864cd9ad7208d96533b0f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.416985 1556 raft_consensus.cc:348] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.417263 1556 raft_consensus.cc:374] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.417330 1556 raft_consensus.cc:729] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.417790 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ae003f1ca76472cbaa8b577b66fe84c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.418009 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d533883e3344eca939cd67644895148 with delete_type TABLET_DATA_DELETED (replaced by tablet 534a74d9f8e648168b87e26fb73c8b3a) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.417822 1556 consensus_queue.cc:260] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.416766 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba163e0f6164d65b09da684ee4872e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.423631 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 727652500d9a47b68b7a0d0dcf583822 with delete_type TABLET_DATA_DELETED (replaced by tablet decee14b5d7a4aef9989051dcaeb5a7b) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.423810 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet c6a248ec4ee64d0a8d986fdc683d69ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.424047 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 1dda8294800f4750839408050e8e7f7a (DEFAULT_TABLE table=default.Table_0510f4e87b194a98a364979d009cbb88 [id=542bbf0daeaa4fa7a8b3ab134e21def7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.424396 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dda8294800f4750839408050e8e7f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.424566 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 906df4eca78d4a1aa37cdc2dfe9388a0 (DEFAULT_TABLE table=default.Table_060f4ec20a184438a46ffcbee7e408d0 [id=057f791b31534680a00a0eeec915c2e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.424975 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 906df4eca78d4a1aa37cdc2dfe9388a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.423820 1418 tablet_service.cc:1467] Processing CreateTablet for tablet e2f6a88f23934740bc433e9303110e94 (DEFAULT_TABLE table=default.Table_46acdac56c074e8aad7df2d4af2a5528 [id=795c864fb1d54c3591a2f6ce059066b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.425670 1402 tablet_service.cc:1467] Processing CreateTablet for tablet da8d5ee1ed414a94b9c2f5c7edfcaffa (DEFAULT_TABLE table=default.Table_e7da400da0844237be49eb47322f6f64 [id=fc68eed6b9a64a62b45dae8d9325f715]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.425765 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2f6a88f23934740bc433e9303110e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.425623 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_470ef5dfe4064ad9a5d188c4e2e888e4" } new_table_name: "default.Table_301f32b65e974fe1b0da037d10a40ebb" modify_external_catalogs: true
I20260927 15:06:19.425426 1435 raft_consensus.cc:2454] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:19.426173 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 20b1c308e3734951b91dee9cb7c63690 (DEFAULT_TABLE table=default.Table_e0091676d0fb46d3a93ec6c2fc515c73 [id=35a2e17a7c94450d9eb64219c1188d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.427132 2797 raft_consensus.cc:482] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.427300 2797 raft_consensus.cc:504] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.428503 2797 leader_election.cc:288] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:19.429044 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0d667472ee4f1481c213e03403461e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:19.429615 1374 leader_election.cc:341] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.430493 1556 ts_tablet_manager.cc:1428] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260927 15:06:19.430941 1556 tablet_bootstrap.cc:492] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.434522 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet b44e2611d2bf40ae90c4fd857225e39e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.434702 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da8d5ee1ed414a94b9c2f5c7edfcaffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.436678 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20b1c308e3734951b91dee9cb7c63690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.443457 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 57580db090ad4e4e94a3d22063e57ad4 (DEFAULT_TABLE table=default.Table_e7bf365b01ff44309a205f3ba9ed6d0a [id=da149c34af0947f9be31b90f531305ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.443854 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57580db090ad4e4e94a3d22063e57ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.447252 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a6c0a227327c4e8e87ebe7347f94106f" } modify_external_catalogs: true
I20260927 15:06:19.447467 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a6c0a227327c4e8e87ebe7347f94106f" } modify_external_catalogs: true
I20260927 15:06:19.449839 2940 consensus_queue.cc:1035] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:19.454285 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 289bea546c8a41bf97edfdc9a453a024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:19.463240 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff5f20f300324dbfae4ae771878ac61e consensus state has no leader
I20260927 15:06:19.463645 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_35e15f0ba6ae4f98a02b20bd26a65003" } modify_external_catalogs: true
I20260927 15:06:19.463873 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_35e15f0ba6ae4f98a02b20bd26a65003" } modify_external_catalogs: true
I20260927 15:06:19.465088 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_63c6bb3ab2a94fbd978bfb8ad64439ef" } modify_external_catalogs: true
I20260927 15:06:19.465284 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_63c6bb3ab2a94fbd978bfb8ad64439ef" } modify_external_catalogs: true
W20260927 15:06:19.465370 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2b18847655594043a3fcf2188d8d0b7e consensus state has no leader
I20260927 15:06:19.465411 1561 tablet_bootstrap.cc:654] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.465740 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b3f43b2aacd4b89b990a6df9e1e7bd6" } modify_external_catalogs: true
I20260927 15:06:19.465921 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b3f43b2aacd4b89b990a6df9e1e7bd6" } modify_external_catalogs: true
W20260927 15:06:19.467159 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56f3c6a79b0e43769368693b493d73f1 consensus state has no leader
I20260927 15:06:19.468063 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e0071303c5c7491cb1289e60813891bb" } modify_external_catalogs: true
I20260927 15:06:19.468263 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e0071303c5c7491cb1289e60813891bb" } modify_external_catalogs: true
W20260927 15:06:19.473142 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 92682624209840c38cab7cb01816bf03 consensus state has no leader
I20260927 15:06:19.479956 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 2268d824f5324cd1b81879e2fe4fd027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.480902 1556 tablet_bootstrap.cc:654] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.481946 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet b9a97e3e6a5749feb4dd5f835d9c01ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.490677 2233 ts_tablet_manager.cc:1918] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260927 15:06:19.491080 809 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 91083.6us
W20260927 15:06:19.492201 1102 consensus_peers.cc:487] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.492230 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 95c8178680ea4b6b8794150188320ea9 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:19.495512 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0d667472ee4f1481c213e03403461e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:19.373720 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63fbd388210d4a1aabfcf27c7533efbf" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.499378 1102 leader_election.cc:341] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.499796 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 20b1c308e3734951b91dee9cb7c63690 (DEFAULT_TABLE table=default.Table_e0091676d0fb46d3a93ec6c2fc515c73 [id=35a2e17a7c94450d9eb64219c1188d3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.500381 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 906df4eca78d4a1aa37cdc2dfe9388a0 (DEFAULT_TABLE table=default.Table_060f4ec20a184438a46ffcbee7e408d0 [id=057f791b31534680a00a0eeec915c2e5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:19.502425 1102 consensus_peers.cc:487] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.502882 1099 leader_election.cc:302] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.503180 2569 raft_consensus.cc:2781] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:19.503364 2569 raft_consensus.cc:686] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:19.503674 2569 consensus_queue.cc:237] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.503999 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c4a123886a847d08b2a94ff5e4e01ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.511337 1282 tablet_service.cc:1467] Processing CreateTablet for tablet e2f6a88f23934740bc433e9303110e94 (DEFAULT_TABLE table=default.Table_46acdac56c074e8aad7df2d4af2a5528 [id=795c864fb1d54c3591a2f6ce059066b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.511545 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 57580db090ad4e4e94a3d22063e57ad4 (DEFAULT_TABLE table=default.Table_e7bf365b01ff44309a205f3ba9ed6d0a [id=da149c34af0947f9be31b90f531305ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.513109 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 414bb75a756f4549b9d147490344287a (DEFAULT_TABLE table=default.Table_2bc6e62cbfb54cca8084c68be203a786 [id=78aa7969041d478490851a5d4a2fd470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.513696 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 1dda8294800f4750839408050e8e7f7a (DEFAULT_TABLE table=default.Table_0510f4e87b194a98a364979d009cbb88 [id=542bbf0daeaa4fa7a8b3ab134e21def7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.495790 2797 raft_consensus.cc:482] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.518196 2797 raft_consensus.cc:504] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.518893 2797 leader_election.cc:288] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:19.499593 1376 leader_election.cc:341] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.519392 1376 leader_election.cc:302] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:19.500295 1433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63fbd388210d4a1aabfcf27c7533efbf" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.520234 1433 raft_consensus.cc:2454] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:19.501550 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:19.520941 1102 consensus_peers.cc:487] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.521023 1435 raft_consensus.cc:2454] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:19.502200 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4714d536373a4bf2a4be9ebeaebe77c1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:19.521287 1438 raft_consensus.cc:3037] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.516803 1561 tablet_bootstrap.cc:492] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:19.523329 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20b1c308e3734951b91dee9cb7c63690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.523427 1561 ts_tablet_manager.cc:1397] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.159s user 0.003s sys 0.001s
I20260927 15:06:19.524160 1438 raft_consensus.cc:2454] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:19.524217 1561 raft_consensus.cc:348] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.502431 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "078ba40ca56745b2a2b86402a1519011" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.524470 1561 raft_consensus.cc:374] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.524518 1440 raft_consensus.cc:2454] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:19.524544 1561 raft_consensus.cc:729] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.502568 1434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db09498a395b4570a34d32fbfc71e8ed" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:19.512857 1556 tablet_bootstrap.cc:492] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.524760 1434 raft_consensus.cc:2454] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:19.524832 1556 ts_tablet_manager.cc:1397] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.008s
I20260927 15:06:19.524761 1561 consensus_queue.cc:260] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.525405 1561 ts_tablet_manager.cc:1428] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:19.525480 1556 raft_consensus.cc:348] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.525822 1561 tablet_bootstrap.cc:492] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:19.525799 1556 raft_consensus.cc:374] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.525892 1556 raft_consensus.cc:729] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.526073 1556 consensus_queue.cc:260] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.527374 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 336dcc56dd25436cafae6b3bdf3e47b9 (DEFAULT_TABLE table=default.Table_ea53750c96144ad8ae86526f847057aa [id=b0fe7454c8b140b4a3c1b3012d1132c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.527410 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:19.527789 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 414bb75a756f4549b9d147490344287a (DEFAULT_TABLE table=default.Table_2bc6e62cbfb54cca8084c68be203a786 [id=78aa7969041d478490851a5d4a2fd470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.528035 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 906df4eca78d4a1aa37cdc2dfe9388a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.532905 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 414bb75a756f4549b9d147490344287a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.539686 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57580db090ad4e4e94a3d22063e57ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.540997 2998 raft_consensus.cc:2726] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:19.541589 1099 consensus_peers.cc:487] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd5f2ab9677c4598b0b8d9a93a6a23c7. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.541777 1556 ts_tablet_manager.cc:1428] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.017s user 0.007s sys 0.003s
I20260927 15:06:19.541908 2927 consensus_queue.cc:1035] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:19.544655 1556 tablet_bootstrap.cc:492] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.544572 2927 consensus_queue.cc:1035] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:19.545538 1099 leader_election.cc:302] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.545825 2927 raft_consensus.cc:2781] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.545990 2927 raft_consensus.cc:482] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:19.546152 2927 raft_consensus.cc:3037] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.546329 1556 tablet_bootstrap.cc:654] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.548930 2119 ts_tablet_manager.cc:1939] T c90e5c66d8564f68b401b3e4280499a7 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:19.549227 2233 log.cc:1196] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/d463a481cb8c4243961e9b0d2b11822c
I20260927 15:06:19.549212 2927 raft_consensus.cc:504] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.549659 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet c90e5c66d8564f68b401b3e4280499a7 (table default.Table_a1cebe864d4d45c6bb51a54581236606 [id=43dfe649643a4eb68609a376a1f5eee0]) successfully deleted
I20260927 15:06:19.549777 2927 leader_election.cc:288] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.549914 2233 ts_tablet_manager.cc:1939] T d463a481cb8c4243961e9b0d2b11822c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:19.550264 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63fbd388210d4a1aabfcf27c7533efbf" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:19.550853 1102 leader_election.cc:341] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.551198 2119 tablet_replica.cc:330] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:19.551457 2119 raft_consensus.cc:2229] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:19.551667 2119 raft_consensus.cc:2258] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.552768 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 336dcc56dd25436cafae6b3bdf3e47b9 (DEFAULT_TABLE table=default.Table_ea53750c96144ad8ae86526f847057aa [id=b0fe7454c8b140b4a3c1b3012d1132c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.553359 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2f6a88f23934740bc433e9303110e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.554054 2119 ts_tablet_manager.cc:1905] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.554580 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 414bb75a756f4549b9d147490344287a (DEFAULT_TABLE table=default.Table_2bc6e62cbfb54cca8084c68be203a786 [id=78aa7969041d478490851a5d4a2fd470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.557411 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 414bb75a756f4549b9d147490344287a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.561368 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 56f3c6a79b0e43769368693b493d73f1 (DEFAULT_TABLE table=default.Table_2c15e29e8a6543c8aa188a5cdb51df2c [id=080ce679c1124638a143a4c8db6e6c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.561789 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56f3c6a79b0e43769368693b493d73f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.562418 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 336dcc56dd25436cafae6b3bdf3e47b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.564102 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b4fff68c11fb4d929f1b0c412316065f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.564736 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4fff68c11fb4d929f1b0c412316065f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.565279 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2bc6e62cbfb54cca8084c68be203a786" } new_table_name: "default.Table_a25f3ce1f0ae47388101a31fc8313cce" modify_external_catalogs: true
I20260927 15:06:19.569936 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_51c91f7735c44128874d2e59a48b992a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.570415 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51c91f7735c44128874d2e59a48b992a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.571512 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0c1e3a4a801f4c0f8334becd67f3cf1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.571946 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c1e3a4a801f4c0f8334becd67f3cf1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.572760 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 56f3c6a79b0e43769368693b493d73f1 (DEFAULT_TABLE table=default.Table_2c15e29e8a6543c8aa188a5cdb51df2c [id=080ce679c1124638a143a4c8db6e6c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.573151 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56f3c6a79b0e43769368693b493d73f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.573774 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c272da8a59fe42d5a5a4bf88b8f3f3ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.574357 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c272da8a59fe42d5a5a4bf88b8f3f3ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.575646 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 998) took 2447 ms. Trace:
I20260927 15:06:19.575788 2233 rpcz_store.cc:276] 0927 15:06:17.128691 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.128752 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:19.223859 (+2095107us) ts_tablet_manager.cc:1145] Deleting tablet d463a481cb8c4243961e9b0d2b11822c
0927 15:06:19.223869 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.361024 (+137155us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.490533 (+129509us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.550818 (+ 60285us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2076624}
I20260927 15:06:19.576344 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet d463a481cb8c4243961e9b0d2b11822c (table default.Table_04e241fd53a64c76b188ab49cd5ea266 [id=9f11325f98a4445eb6ee1d8c251866fb]) successfully deleted
I20260927 15:06:19.576795 2233 tablet_replica.cc:330] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:19.577050 2233 raft_consensus.cc:2229] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:19.577270 2233 raft_consensus.cc:2258] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.578145 2233 ts_tablet_manager.cc:1905] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.581106 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 3b621f34830340e4a1c1443d0d4d4e3b (DEFAULT_TABLE table=default.Table_ab505d59db4043ba95787c44da9d494f [id=b56a25dafdef49b2a8c22f4c653c280b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.583305 1407 tablet_service.cc:1467] Processing CreateTablet for tablet dead2d4d5ac243348ecd9eade6ea843f (DEFAULT_TABLE table=default.Table_f098ab1277e443c48a72b330ab75eac4 [id=716b7f1c93eb42089dbc2be0721c9dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.583729 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dead2d4d5ac243348ecd9eade6ea843f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.589872 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 3b621f34830340e4a1c1443d0d4d4e3b (DEFAULT_TABLE table=default.Table_ab505d59db4043ba95787c44da9d494f [id=b56a25dafdef49b2a8c22f4c653c280b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.591012 1282 tablet_service.cc:1467] Processing CreateTablet for tablet dead2d4d5ac243348ecd9eade6ea843f (DEFAULT_TABLE table=default.Table_f098ab1277e443c48a72b330ab75eac4 [id=716b7f1c93eb42089dbc2be0721c9dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.596753 1552 tablet_bootstrap.cc:492] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:19.598629 1277 tablet_service.cc:1467] Processing CreateTablet for tablet f5520c8eb0be4c7db426d9e22003544f (DEFAULT_TABLE table=default.Table_38daa156d655475aac34a6d9584fef82 [id=d684218a9d4044b99ee84cce73bc417c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.599731 1552 ts_tablet_manager.cc:1397] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.321s user 0.011s sys 0.001s
I20260927 15:06:19.600479 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 9c065746a11f42819334325a3a166d45 (DEFAULT_TABLE table=default.Table_5712683f610a4b13a4581e60061c83b0 [id=93077e9bf3574cf8979d1a2dc067937e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.605314 1272 tablet_service.cc:1467] Processing CreateTablet for tablet d35282079d4f4ab3a6093385244236eb (DEFAULT_TABLE table=default.Table_7156da92993b44a09d20d69c14974466 [id=2e21d11094f4480990537d3e65a89223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.606941 1404 tablet_service.cc:1467] Processing CreateTablet for tablet d35282079d4f4ab3a6093385244236eb (DEFAULT_TABLE table=default.Table_7156da92993b44a09d20d69c14974466 [id=2e21d11094f4480990537d3e65a89223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.607339 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d35282079d4f4ab3a6093385244236eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.611245 1304 raft_consensus.cc:3037] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.616953 2940 raft_consensus.cc:482] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.617328 2940 raft_consensus.cc:504] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.619094 2940 leader_election.cc:288] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
W20260927 15:06:19.619634 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 110723us
I20260927 15:06:19.624334 1552 raft_consensus.cc:348] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.624599 1552 raft_consensus.cc:374] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.624675 1552 raft_consensus.cc:729] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.624931 1552 consensus_queue.cc:260] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.613729 1562 ts_tablet_manager.cc:1918] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:19.626554 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d35282079d4f4ab3a6093385244236eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.626776 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 336dcc56dd25436cafae6b3bdf3e47b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.627004 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c065746a11f42819334325a3a166d45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.627513 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5520c8eb0be4c7db426d9e22003544f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.628584 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b621f34830340e4a1c1443d0d4d4e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.629108 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 414bb75a756f4549b9d147490344287a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.635097 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dead2d4d5ac243348ecd9eade6ea843f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.641477 3004 tablet.cc:1722] T fd8a53f3c95c4cb7bce21d23f79af28c P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:19.643189 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b621f34830340e4a1c1443d0d4d4e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.652302 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 9c065746a11f42819334325a3a166d45 (DEFAULT_TABLE table=default.Table_5712683f610a4b13a4581e60061c83b0 [id=93077e9bf3574cf8979d1a2dc067937e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.652581 1418 tablet_service.cc:1467] Processing CreateTablet for tablet f5520c8eb0be4c7db426d9e22003544f (DEFAULT_TABLE table=default.Table_38daa156d655475aac34a6d9584fef82 [id=d684218a9d4044b99ee84cce73bc417c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.654917 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5520c8eb0be4c7db426d9e22003544f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:19.652750 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 132829us
W20260927 15:06:19.657157 1376 leader_election.cc:341] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.658239 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c065746a11f42819334325a3a166d45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.658882 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79a3125723034cb48bc1a05fc4abbb82" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.661774 1376 leader_election.cc:341] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.661948 2940 raft_consensus.cc:482] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.673214 2940 raft_consensus.cc:504] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.673998 2940 leader_election.cc:288] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:19.675029 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089b6b5ac39d49fea744240261a8010e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:19.666483 2998 raft_consensus.cc:482] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.677793 2998 raft_consensus.cc:504] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.678467 2998 leader_election.cc:288] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:19.675832 1376 leader_election.cc:341] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.679536 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289bea546c8a41bf97edfdc9a453a024" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.680768 1376 leader_election.cc:341] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.675141 1552 ts_tablet_manager.cc:1428] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.070s user 0.003s sys 0.000s
I20260927 15:06:19.683283 1552 tablet_bootstrap.cc:492] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:19.684906 1552 tablet_bootstrap.cc:654] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.689292 1485 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:19.689756 2980 raft_consensus.cc:482] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.689893 2980 raft_consensus.cc:504] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.690151 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 64a500e6a99140729d8630ec0bae7803 (DEFAULT_TABLE table=default.Table_2488bbed3604438f94bdeed81e1161e7 [id=1966e78e3ae04e35bd07610dff7ef69b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.690501 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a500e6a99140729d8630ec0bae7803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.690522 2980 leader_election.cc:288] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:19.691671 1238 leader_election.cc:341] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ce566cc49cfe4483b942d2eaa8269acc
I20260927 15:06:19.693070 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:19.692994 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 6bee3453bfc64ea5afa863f2b0db51b4 (DEFAULT_TABLE table=default.Table_13065d568bf54acfb39a7faea9986554 [id=da9e06b19cbe4075b15a888a56c5cf48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.694885 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 6bee3453bfc64ea5afa863f2b0db51b4 (DEFAULT_TABLE table=default.Table_13065d568bf54acfb39a7faea9986554 [id=da9e06b19cbe4075b15a888a56c5cf48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.695273 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bee3453bfc64ea5afa863f2b0db51b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.700974 2996 raft_consensus.cc:482] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.701161 2996 raft_consensus.cc:504] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.701892 2996 leader_election.cc:288] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:19.702667 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0141fdf4d1ef47b8b3e758ea3ff8b7c8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.703256 1376 leader_election.cc:341] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.706539 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 6bee3453bfc64ea5afa863f2b0db51b4 (DEFAULT_TABLE table=default.Table_13065d568bf54acfb39a7faea9986554 [id=da9e06b19cbe4075b15a888a56c5cf48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.707752 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 318e4bf9d50f4fe6858e438ccf2544bf
I20260927 15:06:19.709517 1269 tablet_service.cc:1467] Processing CreateTablet for tablet e7153ec9399f45dea08b6b7be57d7f7c (DEFAULT_TABLE table=default.Table_4038b63a0be146fdb47df34d335533ab [id=3300a98360f34328adca9476cddf8bff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.711030 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 318e4bf9d50f4fe6858e438ccf2544bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.712105 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 64a500e6a99140729d8630ec0bae7803 (DEFAULT_TABLE table=default.Table_2488bbed3604438f94bdeed81e1161e7 [id=1966e78e3ae04e35bd07610dff7ef69b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.713529 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 24c2ad19ae734066a5914f6c95b192fd (DEFAULT_TABLE table=default.Table_a13b57205a8b490ab36e73f4b3140397 [id=a50dfc99e8564555b359255b41fb560d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.713898 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c2ad19ae734066a5914f6c95b192fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.718250 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 24c2ad19ae734066a5914f6c95b192fd (DEFAULT_TABLE table=default.Table_a13b57205a8b490ab36e73f4b3140397 [id=a50dfc99e8564555b359255b41fb560d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.666342 2233 ts_tablet_manager.cc:1918] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:19.721508 2233 log.cc:1196] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/63fbd388210d4a1aabfcf27c7533efbf
I20260927 15:06:19.722088 2233 ts_tablet_manager.cc:1939] T 63fbd388210d4a1aabfcf27c7533efbf P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:19.723178 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet a8659865bf644458b3b5a78eae36a524 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.723557 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1000) took 2570 ms. Trace:
I20260927 15:06:19.723743 2233 rpcz_store.cc:276] 0927 15:06:17.152932 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.152984 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:19.576741 (+2423757us) ts_tablet_manager.cc:1145] Deleting tablet 63fbd388210d4a1aabfcf27c7533efbf
0927 15:06:19.576756 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.663798 (+ 87042us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.666268 (+ 2470us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.723518 (+ 57250us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2423607}
I20260927 15:06:19.724851 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 63fbd388210d4a1aabfcf27c7533efbf (table default.Table_5d29cefe8c174dd89895f67e0784bf77 [id=35b9ecf64d084b66b80115a19fd1055a]) successfully deleted
I20260927 15:06:19.725313 2985 sys_catalog.cc:263] Verifying existing consensus state
I20260927 15:06:19.725740 912 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet fd8a53f3c95c4cb7bce21d23f79af28c (table default.Table_599d4864bb504fa98740493c10df01f0 [id=a51d9c4b701c4c639d904aef0ac3a2cb]). Expected version 2 got 0
I20260927 15:06:19.728987 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 3540982dd7544e60af6c153fc41a412c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.730088 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 544935abcf1548969bc548160961e0c3 (DEFAULT_TABLE table=default.Table_d05c98c4fe034773b5a1de0b888eb681 [id=7a3822012bda4a6ea393a82670a0d73a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.730804 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 544935abcf1548969bc548160961e0c3 (DEFAULT_TABLE table=default.Table_d05c98c4fe034773b5a1de0b888eb681 [id=7a3822012bda4a6ea393a82670a0d73a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.730790 1281 tablet_service.cc:1467] Processing CreateTablet for tablet d21172fe48704007ae33d42255c9d227 (DEFAULT_TABLE table=default.Table_5abc77ef4a9c4301a05fca21efd0c59d [id=3a8f6ff189624c0f9053df284c4ac11b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.731266 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 544935abcf1548969bc548160961e0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.732020 1406 tablet_service.cc:1467] Processing CreateTablet for tablet d21172fe48704007ae33d42255c9d227 (DEFAULT_TABLE table=default.Table_5abc77ef4a9c4301a05fca21efd0c59d [id=3a8f6ff189624c0f9053df284c4ac11b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.732317 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d21172fe48704007ae33d42255c9d227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.734040 1552 tablet_bootstrap.cc:492] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:19.735332 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 544935abcf1548969bc548160961e0c3 (DEFAULT_TABLE table=default.Table_d05c98c4fe034773b5a1de0b888eb681 [id=7a3822012bda4a6ea393a82670a0d73a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.738503 1552 ts_tablet_manager.cc:1397] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.003s
I20260927 15:06:19.739845 1407 tablet_service.cc:1467] Processing CreateTablet for tablet e7153ec9399f45dea08b6b7be57d7f7c (DEFAULT_TABLE table=default.Table_4038b63a0be146fdb47df34d335533ab [id=3300a98360f34328adca9476cddf8bff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.742053 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7153ec9399f45dea08b6b7be57d7f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.745474 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1001) took 2592 ms. Trace:
I20260927 15:06:19.749631 1282 tablet_service.cc:1467] Processing CreateTablet for tablet cc4827774a664f0c8327d633a0da6867 (DEFAULT_TABLE table=default.Table_6253f595e22742e38b668e0662427dd5 [id=06a91cc99ec14c36bbfd3f4d4e6b99fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.746963 2233 rpcz_store.cc:276] 0927 15:06:17.153015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.153160 (+ 145us) service_pool.cc:227] Handling call
0927 15:06:19.743134 (+2589974us) ts_tablet_manager.cc:1145] Deleting tablet 547f5f0f1d444f348cf7efbbdf95523c
0927 15:06:19.743562 (+ 428us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.745117 (+ 1555us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2589003}
I20260927 15:06:19.751492 1552 raft_consensus.cc:348] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.755206 1552 raft_consensus.cc:374] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.756431 1552 raft_consensus.cc:729] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.759442 1552 consensus_queue.cc:260] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:19.762526 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 547f5f0f1d444f348cf7efbbdf95523c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 547f5f0f1d444f348cf7efbbdf95523c already in progress: creating tablet
I20260927 15:06:19.763458 1418 tablet_service.cc:1467] Processing CreateTablet for tablet cc4827774a664f0c8327d633a0da6867 (DEFAULT_TABLE table=default.Table_6253f595e22742e38b668e0662427dd5 [id=06a91cc99ec14c36bbfd3f4d4e6b99fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.765475 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 999) took 2612 ms. Trace:
I20260927 15:06:19.767793 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a6852cc3f94a40779799beb772b3d34d
I20260927 15:06:19.770738 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 81cc2d5e281648a49fe109a7a00689b3
I20260927 15:06:19.771050 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 13acfcbc13204b2f9edb0f557a62252e
I20260927 15:06:19.771800 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_770437b04ff7404294f04f120483eb7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.772409 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_770437b04ff7404294f04f120483eb7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.772346 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc4827774a664f0c8327d633a0da6867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.767590 2233 rpcz_store.cc:276] 0927 15:06:17.152813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.154020 (+ 1207us) service_pool.cc:227] Handling call
0927 15:06:19.755164 (+2601144us) ts_tablet_manager.cc:1145] Deleting tablet e67cf0526f3c45718312508b306d7089
0927 15:06:19.760990 (+ 5826us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.765041 (+ 4051us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2600531}
I20260927 15:06:19.773167 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2aadf6203773433ebe185e3b8127d619"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.773676 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2aadf6203773433ebe185e3b8127d619 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.774657 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9e7f0754b9ba4e21b05c51b0136729d1
I20260927 15:06:19.774523 1552 ts_tablet_manager.cc:1428] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.034s user 0.005s sys 0.001s
I20260927 15:06:19.775525 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6948707de78f431fbfe1b65dda6fe141" } new_table_name: "default.Table_935bae1ad40741f19442bf281f3247a5" modify_external_catalogs: true
W20260927 15:06:19.776778 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 414bb75a756f4549b9d147490344287a consensus state has no leader
I20260927 15:06:19.777081 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_76fbebbfe0b34b2a83e4dd9a531de7b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.777513 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76fbebbfe0b34b2a83e4dd9a531de7b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.778728 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9776e17214ae47b3a9c9721ad570dc28" } new_table_name: "default.Table_c946f1a657fc4cb492c7a26c19312a94" modify_external_catalogs: true
I20260927 15:06:19.780031 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_59ee7d6e47244bb0b4e3ee148da8d762"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.780434 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59ee7d6e47244bb0b4e3ee148da8d762 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.779907 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1003) took 2594 ms. Trace:
I20260927 15:06:19.782136 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e7f0754b9ba4e21b05c51b0136729d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.782292 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cc2d5e281648a49fe109a7a00689b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.782330 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 13acfcbc13204b2f9edb0f557a62252e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.782605 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet a19c9cc5859f49a58a35460e504b3f84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.782969 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6466b0cace694f81bd2210b587284b7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:19.783087 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 28feaad311b14ea58144fc1417826186 (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:19.783339 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6466b0cace694f81bd2210b587284b7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.786653 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet a6852cc3f94a40779799beb772b3d34d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.786243 1552 tablet_bootstrap.cc:492] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:19.787372 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 278205071701447e8ee7457b2ee84be4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:19.787923 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cc02889552444c75b532fd43df526684"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.788337 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc02889552444c75b532fd43df526684 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.781730 2233 rpcz_store.cc:276] 0927 15:06:17.185046 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.185097 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:19.776272 (+2591175us) ts_tablet_manager.cc:1145] Deleting tablet a4a48e08f69a4727924d006dc19b6ed1
0927 15:06:19.776763 (+ 491us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.779547 (+ 2784us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2590592}
I20260927 15:06:19.788807 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ab505d59db4043ba95787c44da9d494f" } new_table_name: "default.Table_6807e830221b4c54b30d14b6d509ba39" modify_external_catalogs: true
W20260927 15:06:19.793084 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 56f3c6a79b0e43769368693b493d73f1 (table default.Table_2c15e29e8a6543c8aa188a5cdb51df2c [id=080ce679c1124638a143a4c8db6e6c47], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 56f3c6a79b0e43769368693b493d73f1 consensus state has no leader
I20260927 15:06:19.794409 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 0c02b79d7dbe4e1ba670f516bb0d4987 (DEFAULT_TABLE table=default.Table_3dcdf32e55c34e18a3fc62ce5baf3000 [id=58c5606f467641c8b25edaf05e125ce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.794803 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1002) took 2609 ms. Trace:
I20260927 15:06:19.798051 1145 tablet_service.cc:1467] Processing CreateTablet for tablet cc4827774a664f0c8327d633a0da6867 (DEFAULT_TABLE table=default.Table_6253f595e22742e38b668e0662427dd5 [id=06a91cc99ec14c36bbfd3f4d4e6b99fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.798884 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cc2d5e281648a49fe109a7a00689b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.799218 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 13acfcbc13204b2f9edb0f557a62252e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.799539 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e7f0754b9ba4e21b05c51b0136729d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.799880 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet a6852cc3f94a40779799beb772b3d34d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.800347 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 28feaad311b14ea58144fc1417826186 (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:19.800498 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e67cf0526f3c45718312508b306d7089 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e67cf0526f3c45718312508b306d7089 already in progress: creating tablet
I20260927 15:06:19.800819 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28feaad311b14ea58144fc1417826186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.804920 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e2cbc77b8d3c4ef28dd3f7049981efa7" } new_table_name: "default.Table_249ca4abcbda4e149bff910876c47db3" modify_external_catalogs: true
I20260927 15:06:19.806892 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 318e4bf9d50f4fe6858e438ccf2544bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.818691 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 0511464cc9604960ad770931bb5bae81 (DEFAULT_TABLE table=default.Table_8375212a3e50458da359b3328ef24831 [id=9911c3a2c37f4ab1ae6762c1d12fd5c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.819355 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 0c02b79d7dbe4e1ba670f516bb0d4987 (DEFAULT_TABLE table=default.Table_3dcdf32e55c34e18a3fc62ce5baf3000 [id=58c5606f467641c8b25edaf05e125ce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.820004 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c02b79d7dbe4e1ba670f516bb0d4987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.822342 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 0511464cc9604960ad770931bb5bae81 (DEFAULT_TABLE table=default.Table_8375212a3e50458da359b3328ef24831 [id=9911c3a2c37f4ab1ae6762c1d12fd5c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.822659 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0511464cc9604960ad770931bb5bae81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.797362 2233 rpcz_store.cc:276] 0927 15:06:17.184933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.185445 (+ 512us) service_pool.cc:227] Handling call
0927 15:06:19.791479 (+2606034us) ts_tablet_manager.cc:1145] Deleting tablet e1770acc612f4924ba62ee20767a31c1
0927 15:06:19.791908 (+ 429us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.794370 (+ 2462us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2605416}
I20260927 15:06:19.827813 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1004) took 2565 ms. Trace:
I20260927 15:06:19.828481 2233 rpcz_store.cc:276] 0927 15:06:17.262359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.262566 (+ 207us) service_pool.cc:227] Handling call
0927 15:06:19.827338 (+2564772us) ts_tablet_manager.cc:1145] Deleting tablet d9fecfb2325046f98e69797ff8342892
0927 15:06:19.827352 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.827731 (+ 379us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2564536}
I20260927 15:06:19.829499 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dda8294800f4750839408050e8e7f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.829946 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 544935abcf1548969bc548160961e0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.830305 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0511464cc9604960ad770931bb5bae81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.830287 1556 tablet_bootstrap.cc:492] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.830499 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c02b79d7dbe4e1ba670f516bb0d4987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.830485 1556 ts_tablet_manager.cc:1397] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.286s user 0.022s sys 0.103s
I20260927 15:06:19.830780 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28feaad311b14ea58144fc1417826186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.835024 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a500e6a99140729d8630ec0bae7803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.835526 1556 raft_consensus.cc:348] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.836448 1556 raft_consensus.cc:374] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.836591 1556 raft_consensus.cc:729] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
W20260927 15:06:19.836764 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet d9fecfb2325046f98e69797ff8342892 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fecfb2325046f98e69797ff8342892 already in progress: creating tablet
I20260927 15:06:19.837139 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d21172fe48704007ae33d42255c9d227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.836988 1556 consensus_queue.cc:260] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.838950 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bee3453bfc64ea5afa863f2b0db51b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.840881 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7153ec9399f45dea08b6b7be57d7f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.844623 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c2ad19ae734066a5914f6c95b192fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.845880 2980 raft_consensus.cc:482] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.846051 2980 raft_consensus.cc:504] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.846659 2980 leader_election.cc:288] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:19.849314 1238 leader_election.cc:341] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: a19c9cc5859f49a58a35460e504b3f84
I20260927 15:06:19.851975 1556 ts_tablet_manager.cc:1428] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260927 15:06:19.860492 2985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: Bootstrap starting.
I20260927 15:06:19.861096 1556 tablet_bootstrap.cc:492] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.862752 1556 tablet_bootstrap.cc:654] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.868328 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1005) took 2386 ms. Trace:
I20260927 15:06:19.868525 2233 rpcz_store.cc:276] 0927 15:06:17.481823 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.481869 (+ 46us) service_pool.cc:227] Handling call
0927 15:06:19.830000 (+2348131us) ts_tablet_manager.cc:1145] Deleting tablet 9a695b4fd5294f32a6644154487c1486
0927 15:06:19.830013 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.868302 (+ 38289us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2347852}
W20260927 15:06:19.869243 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9a695b4fd5294f32a6644154487c1486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a695b4fd5294f32a6644154487c1486 already in progress: creating tablet
I20260927 15:06:19.869938 2233 tablet_replica.cc:330] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:19.873311 1276 tablet_service.cc:1467] Processing CreateTablet for tablet a50808126865423ab0303ef1667b7f2b (DEFAULT_TABLE table=default.Table_1d40be3d810f4846ac0f57752c1d6008 [id=4f10376a4fbb4b04b802daf33400708d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.873988 2233 raft_consensus.cc:2229] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:19.874346 2233 raft_consensus.cc:2258] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.875085 1405 tablet_service.cc:1467] Processing CreateTablet for tablet a50808126865423ab0303ef1667b7f2b (DEFAULT_TABLE table=default.Table_1d40be3d810f4846ac0f57752c1d6008 [id=4f10376a4fbb4b04b802daf33400708d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.875384 2233 ts_tablet_manager.cc:1905] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.875561 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a50808126865423ab0303ef1667b7f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.879405 2980 raft_consensus.cc:482] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.879539 2980 raft_consensus.cc:504] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:19.879851 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 01ccd1e9e8484461a8a21c6e7ac41849 (DEFAULT_TABLE table=default.Table_b1ff6438778e4789966eb1e2dd2f9225 [id=309c038f07354612b657a820c8318008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.880113 2980 leader_election.cc:288] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.880236 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01ccd1e9e8484461a8a21c6e7ac41849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.879957 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 01ccd1e9e8484461a8a21c6e7ac41849 (DEFAULT_TABLE table=default.Table_b1ff6438778e4789966eb1e2dd2f9225 [id=309c038f07354612b657a820c8318008]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:19.881155 1238 leader_election.cc:341] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 4b9e88c3679d412cac7603f200cf899b
I20260927 15:06:19.883930 2119 ts_tablet_manager.cc:1918] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:19.884040 2119 log.cc:1196] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/b3cc37a97bc145bdaa654bcc193fe93b
I20260927 15:06:19.884356 2119 ts_tablet_manager.cc:1939] T b3cc37a97bc145bdaa654bcc193fe93b P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:19.884876 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet b3cc37a97bc145bdaa654bcc193fe93b (table default.Table_2597f21341574a599cce741248f402e9 [id=fad65497755c45c0b8ba4c338f3712c3]) successfully deleted
I20260927 15:06:19.884922 2119 tablet_replica.cc:330] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:19.885113 2119 raft_consensus.cc:2229] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:19.885254 2119 raft_consensus.cc:2258] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:19.885766 2119 ts_tablet_manager.cc:1905] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:19.885905 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 8830117d5e8f4b1383b314b4d1c672a8 (DEFAULT_TABLE table=default.Table_4ce6fd0cda7248eab6a6c5a419209994 [id=b2e61bfb9b8d4ef68626c8dd4c29aed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.886600 1137 tablet_service.cc:1467] Processing CreateTablet for tablet e7153ec9399f45dea08b6b7be57d7f7c (DEFAULT_TABLE table=default.Table_4038b63a0be146fdb47df34d335533ab [id=3300a98360f34328adca9476cddf8bff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.887012 1129 tablet_service.cc:1467] Processing CreateTablet for tablet d21172fe48704007ae33d42255c9d227 (DEFAULT_TABLE table=default.Table_5abc77ef4a9c4301a05fca21efd0c59d [id=3a8f6ff189624c0f9053df284c4ac11b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.887069 2431 raft_consensus.cc:482] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.889680 1552 tablet_bootstrap.cc:654] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.890146 1561 tablet_bootstrap.cc:654] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:19.896698 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 3b621f34830340e4a1c1443d0d4d4e3b (DEFAULT_TABLE table=default.Table_ab505d59db4043ba95787c44da9d494f [id=b56a25dafdef49b2a8c22f4c653c280b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.899303 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 8830117d5e8f4b1383b314b4d1c672a8 (DEFAULT_TABLE table=default.Table_4ce6fd0cda7248eab6a6c5a419209994 [id=b2e61bfb9b8d4ef68626c8dd4c29aed1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:19.900409 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b621f34830340e4a1c1443d0d4d4e3b consensus state has no leader
W20260927 15:06:19.900885 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50d786631fc849789164e83efaca333d consensus state has no leader
W20260927 15:06:19.903354 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 47816.8us
I20260927 15:06:19.896687 1131 tablet_service.cc:1467] Processing CreateTablet for tablet dead2d4d5ac243348ecd9eade6ea843f (DEFAULT_TABLE table=default.Table_f098ab1277e443c48a72b330ab75eac4 [id=716b7f1c93eb42089dbc2be0721c9dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.896651 1141 tablet_service.cc:1467] Processing CreateTablet for tablet f5520c8eb0be4c7db426d9e22003544f (DEFAULT_TABLE table=default.Table_38daa156d655475aac34a6d9584fef82 [id=d684218a9d4044b99ee84cce73bc417c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:19.900404 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8baa02df777404187611de3ae220e39 consensus state has no leader
I20260927 15:06:19.904872 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 9c065746a11f42819334325a3a166d45 (DEFAULT_TABLE table=default.Table_5712683f610a4b13a4581e60061c83b0 [id=93077e9bf3574cf8979d1a2dc067937e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.905431 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 28feaad311b14ea58144fc1417826186 (DEFAULT_TABLE table=default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.911010 1556 tablet_bootstrap.cc:492] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:19.911335 1556 ts_tablet_manager.cc:1397] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.002s
I20260927 15:06:19.913209 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_23ee3df957cd4a588ff650d85c05ab52" } modify_external_catalogs: true
I20260927 15:06:19.913424 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_23ee3df957cd4a588ff650d85c05ab52" } modify_external_catalogs: true
I20260927 15:06:19.913539 1556 raft_consensus.cc:348] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.914196 1556 raft_consensus.cc:374] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:19.914573 1556 raft_consensus.cc:729] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:19.915670 1556 consensus_queue.cc:260] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:19.918951 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24ea887fb6ed4d21b109f825a8d45d9c consensus state has no leader
I20260927 15:06:19.919119 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet fd1f51cb124d4d20a9d6024e6eb6810f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.926138 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 24a592ebe7db4f36bd2819f6864436ea
I20260927 15:06:19.927790 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 24a592ebe7db4f36bd2819f6864436ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:19.932471 1562 log.cc:1196] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/cad4605da5e045e7969da2d6f56a7e70
I20260927 15:06:19.932512 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 56f3c6a79b0e43769368693b493d73f1 (DEFAULT_TABLE table=default.Table_2c15e29e8a6543c8aa188a5cdb51df2c [id=080ce679c1124638a143a4c8db6e6c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.932327 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 147f57fd52c74f56ade1602f5d05526f (DEFAULT_TABLE table=default.Table_3aad9ee115dc400a9be8c6b0449f7090 [id=1483e81333464860b6168311d49e1e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.932955 1562 ts_tablet_manager.cc:1939] T cad4605da5e045e7969da2d6f56a7e70 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:19.932888 1132 tablet_service.cc:1467] Processing CreateTablet for tablet d35282079d4f4ab3a6093385244236eb (DEFAULT_TABLE table=default.Table_7156da92993b44a09d20d69c14974466 [id=2e21d11094f4480990537d3e65a89223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.933676 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 64a500e6a99140729d8630ec0bae7803 (DEFAULT_TABLE table=default.Table_2488bbed3604438f94bdeed81e1161e7 [id=1966e78e3ae04e35bd07610dff7ef69b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.933990 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bee3453bfc64ea5afa863f2b0db51b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.938660 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 147f57fd52c74f56ade1602f5d05526f (DEFAULT_TABLE table=default.Table_3aad9ee115dc400a9be8c6b0449f7090 [id=1483e81333464860b6168311d49e1e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.940810 1283 tablet_service.cc:1467] Processing CreateTablet for tablet ac1a50e3e3d448f1826c343920cfd864 (DEFAULT_TABLE table=default.Table_aa5bc572b8fd4044bdb2360ac6c72afe [id=d97493200c1d4aed91c0fa5d58df59ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.940898 2233 ts_tablet_manager.cc:1918] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:19.941666 1556 ts_tablet_manager.cc:1428] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.030s user 0.001s sys 0.002s
I20260927 15:06:19.944496 1406 tablet_service.cc:1467] Processing CreateTablet for tablet ac1a50e3e3d448f1826c343920cfd864 (DEFAULT_TABLE table=default.Table_aa5bc572b8fd4044bdb2360ac6c72afe [id=d97493200c1d4aed91c0fa5d58df59ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.946940 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac1a50e3e3d448f1826c343920cfd864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.947167 1556 tablet_bootstrap.cc:492] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:19.951646 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 92682624209840c38cab7cb01816bf03 (DEFAULT_TABLE table=default.Table_301f32b65e974fe1b0da037d10a40ebb [id=fba140e3c5d041db82c41cef3c6c806b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.955135 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 92682624209840c38cab7cb01816bf03 (DEFAULT_TABLE table=default.Table_301f32b65e974fe1b0da037d10a40ebb [id=fba140e3c5d041db82c41cef3c6c806b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.957176 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8830117d5e8f4b1383b314b4d1c672a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.957831 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 147f57fd52c74f56ade1602f5d05526f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.967604 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc4827774a664f0c8327d633a0da6867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.968187 2940 raft_consensus.cc:482] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:19.968374 2940 raft_consensus.cc:504] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.969025 2940 leader_election.cc:288] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:19.969816 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d852b4adbc47c58db352535923ff49" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:19.970741 1376 leader_election.cc:341] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:19.970772 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 544935abcf1548969bc548160961e0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.971161 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28feaad311b14ea58144fc1417826186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.971216 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet efa42545da374ca989199433ce1284c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.971695 1127 tablet_service.cc:1467] Processing CreateTablet for tablet a50808126865423ab0303ef1667b7f2b (DEFAULT_TABLE table=default.Table_1d40be3d810f4846ac0f57752c1d6008 [id=4f10376a4fbb4b04b802daf33400708d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.972088 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a50808126865423ab0303ef1667b7f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.973415 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56f3c6a79b0e43769368693b493d73f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.974547 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 4714d536373a4bf2a4be9ebeaebe77c1 with delete_type TABLET_DATA_DELETED (replaced by tablet f0e0d5f68e5b4bccb59ca2c31efdc60f) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.974797 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e7f0754b9ba4e21b05c51b0136729d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.974962 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d35282079d4f4ab3a6093385244236eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.975006 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet a6852cc3f94a40779799beb772b3d34d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.975171 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b621f34830340e4a1c1443d0d4d4e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.975360 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 0c02b79d7dbe4e1ba670f516bb0d4987 (DEFAULT_TABLE table=default.Table_3dcdf32e55c34e18a3fc62ce5baf3000 [id=58c5606f467641c8b25edaf05e125ce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.975749 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c02b79d7dbe4e1ba670f516bb0d4987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.978204 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5520c8eb0be4c7db426d9e22003544f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.978956 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a500e6a99140729d8630ec0bae7803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.979102 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cc2d5e281648a49fe109a7a00689b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.979143 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 24c2ad19ae734066a5914f6c95b192fd (DEFAULT_TABLE table=default.Table_a13b57205a8b490ab36e73f4b3140397 [id=a50dfc99e8564555b359255b41fb560d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.979452 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24c2ad19ae734066a5914f6c95b192fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:19.979523 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 0511464cc9604960ad770931bb5bae81 (DEFAULT_TABLE table=default.Table_8375212a3e50458da359b3328ef24831 [id=9911c3a2c37f4ab1ae6762c1d12fd5c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.979889 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0511464cc9604960ad770931bb5bae81. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:19.982784 1376 consensus_peers.cc:487] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:19.982908 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 13acfcbc13204b2f9edb0f557a62252e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.983016 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:19.982980 2431 raft_consensus.cc:504] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.983239 1099 leader_election.cc:302] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:19.983529 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 79892.1us
I20260927 15:06:19.983664 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 01ccd1e9e8484461a8a21c6e7ac41849 (DEFAULT_TABLE table=default.Table_b1ff6438778e4789966eb1e2dd2f9225 [id=309c038f07354612b657a820c8318008]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.983804 1099 leader_election.cc:302] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.984117 1099 leader_election.cc:302] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.984453 1099 leader_election.cc:302] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:19.986097 2927 raft_consensus.cc:2781] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:19.986343 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 8830117d5e8f4b1383b314b4d1c672a8 (DEFAULT_TABLE table=default.Table_4ce6fd0cda7248eab6a6c5a419209994 [id=b2e61bfb9b8d4ef68626c8dd4c29aed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:19.983242 1166 raft_consensus.cc:2454] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:19.988705 2982 raft_consensus.cc:2781] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.989008 2982 raft_consensus.cc:482] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:19.989125 2982 raft_consensus.cc:3037] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:19.991567 2982 raft_consensus.cc:504] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:19.992127 2982 leader_election.cc:288] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.992163 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 24a592ebe7db4f36bd2819f6864436ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:19.992300 2982 raft_consensus.cc:2781] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:19.983538 2431 leader_election.cc:288] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:19.993909 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ccf28c193a144586a54870418a519e90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:19.994184 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b36838686d1a4ccabe0659355f8b5f77" } modify_external_catalogs: true
I20260927 15:06:19.994310 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_004cca1243a74c9688562164253e3789" } modify_external_catalogs: true
I20260927 15:06:19.994383 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b36838686d1a4ccabe0659355f8b5f77" } modify_external_catalogs: true
W20260927 15:06:19.994475 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccf28c193a144586a54870418a519e90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.994445 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_004cca1243a74c9688562164253e3789" } modify_external_catalogs: true
I20260927 15:06:19.994774 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8a62519f0ac44349b996d33c3e11e368"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:19.994984 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_30034347f11e4920a17119f94d7a65df" } new_table_name: "default.Table_171a88ebc5dc4a92b5a077a13579ebc1" modify_external_catalogs: true
I20260927 15:06:19.983101 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dead2d4d5ac243348ecd9eade6ea843f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:19.995250 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a62519f0ac44349b996d33c3e11e368 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.995288 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c6e3ae0eaa67405692ba21e9f06fed21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.995653 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6e3ae0eaa67405692ba21e9f06fed21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.995807 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a146546821994116a1aa85bab3b3165e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:19.996210 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a146546821994116a1aa85bab3b3165e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:19.996567 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_967379b2ad1446769b622a56fcd7dd65" } modify_external_catalogs: true
I20260927 15:06:19.996727 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_967379b2ad1446769b622a56fcd7dd65" } modify_external_catalogs: true
I20260927 15:06:19.999516 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_51c91f7735c44128874d2e59a48b992a" } modify_external_catalogs: true
I20260927 15:06:19.999660 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_51c91f7735c44128874d2e59a48b992a" } modify_external_catalogs: true
I20260927 15:06:20.013217 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2b02006875534bdb86ffccee52bca32b
I20260927 15:06:20.014070 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b02006875534bdb86ffccee52bca32b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.026262 1279 tablet_service.cc:1467] Processing CreateTablet for tablet ffcfb481dbaa475e9ecb63cdf59264af (DEFAULT_TABLE table=default.Table_3d9fa71f47d84da197dfc19b5e479d1c [id=2a17417381074f63b56defca79c99dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.034235 2940 raft_consensus.cc:482] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:20.034408 2940 raft_consensus.cc:504] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.035531 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3540982dd7544e60af6c153fc41a412c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:20.046001 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a50808126865423ab0303ef1667b7f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.046414 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffcfb481dbaa475e9ecb63cdf59264af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.048612 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01ccd1e9e8484461a8a21c6e7ac41849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.050552 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8830117d5e8f4b1383b314b4d1c672a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.055130 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92682624209840c38cab7cb01816bf03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.058949 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac1a50e3e3d448f1826c343920cfd864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.061480 1272 tablet_service.cc:1467] Processing CreateTablet for tablet a3e75e26747f40a8b5f6ba37254516b3 (DEFAULT_TABLE table=default.Table_921a441eef1349e181bf8edd1c83b96b [id=ba3d6641338d466392308447624748fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.071501 2982 raft_consensus.cc:482] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:20.072357 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 989ab78ea3de48f9ad55157fd362a8ec (DEFAULT_TABLE table=default.Table_d8f9b77c8863469da1afa6de376a291c [id=5ef11d9c2cb34523a8ae504db54ad4f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.079874 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 147f57fd52c74f56ade1602f5d05526f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.081210 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2375332c8f4e0fb38648a8e49b6df8 (DEFAULT_TABLE table=default.Table_54f655e9ce264e7aa23dd5e652ce8e5f [id=5a1fe73bafc64a1380ff72ee1ccec9db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.084743 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 336dcc56dd25436cafae6b3bdf3e47b9 (DEFAULT_TABLE table=default.Table_ea53750c96144ad8ae86526f847057aa [id=b0fe7454c8b140b4a3c1b3012d1132c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.085785 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 147f57fd52c74f56ade1602f5d05526f (DEFAULT_TABLE table=default.Table_3aad9ee115dc400a9be8c6b0449f7090 [id=1483e81333464860b6168311d49e1e33]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:20.086228 1102 consensus_peers.cc:487] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.086191 2982 raft_consensus.cc:3037] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.086872 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01ccd1e9e8484461a8a21c6e7ac41849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.088025 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b02006875534bdb86ffccee52bca32b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.086867 2568 raft_consensus.cc:2781] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:20.088203 2568 raft_consensus.cc:482] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:20.088290 2568 raft_consensus.cc:3037] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.088361 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 318e4bf9d50f4fe6858e438ccf2544bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:20.088485 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 388973us
I20260927 15:06:20.088747 2982 raft_consensus.cc:504] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.089290 2982 leader_election.cc:288] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:20.090510 2568 raft_consensus.cc:504] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.090885 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 147f57fd52c74f56ade1602f5d05526f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.092042 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f95d664f1134ac9bbb62c1a3d4b5617" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:20.092348 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:20.092716 2568 leader_election.cc:288] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:20.093266 1295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "078ba40ca56745b2a2b86402a1519011" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:20.093513 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8830117d5e8f4b1383b314b4d1c672a8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:20.094725 1102 consensus_peers.cc:487] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:20.094873 1102 leader_election.cc:341] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:20.094998 1102 leader_election.cc:341] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.095713 1299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db09498a395b4570a34d32fbfc71e8ed" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:20.097067 1102 leader_election.cc:341] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:20.097270 1102 consensus_peers.cc:487] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:20.097394 1102 leader_election.cc:341] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.099004 2119 ts_tablet_manager.cc:1918] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.099360 2119 log.cc:1196] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/4b9e88c3679d412cac7603f200cf899b
I20260927 15:06:20.099916 912 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 52e7439320dd48aba25b5f7dc627964c (table default.Table_1f2da6475c904f0d8aec8dea13410524 [id=6ae561a83b5543a89dd0dedc630d9e47]). Expected version 1 got 0
I20260927 15:06:20.100804 2119 ts_tablet_manager.cc:1939] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:20.102288 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 24a592ebe7db4f36bd2819f6864436ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.102732 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3e75e26747f40a8b5f6ba37254516b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.103199 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2375332c8f4e0fb38648a8e49b6df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.103588 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 989ab78ea3de48f9ad55157fd362a8ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.106971 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 4b9e88c3679d412cac7603f200cf899b (table default.Table_1a0416550bbc4a05bc617171ed8c1504 [id=286509b6ce63492cbdc1ddea9374115c]) successfully deleted
I20260927 15:06:20.109050 2119 tablet_replica.cc:330] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:20.114574 2119 raft_consensus.cc:2229] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.118280 2119 raft_consensus.cc:2258] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.124781 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_584fc2c2806641fd8fea5aaba0903ea1" } new_table_name: "default.Table_38066fafb82442bfb95804cedc118082" modify_external_catalogs: true
I20260927 15:06:20.126237 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_20f143bd1e984ba8a2792c6e919d6f9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.126793 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20f143bd1e984ba8a2792c6e919d6f9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.128087 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d685958bb92c4b3eb8483ad67fecaeec" } new_table_name: "default.Table_07ba58159b22421eab89d4c725182a32" modify_external_catalogs: true
W20260927 15:06:20.132375 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 723df898361144aeb16065868885d120 consensus state has no leader
I20260927 15:06:20.132748 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_57b734874dee44c1835941aee4a7a9de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.133270 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57b734874dee44c1835941aee4a7a9de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.132409 2119 ts_tablet_manager.cc:1905] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.134362 905 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet b83fb81d9ace4262a4e85e5e733fc619
I20260927 15:06:20.134651 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2660ca6fcea7477b8da41e782e621c59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.135109 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2660ca6fcea7477b8da41e782e621c59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.136320 914 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 62de886761704cd39f06eba7b734533c
I20260927 15:06:20.136569 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5ec51454fe9c4889816832e8c8382975" } new_table_name: "default.Table_9b5b8d0352a54b9d997057b757ee33cf" modify_external_catalogs: true
I20260927 15:06:20.138630 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_92bc9e8eb45f4f679e968de44b4ed3d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.139192 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92bc9e8eb45f4f679e968de44b4ed3d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.141096 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 69987071cf0f4d599ef6372000217955 (DEFAULT_TABLE table=default.Table_e8e0487c58624bf591f79173d0ffcc48 [id=c315bacd33a84a2499b85f2d60d1f0f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.141496 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69987071cf0f4d599ef6372000217955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.144271 1561 tablet_bootstrap.cc:492] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:20.144266 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 92682624209840c38cab7cb01816bf03 (DEFAULT_TABLE table=default.Table_301f32b65e974fe1b0da037d10a40ebb [id=fba140e3c5d041db82c41cef3c6c806b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.144452 1561 ts_tablet_manager.cc:1397] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.619s user 0.003s sys 0.007s
I20260927 15:06:20.145072 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 8d6f44391d6147ddb221c35205a2c335 (DEFAULT_TABLE table=default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e [id=db7af27293544752bbe914164e4e9d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.145123 2980 raft_consensus.cc:482] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:20.145258 2980 raft_consensus.cc:504] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.145839 2980 leader_election.cc:288] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:20.149312 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 511c66b5d3324a31a1b0c90cc90000b5 (DEFAULT_TABLE table=default.Table_52fd5fb5caf84459a481612b86651b15 [id=d67fbb7fa866492ea8928a86f5f1000f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.154214 1403 tablet_service.cc:1467] Processing CreateTablet for tablet a3e75e26747f40a8b5f6ba37254516b3 (DEFAULT_TABLE table=default.Table_921a441eef1349e181bf8edd1c83b96b [id=ba3d6641338d466392308447624748fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.155180 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2375332c8f4e0fb38648a8e49b6df8 (DEFAULT_TABLE table=default.Table_54f655e9ce264e7aa23dd5e652ce8e5f [id=5a1fe73bafc64a1380ff72ee1ccec9db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.155846 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92682624209840c38cab7cb01816bf03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.160640 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b02006875534bdb86ffccee52bca32b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:20.160780 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d910172cef91481584bcb74ff261aa94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.161307 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d910172cef91481584bcb74ff261aa94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.162426 2940 leader_election.cc:288] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:20.165918 1102 consensus_peers.cc:487] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.167119 2233 log.cc:1196] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/fb2a8e788b71451da4a18f52b643e5e2
I20260927 15:06:20.167595 2233 ts_tablet_manager.cc:1939] T fb2a8e788b71451da4a18f52b643e5e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:20.168411 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1006) took 2635 ms. Trace:
I20260927 15:06:20.168536 2233 rpcz_store.cc:276] 0927 15:06:17.532603 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.532649 (+ 46us) service_pool.cc:227] Handling call
0927 15:06:19.869795 (+2337146us) ts_tablet_manager.cc:1145] Deleting tablet fb2a8e788b71451da4a18f52b643e5e2
0927 15:06:19.869809 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.937215 (+ 67406us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.940751 (+ 3536us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.167920 (+227169us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2336877}
I20260927 15:06:20.168856 2233 tablet_replica.cc:330] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:20.169045 2233 raft_consensus.cc:2229] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:20.169345 2233 raft_consensus.cc:2258] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.169625 1413 tablet_service.cc:1467] Processing CreateTablet for tablet ffcfb481dbaa475e9ecb63cdf59264af (DEFAULT_TABLE table=default.Table_3d9fa71f47d84da197dfc19b5e479d1c [id=2a17417381074f63b56defca79c99dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.169878 2233 ts_tablet_manager.cc:1905] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.170042 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3e75e26747f40a8b5f6ba37254516b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.169988 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 69987071cf0f4d599ef6372000217955 (DEFAULT_TABLE table=default.Table_e8e0487c58624bf591f79173d0ffcc48 [id=c315bacd33a84a2499b85f2d60d1f0f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.170322 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69987071cf0f4d599ef6372000217955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.170593 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffcfb481dbaa475e9ecb63cdf59264af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.170591 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 989ab78ea3de48f9ad55157fd362a8ec (DEFAULT_TABLE table=default.Table_d8f9b77c8863469da1afa6de376a291c [id=5ef11d9c2cb34523a8ae504db54ad4f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.171931 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 989ab78ea3de48f9ad55157fd362a8ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.174854 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 8d6f44391d6147ddb221c35205a2c335 (DEFAULT_TABLE table=default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e [id=db7af27293544752bbe914164e4e9d3b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:20.175161 1376 leader_election.cc:341] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:20.175305 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 139160us
I20260927 15:06:20.176005 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet fb2a8e788b71451da4a18f52b643e5e2 (table default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e [id=db7af27293544752bbe914164e4e9d3b]) successfully deleted
I20260927 15:06:20.179175 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2375332c8f4e0fb38648a8e49b6df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.179582 1274 tablet_service.cc:1467] Processing CreateTablet for tablet ff5b65dba45e487f9d182fd3e0da4afb (DEFAULT_TABLE table=default.Table_b6288d683c3e4dc6bdf763e1f6431234 [id=f028c1e9f0ee41c7bc91f4ec9bb766cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.183578 2940 raft_consensus.cc:482] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:20.183765 2940 raft_consensus.cc:504] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.184437 2940 leader_election.cc:288] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:20.186705 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd1f51cb124d4d20a9d6024e6eb6810f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:20.170646 1434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f95d664f1134ac9bbb62c1a3d4b5617" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:20.191121 1434 raft_consensus.cc:2454] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:20.192214 1376 leader_election.cc:341] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.195075 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1e84d99880494324b802b659e0590170
I20260927 15:06:20.197116 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c7ae3a5600424cf6b72a6a8fb0470378" } new_table_name: "default.Table_48f076a7b0434f4ea93a2657e399a765" modify_external_catalogs: true
W20260927 15:06:20.198400 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54dd4c1c24674440965e247b27c9f717 consensus state has no leader
I20260927 15:06:20.198727 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d3fb059bc4dc4e9da4b50184855ddc9a" } modify_external_catalogs: true
I20260927 15:06:20.198948 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d3fb059bc4dc4e9da4b50184855ddc9a" } modify_external_catalogs: true
W20260927 15:06:20.200765 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06dbc6029bdd412e91c49d4112feee55 consensus state has no leader
I20260927 15:06:20.201313 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e84d99880494324b802b659e0590170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.203106 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 511c66b5d3324a31a1b0c90cc90000b5 (DEFAULT_TABLE table=default.Table_52fd5fb5caf84459a481612b86651b15 [id=d67fbb7fa866492ea8928a86f5f1000f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.203471 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511c66b5d3324a31a1b0c90cc90000b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.207952 2233 ts_tablet_manager.cc:1918] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:20.208061 2233 log.cc:1196] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/a04caae16db84d8ea9050b648c1ba354
W20260927 15:06:20.209357 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff5f20f300324dbfae4ae771878ac61e consensus state has no leader
I20260927 15:06:20.213465 1267 tablet_service.cc:1467] Processing CreateTablet for tablet a78d8fe97a8642e6aefcd54a8b686c9b (DEFAULT_TABLE table=default.Table_b468e75aff2a4632ae34f00837213565 [id=33777868316149e9bd54b0b2a64aa0e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.222853 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d6f44391d6147ddb221c35205a2c335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.225437 2233 ts_tablet_manager.cc:1939] T a04caae16db84d8ea9050b648c1ba354 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:20.225817 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1007) took 2666 ms. Trace:
I20260927 15:06:20.225919 2233 rpcz_store.cc:276] 0927 15:06:17.559672 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.559733 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:20.168817 (+2609084us) ts_tablet_manager.cc:1145] Deleting tablet a04caae16db84d8ea9050b648c1ba354
0927 15:06:20.168826 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.201288 (+ 32462us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.207872 (+ 6584us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.225802 (+ 17930us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2608878}
I20260927 15:06:20.227977 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d6f44391d6147ddb221c35205a2c335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.232839 1280 tablet_service.cc:1467] Processing CreateTablet for tablet a6c57472bc634299b4567117855e31b6 (DEFAULT_TABLE table=default.Table_4294efdda96b4df0964d41be475b81a7 [id=8b0bd51d2161436ba244c8316db573c8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:20.233549 1102 consensus_peers.cc:487] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.241948 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c065746a11f42819334325a3a166d45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.242955 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92682624209840c38cab7cb01816bf03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.247961 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 1e84d99880494324b802b659e0590170 (DEFAULT_TABLE table=default.Table_b36838686d1a4ccabe0659355f8b5f77 [id=e6af39c6e6464dd9ba794f15fc2022cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.253804 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7153ec9399f45dea08b6b7be57d7f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.254515 1143 tablet_service.cc:1467] Processing CreateTablet for tablet ffcfb481dbaa475e9ecb63cdf59264af (DEFAULT_TABLE table=default.Table_3d9fa71f47d84da197dfc19b5e479d1c [id=2a17417381074f63b56defca79c99dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.254580 1127 tablet_service.cc:1467] Processing CreateTablet for tablet a3e75e26747f40a8b5f6ba37254516b3 (DEFAULT_TABLE table=default.Table_921a441eef1349e181bf8edd1c83b96b [id=ba3d6641338d466392308447624748fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.254884 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffcfb481dbaa475e9ecb63cdf59264af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.255086 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3e75e26747f40a8b5f6ba37254516b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.255241 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d21172fe48704007ae33d42255c9d227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.255260 1561 raft_consensus.cc:348] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.255512 1561 raft_consensus.cc:374] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.255573 1561 raft_consensus.cc:729] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:20.255743 1561 consensus_queue.cc:260] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.256098 1142 tablet_service.cc:1467] Processing CreateTablet for tablet ac1a50e3e3d448f1826c343920cfd864 (DEFAULT_TABLE table=default.Table_aa5bc572b8fd4044bdb2360ac6c72afe [id=d97493200c1d4aed91c0fa5d58df59ef]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:20.257275 1102 consensus_peers.cc:487] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.264261 1561 ts_tablet_manager.cc:1428] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.120s user 0.001s sys 0.001s
I20260927 15:06:20.264483 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e84d99880494324b802b659e0590170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.265834 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 8d6f44391d6147ddb221c35205a2c335 (DEFAULT_TABLE table=default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e [id=db7af27293544752bbe914164e4e9d3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.266261 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 989ab78ea3de48f9ad55157fd362a8ec (DEFAULT_TABLE table=default.Table_d8f9b77c8863469da1afa6de376a291c [id=5ef11d9c2cb34523a8ae504db54ad4f0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:20.268313 1238 leader_election.cc:341] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 2c4a123886a847d08b2a94ff5e4e01ca
I20260927 15:06:20.269974 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 336dcc56dd25436cafae6b3bdf3e47b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.270313 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc4827774a664f0c8327d633a0da6867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.270426 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 1e84d99880494324b802b659e0590170 (DEFAULT_TABLE table=default.Table_b36838686d1a4ccabe0659355f8b5f77 [id=e6af39c6e6464dd9ba794f15fc2022cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.270743 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e84d99880494324b802b659e0590170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.271214 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2375332c8f4e0fb38648a8e49b6df8 (DEFAULT_TABLE table=default.Table_54f655e9ce264e7aa23dd5e652ce8e5f [id=5a1fe73bafc64a1380ff72ee1ccec9db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.271186 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f77beb2ccd334371b7601efae663c779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:20.271148 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac1a50e3e3d448f1826c343920cfd864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.271903 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2375332c8f4e0fb38648a8e49b6df8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:20.272125 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f77beb2ccd334371b7601efae663c779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.274422 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 511c66b5d3324a31a1b0c90cc90000b5 (DEFAULT_TABLE table=default.Table_52fd5fb5caf84459a481612b86651b15 [id=d67fbb7fa866492ea8928a86f5f1000f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.274746 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511c66b5d3324a31a1b0c90cc90000b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.275480 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79a3125723034cb48bc1a05fc4abbb82" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.276544 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 69987071cf0f4d599ef6372000217955 (DEFAULT_TABLE table=default.Table_e8e0487c58624bf591f79173d0ffcc48 [id=c315bacd33a84a2499b85f2d60d1f0f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.276952 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69987071cf0f4d599ef6372000217955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.278127 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d6f44391d6147ddb221c35205a2c335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.278882 1138 tablet_service.cc:1467] Processing CreateTablet for tablet a6c57472bc634299b4567117855e31b6 (DEFAULT_TABLE table=default.Table_4294efdda96b4df0964d41be475b81a7 [id=8b0bd51d2161436ba244c8316db573c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.279245 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c57472bc634299b4567117855e31b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.278008 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289bea546c8a41bf97edfdc9a453a024" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.281210 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 989ab78ea3de48f9ad55157fd362a8ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.289124 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1008) took 2650 ms. Trace:
I20260927 15:06:20.289258 2233 rpcz_store.cc:276] 0927 15:06:17.639140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.639193 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:20.226175 (+2586982us) ts_tablet_manager.cc:1145] Deleting tablet 03ce4e8370634ff4967865be6caafab2
0927 15:06:20.226184 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.289100 (+ 62916us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2586776}
I20260927 15:06:20.289565 2233 tablet_replica.cc:330] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:20.289779 2233 raft_consensus.cc:2229] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.289942 2233 raft_consensus.cc:2258] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.290452 2233 ts_tablet_manager.cc:1905] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.291175 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b94ff6d2011948078b03af17b4d95fae" } modify_external_catalogs: true
I20260927 15:06:20.264530 1561 tablet_bootstrap.cc:492] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:20.295446 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_580922ee309b4853930fddfdff7d2904"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.296087 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_580922ee309b4853930fddfdff7d2904 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.296415 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c0035dfe43e54606883fdc82c180334c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.296826 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0035dfe43e54606883fdc82c180334c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.297279 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5d152fad078948fb9fbf120a0c415c6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.297674 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d152fad078948fb9fbf120a0c415c6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.298182 2940 raft_consensus.cc:482] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:20.298333 2940 raft_consensus.cc:504] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.299127 2940 leader_election.cc:288] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:20.299952 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44e2611d2bf40ae90c4fd857225e39e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:20.300491 1376 leader_election.cc:341] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.280028 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d852b4adbc47c58db352535923ff49" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.301196 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0141fdf4d1ef47b8b3e758ea3ff8b7c8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.301890 1374 leader_election.cc:302] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:20.301949 1404 tablet_service.cc:1467] Processing CreateTablet for tablet ff5b65dba45e487f9d182fd3e0da4afb (DEFAULT_TABLE table=default.Table_b6288d683c3e4dc6bdf763e1f6431234 [id=f028c1e9f0ee41c7bc91f4ec9bb766cc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:20.302232 1239 leader_election.cc:341] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: ce566cc49cfe4483b942d2eaa8269acc
I20260927 15:06:20.302314 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff5b65dba45e487f9d182fd3e0da4afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.302356 1239 leader_election.cc:302] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:20.302345 1374 leader_election.cc:341] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.302438 1374 leader_election.cc:302] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:20.302678 1239 leader_election.cc:341] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: a19c9cc5859f49a58a35460e504b3f84
I20260927 15:06:20.302762 1239 leader_election.cc:302] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:20.302948 2999 raft_consensus.cc:2781] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:20.303030 2999 raft_consensus.cc:482] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:20.303375 2996 raft_consensus.cc:2726] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:20.303697 2980 raft_consensus.cc:2726] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:20.303836 2980 raft_consensus.cc:2726] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:20.277860 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089b6b5ac39d49fea744240261a8010e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.304613 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd1f51cb124d4d20a9d6024e6eb6810f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.307523 2233 ts_tablet_manager.cc:1918] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.307638 2233 log.cc:1196] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/e19cd7febe054432899739e21605406d
I20260927 15:06:20.303098 2999 raft_consensus.cc:3037] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.313239 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 511c66b5d3324a31a1b0c90cc90000b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.313499 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c57472bc634299b4567117855e31b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.313874 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e84d99880494324b802b659e0590170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.314604 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet a04caae16db84d8ea9050b648c1ba354 (table default.Table_9e1c88622f89474285f6bdb98faffffb [id=32293fa2bff246dba3dfe47a3fcaf310]) successfully deleted
W20260927 15:06:20.315061 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 03ce4e8370634ff4967865be6caafab2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03ce4e8370634ff4967865be6caafab2 already in progress: creating tablet
I20260927 15:06:20.318161 2119 ts_tablet_manager.cc:1918] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.318284 2119 log.cc:1196] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/610ff6563dc64e73b2b4d7c268468b21
I20260927 15:06:20.318637 2119 ts_tablet_manager.cc:1939] T 610ff6563dc64e73b2b4d7c268468b21 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:20.318991 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78d8fe97a8642e6aefcd54a8b686c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.319180 2233 ts_tablet_manager.cc:1939] T e19cd7febe054432899739e21605406d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:20.319486 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1010) took 2452 ms. Trace:
I20260927 15:06:20.319566 2233 rpcz_store.cc:276] 0927 15:06:17.866979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.867078 (+ 99us) service_pool.cc:227] Handling call
0927 15:06:20.289521 (+2422443us) ts_tablet_manager.cc:1145] Deleting tablet e19cd7febe054432899739e21605406d
0927 15:06:20.289533 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.299094 (+ 9561us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.307438 (+ 8344us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.319470 (+ 12032us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2422261}
I20260927 15:06:20.321626 1418 tablet_service.cc:1467] Processing CreateTablet for tablet a78d8fe97a8642e6aefcd54a8b686c9b (DEFAULT_TABLE table=default.Table_b468e75aff2a4632ae34f00837213565 [id=33777868316149e9bd54b0b2a64aa0e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.321991 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78d8fe97a8642e6aefcd54a8b686c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.322937 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff5b65dba45e487f9d182fd3e0da4afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.320719 2999 raft_consensus.cc:504] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.328764 2999 leader_election.cc:288] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:20.330955 1405 tablet_service.cc:1467] Processing CreateTablet for tablet a6c57472bc634299b4567117855e31b6 (DEFAULT_TABLE table=default.Table_4294efdda96b4df0964d41be475b81a7 [id=8b0bd51d2161436ba244c8316db573c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.331957 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 1e84d99880494324b802b659e0590170 (DEFAULT_TABLE table=default.Table_b36838686d1a4ccabe0659355f8b5f77 [id=e6af39c6e6464dd9ba794f15fc2022cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.332065 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6c57472bc634299b4567117855e31b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.332342 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e84d99880494324b802b659e0590170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.331611 1556 tablet_bootstrap.cc:654] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:20.335103 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:20.335760 1376 leader_election.cc:341] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.341917 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet e19cd7febe054432899739e21605406d (table default.Table_1a919c358b5340f7a616321c89f236a4 [id=9a56fa8ed14a4bff867d4648b4491c31]) successfully deleted
I20260927 15:06:20.348776 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e84d99880494324b802b659e0590170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:19 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:20.304154 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44e2611d2bf40ae90c4fd857225e39e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.301230 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3540982dd7544e60af6c153fc41a412c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.359730 1141 tablet_service.cc:1467] Processing CreateTablet for tablet ff5b65dba45e487f9d182fd3e0da4afb (DEFAULT_TABLE table=default.Table_b6288d683c3e4dc6bdf763e1f6431234 [id=f028c1e9f0ee41c7bc91f4ec9bb766cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.360603 1131 tablet_service.cc:1467] Processing CreateTablet for tablet a78d8fe97a8642e6aefcd54a8b686c9b (DEFAULT_TABLE table=default.Table_b468e75aff2a4632ae34f00837213565 [id=33777868316149e9bd54b0b2a64aa0e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:20.364068 1552 tablet_bootstrap.cc:492] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:20.364203 1552 ts_tablet_manager.cc:1397] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.579s user 0.029s sys 0.062s
I20260927 15:06:20.365080 1552 raft_consensus.cc:348] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.365289 1552 raft_consensus.cc:374] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.365346 1552 raft_consensus.cc:729] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:20.365525 1552 consensus_queue.cc:260] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.366044 1552 ts_tablet_manager.cc:1428] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:20.367671 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff5b65dba45e487f9d182fd3e0da4afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.365226 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1013) took 2497 ms. Trace:
I20260927 15:06:20.370536 2233 rpcz_store.cc:276] 0927 15:06:17.867345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.867669 (+ 324us) service_pool.cc:227] Handling call
0927 15:06:20.319820 (+2452151us) ts_tablet_manager.cc:1145] Deleting tablet 4ebacc9c2fca45ff92635e41a19e5bd8
0927 15:06:20.319829 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.365195 (+ 45366us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2451967}
I20260927 15:06:20.370811 2569 raft_consensus.cc:482] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:20.371256 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78d8fe97a8642e6aefcd54a8b686c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:20.370988 2569 raft_consensus.cc:504] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.372136 2569 leader_election.cc:288] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:20.373126 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 70396.6us
I20260927 15:06:20.374626 1561 tablet_bootstrap.cc:654] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:20.374336 1239 leader_election.cc:341] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 4b9e88c3679d412cac7603f200cf899b
I20260927 15:06:20.375104 1239 leader_election.cc:302] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:20.375173 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 4ebacc9c2fca45ff92635e41a19e5bd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ebacc9c2fca45ff92635e41a19e5bd8 already in progress: creating tablet
W20260927 15:06:20.375856 1239 raft_consensus.cc:2670] T 4b9e88c3679d412cac7603f200cf899b P 4769a710b72a4b49b816725a5921e86e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260927 15:06:20.378074 2233 tablet_replica.cc:330] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:20.383185 1239 leader_election.cc:341] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 2c4a123886a847d08b2a94ff5e4e01ca
I20260927 15:06:20.386317 1239 leader_election.cc:302] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:20.389781 3023 raft_consensus.cc:2726] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:20.391428 1552 tablet_bootstrap.cc:492] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:20.398865 1552 tablet_bootstrap.cc:654] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:20.398873 3023 raft_consensus.cc:482] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:20.399766 3023 raft_consensus.cc:504] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:20.407049 3011 log.cc:924] Time spent T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c: Append to log took a long time: real 0.132s user 0.000s sys 0.000s
I20260927 15:06:20.410449 1298 raft_consensus.cc:3037] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.301230 1161 raft_consensus.cc:2454] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:20.422834 3023 leader_election.cc:288] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:20.428265 1295 raft_consensus.cc:3037] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.432832 1299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8659865bf644458b3b5a78eae36a524" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:20.437662 1102 consensus_peers.cc:487] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.442863 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278205071701447e8ee7457b2ee84be4" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:20.452709 1102 leader_election.cc:341] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.454885 2927 raft_consensus.cc:686] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:20.455428 2927 consensus_queue.cc:237] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.463307 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 994) took 1131 ms. Trace:
I20260927 15:06:20.463419 2119 rpcz_store.cc:276] 0927 15:06:19.332217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.332644 (+ 427us) service_pool.cc:227] Handling call
0927 15:06:20.108265 (+775621us) ts_tablet_manager.cc:1145] Deleting tablet 610ff6563dc64e73b2b4d7c268468b21
0927 15:06:20.108688 (+ 423us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.315514 (+206826us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.318094 (+ 2580us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.463285 (+145191us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":775031}
I20260927 15:06:20.463815 2119 tablet_replica.cc:330] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:20.463902 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 610ff6563dc64e73b2b4d7c268468b21 (table default.Table_5c5b46d2dba044ef8c5bb41023e108ee [id=eb505f5ebaa2482182e05e9b000f35b9]) successfully deleted
I20260927 15:06:20.464011 2119 raft_consensus.cc:2229] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.464162 2119 raft_consensus.cc:2258] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.464991 2233 raft_consensus.cc:2229] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:20.465291 2233 raft_consensus.cc:2258] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.466025 1556 tablet_bootstrap.cc:492] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:20.466681 1556 ts_tablet_manager.cc:1397] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.521s user 0.000s sys 0.011s
I20260927 15:06:20.469749 1556 raft_consensus.cc:348] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.470744 1556 raft_consensus.cc:374] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.471172 1556 raft_consensus.cc:729] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:20.475117 2233 ts_tablet_manager.cc:1905] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.483108 2119 ts_tablet_manager.cc:1905] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:20.483161 1238 leader_election.cc:341] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 278205071701447e8ee7457b2ee84be4
W20260927 15:06:20.487531 1099 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.502s user 0.005s sys 0.011s
W20260927 15:06:20.487650 1099 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.502s user 0.005s sys 0.011s
I20260927 15:06:20.493187 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0f0652967878460c8defab6738bc1839" } new_table_name: "default.Table_ae0c94db71dd4e109b8090ace3c2c655" modify_external_catalogs: true
I20260927 15:06:20.493543 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a0ae944503394570920bd86171112fe7" } modify_external_catalogs: true
I20260927 15:06:20.496891 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:20.497154 1440 raft_consensus.cc:2379] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c4264874db964ff2830b7894c2b3d61c in current term 1: Already voted for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in this term.
I20260927 15:06:20.497463 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db09498a395b4570a34d32fbfc71e8ed" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:20.497603 1440 raft_consensus.cc:3037] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.497823 1435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "078ba40ca56745b2a2b86402a1519011" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:20.497963 1435 raft_consensus.cc:3037] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.500624 1435 raft_consensus.cc:2454] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:20.504278 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 084fbd393881418081df893e13f2fae8 has no consensus state
I20260927 15:06:20.504688 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_df8af8dcea36480da1b3715c8d69646f" } modify_external_catalogs: true
I20260927 15:06:20.504864 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_df8af8dcea36480da1b3715c8d69646f" } modify_external_catalogs: true
I20260927 15:06:20.504887 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_834708d11c7f4f0bb805f814699fb90c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.505472 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_834708d11c7f4f0bb805f814699fb90c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.508046 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a0ae944503394570920bd86171112fe7" } modify_external_catalogs: true
I20260927 15:06:20.508406 1552 tablet_bootstrap.cc:492] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:20.508526 1552 ts_tablet_manager.cc:1397] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.117s user 0.002s sys 0.004s
I20260927 15:06:20.511585 1552 raft_consensus.cc:348] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.512754 1552 raft_consensus.cc:374] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.513092 1552 raft_consensus.cc:729] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:20.514025 1552 consensus_queue.cc:260] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.518325 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b94ff6d2011948078b03af17b4d95fae" } modify_external_catalogs: true
I20260927 15:06:20.518181 1552 ts_tablet_manager.cc:1428] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260927 15:06:20.519505 1552 tablet_bootstrap.cc:492] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:20.519938 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cc91a17a72de4ced8d3f7519430d44b5
I20260927 15:06:20.520740 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_52fd5fb5caf84459a481612b86651b15" } modify_external_catalogs: true
I20260927 15:06:20.520906 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_52fd5fb5caf84459a481612b86651b15" } modify_external_catalogs: true
I20260927 15:06:20.522943 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet cc91a17a72de4ced8d3f7519430d44b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.527453 1552 tablet_bootstrap.cc:654] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:20.528297 2119 ts_tablet_manager.cc:1918] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.528420 2119 log.cc:1196] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/033e71f60c3e47fd9647db090d4d6cd5
I20260927 15:06:20.528772 2119 ts_tablet_manager.cc:1939] T 033e71f60c3e47fd9647db090d4d6cd5 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:20.529121 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 998) took 1196 ms. Trace:
I20260927 15:06:20.529212 2119 rpcz_store.cc:276] 0927 15:06:19.332593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.332711 (+ 118us) service_pool.cc:227] Handling call
0927 15:06:20.463769 (+1131058us) ts_tablet_manager.cc:1145] Deleting tablet 033e71f60c3e47fd9647db090d4d6cd5
0927 15:06:20.463779 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.486445 (+ 22666us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.528200 (+ 41755us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.529105 (+ 905us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1130880}
I20260927 15:06:20.529539 2119 tablet_replica.cc:330] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:20.529734 2119 raft_consensus.cc:2229] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.529891 2119 raft_consensus.cc:2258] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.530408 2119 ts_tablet_manager.cc:1905] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.534373 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 033e71f60c3e47fd9647db090d4d6cd5 (table default.Table_c6d23c73ae904261ac5ed42420c0eaab [id=0fa527ae49b1486f955fef21e0b35e7a]) successfully deleted
I20260927 15:06:20.546207 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1363eb0bffb8454a9bfbc067762dad9c" } new_table_name: "default.Table_a97f2a9983ab4e67ae1fc5edb4afbef2" modify_external_catalogs: true
I20260927 15:06:20.548280 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3897e840376a41e09ba83d5f96f1dd34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.548697 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b37e436d8d1462d8d2299449b53ce7b consensus state has no leader
W20260927 15:06:20.548928 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3897e840376a41e09ba83d5f96f1dd34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.549000 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1d40be3d810f4846ac0f57752c1d6008" } new_table_name: "default.Table_4249e024508544838076d00f351bbaed" modify_external_catalogs: true
I20260927 15:06:20.550289 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet e5d924a79fa2493795abda6ffbbd11b5
I20260927 15:06:20.550966 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3786977bb6a8472a9e3474d78d5ec9f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.551537 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3786977bb6a8472a9e3474d78d5ec9f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.551803 1552 tablet_bootstrap.cc:492] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:20.552546 1552 ts_tablet_manager.cc:1397] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.002s
I20260927 15:06:20.553963 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet e5d924a79fa2493795abda6ffbbd11b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.558470 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet f0e0d5f68e5b4bccb59ca2c31efdc60f
I20260927 15:06:20.557580 1552 raft_consensus.cc:348] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.558883 1552 raft_consensus.cc:374] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.559284 1552 raft_consensus.cc:729] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:20.560026 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.560304 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_493099c0cf6c40a7b6990f7f49812696"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.561024 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_493099c0cf6c40a7b6990f7f49812696 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.560387 1552 consensus_queue.cc:260] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.562873 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dfc10f0ce8074b3c83e6388a718d8e4f" } new_table_name: "default.Table_fda01f3dcccb42e389ebcbb8c30b2b6c" modify_external_catalogs: true
I20260927 15:06:20.563841 1552 ts_tablet_manager.cc:1428] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260927 15:06:20.564558 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_04806c4d169c477aa076124ac18c17f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.565237 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04806c4d169c477aa076124ac18c17f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.565407 1552 tablet_bootstrap.cc:492] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:20.566598 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 4658de7351e9423b83f393f7f7045eed
I20260927 15:06:20.567345 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 4658de7351e9423b83f393f7f7045eed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.568415 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6f019b4793f74cf5940bc17afa1bacaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.569183 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f019b4793f74cf5940bc17afa1bacaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.574885 1552 tablet_bootstrap.cc:654] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:20.576908 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 511c66b5d3324a31a1b0c90cc90000b5
I20260927 15:06:20.577260 2119 ts_tablet_manager.cc:1918] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.577374 2119 log.cc:1196] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/ce566cc49cfe4483b942d2eaa8269acc
I20260927 15:06:20.577679 2119 ts_tablet_manager.cc:1939] T ce566cc49cfe4483b942d2eaa8269acc P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:20.577900 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 511c66b5d3324a31a1b0c90cc90000b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.577997 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 996) took 1245 ms. Trace:
I20260927 15:06:20.578071 2119 rpcz_store.cc:276] 0927 15:06:19.332393 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.342127 (+ 9734us) service_pool.cc:227] Handling call
0927 15:06:20.529497 (+1187370us) ts_tablet_manager.cc:1145] Deleting tablet ce566cc49cfe4483b942d2eaa8269acc
0927 15:06:20.529507 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.574388 (+ 44881us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.577178 (+ 2790us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.577984 (+ 806us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1187163}
I20260927 15:06:20.578457 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1001) took 1215 ms. Trace:
I20260927 15:06:20.578540 2119 rpcz_store.cc:276] 0927 15:06:19.362561 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.362616 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:20.578336 (+1215720us) ts_tablet_manager.cc:1145] Deleting tablet 512a2f4e3c3f479daba37eb1ca0d463b
0927 15:06:20.578347 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.578440 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1215479}
I20260927 15:06:20.578881 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet ce566cc49cfe4483b942d2eaa8269acc (table default.Table_3d65f616a187485eaa9298155971a648 [id=5c5e1b2501064bd5a6df36c4dddda94a]) successfully deleted
W20260927 15:06:20.579348 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 512a2f4e3c3f479daba37eb1ca0d463b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 512a2f4e3c3f479daba37eb1ca0d463b already in progress: creating tablet
I20260927 15:06:20.580122 913 master_service.cc:946] ReplaceTablet: received request to replace tablet afd31e5d011b40c7bfda173a7331ed90 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:20.596911 3018 log.cc:924] Time spent T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: Append to log took a long time: real 0.218s user 0.000s sys 0.000s
I20260927 15:06:20.598464 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet cc91a17a72de4ced8d3f7519430d44b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.598745 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet e5d924a79fa2493795abda6ffbbd11b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.599040 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.599220 2233 ts_tablet_manager.cc:1918] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:20.599339 2233 log.cc:1196] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/2268d824f5324cd1b81879e2fe4fd027
I20260927 15:06:20.600951 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 4658de7351e9423b83f393f7f7045eed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.601121 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet 511c66b5d3324a31a1b0c90cc90000b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.610868 2233 ts_tablet_manager.cc:1939] T 2268d824f5324cd1b81879e2fe4fd027 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:20.619189 1561 tablet_bootstrap.cc:492] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:20.619324 1561 ts_tablet_manager.cc:1397] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.355s user 0.011s sys 0.010s
I20260927 15:06:20.619346 1140 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:60504 (request call id 1092) took 1016 ms. Trace:
I20260927 15:06:20.620150 1561 raft_consensus.cc:348] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.620378 1561 raft_consensus.cc:374] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.620424 1561 raft_consensus.cc:729] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:20.620572 1561 consensus_queue.cc:260] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.620774 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet cc91a17a72de4ced8d3f7519430d44b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:20.620995 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet e5d924a79fa2493795abda6ffbbd11b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:20.619728 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 316954us
I20260927 15:06:20.621596 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:20.623135 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79c983d3119f4754a33a1ec3a84665c1 consensus state has no leader
I20260927 15:06:20.623282 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 4658de7351e9423b83f393f7f7045eed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:20.623705 1561 ts_tablet_manager.cc:1428] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:20.623986 1561 tablet_bootstrap.cc:492] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:20.624116 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a50808126865423ab0303ef1667b7f2b consensus state has no leader
W20260927 15:06:20.623900 1374 leader_election.cc:341] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.624310 1374 leader_election.cc:302] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:20.619411 1140 rpcz_store.cc:276] 0927 15:06:19.602485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.602551 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:19.931996 (+329445us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0927 15:06:19.932017 (+ 21us) ts_tablet_manager.cc:676] Creating new metadata...
0927 15:06:20.409119 (+477102us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.619191 (+210072us) tablet_replica.cc:205] Creating consensus instance
0927 15:06:20.619331 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11520}
I20260927 15:06:20.626883 2996 raft_consensus.cc:2726] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:20.627411 1374 leader_election.cc:341] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.628078 1374 leader_election.cc:302] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:20.630378 2940 raft_consensus.cc:2726] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:20.632017 1374 leader_election.cc:341] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.633188 1374 leader_election.cc:302] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:20.635491 1561 tablet_bootstrap.cc:654] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:20.636210 2940 raft_consensus.cc:2726] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:20.637082 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9cd4941f342d41f6a0b4d9c1c42a983d consensus state has no leader
I20260927 15:06:20.638720 2927 raft_consensus.cc:482] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:20.638854 2927 raft_consensus.cc:504] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.639642 2927 leader_election.cc:288] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:20.472110 1556 consensus_queue.cc:260] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.643808 1556 ts_tablet_manager.cc:1428] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.177s user 0.000s sys 0.003s
I20260927 15:06:20.644093 1556 tablet_bootstrap.cc:492] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:20.643123 1374 leader_election.cc:341] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:20.644706 1099 consensus_peers.cc:487] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d463a481cb8c4243961e9b0d2b11822c. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.644708 1374 leader_election.cc:302] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:20.646354 2996 raft_consensus.cc:2726] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:20.647266 1374 leader_election.cc:341] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.647827 1374 leader_election.cc:302] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:20.649199 2940 raft_consensus.cc:2726] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:20.650208 1374 leader_election.cc:341] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.654106 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet afd31e5d011b40c7bfda173a7331ed90
I20260927 15:06:20.653587 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1011) took 2786 ms. Trace:
I20260927 15:06:20.655444 2233 rpcz_store.cc:276] 0927 15:06:17.867094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.867824 (+ 730us) service_pool.cc:227] Handling call
0927 15:06:20.377995 (+2510171us) ts_tablet_manager.cc:1145] Deleting tablet 2268d824f5324cd1b81879e2fe4fd027
0927 15:06:20.378027 (+ 32us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.504666 (+126639us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.599112 (+ 94446us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.653571 (+ 54459us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2508155}
I20260927 15:06:20.655928 913 catalog_manager.cc:6565] ReplaceTablet: tablet afd31e5d011b40c7bfda173a7331ed90 deleted and replaced by tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df
I20260927 15:06:20.656821 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet afd31e5d011b40c7bfda173a7331ed90 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.646651 2927 consensus_queue.cc:1035] T 4e2c5c3d0f574422be80b318395f199a P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:20.664348 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1014) took 2796 ms. Trace:
I20260927 15:06:20.664474 2233 rpcz_store.cc:276] 0927 15:06:17.867455 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.870880 (+ 3425us) service_pool.cc:227] Handling call
0927 15:06:20.656027 (+2785147us) ts_tablet_manager.cc:1145] Deleting tablet 51f0744f9d804b84a958916c2dd04503
0927 15:06:20.656043 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.664320 (+ 8277us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2784974}
I20260927 15:06:20.664690 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet afd31e5d011b40c7bfda173a7331ed90 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:20.664892 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 511c66b5d3324a31a1b0c90cc90000b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:20.664937 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1015) took 2797 ms. Trace:
I20260927 15:06:20.665021 2233 rpcz_store.cc:276] 0927 15:06:17.867586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.871080 (+ 3494us) service_pool.cc:227] Handling call
0927 15:06:20.664799 (+2793719us) ts_tablet_manager.cc:1145] Deleting tablet 58d7e01486e941f9a6a5f691ae6c7d68
0927 15:06:20.664813 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.664920 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2793570}
I20260927 15:06:20.665318 2233 tablet_replica.cc:330] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:20.665570 2233 raft_consensus.cc:2229] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.665725 2233 raft_consensus.cc:2258] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.666348 2233 ts_tablet_manager.cc:1905] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.667047 1440 raft_consensus.cc:2454] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:20.669235 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 2268d824f5324cd1b81879e2fe4fd027 (table default.Table_83597ebfdee14f58abf228d7cd16bbd3 [id=b36bff625e7a4da699490e2921c33802]) successfully deleted
W20260927 15:06:20.669451 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 51f0744f9d804b84a958916c2dd04503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51f0744f9d804b84a958916c2dd04503 already in progress: creating tablet
W20260927 15:06:20.669586 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 58d7e01486e941f9a6a5f691ae6c7d68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d7e01486e941f9a6a5f691ae6c7d68 already in progress: creating tablet
I20260927 15:06:20.670358 1432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8659865bf644458b3b5a78eae36a524" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:20.656154 1374 leader_election.cc:302] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:20.670547 1432 raft_consensus.cc:2454] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:20.671006 1374 leader_election.cc:302] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:20.671398 2996 raft_consensus.cc:2726] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:20.671783 2996 raft_consensus.cc:482] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:20.671861 1099 leader_election.cc:341] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 63fbd388210d4a1aabfcf27c7533efbf
I20260927 15:06:20.671960 1099 leader_election.cc:302] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:20.671885 2996 raft_consensus.cc:504] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.672335 2996 leader_election.cc:288] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:20.672458 2996 raft_consensus.cc:2781] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:20.672530 2996 raft_consensus.cc:482] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:20.672603 2996 raft_consensus.cc:3037] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.675052 3008 raft_consensus.cc:2726] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 15:06:20.676342 1099 leader_election.cc:302] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:20.676550 3008 raft_consensus.cc:2781] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:20.676623 3008 raft_consensus.cc:482] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:20.676694 3008 raft_consensus.cc:3037] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.677318 2996 raft_consensus.cc:504] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.678015 1099 leader_election.cc:302] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:20.678323 2996 leader_election.cc:288] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:20.679926 3013 raft_consensus.cc:2726] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 15:06:20.681828 2569 consensus_queue.cc:1035] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:06:20.682415 1099 consensus_peers.cc:487] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 541147938d864cd9ad7208d96533b0f4. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.683234 905 master_service.cc:946] ReplaceTablet: received request to replace tablet 4d4c717419864473b7cd47ece4ffd805 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:20.683461 1433 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s user 0.030s sys 0.117s
I20260927 15:06:20.685456 1163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:20.685688 1163 raft_consensus.cc:2379] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fabb59e74b7d48fa9be047d7f4c4cc38 in current term 1: Already voted for candidate c4264874db964ff2830b7894c2b3d61c in this term.
I20260927 15:06:20.686426 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e7439320dd48aba25b5f7dc627964c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.686781 3008 raft_consensus.cc:504] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.687304 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d852b4adbc47c58db352535923ff49" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:20.687439 1164 raft_consensus.cc:3037] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.687510 3008 leader_election.cc:288] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:20.690575 2233 ts_tablet_manager.cc:1918] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.690809 2233 log.cc:1196] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/7f8744e2349e49d3a821eca42c7f89a2
W20260927 15:06:20.683580 1433 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s user 0.030s sys 0.117s
I20260927 15:06:20.691140 1374 leader_election.cc:302] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:20.691425 3022 raft_consensus.cc:2726] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260927 15:06:20.691589 1374 leader_election.cc:341] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.691939 2999 consensus_queue.cc:1035] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:20.692451 2233 ts_tablet_manager.cc:1939] T 7f8744e2349e49d3a821eca42c7f89a2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:20.692987 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1016) took 2825 ms. Trace:
I20260927 15:06:20.693318 2233 rpcz_store.cc:276] 0927 15:06:17.867728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.871253 (+ 3525us) service_pool.cc:227] Handling call
0927 15:06:20.665267 (+2794014us) ts_tablet_manager.cc:1145] Deleting tablet 7f8744e2349e49d3a821eca42c7f89a2
0927 15:06:20.665279 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.672969 (+ 7690us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.688838 (+ 15869us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.692949 (+ 4111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2793901}
I20260927 15:06:20.694572 2233 tablet_replica.cc:330] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:20.695763 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 7f8744e2349e49d3a821eca42c7f89a2 (table default.Table_2ad5d2ac920c40f197a7134129b64442 [id=4d9dd505f13d4b63ac2b4ea898c9eac0]) successfully deleted
I20260927 15:06:20.696715 2233 raft_consensus.cc:2229] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.696926 2233 raft_consensus.cc:2258] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.697897 2233 ts_tablet_manager.cc:1905] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.698669 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet bd5b041a4274477895e88d4822b91cca (table default.Table_215f907352cd4345ae56604d6322ded9 [id=1f51698c91d64bb38f760d13529935b6]). Expected version 1 got 0
I20260927 15:06:20.699368 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:20.699733 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
I20260927 15:06:20.700333 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet adf68ba5020446bf8b522ac6db0e21e7 (table default.Table_9d78b6648ac548e586c621d86d1938ba [id=3fc04b4c774144dd85bbb92d05883018]). Expected version 1 got 0
I20260927 15:06:20.682554 1099 leader_election.cc:302] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:20.701361 3008 raft_consensus.cc:2781] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:20.701506 3008 raft_consensus.cc:686] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:20.701759 3008 consensus_queue.cc:237] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.704851 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (table default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8]). Expected version 3 got 0
I20260927 15:06:20.714995 1556 tablet_bootstrap.cc:654] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:20.718917 2233 ts_tablet_manager.cc:1918] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.719316 2233 log.cc:1196] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/b9a97e3e6a5749feb4dd5f835d9c01ac
I20260927 15:06:20.722497 2233 ts_tablet_manager.cc:1939] T b9a97e3e6a5749feb4dd5f835d9c01ac P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:20.723361 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1026) took 2819 ms. Trace:
I20260927 15:06:20.723526 2233 rpcz_store.cc:276] 0927 15:06:17.903526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.903612 (+ 86us) service_pool.cc:227] Handling call
0927 15:06:20.694408 (+2790796us) ts_tablet_manager.cc:1145] Deleting tablet b9a97e3e6a5749feb4dd5f835d9c01ac
0927 15:06:20.694445 (+ 37us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.707265 (+ 12820us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.718470 (+ 11205us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.723337 (+ 4867us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2771162}
I20260927 15:06:20.724036 2233 tablet_replica.cc:330] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:20.709295 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_34c904ce85ba45cf9da106351336b517" } new_table_name: "default.Table_ac3e01d1336f4820ab46040eaa4bb4ff" modify_external_catalogs: true
I20260927 15:06:20.723469 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fefd3ef9ef60432db2405746db3ece28" } modify_external_catalogs: true
I20260927 15:06:20.724150 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet b9a97e3e6a5749feb4dd5f835d9c01ac (table default.Table_81fc47a80ea6475cacc27b37367105f4 [id=14db419325464ded9b465782c513f3d7]) successfully deleted
I20260927 15:06:20.727319 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fefd3ef9ef60432db2405746db3ece28" } modify_external_catalogs: true
I20260927 15:06:20.730125 2233 raft_consensus.cc:2229] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.730444 2233 raft_consensus.cc:2258] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.730538 1561 tablet_bootstrap.cc:492] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:20.730782 1561 ts_tablet_manager.cc:1397] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.107s user 0.007s sys 0.006s
I20260927 15:06:20.731392 2233 ts_tablet_manager.cc:1905] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:20.732645 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e1ae6251bc343b0bd0fbf627083ffb9 consensus state has no leader
I20260927 15:06:20.734241 1099 leader_election.cc:302] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:20.734606 3013 raft_consensus.cc:2781] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:20.734730 3013 raft_consensus.cc:686] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:20.735515 1561 raft_consensus.cc:348] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.735857 1561 raft_consensus.cc:374] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.736018 1561 raft_consensus.cc:729] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:20.737053 907 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet b7dd0c66cf704a729e7a8b57db8d341e
I20260927 15:06:20.742933 3012 consensus_queue.cc:1035] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:20.750125 1164 raft_consensus.cc:2454] T 59d852b4adbc47c58db352535923ff49 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:20.751258 1556 tablet_bootstrap.cc:492] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:20.751538 1556 ts_tablet_manager.cc:1397] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.107s user 0.001s sys 0.005s
I20260927 15:06:20.752948 1556 raft_consensus.cc:348] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.754446 1556 raft_consensus.cc:374] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.736406 1561 consensus_queue.cc:260] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.734965 3013 consensus_queue.cc:237] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.755400 1561 ts_tablet_manager.cc:1428] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260927 15:06:20.755645 1561 tablet_bootstrap.cc:492] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:20.755560 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d430acf08a154178b69c4d6f2f4cce5c" } modify_external_catalogs: true
I20260927 15:06:20.755753 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d430acf08a154178b69c4d6f2f4cce5c" } modify_external_catalogs: true
I20260927 15:06:20.755986 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e7bf365b01ff44309a205f3ba9ed6d0a" } new_table_name: "default.Table_3c1f35d7f77541faa816fcfc1c4ecf0a" modify_external_catalogs: true
I20260927 15:06:20.756119 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a534c7930d764771b5f4712ba616bb73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:20.756318 1556 raft_consensus.cc:729] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
W20260927 15:06:20.756654 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a534c7930d764771b5f4712ba616bb73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.757332 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6aff014daf0b4f4486aca13d6a669f20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.757777 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6aff014daf0b4f4486aca13d6a669f20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.756990 1556 consensus_queue.cc:260] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:20.758798 1374 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 66962.3us
I20260927 15:06:20.759601 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fd1cf18051124d5fab0d547ea32c4f4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.760039 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd1cf18051124d5fab0d547ea32c4f4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.760012 1374 leader_election.cc:302] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:20.759864 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 953) took 4192 ms. Trace:
I20260927 15:06:20.761091 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1098d7de1c054e21abb4fe1e91309fd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.761469 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1098d7de1c054e21abb4fe1e91309fd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.760456 1562 rpcz_store.cc:276] 0927 15:06:16.566930 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.569640 (+ 2710us) service_pool.cc:227] Handling call
0927 15:06:19.313499 (+2743859us) ts_tablet_manager.cc:1145] Deleting tablet cad4605da5e045e7969da2d6f56a7e70
0927 15:06:19.313526 (+ 27us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:19.478503 (+164977us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:19.610315 (+131812us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.759846 (+1149531us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3840,"tablet-delete.queue_time_us":2743658}
I20260927 15:06:20.762251 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2c15e29e8a6543c8aa188a5cdb51df2c" } modify_external_catalogs: true
I20260927 15:06:20.762389 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2c15e29e8a6543c8aa188a5cdb51df2c" } modify_external_catalogs: true
I20260927 15:06:20.763331 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet cad4605da5e045e7969da2d6f56a7e70 (table default.Table_dd8f1d71fa7d4665b96954a6d766c9ce [id=672533238895472b9bfb06706e4b41bb]) successfully deleted
I20260927 15:06:20.764818 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 954) took 4083 ms. Trace:
I20260927 15:06:20.765633 1562 rpcz_store.cc:276] 0927 15:06:16.680914 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.681193 (+ 279us) service_pool.cc:227] Handling call
0927 15:06:20.764023 (+4082830us) ts_tablet_manager.cc:1145] Deleting tablet 1d25749db81f4631bbc1e5581bcc666e
0927 15:06:20.764035 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.764633 (+ 598us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4081905}
W20260927 15:06:20.767326 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1d25749db81f4631bbc1e5581bcc666e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d25749db81f4631bbc1e5581bcc666e already in progress: creating tablet
W20260927 15:06:20.768306 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57580db090ad4e4e94a3d22063e57ad4 consensus state has no leader
I20260927 15:06:20.769578 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 955461f27b6444d4b4c3f9a9f629d5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.769419 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 955) took 4083 ms. Trace:
I20260927 15:06:20.769971 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ec640fa361004c6b9085d7a973b5970f" } modify_external_catalogs: true
I20260927 15:06:20.770112 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ec640fa361004c6b9085d7a973b5970f" } modify_external_catalogs: true
I20260927 15:06:20.770323 3036 raft_consensus.cc:2781] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:20.770536 2927 consensus_queue.cc:1035] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:20.770874 3036 raft_consensus.cc:686] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:20.771304 2927 consensus_queue.cc:1035] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:20.771270 3036 consensus_queue.cc:237] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.770206 1562 rpcz_store.cc:276] 0927 15:06:16.686224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.686460 (+ 236us) service_pool.cc:227] Handling call
0927 15:06:20.768041 (+4081581us) ts_tablet_manager.cc:1145] Deleting tablet 476d3f3762a04acaa10f7b910984bec7
0927 15:06:20.768220 (+ 179us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.769400 (+ 1180us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4080722}
I20260927 15:06:20.772588 1099 leader_election.cc:302] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:20.772615 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 476d3f3762a04acaa10f7b910984bec7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 476d3f3762a04acaa10f7b910984bec7 already in progress: creating tablet
I20260927 15:06:20.772805 2927 raft_consensus.cc:2781] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:20.772872 2927 raft_consensus.cc:482] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:20.772938 2927 raft_consensus.cc:3037] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.773170 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 958) took 4072 ms. Trace:
I20260927 15:06:20.774804 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0d667472ee4f1481c213e03403461e with delete_type TABLET_DATA_DELETED (replaced by tablet 0a64059ef2234ad6adbdfd8d3576f2a6) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:20.773980 1562 rpcz_store.cc:276] 0927 15:06:16.700157 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.700319 (+ 162us) service_pool.cc:227] Handling call
0927 15:06:20.772562 (+4072243us) ts_tablet_manager.cc:1145] Deleting tablet c65bc09865bc4a0283eaa4af9f860bdd
0927 15:06:20.772574 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.772982 (+ 408us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4071873}
I20260927 15:06:20.775481 2927 raft_consensus.cc:504] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:20.775844 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c65bc09865bc4a0283eaa4af9f860bdd because the tablet was not found. No further retry: Not found: Tablet not found: c65bc09865bc4a0283eaa4af9f860bdd
I20260927 15:06:20.776983 2927 leader_election.cc:288] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:20.778082 2569 consensus_queue.cc:1035] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:20.777520 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 960) took 4077 ms. Trace:
I20260927 15:06:20.779554 2233 ts_tablet_manager.cc:1918] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.778982 1562 rpcz_store.cc:276] 0927 15:06:16.700377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.700424 (+ 47us) service_pool.cc:227] Handling call
0927 15:06:20.776834 (+4076410us) ts_tablet_manager.cc:1145] Deleting tablet c41cd38355e64590b43b2e1271c43e91
0927 15:06:20.776845 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.777502 (+ 657us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4076139}
I20260927 15:06:20.781083 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 957) took 4080 ms. Trace:
I20260927 15:06:20.781560 1562 rpcz_store.cc:276] 0927 15:06:16.700065 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.700658 (+ 593us) service_pool.cc:227] Handling call
0927 15:06:20.780490 (+4079832us) ts_tablet_manager.cc:1145] Deleting tablet 9049d003d787403f80aa0c08872dd3b5
0927 15:06:20.780501 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.781011 (+ 510us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4079601}
I20260927 15:06:20.782809 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 961) took 4082 ms. Trace:
I20260927 15:06:20.783186 1562 rpcz_store.cc:276] 0927 15:06:16.700464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.700618 (+ 154us) service_pool.cc:227] Handling call
0927 15:06:20.782484 (+4081866us) ts_tablet_manager.cc:1145] Deleting tablet 70cc2e16bd6c40bf99ed4436f17d7096
0927 15:06:20.782494 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.782733 (+ 239us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4081616}
I20260927 15:06:20.784297 1562 tablet_replica.cc:330] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:20.785101 1562 raft_consensus.cc:2229] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:06:20.786113 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet c41cd38355e64590b43b2e1271c43e91 because the tablet was not found. No further retry: Not found: Tablet not found: c41cd38355e64590b43b2e1271c43e91
W20260927 15:06:20.787271 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9049d003d787403f80aa0c08872dd3b5 because the tablet was not found. No further retry: Not found: Tablet not found: 9049d003d787403f80aa0c08872dd3b5
W20260927 15:06:20.787525 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 70cc2e16bd6c40bf99ed4436f17d7096 because the tablet was not found. No further retry: Not found: Tablet not found: 70cc2e16bd6c40bf99ed4436f17d7096
I20260927 15:06:20.791078 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f098ab1277e443c48a72b330ab75eac4" } modify_external_catalogs: true
I20260927 15:06:20.791291 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f098ab1277e443c48a72b330ab75eac4" } modify_external_catalogs: true
I20260927 15:06:20.807973 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9b14f02426df4839b98f012042d8ee9b
W20260927 15:06:20.810004 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 06dbc6029bdd412e91c49d4112feee55 (table default.Table_07ba58159b22421eab89d4c725182a32 [id=d9d9bdad77224374a2bb7de6b1948b2f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 06dbc6029bdd412e91c49d4112feee55 consensus state has no leader
I20260927 15:06:20.813169 1561 tablet_bootstrap.cc:654] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:20.783526 1426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8659865bf644458b3b5a78eae36a524" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:20.819185 2233 log.cc:1196] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/4714d536373a4bf2a4be9ebeaebe77c1
I20260927 15:06:20.800628 1485 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:20.809192 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b14f02426df4839b98f012042d8ee9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:20.819239 1426 raft_consensus.cc:3037] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.819667 2233 ts_tablet_manager.cc:1939] T 4714d536373a4bf2a4be9ebeaebe77c1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:20.819974 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1027) took 2878 ms. Trace:
I20260927 15:06:20.820065 2233 rpcz_store.cc:276] 0927 15:06:17.941305 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.946903 (+ 5598us) service_pool.cc:227] Handling call
0927 15:06:20.723992 (+2777089us) ts_tablet_manager.cc:1145] Deleting tablet 4714d536373a4bf2a4be9ebeaebe77c1
0927 15:06:20.724004 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.766846 (+ 42842us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.779447 (+ 12601us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.819958 (+ 40511us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2776871}
I20260927 15:06:20.820534 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1029) took 2870 ms. Trace:
I20260927 15:06:20.820637 2233 rpcz_store.cc:276] 0927 15:06:17.950385 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.950749 (+ 364us) service_pool.cc:227] Handling call
0927 15:06:20.820383 (+2869634us) ts_tablet_manager.cc:1145] Deleting tablet d25d98b148a94de4bba78a6969e81430
0927 15:06:20.820396 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.820514 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2869405}
I20260927 15:06:20.821008 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1030) took 2870 ms. Trace:
W20260927 15:06:20.821050 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet d25d98b148a94de4bba78a6969e81430 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d25d98b148a94de4bba78a6969e81430 already in progress: creating tablet
I20260927 15:06:20.821098 2233 rpcz_store.cc:276] 0927 15:06:17.950520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.963378 (+ 12858us) service_pool.cc:227] Handling call
0927 15:06:20.820895 (+2857517us) ts_tablet_manager.cc:1145] Deleting tablet 4febf85191d04dd98db55c5730232e1c
0927 15:06:20.820908 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.820992 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2857234}
I20260927 15:06:20.821456 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1032) took 2855 ms. Trace:
W20260927 15:06:20.821501 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 4febf85191d04dd98db55c5730232e1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4febf85191d04dd98db55c5730232e1c already in progress: creating tablet
I20260927 15:06:20.821547 2233 rpcz_store.cc:276] 0927 15:06:17.966356 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.992484 (+ 26128us) service_pool.cc:227] Handling call
0927 15:06:20.821350 (+2828866us) ts_tablet_manager.cc:1145] Deleting tablet 171ba98418b34aa283b7a7b243678fa9
0927 15:06:20.821362 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.821440 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2828670}
I20260927 15:06:20.821816 2233 tablet_replica.cc:330] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:20.821988 2233 raft_consensus.cc:2229] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:20.822027 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 171ba98418b34aa283b7a7b243678fa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 171ba98418b34aa283b7a7b243678fa9 already in progress: creating tablet
I20260927 15:06:20.822178 2233 raft_consensus.cc:2258] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.822198 1426 raft_consensus.cc:2454] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:20.784435 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f95d664f1134ac9bbb62c1a3d4b5617" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:20.822558 1440 raft_consensus.cc:3037] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:20.824669 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b518b0bdc28d4894b2a09ef80c2e8d27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.825382 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b518b0bdc28d4894b2a09ef80c2e8d27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.828208 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7f3a9856266c44c491c1e528ba208be8" } new_table_name: "default.Table_79efc79594f9432ebbfd9f08fc040953" modify_external_catalogs: true
I20260927 15:06:20.828325 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ac3e01d1336f4820ab46040eaa4bb4ff" } new_table_name: "default.Table_458fa28b55d44e0da080b822f3ab6eb9" modify_external_catalogs: true
I20260927 15:06:20.828509 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7363e92dbea54253b766246d2941b7c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.828980 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7363e92dbea54253b766246d2941b7c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.829118 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_382bd6f970f646b1ab7b6f695f39a80f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.829735 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_382bd6f970f646b1ab7b6f695f39a80f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.822794 2233 ts_tablet_manager.cc:1905] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.825732 1440 raft_consensus.cc:2454] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:20.853197 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet dead2d4d5ac243348ecd9eade6ea843f
I20260927 15:06:20.853950 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0c8f72e3b67048b9a9fad7b19b50a42a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.854457 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c8f72e3b67048b9a9fad7b19b50a42a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.857483 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet dead2d4d5ac243348ecd9eade6ea843f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:20.860728 2233 ts_tablet_manager.cc:1918] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:20.862922 2233 log.cc:1196] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/df6d7670381b49bb927943b2ee920c84
I20260927 15:06:20.863376 2233 ts_tablet_manager.cc:1939] T df6d7670381b49bb927943b2ee920c84 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:20.865916 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1031) took 2903 ms. Trace:
W20260927 15:06:20.868187 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e1ae6251bc343b0bd0fbf627083ffb9 consensus state has no leader
I20260927 15:06:20.868625 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c07af699cdab4f7cbedf4ded035a208c" } new_table_name: "default.Table_48dbcdfff99e4463a16af1c5b367ea31" modify_external_catalogs: true
I20260927 15:06:20.869086 2233 rpcz_store.cc:276] 0927 15:06:17.962478 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.974681 (+ 12203us) service_pool.cc:227] Handling call
0927 15:06:20.821776 (+2847095us) ts_tablet_manager.cc:1145] Deleting tablet df6d7670381b49bb927943b2ee920c84
0927 15:06:20.821787 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.842488 (+ 20701us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.860604 (+ 18116us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.865892 (+ 5288us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2796801}
I20260927 15:06:20.869427 2233 tablet_replica.cc:330] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:20.869601 2233 raft_consensus.cc:2229] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.869745 2233 raft_consensus.cc:2258] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.869526 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c8dff83721c444da9087a669433462b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.870179 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8dff83721c444da9087a669433462b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.870251 2233 ts_tablet_manager.cc:1905] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.871863 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_637b66b95fd240b384ff0cf64aa51cd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.872376 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_637b66b95fd240b384ff0cf64aa51cd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.601459 1239 leader_election.cc:302] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:20.874948 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 273505us
I20260927 15:06:20.876132 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet df6d7670381b49bb927943b2ee920c84 (table default.Table_c10827cf92b44050bf8d4dc379b26be3 [id=2125b2fb567a43128346e08a4370ace2]) successfully deleted
I20260927 15:06:20.877295 1293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8659865bf644458b3b5a78eae36a524" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:20.878034 3023 raft_consensus.cc:2726] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:20.878180 3023 raft_consensus.cc:482] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:20.878314 3023 raft_consensus.cc:504] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.878562 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f95d664f1134ac9bbb62c1a3d4b5617" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:20.877188 1292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f8744e2349e49d3a821eca42c7f89a2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:20.633234 1552 tablet_bootstrap.cc:492] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:20.881198 1552 ts_tablet_manager.cc:1397] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.316s user 0.010s sys 0.000s
I20260927 15:06:20.882054 1552 raft_consensus.cc:348] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.882290 1552 raft_consensus.cc:374] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.882339 1552 raft_consensus.cc:729] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:20.882548 1552 consensus_queue.cc:260] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.878861 3023 leader_election.cc:288] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:20.644277 3031 tablet.cc:1722] T 595c84453cd84c3bb5a4d444892bf5e6 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:20.883234 880 master_runner.cc:186] Error getting master registration for 127.0.201.60:46799: OK, instance_id { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" instance_seqno: 1790521579018896 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:06:20.884660 880 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260927 15:06:20.884837 1238 leader_election.cc:341] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 6b1f2143af1142eb9f3dbc777299c186
I20260927 15:06:20.676091 1299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e7439320dd48aba25b5f7dc627964c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:20.678247 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d852b4adbc47c58db352535923ff49" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:20.857121 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet dead2d4d5ac243348ecd9eade6ea843f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.655720 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet afd31e5d011b40c7bfda173a7331ed90 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.808952 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b14f02426df4839b98f012042d8ee9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:20.885594 1376 leader_election.cc:341] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.885727 1376 leader_election.cc:302] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:20.886150 3036 raft_consensus.cc:2726] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:20.886197 1376 leader_election.cc:341] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:20.889797 1552 ts_tablet_manager.cc:1428] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 15:06:20.890725 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b1f2143af1142eb9f3dbc777299c186" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:20.891626 1239 leader_election.cc:302] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:20.891888 3023 raft_consensus.cc:2726] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:20.892967 1556 ts_tablet_manager.cc:1428] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.141s user 0.001s sys 0.001s
I20260927 15:06:20.893373 1556 tablet_bootstrap.cc:492] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:20.895529 1556 tablet_bootstrap.cc:654] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:20.578819 2119 tablet_replica.cc:330] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:20.902155 2119 raft_consensus.cc:2229] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.902221 911 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 595c84453cd84c3bb5a4d444892bf5e6 (table default.Table_c33713f5f5d841b1a1f9e687db26c2e6 [id=06ca630052694f10aebe6f8b7aaa81d9]). Expected version 1 got 0
I20260927 15:06:20.902477 2119 raft_consensus.cc:2258] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.903155 2119 ts_tablet_manager.cc:1905] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.903353 1552 tablet_bootstrap.cc:492] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:20.903831 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 with delete_type TABLET_DATA_DELETED (replaced by tablet 99d4707e599840b3bdc2ab13c348ea80) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.905313 1562 raft_consensus.cc:2258] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:20.906015 1102 consensus_peers.cc:487] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.907007 1562 ts_tablet_manager.cc:1905] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.908120 1552 tablet_bootstrap.cc:654] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:20.914572 1562 ts_tablet_manager.cc:1918] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:20.914755 1562 log.cc:1196] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/66b54ee47e424aacb7f53fd95b0ce889
I20260927 15:06:20.915198 1562 ts_tablet_manager.cc:1939] T 66b54ee47e424aacb7f53fd95b0ce889 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:20.915599 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 959) took 4215 ms. Trace:
I20260927 15:06:20.915882 1562 rpcz_store.cc:276] 0927 15:06:16.700281 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.700821 (+ 540us) service_pool.cc:227] Handling call
0927 15:06:20.784157 (+4083336us) ts_tablet_manager.cc:1145] Deleting tablet 66b54ee47e424aacb7f53fd95b0ce889
0927 15:06:20.784170 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.910153 (+125983us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.914474 (+ 4321us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.915582 (+ 1108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":120239,"tablet-delete.queue_time_us":4083111}
I20260927 15:06:20.916525 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 956) took 4216 ms. Trace:
I20260927 15:06:20.916621 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4cff4a06db44269defca578af289d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.916671 1562 rpcz_store.cc:276] 0927 15:06:16.699951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.700599 (+ 648us) service_pool.cc:227] Handling call
0927 15:06:20.916387 (+4215788us) ts_tablet_manager.cc:1145] Deleting tablet 917b445477c4403980f2fdfeaeab0854
0927 15:06:20.916401 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.916507 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4215343}
I20260927 15:06:20.917112 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 962) took 4216 ms. Trace:
I20260927 15:06:20.917246 1562 rpcz_store.cc:276] 0927 15:06:16.700544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.700586 (+ 42us) service_pool.cc:227] Handling call
0927 15:06:20.917037 (+4216451us) ts_tablet_manager.cc:1145] Deleting tablet 5ca21f240d8d4252b9cf0355c69f7166
0927 15:06:20.917044 (+ 7us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.917101 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4215451}
I20260927 15:06:20.917485 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 66b54ee47e424aacb7f53fd95b0ce889 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.917608 1562 tablet_replica.cc:330] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:20.917883 1562 raft_consensus.cc:2229] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:20.918118 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.918190 1562 pending_rounds.cc:62] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:20.918229 1562 pending_rounds.cc:68] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976377112875008 op_type: NO_OP noop_request { }
I20260927 15:06:20.918426 1562 raft_consensus.cc:2866] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:20.918581 1562 raft_consensus.cc:2258] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.919328 1562 ts_tablet_manager.cc:1905] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.930665 2233 ts_tablet_manager.cc:1918] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.931860 2233 log.cc:1196] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/a8659865bf644458b3b5a78eae36a524
I20260927 15:06:20.932399 2233 ts_tablet_manager.cc:1939] T a8659865bf644458b3b5a78eae36a524 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:20.934185 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1040) took 2770 ms. Trace:
I20260927 15:06:20.934602 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b4fff68c11fb4d929f1b0c412316065f" } new_table_name: "default.Table_a559d7c784e0485bbd41c3a4dfbd34d2" modify_external_catalogs: true
I20260927 15:06:20.934778 2233 rpcz_store.cc:276] 0927 15:06:18.163593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.163660 (+ 67us) service_pool.cc:227] Handling call
0927 15:06:20.869384 (+2705724us) ts_tablet_manager.cc:1145] Deleting tablet a8659865bf644458b3b5a78eae36a524
0927 15:06:20.869396 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.886923 (+ 17527us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.930554 (+ 43631us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.934167 (+ 3613us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2705522}
I20260927 15:06:20.935861 2233 tablet_replica.cc:330] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:20.936049 1552 tablet_bootstrap.cc:492] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:20.936031 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet a8659865bf644458b3b5a78eae36a524 (table default.Table_cf1a116400854111ad696b9bbc4fc97d [id=d6bb694a914342d8b8ae58cf744932fd]) successfully deleted
I20260927 15:06:20.936259 1552 ts_tablet_manager.cc:1397] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.000s
I20260927 15:06:20.937522 1552 raft_consensus.cc:348] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.937845 1552 raft_consensus.cc:374] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.937976 1552 raft_consensus.cc:729] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:20.938027 1099 consensus_peers.cc:487] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb2a8e788b71451da4a18f52b643e5e2. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:20.938244 1099 leader_election.cc:341] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 7f8744e2349e49d3a821eca42c7f89a2
W20260927 15:06:20.938565 1099 consensus_peers.cc:487] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9a97e3e6a5749feb4dd5f835d9c01ac. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.938338 1552 consensus_queue.cc:260] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.939332 1552 ts_tablet_manager.cc:1428] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:20.940596 1552 tablet_bootstrap.cc:492] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:20.945657 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28b6bc8e3a234191807aeec78d368c72 consensus state has no leader
I20260927 15:06:20.949831 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d4ced27460fd468abb680a28e7f9e530" } modify_external_catalogs: true
I20260927 15:06:20.950002 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d4ced27460fd468abb680a28e7f9e530" } modify_external_catalogs: true
I20260927 15:06:20.950838 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet cd76c49eda1c4b4ca0edf0f4d2790188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.956295 1552 tablet_bootstrap.cc:654] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:20.959656 1099 consensus_peers.cc:487] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e19cd7febe054432899739e21605406d. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:20.960080 1099 leader_election.cc:302] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:20.960366 2927 raft_consensus.cc:2781] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:20.960495 2927 raft_consensus.cc:686] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:20.960820 2927 consensus_queue.cc:237] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:20.969668 2119 ts_tablet_manager.cc:1918] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:20.969789 2119 log.cc:1196] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/2c4a123886a847d08b2a94ff5e4e01ca
I20260927 15:06:20.970158 2119 ts_tablet_manager.cc:1939] T 2c4a123886a847d08b2a94ff5e4e01ca P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:20.970952 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1002) took 1471 ms. Trace:
I20260927 15:06:20.971038 2119 rpcz_store.cc:276] 0927 15:06:19.499190 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.503949 (+ 4759us) service_pool.cc:227] Handling call
0927 15:06:20.578776 (+1074827us) ts_tablet_manager.cc:1145] Deleting tablet 2c4a123886a847d08b2a94ff5e4e01ca
0927 15:06:20.578787 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.952212 (+373425us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.969565 (+ 17353us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:20.970935 (+ 1370us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5298,"tablet-delete.queue_time_us":1074629}
I20260927 15:06:20.971446 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1019) took 1263 ms. Trace:
I20260927 15:06:20.971531 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 2c4a123886a847d08b2a94ff5e4e01ca (table default.Table_862695dd435f415a9be8f6394105e76a [id=3415aea6aba444339a381ccdde11e18c]) successfully deleted
I20260927 15:06:20.971525 2119 rpcz_store.cc:276] 0927 15:06:19.708286 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.710955 (+ 2669us) service_pool.cc:227] Handling call
0927 15:06:20.971323 (+1260368us) ts_tablet_manager.cc:1145] Deleting tablet 318e4bf9d50f4fe6858e438ccf2544bf
0927 15:06:20.971333 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.971433 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1260020}
W20260927 15:06:20.972115 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 318e4bf9d50f4fe6858e438ccf2544bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 318e4bf9d50f4fe6858e438ccf2544bf already in progress: creating tablet
I20260927 15:06:20.973578 2233 raft_consensus.cc:2229] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:20.973608 1552 tablet_bootstrap.cc:492] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:20.974002 2233 raft_consensus.cc:2258] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:20.973999 1552 ts_tablet_manager.cc:1397] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260927 15:06:20.974670 2233 ts_tablet_manager.cc:1905] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:20.976330 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_69e7da33db594b0494d614660c3525f8" } new_table_name: "default.Table_abb2a056a859472fb4d4b36dde2ff8d3" modify_external_catalogs: true
I20260927 15:06:20.977126 1099 leader_election.cc:302] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:20.977512 1552 raft_consensus.cc:348] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.977877 1552 raft_consensus.cc:374] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:20.978016 1552 raft_consensus.cc:729] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:20.978336 1552 consensus_queue.cc:260] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:20.980909 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:20.983129 1552 ts_tablet_manager.cc:1428] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260927 15:06:20.984748 1552 tablet_bootstrap.cc:492] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:20.987334 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31b8ad6c423443c7b1ef95dba6273af5 consensus state has no leader
I20260927 15:06:20.971832 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1027) took 1189 ms. Trace:
I20260927 15:06:20.987820 2119 rpcz_store.cc:276] 0927 15:06:19.782026 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.782071 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:20.971735 (+1189664us) ts_tablet_manager.cc:1145] Deleting tablet 9e7f0754b9ba4e21b05c51b0136729d1
0927 15:06:20.971746 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.971818 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189435}
W20260927 15:06:20.991078 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9e7f0754b9ba4e21b05c51b0136729d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e7f0754b9ba4e21b05c51b0136729d1 already in progress: creating tablet
I20260927 15:06:20.992729 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fac46c3377064415bbb90be5ca23da6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:20.993302 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fac46c3377064415bbb90be5ca23da6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:20.993719 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1024) took 1212 ms. Trace:
I20260927 15:06:20.994643 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet cb859b43634c420382da5c201ce24dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:20.994030 2119 rpcz_store.cc:276] 0927 15:06:19.781685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.782196 (+ 511us) service_pool.cc:227] Handling call
0927 15:06:20.991715 (+1209519us) ts_tablet_manager.cc:1145] Deleting tablet 81cc2d5e281648a49fe109a7a00689b3
0927 15:06:20.993516 (+ 1801us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.993679 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209041}
I20260927 15:06:20.996089 1552 tablet_bootstrap.cc:654] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:20.996315 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 81cc2d5e281648a49fe109a7a00689b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81cc2d5e281648a49fe109a7a00689b3 already in progress: creating tablet
I20260927 15:06:20.997922 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1025) took 1215 ms. Trace:
I20260927 15:06:20.998795 2119 rpcz_store.cc:276] 0927 15:06:19.781851 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.782228 (+ 377us) service_pool.cc:227] Handling call
0927 15:06:20.996916 (+1214688us) ts_tablet_manager.cc:1145] Deleting tablet 13acfcbc13204b2f9edb0f557a62252e
0927 15:06:20.997117 (+ 201us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.997665 (+ 548us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1214288}
W20260927 15:06:21.000969 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 13acfcbc13204b2f9edb0f557a62252e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13acfcbc13204b2f9edb0f557a62252e already in progress: creating tablet
I20260927 15:06:21.003182 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a7dd25df190042b99672a95502aa1b2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:21.004614 2233 ts_tablet_manager.cc:1918] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.004768 2233 log.cc:1196] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/8d533883e3344eca939cd67644895148
I20260927 15:06:21.005134 2233 ts_tablet_manager.cc:1939] T 8d533883e3344eca939cd67644895148 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.004066 2119 tablet_replica.cc:330] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:21.005467 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1045) took 2699 ms. Trace:
I20260927 15:06:21.005548 2233 rpcz_store.cc:276] 0927 15:06:18.306490 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.306539 (+ 49us) service_pool.cc:227] Handling call
0927 15:06:20.935816 (+2629277us) ts_tablet_manager.cc:1145] Deleting tablet 8d533883e3344eca939cd67644895148
0927 15:06:20.935826 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:20.973903 (+ 38077us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x61500031d1a4. stack: 00007f26d729d66e 00007f26d729d430 00007f26d63245ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f26e27d904d 00007f26e3a7d5ec 00007f26e640c2e6 00007f26e643e404 00007f26e641f870 00007f26e641f5fd 00000000009edb7c 00007f26d72e3344 00007f26d72e691b 00007f26d72e6798
0927 15:06:20.979532 (+ 5629us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.004500 (+ 24968us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.005446 (+ 946us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":79789952,"tablet-delete.queue_time_us":2629033}
W20260927 15:06:21.006456 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7dd25df190042b99672a95502aa1b2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:21.007055 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1053) took 2480 ms. Trace:
I20260927 15:06:21.007236 2233 rpcz_store.cc:276] 0927 15:06:18.527044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.527097 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:21.006457 (+2479360us) ts_tablet_manager.cc:1145] Deleting tablet b0b25e485f3d4e6780cd34d9e13fa807
0927 15:06:21.006468 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.007035 (+ 567us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2479080}
I20260927 15:06:21.007623 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1055) took 2479 ms. Trace:
I20260927 15:06:21.007731 2233 rpcz_store.cc:276] 0927 15:06:18.528128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.528195 (+ 67us) service_pool.cc:227] Handling call
0927 15:06:21.007508 (+2479313us) ts_tablet_manager.cc:1145] Deleting tablet 35a09718f15147f59575a7ea6f24573b
0927 15:06:21.007518 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.007608 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2479066}
I20260927 15:06:21.007784 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 8d533883e3344eca939cd67644895148 (table default.Table_d072149ddba94cff935fb906dcf0524c [id=ba95aca9e7c449bd8fe939e896ab1ba5]) successfully deleted
W20260927 15:06:21.008004 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b0b25e485f3d4e6780cd34d9e13fa807 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0b25e485f3d4e6780cd34d9e13fa807 already in progress: creating tablet
W20260927 15:06:21.008432 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 35a09718f15147f59575a7ea6f24573b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35a09718f15147f59575a7ea6f24573b already in progress: creating tablet
I20260927 15:06:21.008188 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1056) took 2479 ms. Trace:
I20260927 15:06:21.008055 2119 raft_consensus.cc:2229] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.008625 2233 rpcz_store.cc:276] 0927 15:06:18.528359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.528406 (+ 47us) service_pool.cc:227] Handling call
0927 15:06:21.008031 (+2479625us) ts_tablet_manager.cc:1145] Deleting tablet bc47ec18419c42c5bf64a3a9a414d771
0927 15:06:21.008043 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.008156 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2479456}
I20260927 15:06:21.009935 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1054) took 2482 ms. Trace:
I20260927 15:06:21.010130 2233 rpcz_store.cc:276] 0927 15:06:18.527931 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.528598 (+ 667us) service_pool.cc:227] Handling call
0927 15:06:21.008964 (+2480366us) ts_tablet_manager.cc:1145] Deleting tablet 832bf0ee6cbf4c639d2ea569c565ca20
0927 15:06:21.008975 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.009916 (+ 941us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2480245}
I20260927 15:06:21.009876 2119 raft_consensus.cc:2258] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.010892 2233 tablet_replica.cc:330] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.011250 2233 raft_consensus.cc:2229] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:21.011813 2233 raft_consensus.cc:2258] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.011952 1556 tablet_bootstrap.cc:492] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
W20260927 15:06:21.011984 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bc47ec18419c42c5bf64a3a9a414d771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc47ec18419c42c5bf64a3a9a414d771 already in progress: creating tablet
I20260927 15:06:21.012089 1556 ts_tablet_manager.cc:1397] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.119s user 0.003s sys 0.000s
W20260927 15:06:21.012199 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 832bf0ee6cbf4c639d2ea569c565ca20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 832bf0ee6cbf4c639d2ea569c565ca20 already in progress: creating tablet
I20260927 15:06:21.012741 2233 ts_tablet_manager.cc:1905] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.012867 1556 raft_consensus.cc:348] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.013123 1556 raft_consensus.cc:374] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.013190 1556 raft_consensus.cc:729] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.013446 1556 consensus_queue.cc:260] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.014178 1556 ts_tablet_manager.cc:1428] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:21.014480 1556 tablet_bootstrap.cc:492] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:21.015146 2119 ts_tablet_manager.cc:1905] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.019809 2233 ts_tablet_manager.cc:1918] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.019972 2233 log.cc:1196] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/9ae003f1ca76472cbaa8b577b66fe84c
I20260927 15:06:21.020370 2233 ts_tablet_manager.cc:1939] T 9ae003f1ca76472cbaa8b577b66fe84c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.020713 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1057) took 2442 ms. Trace:
I20260927 15:06:21.020844 2233 rpcz_store.cc:276] 0927 15:06:18.578143 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.578199 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:21.010809 (+2432610us) ts_tablet_manager.cc:1145] Deleting tablet 9ae003f1ca76472cbaa8b577b66fe84c
0927 15:06:21.010862 (+ 53us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.016449 (+ 5587us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.019733 (+ 3284us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.020698 (+ 965us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2432437}
I20260927 15:06:21.021349 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1058) took 2302 ms. Trace:
I20260927 15:06:21.021407 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 9ae003f1ca76472cbaa8b577b66fe84c (table default.Table_9cb03ce349ee4cefa2a1b109f59c75ee [id=8e5ae781d15d48f7924076fea8d3d292]) successfully deleted
I20260927 15:06:21.021471 2233 rpcz_store.cc:276] 0927 15:06:18.718867 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.718931 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:21.021196 (+2302265us) ts_tablet_manager.cc:1145] Deleting tablet f052aaaa3793455bb19d7cceb4e127c4
0927 15:06:21.021206 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.021333 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2302036}
I20260927 15:06:21.021737 2233 tablet_replica.cc:330] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.021981 2233 raft_consensus.cc:2229] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:06:21.021972 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f052aaaa3793455bb19d7cceb4e127c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f052aaaa3793455bb19d7cceb4e127c4 already in progress: creating tablet
I20260927 15:06:21.022269 2233 pending_rounds.cc:62] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:21.022475 2233 pending_rounds.cc:68] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976388389588992 op_type: NO_OP noop_request { }
I20260927 15:06:21.022655 2233 raft_consensus.cc:2866] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:21.022799 2233 raft_consensus.cc:2258] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.023392 2233 ts_tablet_manager.cc:1905] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.023988 1552 tablet_bootstrap.cc:492] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.024540 1552 ts_tablet_manager.cc:1397] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.000s
I20260927 15:06:21.029924 2233 ts_tablet_manager.cc:1918] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.030117 2233 log.cc:1196] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/1ba163e0f6164d65b09da684ee4872e0
I20260927 15:06:21.030550 2233 ts_tablet_manager.cc:1939] T 1ba163e0f6164d65b09da684ee4872e0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.031422 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1060) took 1875 ms. Trace:
I20260927 15:06:21.031566 2233 rpcz_store.cc:276] 0927 15:06:19.156142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.156200 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:21.021699 (+1865499us) ts_tablet_manager.cc:1145] Deleting tablet 1ba163e0f6164d65b09da684ee4872e0
0927 15:06:21.021710 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.027038 (+ 5328us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.029840 (+ 2802us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.031405 (+ 1565us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1865313}
I20260927 15:06:21.031967 2233 tablet_replica.cc:330] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.032212 2233 raft_consensus.cc:2229] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.032196 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 1ba163e0f6164d65b09da684ee4872e0 (table default.Table_df75a53e443d434aaa888fab1ad38e36 [id=935f8397667e4d338a12c98850a26789]) successfully deleted
I20260927 15:06:21.032414 2233 raft_consensus.cc:2258] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.032927 2233 ts_tablet_manager.cc:1905] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.033116 3023 raft_consensus.cc:482] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.033246 3023 raft_consensus.cc:504] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.033878 3023 leader_election.cc:288] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:21.035001 1239 leader_election.cc:341] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 66b54ee47e424aacb7f53fd95b0ce889
I20260927 15:06:21.038655 2233 ts_tablet_manager.cc:1918] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.038818 2233 log.cc:1196] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/ac64eacc7d924940aacc8779b5bfeae7
I20260927 15:06:21.039199 2233 ts_tablet_manager.cc:1939] T ac64eacc7d924940aacc8779b5bfeae7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.041152 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1061) took 1884 ms. Trace:
I20260927 15:06:21.041291 2233 rpcz_store.cc:276] 0927 15:06:19.156275 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.158035 (+ 1760us) service_pool.cc:227] Handling call
0927 15:06:21.031924 (+1873889us) ts_tablet_manager.cc:1145] Deleting tablet ac64eacc7d924940aacc8779b5bfeae7
0927 15:06:21.031937 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.035838 (+ 3901us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.038585 (+ 2747us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.041135 (+ 2550us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1873735}
I20260927 15:06:21.041671 2233 tablet_replica.cc:330] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.041888 2233 raft_consensus.cc:2229] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.042078 2233 raft_consensus.cc:2258] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.042625 2233 ts_tablet_manager.cc:1905] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.043933 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet ac64eacc7d924940aacc8779b5bfeae7 (table default.Table_a26bdbe66d9a438ab4a3a6cf93fbe430 [id=10a0f9e80795470996770db15c99a546]) successfully deleted
I20260927 15:06:21.051404 2233 ts_tablet_manager.cc:1918] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.051594 2233 log.cc:1196] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/955461f27b6444d4b4c3f9a9f629d5e3
I20260927 15:06:21.052170 2233 ts_tablet_manager.cc:1939] T 955461f27b6444d4b4c3f9a9f629d5e3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.052711 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1062) took 1895 ms. Trace:
I20260927 15:06:21.053098 2233 rpcz_store.cc:276] 0927 15:06:19.156892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.162512 (+ 5620us) service_pool.cc:227] Handling call
0927 15:06:21.041630 (+1879118us) ts_tablet_manager.cc:1145] Deleting tablet 955461f27b6444d4b4c3f9a9f629d5e3
0927 15:06:21.041640 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.045965 (+ 4325us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.051321 (+ 5356us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.052687 (+ 1366us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1878965}
I20260927 15:06:21.054298 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 955461f27b6444d4b4c3f9a9f629d5e3 (table default.Table_effad7577e2d439c8426666a6d741a88 [id=e0720391578a4511b5393a5d332985ce]) successfully deleted
I20260927 15:06:21.055282 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1059) took 1899 ms. Trace:
I20260927 15:06:21.055676 2233 rpcz_store.cc:276] 0927 15:06:19.156025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.162818 (+ 6793us) service_pool.cc:227] Handling call
0927 15:06:21.054886 (+1892068us) ts_tablet_manager.cc:1145] Deleting tablet 3042c17580d54082971b761433a7dca9
0927 15:06:21.054900 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.055260 (+ 360us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1891763}
W20260927 15:06:21.056711 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3042c17580d54082971b761433a7dca9 because the tablet was not found. No further retry: Not found: Tablet not found: 3042c17580d54082971b761433a7dca9
I20260927 15:06:21.057425 2233 tablet_replica.cc:330] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.058349 2233 raft_consensus.cc:2229] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.058987 2233 raft_consensus.cc:2258] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.059794 2927 raft_consensus.cc:2781] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:21.059988 2927 raft_consensus.cc:686] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:21.060307 2927 consensus_queue.cc:237] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.062605 2233 ts_tablet_manager.cc:1905] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.064764 2119 ts_tablet_manager.cc:1918] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.064888 2119 log.cc:1196] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/a19c9cc5859f49a58a35460e504b3f84
I20260927 15:06:21.065214 2119 ts_tablet_manager.cc:1939] T a19c9cc5859f49a58a35460e504b3f84 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:21.065955 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1026) took 1284 ms. Trace:
I20260927 15:06:21.066049 2119 rpcz_store.cc:276] 0927 15:06:19.781951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.782571 (+ 620us) service_pool.cc:227] Handling call
0927 15:06:21.001423 (+1218852us) ts_tablet_manager.cc:1145] Deleting tablet a19c9cc5859f49a58a35460e504b3f84
0927 15:06:21.001435 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.046669 (+ 45234us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.064672 (+ 18003us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.065934 (+ 1262us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1218444}
I20260927 15:06:21.066458 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet a19c9cc5859f49a58a35460e504b3f84 (table default.Table_d824f1399fb8451dad058a93321740ce [id=7fc0363b53f4466f9e6320ea6750aec3]) successfully deleted
I20260927 15:06:21.069061 1552 raft_consensus.cc:348] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.071787 1552 raft_consensus.cc:374] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.072552 1552 raft_consensus.cc:729] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.073928 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1029) took 1287 ms. Trace:
I20260927 15:06:21.076360 2119 rpcz_store.cc:276] 0927 15:06:19.786499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.786571 (+ 72us) service_pool.cc:227] Handling call
0927 15:06:21.066337 (+1279766us) ts_tablet_manager.cc:1145] Deleting tablet a6852cc3f94a40779799beb772b3d34d
0927 15:06:21.066347 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.073911 (+ 7564us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1279547}
I20260927 15:06:21.076936 2119 tablet_replica.cc:330] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
W20260927 15:06:21.077148 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a6852cc3f94a40779799beb772b3d34d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6852cc3f94a40779799beb772b3d34d already in progress: creating tablet
I20260927 15:06:21.077407 2119 raft_consensus.cc:2229] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.074570 1552 consensus_queue.cc:260] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.077872 2119 pending_rounds.cc:62] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:21.077926 2119 pending_rounds.cc:68] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976376742383616 op_type: NO_OP noop_request { }
I20260927 15:06:21.078054 2119 raft_consensus.cc:2866] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:21.078184 2119 raft_consensus.cc:2258] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.085008 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 66b54ee47e424aacb7f53fd95b0ce889 (table default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]) successfully deleted
W20260927 15:06:21.085248 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 917b445477c4403980f2fdfeaeab0854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 917b445477c4403980f2fdfeaeab0854 already in progress: creating tablet
W20260927 15:06:21.085451 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 5ca21f240d8d4252b9cf0355c69f7166 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ca21f240d8d4252b9cf0355c69f7166 already in progress: creating tablet
I20260927 15:06:21.086398 1552 ts_tablet_manager.cc:1428] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.054s user 0.003s sys 0.000s
I20260927 15:06:21.088423 3070 tablet.cc:1722] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260927 15:06:21.091506 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 185288us
W20260927 15:06:21.093639 1102 consensus_peers.cc:487] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:21.094159 1102 leader_election.cc:341] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.094796 1552 tablet_bootstrap.cc:492] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.100553 2233 ts_tablet_manager.cc:1918] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.100816 2233 log.cc:1196] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/769e9b5c08cd44cc8a0d681500d64f54
I20260927 15:06:21.101302 2233 ts_tablet_manager.cc:1939] T 769e9b5c08cd44cc8a0d681500d64f54 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.101316 2119 ts_tablet_manager.cc:1905] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.102643 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1069) took 1823 ms. Trace:
I20260927 15:06:21.102865 2233 rpcz_store.cc:276] 0927 15:06:19.278929 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.278995 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:21.057277 (+1778282us) ts_tablet_manager.cc:1145] Deleting tablet 769e9b5c08cd44cc8a0d681500d64f54
0927 15:06:21.057292 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.088850 (+ 31558us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.100389 (+ 11539us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.102624 (+ 2235us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1777939}
I20260927 15:06:21.103516 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 769e9b5c08cd44cc8a0d681500d64f54 (table default.Table_144247c8f6c749539a8c431dd3e74d17 [id=e8ef09e7d3114b19a5e62a4ff883166e]) successfully deleted
I20260927 15:06:21.104107 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1063) took 1825 ms. Trace:
I20260927 15:06:21.104329 2233 rpcz_store.cc:276] 0927 15:06:19.278387 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.279348 (+ 961us) service_pool.cc:227] Handling call
0927 15:06:21.103887 (+1824539us) ts_tablet_manager.cc:1145] Deleting tablet eed526a0500c4f098719c74dd74975c6
0927 15:06:21.103898 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.104082 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1824349}
I20260927 15:06:21.105031 1552 tablet_bootstrap.cc:654] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:21.105042 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet eed526a0500c4f098719c74dd74975c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eed526a0500c4f098719c74dd74975c6 already in progress: creating tablet
I20260927 15:06:21.105655 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1065) took 1827 ms. Trace:
I20260927 15:06:21.105877 2233 rpcz_store.cc:276] 0927 15:06:19.278580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.279601 (+ 1021us) service_pool.cc:227] Handling call
0927 15:06:21.105434 (+1825833us) ts_tablet_manager.cc:1145] Deleting tablet 85e8909687fb40fdbccad15cd99b6eaf
0927 15:06:21.105448 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.105635 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1825673}
W20260927 15:06:21.106432 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 85e8909687fb40fdbccad15cd99b6eaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85e8909687fb40fdbccad15cd99b6eaf already in progress: creating tablet
W20260927 15:06:21.106812 1238 leader_election.cc:341] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 66b54ee47e424aacb7f53fd95b0ce889
I20260927 15:06:21.107092 1238 leader_election.cc:302] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.107131 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1064) took 1828 ms. Trace:
I20260927 15:06:21.107261 2233 rpcz_store.cc:276] 0927 15:06:19.278499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.279543 (+ 1044us) service_pool.cc:227] Handling call
0927 15:06:21.106928 (+1827385us) ts_tablet_manager.cc:1145] Deleting tablet 72862763900249b8a7079fde891d8021
0927 15:06:21.106944 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.107092 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1826818}
I20260927 15:06:21.107614 3023 raft_consensus.cc:2726] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:21.107823 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 72862763900249b8a7079fde891d8021 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72862763900249b8a7079fde891d8021 already in progress: creating tablet
I20260927 15:06:21.107966 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_630d1e22ffd640d5b7d2221a21e388b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:21.108283 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1067) took 1829 ms. Trace:
I20260927 15:06:21.108402 2233 rpcz_store.cc:276] 0927 15:06:19.278748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.280004 (+ 1256us) service_pool.cc:227] Handling call
0927 15:06:21.108137 (+1828133us) ts_tablet_manager.cc:1145] Deleting tablet 1dfbe94faecb4c6a9bea043a4b0f6361
0927 15:06:21.108147 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.108268 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1827968}
W20260927 15:06:21.108565 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_630d1e22ffd640d5b7d2221a21e388b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:21.108867 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1dfbe94faecb4c6a9bea043a4b0f6361 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dfbe94faecb4c6a9bea043a4b0f6361 already in progress: creating tablet
I20260927 15:06:21.109318 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1068) took 1830 ms. Trace:
I20260927 15:06:21.109445 2233 rpcz_store.cc:276] 0927 15:06:19.278846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.280175 (+ 1329us) service_pool.cc:227] Handling call
0927 15:06:21.109170 (+1828995us) ts_tablet_manager.cc:1145] Deleting tablet 9d8fd588fe344e819f13aadb33e26153
0927 15:06:21.109180 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.109300 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1828797}
W20260927 15:06:21.109982 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9d8fd588fe344e819f13aadb33e26153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d8fd588fe344e819f13aadb33e26153 already in progress: creating tablet
I20260927 15:06:21.110037 2119 ts_tablet_manager.cc:1918] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.110152 2119 log.cc:1196] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/278205071701447e8ee7457b2ee84be4
I20260927 15:06:21.110525 2119 ts_tablet_manager.cc:1939] T 278205071701447e8ee7457b2ee84be4 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:21.110507 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1070) took 1831 ms. Trace:
I20260927 15:06:21.110692 2233 rpcz_store.cc:276] 0927 15:06:19.279027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.280376 (+ 1349us) service_pool.cc:227] Handling call
0927 15:06:21.110311 (+1829935us) ts_tablet_manager.cc:1145] Deleting tablet 0163a49d9a894953905e20941878400b
0927 15:06:21.110349 (+ 38us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.110488 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1829801}
I20260927 15:06:21.111269 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1030) took 1324 ms. Trace:
W20260927 15:06:21.111296 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0163a49d9a894953905e20941878400b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0163a49d9a894953905e20941878400b already in progress: creating tablet
I20260927 15:06:21.111346 2119 rpcz_store.cc:276] 0927 15:06:19.787272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.787322 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:21.076890 (+1289568us) ts_tablet_manager.cc:1145] Deleting tablet 278205071701447e8ee7457b2ee84be4
0927 15:06:21.076900 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.106039 (+ 29139us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.109956 (+ 3917us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.111252 (+ 1296us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1289400}
I20260927 15:06:21.111711 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 278205071701447e8ee7457b2ee84be4 (table default.Table_b3d8c342ab564cf8a14311ab99ac9615 [id=550aebac3b894a95ae6482fd0b422a8c]) successfully deleted
I20260927 15:06:21.111948 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1076) took 1747 ms. Trace:
I20260927 15:06:21.112188 2233 rpcz_store.cc:276] 0927 15:06:19.364546 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.366767 (+ 2221us) service_pool.cc:227] Handling call
0927 15:06:21.111771 (+1745004us) ts_tablet_manager.cc:1145] Deleting tablet 512a2f4e3c3f479daba37eb1ca0d463b
0927 15:06:21.111805 (+ 34us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.111896 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1744731}
W20260927 15:06:21.112699 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 512a2f4e3c3f479daba37eb1ca0d463b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 512a2f4e3c3f479daba37eb1ca0d463b already in progress: creating tablet
I20260927 15:06:21.113098 2233 tablet_replica.cc:330] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.113560 2233 raft_consensus.cc:2229] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.113875 2233 raft_consensus.cc:2258] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.114816 2233 ts_tablet_manager.cc:1905] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.114899 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1040) took 1101 ms. Trace:
I20260927 15:06:21.115012 2119 rpcz_store.cc:276] 0927 15:06:20.013919 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:20.013983 (+ 64us) service_pool.cc:227] Handling call
0927 15:06:21.114770 (+1100787us) ts_tablet_manager.cc:1145] Deleting tablet 2b02006875534bdb86ffccee52bca32b
0927 15:06:21.114781 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.114883 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1100545}
W20260927 15:06:21.116240 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2b02006875534bdb86ffccee52bca32b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b02006875534bdb86ffccee52bca32b already in progress: creating tablet
I20260927 15:06:21.116654 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1037) took 1190 ms. Trace:
W20260927 15:06:21.117352 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46423c50fa7144f7a299765cd476bb18 has no consensus state
I20260927 15:06:21.117307 3023 raft_consensus.cc:482] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.117818 3023 raft_consensus.cc:504] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.118522 3023 leader_election.cc:288] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.117692 1552 tablet_bootstrap.cc:492] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.119365 1552 ts_tablet_manager.cc:1397] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.001s
I20260927 15:06:21.120263 1552 raft_consensus.cc:348] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.120545 1552 raft_consensus.cc:374] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.120628 1552 raft_consensus.cc:729] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:21.121165 1238 leader_election.cc:341] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 5e9b07ea3ec9457399e2b765580d06e7
I20260927 15:06:21.121338 1552 consensus_queue.cc:260] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:21.123359 1102 leader_election.cc:341] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:21.123675 1102 leader_election.cc:341] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.123871 1102 leader_election.cc:302] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.124156 2233 ts_tablet_manager.cc:1918] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.124480 2233 log.cc:1196] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/79a3125723034cb48bc1a05fc4abbb82
I20260927 15:06:21.124627 3012 raft_consensus.cc:2726] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.125094 2233 ts_tablet_manager.cc:1939] T 79a3125723034cb48bc1a05fc4abbb82 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:21.095808 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 118168us
I20260927 15:06:21.108561 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b14f02426df4839b98f012042d8ee9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:21.111567 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet dead2d4d5ac243348ecd9eade6ea843f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:21.126885 3068 raft_consensus.cc:482] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.127070 3068 raft_consensus.cc:504] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.127662 3068 leader_election.cc:288] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.114310 1561 tablet_bootstrap.cc:492] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:21.128661 1561 ts_tablet_manager.cc:1397] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.373s user 0.006s sys 0.008s
I20260927 15:06:21.127085 1211 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:21.138574 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1077) took 1773 ms. Trace:
I20260927 15:06:21.139120 2233 rpcz_store.cc:276] 0927 15:06:19.364689 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.364760 (+ 71us) service_pool.cc:227] Handling call
0927 15:06:21.112986 (+1748226us) ts_tablet_manager.cc:1145] Deleting tablet 79a3125723034cb48bc1a05fc4abbb82
0927 15:06:21.112997 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.119544 (+ 6547us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.124011 (+ 4467us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.138315 (+ 14304us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1745744}
I20260927 15:06:21.140372 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 79a3125723034cb48bc1a05fc4abbb82 (table default.Table_9a6330b2000f4bb5a7817b924f99ad53 [id=09a85e91664d444eab58b705a3be138d]) successfully deleted
I20260927 15:06:21.140803 2233 tablet_replica.cc:330] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.141680 2233 raft_consensus.cc:2229] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.142370 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ebda84dc8d2e4e3fa11fee32f4a35223"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:21.142760 2233 raft_consensus.cc:2258] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.143426 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 with delete_type TABLET_DATA_DELETED (replaced by tablet b2d2501a9f764790818426665e7f0340) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:21.143610 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebda84dc8d2e4e3fa11fee32f4a35223 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:21.145823 2233 ts_tablet_manager.cc:1905] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.139135 1561 raft_consensus.cc:348] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.146435 1561 raft_consensus.cc:374] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.146528 1561 raft_consensus.cc:729] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.146765 1561 consensus_queue.cc:260] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.146181 3078 tablet.cc:1722] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:21.146315 3079 tablet.cc:1722] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:21.147655 1561 ts_tablet_manager.cc:1428] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260927 15:06:21.148147 1561 tablet_bootstrap.cc:492] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:21.150863 1552 ts_tablet_manager.cc:1428] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20260927 15:06:21.153338 3070 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:60504 (request call id 1112) took 1263 ms. Trace:
I20260927 15:06:21.153522 3070 rpcz_store.cc:276] 0927 15:06:19.889500 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.983066 (+ 93566us) service_pool.cc:227] Handling call
0927 15:06:21.153283 (+1170217us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:19.983458 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0927 15:06:19.983578 (+ 120us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0927 15:06:19.983588 (+ 10us) alter_schema_op.cc:65] Acquired schema lock
0927 15:06:19.983594 (+ 6us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0927 15:06:19.983630 (+ 36us) alter_schema_op.cc:126] START. Timestamp: 1790521579983598
0927 15:06:19.983633 (+ 3us) op_driver.cc:331] REPLICATION: starting
0927 15:06:19.983826 (+ 193us) log.cc:842] Serialized 173 byte log entry
0927 15:06:21.084631 (+1100805us) op_driver.cc:444] REPLICATION: finished
0927 15:06:21.088305 (+ 3674us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0927 15:06:21.090700 (+ 2395us) log.cc:842] Serialized 5 byte log entry
0927 15:06:21.152704 (+ 62004us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.152969 (+ 265us) log.cc:842] Serialized 14 byte log entry
0927 15:06:21.153213 (+ 244us) alter_schema_op.cc:71] Released schema lock
0927 15:06:21.153217 (+ 4us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3522,"prepare.queue_time_us":37,"prepare.run_cpu_time_us":30516,"prepare.run_wall_time_us":382132,"raft.queue_time_us":33,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":1100968,"thread_start_us":403637,"threads_started":2,"wal-append.queue_time_us":290644}]]}
W20260927 15:06:21.159487 1099 leader_election.cc:341] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 955461f27b6444d4b4c3f9a9f629d5e3
I20260927 15:06:21.161659 3081 tablet.cc:1722] T bd5b041a4274477895e88d4822b91cca P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:21.163264 1561 tablet_bootstrap.cc:654] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.166632 3070 tablet.cc:1722] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260927 15:06:21.168080 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 43549.4us
I20260927 15:06:21.169443 1304 raft_consensus.cc:3037] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:21.174206 2233 ts_tablet_manager.cc:1918] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.174373 2233 log.cc:1196] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/efa42545da374ca989199433ce1284c3
I20260927 15:06:21.174789 2233 ts_tablet_manager.cc:1939] T efa42545da374ca989199433ce1284c3 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.176151 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1079) took 1782 ms. Trace:
I20260927 15:06:21.176309 2233 rpcz_store.cc:276] 0927 15:06:19.393434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.393702 (+ 268us) service_pool.cc:227] Handling call
0927 15:06:21.140406 (+1746704us) ts_tablet_manager.cc:1145] Deleting tablet efa42545da374ca989199433ce1284c3
0927 15:06:21.140420 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.167795 (+ 27375us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.174067 (+ 6272us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.176103 (+ 2036us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1746418}
I20260927 15:06:21.176775 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet efa42545da374ca989199433ce1284c3 (table default.Table_68376a56de55491a97cd372ac2473b62 [id=6d1dd8371c594833aab5bf7dfc193107]) successfully deleted
I20260927 15:06:21.176833 1552 tablet_bootstrap.cc:492] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.177143 2233 tablet_replica.cc:330] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.177393 2233 raft_consensus.cc:2229] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.177678 2233 raft_consensus.cc:2258] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.177770 2119 rpcz_store.cc:276] 0927 15:06:19.926642 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:20.102235 (+175593us) service_pool.cc:227] Handling call
0927 15:06:21.116541 (+1014306us) ts_tablet_manager.cc:1145] Deleting tablet 24a592ebe7db4f36bd2819f6864436ea
0927 15:06:21.116552 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.116635 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1014058}
W20260927 15:06:21.178246 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 24a592ebe7db4f36bd2819f6864436ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24a592ebe7db4f36bd2819f6864436ea already in progress: creating tablet
I20260927 15:06:21.178580 2233 ts_tablet_manager.cc:1905] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.181584 3012 raft_consensus.cc:482] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.181767 3012 raft_consensus.cc:504] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.182536 3012 leader_election.cc:288] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:21.182598 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1e84d99880494324b802b659e0590170 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e84d99880494324b802b659e0590170 already in progress: creating tablet
I20260927 15:06:21.183049 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9b07ea3ec9457399e2b765580d06e7" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:21.183372 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet cc91a17a72de4ced8d3f7519430d44b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc91a17a72de4ced8d3f7519430d44b5 already in progress: creating tablet
I20260927 15:06:21.184324 1552 tablet_bootstrap.cc:654] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.185181 1239 leader_election.cc:302] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:21.186033 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet e5d924a79fa2493795abda6ffbbd11b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5d924a79fa2493795abda6ffbbd11b5 already in progress: creating tablet
W20260927 15:06:21.186523 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0e0d5f68e5b4bccb59ca2c31efdc60f already in progress: creating tablet
I20260927 15:06:21.187068 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet f271c76b5f2447239d3d014fbde4e8b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:21.187326 2119 tablet_replica.cc:330] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:21.187515 2119 raft_consensus.cc:2229] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.193503 2119 raft_consensus.cc:2258] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.194093 2119 ts_tablet_manager.cc:1905] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.200275 1561 tablet_bootstrap.cc:492] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:21.200476 1561 ts_tablet_manager.cc:1397] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.000s
I20260927 15:06:21.201149 1561 raft_consensus.cc:348] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.201411 1561 raft_consensus.cc:374] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.201529 1561 raft_consensus.cc:729] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.201802 1561 consensus_queue.cc:260] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.202814 1561 ts_tablet_manager.cc:1428] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:21.202979 2233 ts_tablet_manager.cc:1918] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.203308 1561 tablet_bootstrap.cc:492] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:21.204197 2233 log.cc:1196] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/089b6b5ac39d49fea744240261a8010e
I20260927 15:06:21.204762 2233 ts_tablet_manager.cc:1939] T 089b6b5ac39d49fea744240261a8010e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.205726 3073 raft_consensus.cc:482] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.205895 3073 raft_consensus.cc:504] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.206532 3073 leader_election.cc:288] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.206724 3036 raft_consensus.cc:482] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.206915 3036 raft_consensus.cc:504] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.207698 3036 leader_election.cc:288] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:21.208164 1299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fff31ceb379400bbfa4586c749e6d6e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:21.208956 3070 tablet.cc:1717] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c: Skipping requested alter to schema version 3, tablet already version 3
I20260927 15:06:21.209538 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955461f27b6444d4b4c3f9a9f629d5e3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:21.209965 1376 leader_election.cc:341] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.213790 1561 tablet_bootstrap.cc:654] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.216432 1552 tablet_bootstrap.cc:492] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.216560 1552 ts_tablet_manager.cc:1397] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.003s
I20260927 15:06:21.217073 3070 tablet.cc:1722] T 1ef93a120f00423d91664ce4eaf03803 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:21.217443 1552 raft_consensus.cc:348] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.217653 1552 raft_consensus.cc:374] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.217720 1552 raft_consensus.cc:729] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.217979 1552 consensus_queue.cc:260] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.218540 1552 ts_tablet_manager.cc:1428] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260927 15:06:21.218791 1552 tablet_bootstrap.cc:492] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.219468 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1082) took 1825 ms. Trace:
I20260927 15:06:21.219620 2233 rpcz_store.cc:276] 0927 15:06:19.393666 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.393765 (+ 99us) service_pool.cc:227] Handling call
0927 15:06:21.177065 (+1783300us) ts_tablet_manager.cc:1145] Deleting tablet 089b6b5ac39d49fea744240261a8010e
0927 15:06:21.177079 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.191111 (+ 14032us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.202857 (+ 11746us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.219408 (+ 16551us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1783132}
I20260927 15:06:21.220094 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 089b6b5ac39d49fea744240261a8010e (table default.Table_ade3cb71f3dd4d55ac7e8839474d785a [id=fd1367da84814f54b92d304168674f0c]) successfully deleted
I20260927 15:06:21.220451 2233 tablet_replica.cc:330] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.220528 1552 tablet_bootstrap.cc:654] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.220721 2233 raft_consensus.cc:2229] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.220919 2233 raft_consensus.cc:2258] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.221421 2233 ts_tablet_manager.cc:1905] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.221658 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fff31ceb379400bbfa4586c749e6d6e" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:21.222555 1374 leader_election.cc:341] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.222780 1374 leader_election.cc:302] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:21.223100 3086 tablet.cc:1722] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:21.223232 3036 raft_consensus.cc:2726] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.225550 2119 ts_tablet_manager.cc:1918] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.225684 2119 log.cc:1196] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/4658de7351e9423b83f393f7f7045eed
I20260927 15:06:21.226075 2119 ts_tablet_manager.cc:1939] T 4658de7351e9423b83f393f7f7045eed P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:21.226663 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 4658de7351e9423b83f393f7f7045eed (table default.Table_df8af8dcea36480da1b3715c8d69646f [id=4e520f2c8e9348b0905f6b71bd98d6a1]) successfully deleted
W20260927 15:06:21.227295 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 511c66b5d3324a31a1b0c90cc90000b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 511c66b5d3324a31a1b0c90cc90000b5 already in progress: creating tablet
W20260927 15:06:21.227857 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet dead2d4d5ac243348ecd9eade6ea843f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dead2d4d5ac243348ecd9eade6ea843f already in progress: creating tablet
W20260927 15:06:21.228593 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet afd31e5d011b40c7bfda173a7331ed90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afd31e5d011b40c7bfda173a7331ed90 already in progress: creating tablet
W20260927 15:06:21.229063 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9b14f02426df4839b98f012042d8ee9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b14f02426df4839b98f012042d8ee9b already in progress: creating tablet
I20260927 15:06:21.229327 2119 tablet_replica.cc:330] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:21.229621 2119 raft_consensus.cc:2229] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.230006 2119 raft_consensus.cc:2258] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.230671 2119 ts_tablet_manager.cc:1905] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.234548 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6107c32d572944a0aafc76ab7111a7aa" } modify_external_catalogs: true
I20260927 15:06:21.234800 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6107c32d572944a0aafc76ab7111a7aa" } modify_external_catalogs: true
I20260927 15:06:21.235875 1552 tablet_bootstrap.cc:492] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
W20260927 15:06:21.222803 1099 leader_election.cc:341] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 79a3125723034cb48bc1a05fc4abbb82
I20260927 15:06:21.236034 1552 ts_tablet_manager.cc:1397] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.002s
I20260927 15:06:21.236971 1561 tablet_bootstrap.cc:492] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:21.236891 1552 raft_consensus.cc:348] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.237103 1552 raft_consensus.cc:374] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.237165 1552 raft_consensus.cc:729] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.237289 1561 ts_tablet_manager.cc:1397] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260927 15:06:21.237406 1552 consensus_queue.cc:260] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.238037 1552 ts_tablet_manager.cc:1428] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:21.238413 1552 tablet_bootstrap.cc:492] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.239916 1552 tablet_bootstrap.cc:654] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.245855 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089b6b5ac39d49fea744240261a8010e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:21.246402 1561 raft_consensus.cc:348] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.246625 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79a3125723034cb48bc1a05fc4abbb82" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:21.244737 2119 ts_tablet_manager.cc:1918] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.247340 2119 log.cc:1196] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/6b1f2143af1142eb9f3dbc777299c186
I20260927 15:06:21.248189 3081 tablet.cc:1722] T 1ef93a120f00423d91664ce4eaf03803 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:21.247923 1552 tablet_bootstrap.cc:492] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.249434 1552 ts_tablet_manager.cc:1397] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260927 15:06:21.249752 3023 raft_consensus.cc:2726] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.250985 1552 raft_consensus.cc:348] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.251219 1552 raft_consensus.cc:374] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.251282 1552 raft_consensus.cc:729] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.251479 1552 consensus_queue.cc:260] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.252208 1552 ts_tablet_manager.cc:1428] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 15:06:21.252497 2119 ts_tablet_manager.cc:1939] T 6b1f2143af1142eb9f3dbc777299c186 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:21.252902 3079 tablet.cc:1717] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: Skipping requested alter to schema version 3, tablet already version 3
I20260927 15:06:21.253072 1561 raft_consensus.cc:374] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.253285 1561 raft_consensus.cc:729] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.253505 1561 consensus_queue.cc:260] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.254204 1561 ts_tablet_manager.cc:1428] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260927 15:06:21.254498 1561 tablet_bootstrap.cc:492] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:21.256762 1561 tablet_bootstrap.cc:654] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:21.257822 1099 leader_election.cc:341] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 089b6b5ac39d49fea744240261a8010e
I20260927 15:06:21.260433 1552 tablet_bootstrap.cc:492] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.269038 2233 ts_tablet_manager.cc:1918] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.270725 2119 tablet_replica.cc:330] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:21.270923 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 6b1f2143af1142eb9f3dbc777299c186 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]) successfully deleted
I20260927 15:06:21.271030 2119 raft_consensus.cc:2229] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.272614 2233 log.cc:1196] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/7f0d667472ee4f1481c213e03403461e
I20260927 15:06:21.273144 2233 ts_tablet_manager.cc:1939] T 7f0d667472ee4f1481c213e03403461e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.275009 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1080) took 1881 ms. Trace:
I20260927 15:06:21.275264 2233 rpcz_store.cc:276] 0927 15:06:19.393516 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.394014 (+ 498us) service_pool.cc:227] Handling call
0927 15:06:21.220371 (+1826357us) ts_tablet_manager.cc:1145] Deleting tablet 7f0d667472ee4f1481c213e03403461e
0927 15:06:21.220381 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.265917 (+ 45536us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.268942 (+ 3025us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.274990 (+ 6048us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1826237}
I20260927 15:06:21.275913 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 7f0d667472ee4f1481c213e03403461e (table default.Table_47142ae009c646398d187fa84231faa2 [id=4a2d7f51ed0d461dab1ea8add3ba8619]) successfully deleted
I20260927 15:06:21.276278 2233 tablet_replica.cc:330] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.276639 2233 raft_consensus.cc:2229] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.276994 2233 raft_consensus.cc:2258] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.277307 3023 raft_consensus.cc:482] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.277451 3023 raft_consensus.cc:504] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.277973 2233 ts_tablet_manager.cc:1905] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.278098 3023 leader_election.cc:288] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:21.279609 1239 leader_election.cc:341] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: cd76c49eda1c4b4ca0edf0f4d2790188
W20260927 15:06:21.280087 1238 leader_election.cc:341] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: cd76c49eda1c4b4ca0edf0f4d2790188
I20260927 15:06:21.280201 1556 tablet_bootstrap.cc:654] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.280233 1238 leader_election.cc:302] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.280634 3023 raft_consensus.cc:2726] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.280910 2119 raft_consensus.cc:2258] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.281996 1562 ts_tablet_manager.cc:1918] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.281945 1552 tablet_bootstrap.cc:654] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.282238 1562 log.cc:1196] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/cb859b43634c420382da5c201ce24dfc
I20260927 15:06:21.282809 1562 ts_tablet_manager.cc:1939] T cb859b43634c420382da5c201ce24dfc P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:21.283277 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 980) took 4526 ms. Trace:
I20260927 15:06:21.283427 1562 rpcz_store.cc:276] 0927 15:06:16.756676 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.756758 (+ 82us) service_pool.cc:227] Handling call
0927 15:06:20.917564 (+4160806us) ts_tablet_manager.cc:1145] Deleting tablet cb859b43634c420382da5c201ce24dfc
0927 15:06:20.917574 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.101592 (+184018us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.281894 (+180302us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.283258 (+ 1364us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4160568}
I20260927 15:06:21.283954 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet cb859b43634c420382da5c201ce24dfc (table default.Table_d30c425670fb48e8b23a840865bee28b [id=0303fc8be5ae400a87d56696b7b75994]) successfully deleted
I20260927 15:06:21.284304 1562 tablet_replica.cc:330] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:21.284520 1562 raft_consensus.cc:2229] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:21.284435 2119 ts_tablet_manager.cc:1905] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.290678 2233 ts_tablet_manager.cc:1918] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.293200 2233 log.cc:1196] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/727652500d9a47b68b7a0d0dcf583822
I20260927 15:06:21.294950 2233 ts_tablet_manager.cc:1939] T 727652500d9a47b68b7a0d0dcf583822 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.295827 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1078) took 1902 ms. Trace:
I20260927 15:06:21.296872 2233 rpcz_store.cc:276] 0927 15:06:19.393303 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.393721 (+ 418us) service_pool.cc:227] Handling call
0927 15:06:21.276235 (+1882514us) ts_tablet_manager.cc:1145] Deleting tablet 727652500d9a47b68b7a0d0dcf583822
0927 15:06:21.276245 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.285222 (+ 8977us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.290589 (+ 5367us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.295805 (+ 5216us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1852471}
I20260927 15:06:21.297631 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 727652500d9a47b68b7a0d0dcf583822 (table default.Table_6415984e90b9420d867c66eae3dabdee [id=645add1330bd41618f53f3c008b48200]) successfully deleted
I20260927 15:06:21.298038 2233 tablet_replica.cc:330] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.298470 2233 raft_consensus.cc:2229] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.298913 2233 raft_consensus.cc:2258] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.300324 2233 ts_tablet_manager.cc:1905] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.305075 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bb0cfb89d00b491285ded7ae087d8315" } modify_external_catalogs: true
I20260927 15:06:21.305277 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bb0cfb89d00b491285ded7ae087d8315" } modify_external_catalogs: true
I20260927 15:06:21.309283 1552 tablet_bootstrap.cc:492] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.309427 1552 ts_tablet_manager.cc:1397] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.000s
I20260927 15:06:21.310137 1552 raft_consensus.cc:348] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.310344 1552 raft_consensus.cc:374] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.310401 1552 raft_consensus.cc:729] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.310586 1552 consensus_queue.cc:260] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.311107 1552 ts_tablet_manager.cc:1428] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:21.311352 1552 tablet_bootstrap.cc:492] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.312538 2233 ts_tablet_manager.cc:1918] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.312757 1552 tablet_bootstrap.cc:654] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.313773 2233 log.cc:1196] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/c6a248ec4ee64d0a8d986fdc683d69ba
I20260927 15:06:21.314227 2233 ts_tablet_manager.cc:1939] T c6a248ec4ee64d0a8d986fdc683d69ba P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.315582 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1081) took 1922 ms. Trace:
I20260927 15:06:21.316279 2233 rpcz_store.cc:276] 0927 15:06:19.393592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.393987 (+ 395us) service_pool.cc:227] Handling call
0927 15:06:21.297966 (+1903979us) ts_tablet_manager.cc:1145] Deleting tablet c6a248ec4ee64d0a8d986fdc683d69ba
0927 15:06:21.298001 (+ 35us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.304753 (+ 6752us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.312442 (+ 7689us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.315561 (+ 3119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1874051}
I20260927 15:06:21.316996 2233 tablet_replica.cc:330] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.317353 2233 raft_consensus.cc:2229] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.317737 2233 raft_consensus.cc:2258] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.318418 2233 ts_tablet_manager.cc:1905] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.320050 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet c6a248ec4ee64d0a8d986fdc683d69ba (table default.Table_b33719cf7165405caf26b84396bd5f7b [id=fa89a4b72c5f49589d9ee43f118da869]) successfully deleted
I20260927 15:06:21.324416 2233 ts_tablet_manager.cc:1918] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.330073 2233 log.cc:1196] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/b44e2611d2bf40ae90c4fd857225e39e
I20260927 15:06:21.330598 2233 ts_tablet_manager.cc:1939] T b44e2611d2bf40ae90c4fd857225e39e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.331106 1552 tablet_bootstrap.cc:492] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.331249 1552 ts_tablet_manager.cc:1397] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.003s
I20260927 15:06:21.331964 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1089) took 1898 ms. Trace:
I20260927 15:06:21.331947 1552 raft_consensus.cc:348] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.332145 1552 raft_consensus.cc:374] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.332203 1552 raft_consensus.cc:729] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.332387 1552 consensus_queue.cc:260] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.332873 1552 ts_tablet_manager.cc:1428] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:21.332835 2233 rpcz_store.cc:276] 0927 15:06:19.433916 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.433994 (+ 78us) service_pool.cc:227] Handling call
0927 15:06:21.316953 (+1882959us) ts_tablet_manager.cc:1145] Deleting tablet b44e2611d2bf40ae90c4fd857225e39e
0927 15:06:21.316964 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.321749 (+ 4785us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.324338 (+ 2589us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.331941 (+ 7603us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1882310}
I20260927 15:06:21.333596 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet b44e2611d2bf40ae90c4fd857225e39e (table default.Table_c46b2f0f6ed04caab359a17bf48da08a [id=9be8df1ac1d44d99a54426f250216921]) successfully deleted
I20260927 15:06:21.334035 2233 tablet_replica.cc:330] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.334400 1552 tablet_bootstrap.cc:492] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.334429 2233 raft_consensus.cc:2229] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.334934 2233 raft_consensus.cc:2258] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.335573 2119 ts_tablet_manager.cc:1918] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.336144 2233 ts_tablet_manager.cc:1905] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.336376 2119 log.cc:1196] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/0f4cff4a06db44269defca578af289d8
I20260927 15:06:21.338732 2119 ts_tablet_manager.cc:1939] T 0f4cff4a06db44269defca578af289d8 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:21.346652 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 0f4cff4a06db44269defca578af289d8 (table default.Table_1b1639fc47724907a79f94e34f6b9469 [id=8be5c577dcb3490d883bede28c6b73ea]) successfully deleted
I20260927 15:06:21.347443 2119 tablet_replica.cc:330] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:21.349408 2233 ts_tablet_manager.cc:1918] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.349223 2119 raft_consensus.cc:2229] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.350389 2119 raft_consensus.cc:2258] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.351154 2233 log.cc:1196] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/289bea546c8a41bf97edfdc9a453a024
I20260927 15:06:21.351627 2233 ts_tablet_manager.cc:1939] T 289bea546c8a41bf97edfdc9a453a024 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.352020 1552 tablet_bootstrap.cc:654] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.352823 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1090) took 1904 ms. Trace:
I20260927 15:06:21.353807 2233 rpcz_store.cc:276] 0927 15:06:19.448812 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.449218 (+ 406us) service_pool.cc:227] Handling call
0927 15:06:21.333984 (+1884766us) ts_tablet_manager.cc:1145] Deleting tablet 289bea546c8a41bf97edfdc9a453a024
0927 15:06:21.333998 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.343366 (+ 9368us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.349319 (+ 5953us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.352805 (+ 3486us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1879569}
I20260927 15:06:21.354341 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 289bea546c8a41bf97edfdc9a453a024 (table default.Table_3ece36785b214c7fb4352a79cb3b4438 [id=37dab0cf0ab84245acb1fda4e02b1ded]) successfully deleted
I20260927 15:06:21.354696 2233 tablet_replica.cc:330] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.354952 2233 raft_consensus.cc:2229] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.355129 2233 raft_consensus.cc:2258] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.355647 2233 ts_tablet_manager.cc:1905] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.358047 2119 ts_tablet_manager.cc:1905] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.358407 913 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 1ef93a120f00423d91664ce4eaf03803 (table default.Table_abb2a056a859472fb4d4b36dde2ff8d3 [id=40aeb63abca64c3a8d12f9085fd816d8]). Expected version 4 got 0
I20260927 15:06:21.359642 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_10fe8b78b2894efa9727654ba2eebcfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:21.360280 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10fe8b78b2894efa9727654ba2eebcfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:21.362267 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 429088342b4743c39fb1e38d235024de with delete_type TABLET_DATA_DELETED (replaced by tablet 79a3125723034cb48bc1a05fc4abbb82) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:21.362452 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:21.374042 2233 ts_tablet_manager.cc:1918] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.374221 2233 log.cc:1196] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3540982dd7544e60af6c153fc41a412c
I20260927 15:06:21.374717 2233 ts_tablet_manager.cc:1939] T 3540982dd7544e60af6c153fc41a412c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.375483 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1104) took 1646 ms. Trace:
I20260927 15:06:21.375613 2233 rpcz_store.cc:276] 0927 15:06:19.728890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.728941 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:21.354651 (+1625710us) ts_tablet_manager.cc:1145] Deleting tablet 3540982dd7544e60af6c153fc41a412c
0927 15:06:21.354661 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.371205 (+ 16544us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.373935 (+ 2730us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.375462 (+ 1527us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1625479}
I20260927 15:06:21.376082 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 3540982dd7544e60af6c153fc41a412c (table default.Table_807b252506684a4a804a3f2a52913df8 [id=eb67e70601274115808752561ecaa5e4]) successfully deleted
I20260927 15:06:21.376497 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1108) took 1577 ms. Trace:
I20260927 15:06:21.376613 2233 rpcz_store.cc:276] 0927 15:06:19.798758 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.798837 (+ 79us) service_pool.cc:227] Handling call
0927 15:06:21.376377 (+1577540us) ts_tablet_manager.cc:1145] Deleting tablet 81cc2d5e281648a49fe109a7a00689b3
0927 15:06:21.376389 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.376480 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1577312}
I20260927 15:06:21.376838 1552 tablet_bootstrap.cc:492] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.376967 1552 ts_tablet_manager.cc:1397] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.008s
W20260927 15:06:21.377089 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 81cc2d5e281648a49fe109a7a00689b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81cc2d5e281648a49fe109a7a00689b3 already in progress: creating tablet
I20260927 15:06:21.377470 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1109) took 1578 ms. Trace:
I20260927 15:06:21.377575 2233 rpcz_store.cc:276] 0927 15:06:19.799114 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.799179 (+ 65us) service_pool.cc:227] Handling call
0927 15:06:21.377366 (+1578187us) ts_tablet_manager.cc:1145] Deleting tablet 13acfcbc13204b2f9edb0f557a62252e
0927 15:06:21.377378 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.377454 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1577978}
I20260927 15:06:21.377671 1552 raft_consensus.cc:348] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.377867 1552 raft_consensus.cc:374] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.377933 1552 raft_consensus.cc:729] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:21.378001 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 13acfcbc13204b2f9edb0f557a62252e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13acfcbc13204b2f9edb0f557a62252e already in progress: creating tablet
I20260927 15:06:21.378353 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1110) took 1578 ms. Trace:
I20260927 15:06:21.378332 1552 consensus_queue.cc:260] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.378459 2233 rpcz_store.cc:276] 0927 15:06:19.799453 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.799506 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:21.378260 (+1578754us) ts_tablet_manager.cc:1145] Deleting tablet 9e7f0754b9ba4e21b05c51b0136729d1
0927 15:06:21.378269 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.378338 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1578567}
I20260927 15:06:21.378921 1552 ts_tablet_manager.cc:1428] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260927 15:06:21.378928 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9e7f0754b9ba4e21b05c51b0136729d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e7f0754b9ba4e21b05c51b0136729d1 already in progress: creating tablet
I20260927 15:06:21.379176 1552 tablet_bootstrap.cc:492] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.379307 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1111) took 1579 ms. Trace:
I20260927 15:06:21.379415 2233 rpcz_store.cc:276] 0927 15:06:19.799791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.799828 (+ 37us) service_pool.cc:227] Handling call
0927 15:06:21.379175 (+1579347us) ts_tablet_manager.cc:1145] Deleting tablet a6852cc3f94a40779799beb772b3d34d
0927 15:06:21.379184 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.379291 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1579150}
W20260927 15:06:21.379803 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a6852cc3f94a40779799beb772b3d34d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6852cc3f94a40779799beb772b3d34d already in progress: creating tablet
I20260927 15:06:21.380154 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1101) took 1667 ms. Trace:
I20260927 15:06:21.380265 2233 rpcz_store.cc:276] 0927 15:06:19.713154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.806780 (+ 93626us) service_pool.cc:227] Handling call
0927 15:06:21.380052 (+1573272us) ts_tablet_manager.cc:1145] Deleting tablet 318e4bf9d50f4fe6858e438ccf2544bf
0927 15:06:21.380062 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.380139 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1573004}
I20260927 15:06:21.380694 1552 tablet_bootstrap.cc:654] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:21.380722 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 318e4bf9d50f4fe6858e438ccf2544bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 318e4bf9d50f4fe6858e438ccf2544bf already in progress: creating tablet
I20260927 15:06:21.381003 2233 tablet_replica.cc:330] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.381192 2233 raft_consensus.cc:2229] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.381338 2233 raft_consensus.cc:2258] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.381824 2233 ts_tablet_manager.cc:1905] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.387445 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_57b734874dee44c1835941aee4a7a9de" } new_table_name: "default.Table_8099ae6bb34144a4b6ee60602eb8c0c2" modify_external_catalogs: true
I20260927 15:06:21.388796 2233 ts_tablet_manager.cc:1918] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.388929 2233 log.cc:1196] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/fd1f51cb124d4d20a9d6024e6eb6810f
I20260927 15:06:21.389251 2233 ts_tablet_manager.cc:1939] T fd1f51cb124d4d20a9d6024e6eb6810f P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.389452 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 9576d1a36d7547bf81faabe9c362e3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:21.389708 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet d4f05da432f041378c5ab808536e6b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:21.389997 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1118) took 1471 ms. Trace:
I20260927 15:06:21.390108 2233 rpcz_store.cc:276] 0927 15:06:19.918551 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.918714 (+ 163us) service_pool.cc:227] Handling call
0927 15:06:21.380954 (+1462240us) ts_tablet_manager.cc:1145] Deleting tablet fd1f51cb124d4d20a9d6024e6eb6810f
0927 15:06:21.380975 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.385966 (+ 4991us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.388710 (+ 2744us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.389980 (+ 1270us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1461349}
I20260927 15:06:21.390554 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet fd1f51cb124d4d20a9d6024e6eb6810f (table default.Table_80b31537a3164aa7ad56ac09e6b8a2a6 [id=4bd55908fae746d192e45bb674ecc75d]) successfully deleted
I20260927 15:06:21.390921 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1119) took 1463 ms. Trace:
I20260927 15:06:21.391019 2233 rpcz_store.cc:276] 0927 15:06:19.927362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.927494 (+ 132us) service_pool.cc:227] Handling call
0927 15:06:21.390791 (+1463297us) ts_tablet_manager.cc:1145] Deleting tablet 24a592ebe7db4f36bd2819f6864436ea
0927 15:06:21.390801 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.390905 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1462444}
W20260927 15:06:21.391444 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 24a592ebe7db4f36bd2819f6864436ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24a592ebe7db4f36bd2819f6864436ea already in progress: creating tablet
I20260927 15:06:21.391767 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1123) took 1377 ms. Trace:
I20260927 15:06:21.391861 2233 rpcz_store.cc:276] 0927 15:06:20.014109 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:20.014185 (+ 76us) service_pool.cc:227] Handling call
0927 15:06:21.391673 (+1377488us) ts_tablet_manager.cc:1145] Deleting tablet 2b02006875534bdb86ffccee52bca32b
0927 15:06:21.391683 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.391752 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1230881}
W20260927 15:06:21.392251 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2b02006875534bdb86ffccee52bca32b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b02006875534bdb86ffccee52bca32b already in progress: creating tablet
I20260927 15:06:21.392555 2233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1132) took 1082 ms. Trace:
I20260927 15:06:21.392660 2233 rpcz_store.cc:276] 0927 15:06:20.310337 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:20.315238 (+ 4901us) service_pool.cc:227] Handling call
0927 15:06:21.392465 (+1077227us) ts_tablet_manager.cc:1145] Deleting tablet 1e84d99880494324b802b659e0590170
0927 15:06:21.392474 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.392541 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1043464}
W20260927 15:06:21.393061 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1e84d99880494324b802b659e0590170 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e84d99880494324b802b659e0590170 already in progress: creating tablet
W20260927 15:06:21.393699 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet cc91a17a72de4ced8d3f7519430d44b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc91a17a72de4ced8d3f7519430d44b5 already in progress: creating tablet
I20260927 15:06:21.393980 3023 raft_consensus.cc:482] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.394110 3023 raft_consensus.cc:504] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:21.394271 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet e5d924a79fa2493795abda6ffbbd11b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5d924a79fa2493795abda6ffbbd11b5 already in progress: creating tablet
I20260927 15:06:21.394491 1552 tablet_bootstrap.cc:492] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.394594 1552 ts_tablet_manager.cc:1397] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.003s
I20260927 15:06:21.394752 3023 leader_election.cc:288] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:21.394763 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet f0e0d5f68e5b4bccb59ca2c31efdc60f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0e0d5f68e5b4bccb59ca2c31efdc60f already in progress: creating tablet
I20260927 15:06:21.395030 2233 tablet_replica.cc:330] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:21.395254 2233 raft_consensus.cc:2229] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.395432 2233 raft_consensus.cc:2258] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.395365 1552 raft_consensus.cc:348] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.395555 1552 raft_consensus.cc:374] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.395620 1552 raft_consensus.cc:729] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.395793 1552 consensus_queue.cc:260] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.396063 2233 ts_tablet_manager.cc:1905] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:21.396217 1238 leader_election.cc:341] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9576d1a36d7547bf81faabe9c362e3cb
I20260927 15:06:21.396294 1552 ts_tablet_manager.cc:1428] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:21.396512 1552 tablet_bootstrap.cc:492] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.397915 1552 tablet_bootstrap.cc:654] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.401463 1562 raft_consensus.cc:2258] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:21.298738 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 53033.2us
I20260927 15:06:21.374332 3013 raft_consensus.cc:482] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:21.402416 1102 consensus_peers.cc:487] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 278205071701447e8ee7457b2ee84be4. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:21.402374 3013 raft_consensus.cc:504] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:21.402655 1102 leader_election.cc:341] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.402735 1102 leader_election.cc:302] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.402932 3013 leader_election.cc:288] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.402937 3012 raft_consensus.cc:2726] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:21.403272 1102 leader_election.cc:341] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.403349 1102 leader_election.cc:302] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.396891 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9576d1a36d7547bf81faabe9c362e3cb" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:21.403759 3013 raft_consensus.cc:2726] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.403709 1164 raft_consensus.cc:2454] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:21.404466 1239 leader_election.cc:302] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.404919 3023 raft_consensus.cc:2781] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:21.405005 3023 raft_consensus.cc:482] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:21.405089 3023 raft_consensus.cc:3037] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:21.408403 3023 raft_consensus.cc:504] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.409559 3023 leader_election.cc:288] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.409772 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9576d1a36d7547bf81faabe9c362e3cb" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:21.409961 1164 raft_consensus.cc:3037] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:21.410411 1238 leader_election.cc:341] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9576d1a36d7547bf81faabe9c362e3cb
I20260927 15:06:21.411863 1298 raft_consensus.cc:3037] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:21.412550 1164 raft_consensus.cc:2454] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:21.412967 1239 leader_election.cc:302] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.413297 3023 raft_consensus.cc:2781] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:21.413486 3023 raft_consensus.cc:686] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:21.413700 3023 consensus_queue.cc:237] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.415728 1556 tablet_bootstrap.cc:492] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:21.415925 1556 ts_tablet_manager.cc:1397] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.402s user 0.003s sys 0.000s
I20260927 15:06:21.416628 1556 raft_consensus.cc:348] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.416791 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0d667472ee4f1481c213e03403461e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:21.417893 1556 raft_consensus.cc:374] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.418115 1556 raft_consensus.cc:729] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
W20260927 15:06:21.401083 1099 consensus_peers.cc:487] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4714d536373a4bf2a4be9ebeaebe77c1. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:21.417361 2233 ts_tablet_manager.cc:1918] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.418450 2233 log.cc:1196] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/4658de7351e9423b83f393f7f7045eed
I20260927 15:06:21.418879 2233 ts_tablet_manager.cc:1939] T 4658de7351e9423b83f393f7f7045eed P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:21.420383 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 4658de7351e9423b83f393f7f7045eed (table default.Table_df8af8dcea36480da1b3715c8d69646f [id=4e520f2c8e9348b0905f6b71bd98d6a1]) successfully deleted
I20260927 15:06:21.419188 1556 consensus_queue.cc:260] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:21.423017 1102 consensus_peers.cc:487] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:21.423986 1102 leader_election.cc:341] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:21.425201 1099 leader_election.cc:341] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 7f0d667472ee4f1481c213e03403461e
I20260927 15:06:21.425365 1099 leader_election.cc:302] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.425568 2927 raft_consensus.cc:2726] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.428056 1556 ts_tablet_manager.cc:1428] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260927 15:06:21.429275 1556 tablet_bootstrap.cc:492] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:21.429211 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet afd31e5d011b40c7bfda173a7331ed90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afd31e5d011b40c7bfda173a7331ed90 already in progress: creating tablet
W20260927 15:06:21.430039 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 511c66b5d3324a31a1b0c90cc90000b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 511c66b5d3324a31a1b0c90cc90000b5 already in progress: creating tablet
W20260927 15:06:21.430878 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9b14f02426df4839b98f012042d8ee9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b14f02426df4839b98f012042d8ee9b already in progress: creating tablet
W20260927 15:06:21.440310 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet dead2d4d5ac243348ecd9eade6ea843f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dead2d4d5ac243348ecd9eade6ea843f already in progress: creating tablet
I20260927 15:06:21.440819 1552 tablet_bootstrap.cc:492] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.440914 3023 raft_consensus.cc:482] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.441108 3023 raft_consensus.cc:504] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.440980 1552 ts_tablet_manager.cc:1397] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.018s
I20260927 15:06:21.442301 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f271c76b5f2447239d3d014fbde4e8b2" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:21.442912 1239 leader_election.cc:341] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.443202 1552 raft_consensus.cc:348] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.443449 1552 raft_consensus.cc:374] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.443519 1552 raft_consensus.cc:729] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:21.443552 1238 leader_election.cc:341] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: f271c76b5f2447239d3d014fbde4e8b2
I20260927 15:06:21.443691 1238 leader_election.cc:302] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.444000 2980 raft_consensus.cc:2726] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.444358 3023 leader_election.cc:288] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.444594 1552 consensus_queue.cc:260] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.445824 1552 ts_tablet_manager.cc:1428] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:21.446125 1552 tablet_bootstrap.cc:492] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.447979 1552 tablet_bootstrap.cc:654] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.451550 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 3efc44686be2407cbcdca61909301539 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:21.452831 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_eae443c27a234a5c8378e6b41e9b8d2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:21.453488 2119 ts_tablet_manager.cc:1918] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.453612 2119 log.cc:1196] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/66b54ee47e424aacb7f53fd95b0ce889
W20260927 15:06:21.453920 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eae443c27a234a5c8378e6b41e9b8d2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:21.453970 2119 ts_tablet_manager.cc:1939] T 66b54ee47e424aacb7f53fd95b0ce889 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:21.464473 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23306cd9652e4d32b188f7e9e29d8452 has no consensus state
I20260927 15:06:21.470525 1562 ts_tablet_manager.cc:1905] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.473330 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 66b54ee47e424aacb7f53fd95b0ce889 (table default.Table_55b153455b5b46ed916f0a47ccc6b0ec [id=1d6cd7d0ee4e461ca0c91dca72118d5f]) successfully deleted
I20260927 15:06:21.473847 2119 tablet_replica.cc:330] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:21.474030 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:21.474339 2119 raft_consensus.cc:2229] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.474635 2119 raft_consensus.cc:2258] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.475876 2119 ts_tablet_manager.cc:1905] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.514914 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1c3f3f4c12b24ecc9c57dccef288bd6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:21.515336 1556 tablet_bootstrap.cc:654] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:21.515671 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c3f3f4c12b24ecc9c57dccef288bd6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:21.534711 913 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (table default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8]). Expected version 3 got 0
I20260927 15:06:21.536875 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d498ea4d76e248a98a4c6e184d194324" } new_table_name: "default.Table_2b6fbd502fb743878cddd5371cf5e109" modify_external_catalogs: true
I20260927 15:06:21.547475 1298 raft_consensus.cc:3037] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:21.551544 1556 tablet_bootstrap.cc:492] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:21.552397 1556 ts_tablet_manager.cc:1397] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.124s user 0.015s sys 0.011s
I20260927 15:06:21.553836 3036 raft_consensus.cc:482] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.553972 3036 raft_consensus.cc:504] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.554494 3036 leader_election.cc:288] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:21.556404 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 52e7439320dd48aba25b5f7dc627964c (table default.Table_1f2da6475c904f0d8aec8dea13410524 [id=6ae561a83b5543a89dd0dedc630d9e47]). Expected version 1 got 0
I20260927 15:06:21.556666 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
W20260927 15:06:21.557790 906 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.201.3:60991 (request call id 165) took 842 ms (client timeout 1000 ms). Trace:
W20260927 15:06:21.557916 906 rpcz_store.cc:269] 0927 15:06:20.714926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:20.714977 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:21.557713 (+842736us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":3}
I20260927 15:06:21.558596 910 catalog_manager.cc:5495] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:21.558962 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d533883e3344eca939cd67644895148 with delete_type TABLET_DATA_DELETED (replaced by tablet 534a74d9f8e648168b87e26fb73c8b3a) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:21.559070 910 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 078ba40ca56745b2a2b86402a1519011 (table default.Table_4e61792c99664faca894de841edc089d [id=f8a991083fb74bfc9d9969214ac7108f]). Expected version 2 got 0
I20260927 15:06:21.559245 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d4487cbbce24e60ae76ec0aca2760f4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:21.559319 910 catalog_manager.cc:5495] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:21.559670 910 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet db09498a395b4570a34d32fbfc71e8ed (table default.Table_5b7e58750e9a481cab2abf34e5753a5e [id=ed34d1e88ae54c6086ae3a7cbfdf7861]). Expected version 1 got 0
W20260927 15:06:21.560212 1374 leader_election.cc:341] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:21.566270 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8d533883e3344eca939cd67644895148 because the tablet was not found. No further retry: Not found: Tablet not found: 8d533883e3344eca939cd67644895148
I20260927 15:06:21.566262 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d4487cbbce24e60ae76ec0aca2760f4" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:21.566877 1376 leader_election.cc:341] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.567009 1376 leader_election.cc:302] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:21.568912 3036 raft_consensus.cc:2726] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.569047 3036 raft_consensus.cc:482] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.569133 3036 raft_consensus.cc:504] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.569659 3036 leader_election.cc:288] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:21.570215 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af25950fd08043f18a6eaaf46ded4378" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:21.570756 1374 leader_election.cc:341] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.573413 1140 tablet_service.cc:1467] Processing CreateTablet for tablet baa542420a7441b5a154093782568284 (DEFAULT_TABLE table=default.Table_92bc9e8eb45f4f679e968de44b4ed3d2 [id=85ad9e88b6a944509ba43bb54ba2ba77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.573905 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa542420a7441b5a154093782568284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.574031 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 23306cd9652e4d32b188f7e9e29d8452 (DEFAULT_TABLE table=default.Table_8099ae6bb34144a4b6ee60602eb8c0c2 [id=b81b0b37f6e84ab9b58a1c8cfb37b03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.574429 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23306cd9652e4d32b188f7e9e29d8452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.575192 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
I20260927 15:06:21.575405 906 catalog_manager.cc:5495] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:21.575868 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 23306cd9652e4d32b188f7e9e29d8452 (DEFAULT_TABLE table=default.Table_8099ae6bb34144a4b6ee60602eb8c0c2 [id=b81b0b37f6e84ab9b58a1c8cfb37b03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.576155 906 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:21.576225 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23306cd9652e4d32b188f7e9e29d8452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.575281 1556 raft_consensus.cc:348] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.577040 1556 raft_consensus.cc:374] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.577327 1556 raft_consensus.cc:729] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.578356 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 0796e55c8f8c49adbf4fc5a51a8912e1 (DEFAULT_TABLE table=default.Table_20f143bd1e984ba8a2792c6e919d6f9b [id=7cb5b07b9b104d2da19a6ac7fa7b2bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.578682 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0796e55c8f8c49adbf4fc5a51a8912e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.579054 1420 tablet_service.cc:1467] Processing CreateTablet for tablet baa542420a7441b5a154093782568284 (DEFAULT_TABLE table=default.Table_92bc9e8eb45f4f679e968de44b4ed3d2 [id=85ad9e88b6a944509ba43bb54ba2ba77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.579331 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa542420a7441b5a154093782568284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.578860 1556 consensus_queue.cc:260] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.583014 1556 ts_tablet_manager.cc:1428] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.030s user 0.003s sys 0.000s
I20260927 15:06:21.584776 1556 tablet_bootstrap.cc:492] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:21.589684 3023 raft_consensus.cc:482] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.592387 1211 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:21.595949 1561 tablet_bootstrap.cc:492] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:21.596112 1561 ts_tablet_manager.cc:1397] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.342s user 0.063s sys 0.107s
I20260927 15:06:21.596809 1561 raft_consensus.cc:348] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.597239 1561 raft_consensus.cc:374] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.597318 1561 raft_consensus.cc:729] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.597537 1561 consensus_queue.cc:260] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.598104 1561 ts_tablet_manager.cc:1428] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:21.598366 1561 tablet_bootstrap.cc:492] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:21.599958 1561 tablet_bootstrap.cc:654] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.601871 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 0796e55c8f8c49adbf4fc5a51a8912e1 (DEFAULT_TABLE table=default.Table_20f143bd1e984ba8a2792c6e919d6f9b [id=7cb5b07b9b104d2da19a6ac7fa7b2bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.602262 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0796e55c8f8c49adbf4fc5a51a8912e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.608484 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 247b917dc7c8470389132aa01b3f780b (DEFAULT_TABLE table=default.Table_ccf28c193a144586a54870418a519e90 [id=4d00942ad9ac4efdb5b9cd002b8a7e85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.609056 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 247b917dc7c8470389132aa01b3f780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.609160 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa93e083be94764abc98d2419da7e37 (DEFAULT_TABLE table=default.Table_c6e3ae0eaa67405692ba21e9f06fed21 [id=625b10f761354d759c0f675299256678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.609542 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa93e083be94764abc98d2419da7e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.609575 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 247b917dc7c8470389132aa01b3f780b (DEFAULT_TABLE table=default.Table_ccf28c193a144586a54870418a519e90 [id=4d00942ad9ac4efdb5b9cd002b8a7e85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.609964 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 247b917dc7c8470389132aa01b3f780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.610239 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 90290610f1e34ae0bd024240b695d9e5 (DEFAULT_TABLE table=default.Table_8a62519f0ac44349b996d33c3e11e368 [id=3d6ec7888dbd4c6a8570e1a7515ae939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.610569 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90290610f1e34ae0bd024240b695d9e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.615098 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa93e083be94764abc98d2419da7e37 (DEFAULT_TABLE table=default.Table_c6e3ae0eaa67405692ba21e9f06fed21 [id=625b10f761354d759c0f675299256678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.615098 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 90290610f1e34ae0bd024240b695d9e5 (DEFAULT_TABLE table=default.Table_8a62519f0ac44349b996d33c3e11e368 [id=3d6ec7888dbd4c6a8570e1a7515ae939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.615465 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa93e083be94764abc98d2419da7e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.615675 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90290610f1e34ae0bd024240b695d9e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.620795 1556 tablet_bootstrap.cc:654] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.626148 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 684bf999658b4c0c9d66918921d98194 (DEFAULT_TABLE table=default.Table_2aadf6203773433ebe185e3b8127d619 [id=df2b75aab7bb43cb9eefe69d2e85172e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.626617 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 684bf999658b4c0c9d66918921d98194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.627904 1299 raft_consensus.cc:3037] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:21.629130 1561 tablet_bootstrap.cc:492] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:21.629333 1561 ts_tablet_manager.cc:1397] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260927 15:06:21.631067 1561 raft_consensus.cc:348] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.631395 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 684bf999658b4c0c9d66918921d98194 (DEFAULT_TABLE table=default.Table_2aadf6203773433ebe185e3b8127d619 [id=df2b75aab7bb43cb9eefe69d2e85172e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.632262 1561 raft_consensus.cc:374] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.632529 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 684bf999658b4c0c9d66918921d98194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.632519 1561 raft_consensus.cc:729] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.632679 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 23306cd9652e4d32b188f7e9e29d8452 (DEFAULT_TABLE table=default.Table_8099ae6bb34144a4b6ee60602eb8c0c2 [id=b81b0b37f6e84ab9b58a1c8cfb37b03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.633028 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23306cd9652e4d32b188f7e9e29d8452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.633078 1561 consensus_queue.cc:260] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.634019 1301 raft_consensus.cc:3037] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:21.632692 2119 ts_tablet_manager.cc:1918] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.635063 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 1d81159f316e4d9380ff80f179dda660 (DEFAULT_TABLE table=default.Table_59ee7d6e47244bb0b4e3ee148da8d762 [id=1d4c51ac1d444ce284aee76f0bf37c75]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:21.635133 1102 consensus_peers.cc:487] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:21.635450 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d81159f316e4d9380ff80f179dda660. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:21.636361 1102 consensus_peers.cc:487] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4658de7351e9423b83f393f7f7045eed. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:21.636834 1561 ts_tablet_manager.cc:1428] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260927 15:06:21.640010 1561 tablet_bootstrap.cc:492] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:21.641139 3023 raft_consensus.cc:504] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.641288 1270 tablet_service.cc:1467] Processing CreateTablet for tablet baa542420a7441b5a154093782568284 (DEFAULT_TABLE table=default.Table_92bc9e8eb45f4f679e968de44b4ed3d2 [id=85ad9e88b6a944509ba43bb54ba2ba77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.641336 1297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af25950fd08043f18a6eaaf46ded4378" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:21.641484 1304 raft_consensus.cc:3037] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:21.641798 3023 leader_election.cc:288] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.641996 3023 raft_consensus.cc:482] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:21.642086 1376 leader_election.cc:341] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.642159 3023 raft_consensus.cc:504] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.642244 1376 leader_election.cc:302] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:21.642473 3105 raft_consensus.cc:2726] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.643011 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc20a62bbd484c4e9e25cf1c15e1dde0" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:21.634585 2119 log.cc:1196] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/5e9b07ea3ec9457399e2b765580d06e7
I20260927 15:06:21.644025 2119 ts_tablet_manager.cc:1939] T 5e9b07ea3ec9457399e2b765580d06e7 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:21.644121 1561 tablet_bootstrap.cc:654] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.645503 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 0796e55c8f8c49adbf4fc5a51a8912e1 (DEFAULT_TABLE table=default.Table_20f143bd1e984ba8a2792c6e919d6f9b [id=7cb5b07b9b104d2da19a6ac7fa7b2bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.646355 3023 leader_election.cc:288] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:21.646355 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 90290610f1e34ae0bd024240b695d9e5 (DEFAULT_TABLE table=default.Table_8a62519f0ac44349b996d33c3e11e368 [id=3d6ec7888dbd4c6a8570e1a7515ae939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.647068 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e2c5c3d0f574422be80b318395f199a" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:21.648587 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baa542420a7441b5a154093782568284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.649034 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0796e55c8f8c49adbf4fc5a51a8912e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.649179 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 04483a489f254123a1ccd69667acb0b1
I20260927 15:06:21.650098 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 56f3c6a79b0e43769368693b493d73f1
I20260927 15:06:21.651383 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90290610f1e34ae0bd024240b695d9e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.651647 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 247b917dc7c8470389132aa01b3f780b (DEFAULT_TABLE table=default.Table_ccf28c193a144586a54870418a519e90 [id=4d00942ad9ac4efdb5b9cd002b8a7e85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.651964 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 247b917dc7c8470389132aa01b3f780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.652853 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 04483a489f254123a1ccd69667acb0b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:21 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:21.653111 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 56f3c6a79b0e43769368693b493d73f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:21.655469 1552 tablet_bootstrap.cc:492] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:21.655584 1552 ts_tablet_manager.cc:1397] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.210s user 0.018s sys 0.046s
I20260927 15:06:21.655833 1561 tablet_bootstrap.cc:492] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:21.655877 2119 tablet_replica.cc:330] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:21.656112 1561 ts_tablet_manager.cc:1397] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260927 15:06:21.656098 2119 raft_consensus.cc:2229] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.656241 2119 raft_consensus.cc:2258] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.656397 1556 tablet_bootstrap.cc:492] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:21.656599 1556 ts_tablet_manager.cc:1397] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.000s
I20260927 15:06:21.656808 2119 ts_tablet_manager.cc:1905] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.657037 1561 raft_consensus.cc:348] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.657307 1561 raft_consensus.cc:374] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.657433 1561 raft_consensus.cc:729] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.657467 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 8aa93e083be94764abc98d2419da7e37 (DEFAULT_TABLE table=default.Table_c6e3ae0eaa67405692ba21e9f06fed21 [id=625b10f761354d759c0f675299256678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.657702 1561 consensus_queue.cc:260] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.658176 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 684bf999658b4c0c9d66918921d98194 (DEFAULT_TABLE table=default.Table_2aadf6203773433ebe185e3b8127d619 [id=df2b75aab7bb43cb9eefe69d2e85172e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.658425 1561 ts_tablet_manager.cc:1428] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:21.658496 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 684bf999658b4c0c9d66918921d98194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.659284 3012 raft_consensus.cc:482] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.659312 1297 raft_consensus.cc:3037] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:21.659293 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 56f3c6a79b0e43769368693b493d73f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:21.659402 3012 raft_consensus.cc:504] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.659960 3012 leader_election.cc:288] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.660512 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 1d81159f316e4d9380ff80f179dda660 (DEFAULT_TABLE table=default.Table_59ee7d6e47244bb0b4e3ee148da8d762 [id=1d4c51ac1d444ce284aee76f0bf37c75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.660637 1277 tablet_service.cc:1514] Processing DeleteTablet for tablet 56f3c6a79b0e43769368693b493d73f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:21.660802 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d81159f316e4d9380ff80f179dda660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.660995 1552 raft_consensus.cc:348] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.661181 1552 raft_consensus.cc:374] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.661228 1552 raft_consensus.cc:729] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.661793 1552 consensus_queue.cc:260] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.662228 1552 ts_tablet_manager.cc:1428] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260927 15:06:21.662434 1552 tablet_bootstrap.cc:492] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:21.662925 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet 04483a489f254123a1ccd69667acb0b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:21 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:21.663424 1561 tablet_bootstrap.cc:492] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:21.663499 1296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "769e9b5c08cd44cc8a0d681500d64f54" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:21.663973 1102 leader_election.cc:341] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.665304 1561 tablet_bootstrap.cc:654] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.667374 1556 raft_consensus.cc:348] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.667855 1556 raft_consensus.cc:374] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.667979 1556 raft_consensus.cc:729] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.668393 1556 consensus_queue.cc:260] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.672468 1562 ts_tablet_manager.cc:1918] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.672667 1556 ts_tablet_manager.cc:1428] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260927 15:06:21.674300 1562 log.cc:1196] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/f271c76b5f2447239d3d014fbde4e8b2
I20260927 15:06:21.675064 1556 tablet_bootstrap.cc:492] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:21.675621 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 5e9b07ea3ec9457399e2b765580d06e7 (table default.Table_e09fcea174c647adb26c6caeacda55a6 [id=450ecac4fd094088b06f5d3add7acd2b]) successfully deleted
W20260927 15:06:21.676026 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 56f3c6a79b0e43769368693b493d73f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56f3c6a79b0e43769368693b493d73f1 already in progress: creating tablet
I20260927 15:06:21.677795 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aa93e083be94764abc98d2419da7e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.679123 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 04483a489f254123a1ccd69667acb0b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:21 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:21.679919 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 04483a489f254123a1ccd69667acb0b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04483a489f254123a1ccd69667acb0b1 already in progress: creating tablet
I20260927 15:06:21.683701 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 1d81159f316e4d9380ff80f179dda660 (DEFAULT_TABLE table=default.Table_59ee7d6e47244bb0b4e3ee148da8d762 [id=1d4c51ac1d444ce284aee76f0bf37c75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.684258 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 0231da3ec6204442885da7981ec2d3ad (DEFAULT_TABLE table=default.Table_76fbebbfe0b34b2a83e4dd9a531de7b6 [id=420a0a49fdde4b47909f90b2935bd6ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.684415 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 0231da3ec6204442885da7981ec2d3ad (DEFAULT_TABLE table=default.Table_76fbebbfe0b34b2a83e4dd9a531de7b6 [id=420a0a49fdde4b47909f90b2935bd6ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.684785 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0231da3ec6204442885da7981ec2d3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.689577 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 0231da3ec6204442885da7981ec2d3ad (DEFAULT_TABLE table=default.Table_76fbebbfe0b34b2a83e4dd9a531de7b6 [id=420a0a49fdde4b47909f90b2935bd6ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.690287 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0231da3ec6204442885da7981ec2d3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.691425 1144 tablet_service.cc:1467] Processing CreateTablet for tablet ba74e7dce0d5464ab3a3598fa1e5bce6 (DEFAULT_TABLE table=default.Table_0c1e3a4a801f4c0f8334becd67f3cf1d [id=2ebbf6b51602411d96110b5b039bc47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.692047 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 9bf5bbd9397a46eda7a60bf1fcfa7f96 (DEFAULT_TABLE table=default.Table_770437b04ff7404294f04f120483eb7b [id=8e19e188f7f149b98bd9be576513a5e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.692174 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 8ecb47b3919442118792eea1f2648a97 (DEFAULT_TABLE table=default.Table_a4e3fc09997845c0b6bfc3a64ad7197f [id=b43fde8760cb48ac94dacc663a831c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.692529 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 34e40bea0cd04d3f8ff17b518f50b859 (DEFAULT_TABLE table=default.Table_766da62d2f6e4daab98bca846d688515 [id=429539baf2a54a1aba8b2c3e7716dfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.693063 1131 tablet_service.cc:1467] Processing CreateTablet for tablet cd1cbe255dea4bd184a504df6da284d8 (DEFAULT_TABLE table=default.Table_f032422e891740819ffdfaeade5c0c1b [id=b99d6a5bd587492e9db5a69843a35245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.693684 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 34e40bea0cd04d3f8ff17b518f50b859 (DEFAULT_TABLE table=default.Table_766da62d2f6e4daab98bca846d688515 [id=429539baf2a54a1aba8b2c3e7716dfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.693935 1404 tablet_service.cc:1467] Processing CreateTablet for tablet ba74e7dce0d5464ab3a3598fa1e5bce6 (DEFAULT_TABLE table=default.Table_0c1e3a4a801f4c0f8334becd67f3cf1d [id=2ebbf6b51602411d96110b5b039bc47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.694128 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e40bea0cd04d3f8ff17b518f50b859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.694628 1413 tablet_service.cc:1467] Processing CreateTablet for tablet cd1cbe255dea4bd184a504df6da284d8 (DEFAULT_TABLE table=default.Table_f032422e891740819ffdfaeade5c0c1b [id=b99d6a5bd587492e9db5a69843a35245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.694790 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba74e7dce0d5464ab3a3598fa1e5bce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.695007 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd1cbe255dea4bd184a504df6da284d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.695315 1267 tablet_service.cc:1467] Processing CreateTablet for tablet ba74e7dce0d5464ab3a3598fa1e5bce6 (DEFAULT_TABLE table=default.Table_0c1e3a4a801f4c0f8334becd67f3cf1d [id=2ebbf6b51602411d96110b5b039bc47f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.695580 1562 ts_tablet_manager.cc:1939] T f271c76b5f2447239d3d014fbde4e8b2 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:21.695772 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 8ecb47b3919442118792eea1f2648a97 (DEFAULT_TABLE table=default.Table_a4e3fc09997845c0b6bfc3a64ad7197f [id=b43fde8760cb48ac94dacc663a831c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.696096 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ecb47b3919442118792eea1f2648a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.697784 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 9bf5bbd9397a46eda7a60bf1fcfa7f96 (DEFAULT_TABLE table=default.Table_770437b04ff7404294f04f120483eb7b [id=8e19e188f7f149b98bd9be576513a5e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.698143 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bf5bbd9397a46eda7a60bf1fcfa7f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.700968 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 9bf5bbd9397a46eda7a60bf1fcfa7f96 (DEFAULT_TABLE table=default.Table_770437b04ff7404294f04f120483eb7b [id=8e19e188f7f149b98bd9be576513a5e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.701375 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bf5bbd9397a46eda7a60bf1fcfa7f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.702957 1432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e2c5c3d0f574422be80b318395f199a" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:21.712947 1402 tablet_service.cc:1467] Processing CreateTablet for tablet b971e7cc702342d8be6d3e478ef38090 (DEFAULT_TABLE table=default.Table_5928117889194139983a092a6a1d747c [id=a161e88ab9d94708b74ac0e008f4808e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.714052 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 8ecb47b3919442118792eea1f2648a97 (DEFAULT_TABLE table=default.Table_a4e3fc09997845c0b6bfc3a64ad7197f [id=b43fde8760cb48ac94dacc663a831c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.714542 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba74e7dce0d5464ab3a3598fa1e5bce6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:21.717586 1099 consensus_peers.cc:487] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df6d7670381b49bb927943b2ee920c84. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:21.718475 1099 leader_election.cc:341] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 769e9b5c08cd44cc8a0d681500d64f54
I20260927 15:06:21.718580 1099 leader_election.cc:302] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.718940 3073 raft_consensus.cc:2726] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.723614 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b971e7cc702342d8be6d3e478ef38090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.734140 1127 tablet_service.cc:1467] Processing CreateTablet for tablet b971e7cc702342d8be6d3e478ef38090 (DEFAULT_TABLE table=default.Table_5928117889194139983a092a6a1d747c [id=a161e88ab9d94708b74ac0e008f4808e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.734797 1142 tablet_service.cc:1467] Processing CreateTablet for tablet aa3094d63be7471191e21a66a2e66dd2 (DEFAULT_TABLE table=default.Table_69a4bed2711242a2be679d44481b97b0 [id=791521edfe5b469aad32454e74ca2c0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.735630 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 9850f919fb14421eb6bc76ab4ac88c0d (DEFAULT_TABLE table=default.Table_c93be0971e984cc0a524ef3e04a5b01c [id=e09cd7252ae747ccb289f498878f2999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.735751 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 3523f8087f2c4d5bb7c59b63cc40816a (DEFAULT_TABLE table=default.Table_7d0fe0f317424922abbcb5c2375a5d6e [id=b8e92e1b5d3d42f5a85ebf6577e3ab73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.736088 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3523f8087f2c4d5bb7c59b63cc40816a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.736129 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 9850f919fb14421eb6bc76ab4ac88c0d (DEFAULT_TABLE table=default.Table_c93be0971e984cc0a524ef3e04a5b01c [id=e09cd7252ae747ccb289f498878f2999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.736425 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9850f919fb14421eb6bc76ab4ac88c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.736529 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 3523f8087f2c4d5bb7c59b63cc40816a (DEFAULT_TABLE table=default.Table_7d0fe0f317424922abbcb5c2375a5d6e [id=b8e92e1b5d3d42f5a85ebf6577e3ab73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.736853 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 984a8729218e42538862cdb41cfbb861 (DEFAULT_TABLE table=default.Table_e0e654856c8c4cb4b7982aa734a49bae [id=79e2b35a2b2846cc9085cf38a42ca960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.737563 1146 tablet_service.cc:1467] Processing CreateTablet for tablet f982f393f34c4b01a3d10806d848a156 (DEFAULT_TABLE table=default.Table_582351ce74b84b4b9ba95b4c76aed8a2 [id=a7f62fa2ae9e4ed8a32f013bc1d28f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.739140 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 984a8729218e42538862cdb41cfbb861 (DEFAULT_TABLE table=default.Table_e0e654856c8c4cb4b7982aa734a49bae [id=79e2b35a2b2846cc9085cf38a42ca960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.739519 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 984a8729218e42538862cdb41cfbb861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.740958 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 8d7b2f46db754d4892a08d0c15f0f7bf (DEFAULT_TABLE table=default.Table_a076458f952d47618ed11925e13327aa [id=111683a21c834f71b7a92a86c6191726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.741334 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d7b2f46db754d4892a08d0c15f0f7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.742887 1556 tablet_bootstrap.cc:654] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.743281 1405 tablet_service.cc:1467] Processing CreateTablet for tablet f982f393f34c4b01a3d10806d848a156 (DEFAULT_TABLE table=default.Table_582351ce74b84b4b9ba95b4c76aed8a2 [id=a7f62fa2ae9e4ed8a32f013bc1d28f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.743637 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f982f393f34c4b01a3d10806d848a156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.744812 3105 consensus_queue.cc:1035] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:21.748898 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d81159f316e4d9380ff80f179dda660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.753896 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0231da3ec6204442885da7981ec2d3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.759513 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba74e7dce0d5464ab3a3598fa1e5bce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.763208 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bf5bbd9397a46eda7a60bf1fcfa7f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.764250 3013 consensus_queue.cc:1035] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:21.767202 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ecb47b3919442118792eea1f2648a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.770381 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e40bea0cd04d3f8ff17b518f50b859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.770532 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd1cbe255dea4bd184a504df6da284d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.770758 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b971e7cc702342d8be6d3e478ef38090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.775035 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa3094d63be7471191e21a66a2e66dd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.777770 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 977) took 5022 ms. Trace:
I20260927 15:06:21.778251 1562 rpcz_store.cc:276] 0927 15:06:16.755215 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.757044 (+ 1829us) service_pool.cc:227] Handling call
0927 15:06:21.284259 (+4527215us) ts_tablet_manager.cc:1145] Deleting tablet f271c76b5f2447239d3d014fbde4e8b2
0927 15:06:21.284270 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.580808 (+296538us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.672379 (+ 91571us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.777752 (+105373us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4527077}
I20260927 15:06:21.779012 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9850f919fb14421eb6bc76ab4ac88c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.779922 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 984a8729218e42538862cdb41cfbb861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.781523 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f982f393f34c4b01a3d10806d848a156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.781723 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 34e40bea0cd04d3f8ff17b518f50b859 (DEFAULT_TABLE table=default.Table_766da62d2f6e4daab98bca846d688515 [id=429539baf2a54a1aba8b2c3e7716dfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.782071 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34e40bea0cd04d3f8ff17b518f50b859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.782929 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3523f8087f2c4d5bb7c59b63cc40816a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.792691 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet f271c76b5f2447239d3d014fbde4e8b2 (table default.Table_e54284c6f69f46a58add5dfc7c9bec4a [id=6b5a311a2ea347fb8e51feecb8e01b7c]) successfully deleted
I20260927 15:06:21.793149 1562 tablet_replica.cc:330] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:21.793557 1562 raft_consensus.cc:2229] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:06:21.795169 1102 leader_election.cc:341] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.795286 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ecb47b3919442118792eea1f2648a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.795291 1102 leader_election.cc:302] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.795660 3073 raft_consensus.cc:2726] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.797487 1562 raft_consensus.cc:2258] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:21.797695 1099 consensus_peers.cc:487] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d533883e3344eca939cd67644895148. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:21.798516 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 8d7b2f46db754d4892a08d0c15f0f7bf (DEFAULT_TABLE table=default.Table_a076458f952d47618ed11925e13327aa [id=111683a21c834f71b7a92a86c6191726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.798940 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d7b2f46db754d4892a08d0c15f0f7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.799667 1562 ts_tablet_manager.cc:1905] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.803130 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 99f8fb206a1e428ca8098eb50a4accb8 (DEFAULT_TABLE table=default.Table_1a48ee50b8894e3682943009faeabbcd [id=cd71627ff1c144448320a6b9a2a685ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.803615 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 3ea6a502cce64a81b324a148973929c5 (DEFAULT_TABLE table=default.Table_eb88510bf8b741bbad0d2e49ca1a0b7d [id=d81b74d76a4142ef9b8c2f0f06fa70e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.804114 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca672b224854e3eb0fd228da87bb8c1 (DEFAULT_TABLE table=default.Table_88e1ef24cbc841da9c1fdfe81dfb80d6 [id=4ba1eb7f5af54e83a1dd65014677a1e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.804639 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 56ae10b37e084b9abd2e7d2e7bc52a56 (DEFAULT_TABLE table=default.Table_a146546821994116a1aa85bab3b3165e [id=df5360f3bd2c4b6f8b6bbc94c91b230c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.805262 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 56ae10b37e084b9abd2e7d2e7bc52a56 (DEFAULT_TABLE table=default.Table_a146546821994116a1aa85bab3b3165e [id=df5360f3bd2c4b6f8b6bbc94c91b230c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.805682 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56ae10b37e084b9abd2e7d2e7bc52a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.809360 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 33d39c222cc84cbfb02674d07ad09175 (DEFAULT_TABLE table=default.Table_cce809a4e7644a39b4ee97078ae8fc27 [id=7b0329a467bd4be19648f24f7a358b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.810060 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 084fbd393881418081df893e13f2fae8 (DEFAULT_TABLE table=default.Table_48f076a7b0434f4ea93a2657e399a765 [id=3e4e0b9b017d4bb1881781cc8a3bb597]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.811038 1143 tablet_service.cc:1467] Processing CreateTablet for tablet bcde406d88c64746ac5970d79d774c4d (DEFAULT_TABLE table=default.Table_ae7f349e69914d07b2857d4decf5b8f6 [id=3617e264501d443083baa532c80b8fbf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:21.811517 901 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet d827f6a3a6834ecd86d8722b1f1e4444 (table default.Table_40080b13414f408bb2af14042c50fd36 [id=612b1b17cb3a43d5a13734758d317e33], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d827f6a3a6834ecd86d8722b1f1e4444 consensus state has no leader
I20260927 15:06:21.811132 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 1909f8ec48cf42148720032de62db909 (DEFAULT_TABLE table=default.Table_4aa9e57d83634b47ad095defed34668e [id=a3a5cb4a5d33493b8f5af983cb6cf54e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.811388 1131 tablet_service.cc:1467] Processing CreateTablet for tablet e808a583f8c74d8a80ec173eae69f2cc (DEFAULT_TABLE table=default.Table_74beb80739aa41539ec16812dd37761c [id=056840e50d5b497bb0b22822397a0864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.813004 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 75078ead08d24cd3a3930e9c7b7cba91 (DEFAULT_TABLE table=default.Table_f09aa55cb7dc412682bd75ac25798b44 [id=70d93f35cff84a1e8ee46046e781887c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.813359 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75078ead08d24cd3a3930e9c7b7cba91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.815553 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 224c237b0e9f4a15a78d1f4ae7eab864 (DEFAULT_TABLE table=default.Table_5b7595df893e4227849f96f42e5bc110 [id=a6f9ffa400b34051a76af71e78f72b9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.815868 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 224c237b0e9f4a15a78d1f4ae7eab864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.819278 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99f8fb206a1e428ca8098eb50a4accb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.819811 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca672b224854e3eb0fd228da87bb8c1 (DEFAULT_TABLE table=default.Table_88e1ef24cbc841da9c1fdfe81dfb80d6 [id=4ba1eb7f5af54e83a1dd65014677a1e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.820312 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 2fa55f2e72764ae8aba99757a173fdd0 (DEFAULT_TABLE table=default.Table_6466b0cace694f81bd2210b587284b7a [id=6e11215de83646f2ab2cbeb1deba7073]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.820729 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fa55f2e72764ae8aba99757a173fdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.823823 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ea6a502cce64a81b324a148973929c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.823892 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 75078ead08d24cd3a3930e9c7b7cba91 (DEFAULT_TABLE table=default.Table_f09aa55cb7dc412682bd75ac25798b44 [id=70d93f35cff84a1e8ee46046e781887c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.824060 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084fbd393881418081df893e13f2fae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.824220 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75078ead08d24cd3a3930e9c7b7cba91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.824411 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56ae10b37e084b9abd2e7d2e7bc52a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.824615 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1909f8ec48cf42148720032de62db909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.824654 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 224c237b0e9f4a15a78d1f4ae7eab864 (DEFAULT_TABLE table=default.Table_5b7595df893e4227849f96f42e5bc110 [id=a6f9ffa400b34051a76af71e78f72b9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.824846 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca672b224854e3eb0fd228da87bb8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.825093 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e808a583f8c74d8a80ec173eae69f2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.827703 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcde406d88c64746ac5970d79d774c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.831569 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 084fbd393881418081df893e13f2fae8 (DEFAULT_TABLE table=default.Table_48f076a7b0434f4ea93a2657e399a765 [id=3e4e0b9b017d4bb1881781cc8a3bb597]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.831738 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 1909f8ec48cf42148720032de62db909 (DEFAULT_TABLE table=default.Table_4aa9e57d83634b47ad095defed34668e [id=a3a5cb4a5d33493b8f5af983cb6cf54e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.832358 1409 tablet_service.cc:1467] Processing CreateTablet for tablet bcde406d88c64746ac5970d79d774c4d (DEFAULT_TABLE table=default.Table_ae7f349e69914d07b2857d4decf5b8f6 [id=3617e264501d443083baa532c80b8fbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.832667 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33d39c222cc84cbfb02674d07ad09175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.832953 1410 tablet_service.cc:1467] Processing CreateTablet for tablet e808a583f8c74d8a80ec173eae69f2cc (DEFAULT_TABLE table=default.Table_74beb80739aa41539ec16812dd37761c [id=056840e50d5b497bb0b22822397a0864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.833638 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 2fa55f2e72764ae8aba99757a173fdd0 (DEFAULT_TABLE table=default.Table_6466b0cace694f81bd2210b587284b7a [id=6e11215de83646f2ab2cbeb1deba7073]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.843713 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3b4aa4811a4e0f8e245812da8f731a (DEFAULT_TABLE table=default.Table_d910172cef91481584bcb74ff261aa94 [id=7c9f2daa51c748d6a1e83368e5c86950]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.844594 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 7478197a83254111bed69f1cb194db52 (DEFAULT_TABLE table=default.Table_6acef4be466846338bef3dfb9ef9cb17 [id=091cbf977c9a4cd58c7acdfad083eff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.846191 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 224c237b0e9f4a15a78d1f4ae7eab864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.847047 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 7478197a83254111bed69f1cb194db52 (DEFAULT_TABLE table=default.Table_6acef4be466846338bef3dfb9ef9cb17 [id=091cbf977c9a4cd58c7acdfad083eff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.847395 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7478197a83254111bed69f1cb194db52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.847838 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 33d39c222cc84cbfb02674d07ad09175 (DEFAULT_TABLE table=default.Table_cce809a4e7644a39b4ee97078ae8fc27 [id=7b0329a467bd4be19648f24f7a358b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.849547 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 99f8fb206a1e428ca8098eb50a4accb8 (DEFAULT_TABLE table=default.Table_1a48ee50b8894e3682943009faeabbcd [id=cd71627ff1c144448320a6b9a2a685ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.851182 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3b4aa4811a4e0f8e245812da8f731a (DEFAULT_TABLE table=default.Table_d910172cef91481584bcb74ff261aa94 [id=7c9f2daa51c748d6a1e83368e5c86950]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.853504 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_621c68a85e5943a8907d419f99272e72" } new_table_name: "default.Table_776494daeb7b4503a513e14e4da8dd2c" modify_external_catalogs: true
I20260927 15:06:21.855000 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5b325959fd7c4c07a329ca3d6d65f01b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:21.855523 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b325959fd7c4c07a329ca3d6d65f01b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:21.856730 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f5ddecd47cad4c52ac5cefff1443300b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:21.856878 1408 tablet_service.cc:1467] Processing CreateTablet for tablet aa3094d63be7471191e21a66a2e66dd2 (DEFAULT_TABLE table=default.Table_69a4bed2711242a2be679d44481b97b0 [id=791521edfe5b469aad32454e74ca2c0f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:21.857210 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5ddecd47cad4c52ac5cefff1443300b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:21.857797 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 3ea6a502cce64a81b324a148973929c5 (DEFAULT_TABLE table=default.Table_eb88510bf8b741bbad0d2e49ca1a0b7d [id=d81b74d76a4142ef9b8c2f0f06fa70e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.859673 1277 tablet_service.cc:1467] Processing CreateTablet for tablet aa3094d63be7471191e21a66a2e66dd2 (DEFAULT_TABLE table=default.Table_69a4bed2711242a2be679d44481b97b0 [id=791521edfe5b469aad32454e74ca2c0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.859704 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 9850f919fb14421eb6bc76ab4ac88c0d (DEFAULT_TABLE table=default.Table_c93be0971e984cc0a524ef3e04a5b01c [id=e09cd7252ae747ccb289f498878f2999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.860024 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa3094d63be7471191e21a66a2e66dd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.860384 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ca9820ae718c4a50b76a64d609cb2693"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:21.860797 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca9820ae718c4a50b76a64d609cb2693 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:21.861830 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9850f919fb14421eb6bc76ab4ac88c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.862501 1280 tablet_service.cc:1467] Processing CreateTablet for tablet cd1cbe255dea4bd184a504df6da284d8 (DEFAULT_TABLE table=default.Table_f032422e891740819ffdfaeade5c0c1b [id=b99d6a5bd587492e9db5a69843a35245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.862852 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd1cbe255dea4bd184a504df6da284d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.865155 1284 tablet_service.cc:1467] Processing CreateTablet for tablet b971e7cc702342d8be6d3e478ef38090 (DEFAULT_TABLE table=default.Table_5928117889194139983a092a6a1d747c [id=a161e88ab9d94708b74ac0e008f4808e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:21.865291 1102 consensus_peers.cc:487] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:21.865554 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b971e7cc702342d8be6d3e478ef38090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.868053 3012 raft_consensus.cc:482] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.868170 3012 raft_consensus.cc:504] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.868750 3012 leader_election.cc:288] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.868880 2119 ts_tablet_manager.cc:1918] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:21.868973 2119 log.cc:1196] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/cd76c49eda1c4b4ca0edf0f4d2790188
I20260927 15:06:21.869338 2119 ts_tablet_manager.cc:1939] T cd76c49eda1c4b4ca0edf0f4d2790188 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:21.873399 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 3523f8087f2c4d5bb7c59b63cc40816a (DEFAULT_TABLE table=default.Table_7d0fe0f317424922abbcb5c2375a5d6e [id=b8e92e1b5d3d42f5a85ebf6577e3ab73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.873845 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3523f8087f2c4d5bb7c59b63cc40816a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.875639 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 4d4c717419864473b7cd47ece4ffd805
I20260927 15:06:21.876062 905 catalog_manager.cc:6565] ReplaceTablet: tablet 4d4c717419864473b7cd47ece4ffd805 deleted and replaced by tablet dc1e9e92132c4ae588121644137ac70a
I20260927 15:06:21.876195 905 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:49800 (request call id 1415) took 1193 ms. Trace:
I20260927 15:06:21.876302 905 rpcz_store.cc:276] 0927 15:06:20.683075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:20.683192 (+ 117us) service_pool.cc:227] Handling call
0927 15:06:21.876166 (+1192974us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:21.662972 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:21.665882 (+ 2910us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:21.665890 (+ 8us) write_op.cc:435] Acquired schema lock
0927 15:06:21.665893 (+ 3us) tablet.cc:660] Decoding operations
0927 15:06:21.666023 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:21.666037 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:21.666042 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:21.666132 (+ 90us) tablet.cc:699] Row locks acquired
0927 15:06:21.666134 (+ 2us) write_op.cc:260] PREPARE: finished
0927 15:06:21.671011 (+ 4877us) write_op.cc:270] Start()
0927 15:06:21.671056 (+ 45us) write_op.cc:276] Timestamp: P: 1790521581670959 usec, L: 0
0927 15:06:21.671060 (+ 4us) op_driver.cc:331] REPLICATION: starting
0927 15:06:21.858343 (+187283us) log.cc:842] Serialized 622 byte log entry
0927 15:06:21.858556 (+ 213us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f2c3410dd02 00007f2c354407f1 00007f2c3543f359 00007f2c354471bb 00007f2c35447038 00000000009edb7c 00007f2c28c41344 00007f2c28c4491b 00007f2c28c44798 00000000009edb7c
0927 15:06:21.874173 (+ 15617us) op_driver.cc:444] REPLICATION: finished
0927 15:06:21.874402 (+ 229us) write_op.cc:301] APPLY: starting
0927 15:06:21.874423 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:21.874473 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:21.874478 (+ 5us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:21.874599 (+ 121us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:21.874660 (+ 61us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 15:06:21.874666 (+ 6us) write_op.cc:312] APPLY: finished
0927 15:06:21.874756 (+ 90us) log.cc:842] Serialized 29 byte log entry
0927 15:06:21.874844 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:21.874864 (+ 20us) write_op.cc:454] Released schema lock
0927 15:06:21.874872 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:21.874931 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:21.874935 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":172,"apply.run_cpu_time_us":586,"apply.run_wall_time_us":586,"num_ops":2,"prepare.queue_time_us":105720,"prepare.run_cpu_time_us":2653,"prepare.run_wall_time_us":195649,"raft.queue_time_us":3067,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":249,"replication_time_us":203085,"spinlock_wait_cycles":430195584}]]}
I20260927 15:06:21.876677 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 8d7b2f46db754d4892a08d0c15f0f7bf (DEFAULT_TABLE table=default.Table_a076458f952d47618ed11925e13327aa [id=111683a21c834f71b7a92a86c6191726]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.876998 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d7b2f46db754d4892a08d0c15f0f7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.877544 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 87b54364a63b48e9981463d1019dad59
I20260927 15:06:21.879014 1266 tablet_service.cc:1467] Processing CreateTablet for tablet f982f393f34c4b01a3d10806d848a156 (DEFAULT_TABLE table=default.Table_582351ce74b84b4b9ba95b4c76aed8a2 [id=a7f62fa2ae9e4ed8a32f013bc1d28f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.879303 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f982f393f34c4b01a3d10806d848a156. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.880389 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d4c717419864473b7cd47ece4ffd805 with delete_type TABLET_DATA_DELETED (replaced by tablet dc1e9e92132c4ae588121644137ac70a) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:21.880645 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 87b54364a63b48e9981463d1019dad59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:21 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:21.882136 1562 ts_tablet_manager.cc:1918] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.883096 1562 log.cc:1196] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/bc20a62bbd484c4e9e25cf1c15e1dde0
I20260927 15:06:21.883667 1292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44e2611d2bf40ae90c4fd857225e39e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:21.884095 1102 leader_election.cc:341] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.884618 1562 ts_tablet_manager.cc:1939] T bc20a62bbd484c4e9e25cf1c15e1dde0 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:21.885363 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_171a88ebc5dc4a92b5a077a13579ebc1" } new_table_name: "default.Table_7006597b352b41a3b4586f2af6d635ae" modify_external_catalogs: true
I20260927 15:06:21.886277 2119 tablet_replica.cc:330] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:21.886534 2119 raft_consensus.cc:2229] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:21.886698 2119 raft_consensus.cc:2258] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.886699 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cff6f4158c88488a9a5ab6a6b59d6711" } new_table_name: "default.Table_fe3cc6a2a1d94b699e80fe949aaed178" modify_external_catalogs: true
I20260927 15:06:21.887377 2119 ts_tablet_manager.cc:1905] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.887394 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 87b54364a63b48e9981463d1019dad59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:21 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:21.889392 1376 consensus_peers.cc:487] T 59d852b4adbc47c58db352535923ff49 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:21.890959 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 99f8fb206a1e428ca8098eb50a4accb8 (DEFAULT_TABLE table=default.Table_1a48ee50b8894e3682943009faeabbcd [id=cd71627ff1c144448320a6b9a2a685ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.891388 3013 raft_consensus.cc:482] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:21.891649 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99f8fb206a1e428ca8098eb50a4accb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.891578 3013 raft_consensus.cc:504] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.892379 3013 leader_election.cc:288] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:21.892908 1292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568ba79ea795403cba76fb6632efd7e2" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:21.893414 1102 leader_election.cc:341] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:21.896266 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d4c717419864473b7cd47ece4ffd805 with delete_type TABLET_DATA_DELETED (replaced by tablet dc1e9e92132c4ae588121644137ac70a) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:21.899480 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 984a8729218e42538862cdb41cfbb861 (DEFAULT_TABLE table=default.Table_e0e654856c8c4cb4b7982aa734a49bae [id=79e2b35a2b2846cc9085cf38a42ca960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.899854 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 984a8729218e42538862cdb41cfbb861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.906461 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b3b4aa4811a4e0f8e245812da8f731a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.911708 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 978) took 5155 ms. Trace:
I20260927 15:06:21.911810 1562 rpcz_store.cc:276] 0927 15:06:16.755838 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.757210 (+ 1372us) service_pool.cc:227] Handling call
0927 15:06:21.793103 (+5035893us) ts_tablet_manager.cc:1145] Deleting tablet bc20a62bbd484c4e9e25cf1c15e1dde0
0927 15:06:21.793114 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.812244 (+ 19130us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.882039 (+ 69795us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.911672 (+ 29633us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5035757}
I20260927 15:06:21.912114 1562 tablet_replica.cc:330] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:21.912312 1562 raft_consensus.cc:2229] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:21.912626 1562 raft_consensus.cc:2258] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.913543 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet bc20a62bbd484c4e9e25cf1c15e1dde0 (table default.Table_565f7d1851f74565b073c0e1c74d9403 [id=3305179f942c4133896ea7b9b1bc898b]) successfully deleted
I20260927 15:06:21.913654 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 75078ead08d24cd3a3930e9c7b7cba91 (DEFAULT_TABLE table=default.Table_f09aa55cb7dc412682bd75ac25798b44 [id=70d93f35cff84a1e8ee46046e781887c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.914006 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75078ead08d24cd3a3930e9c7b7cba91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.914041 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 56ae10b37e084b9abd2e7d2e7bc52a56 (DEFAULT_TABLE table=default.Table_a146546821994116a1aa85bab3b3165e [id=df5360f3bd2c4b6f8b6bbc94c91b230c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.914173 1562 ts_tablet_manager.cc:1905] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.914367 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56ae10b37e084b9abd2e7d2e7bc52a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.915414 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca672b224854e3eb0fd228da87bb8c1 (DEFAULT_TABLE table=default.Table_88e1ef24cbc841da9c1fdfe81dfb80d6 [id=4ba1eb7f5af54e83a1dd65014677a1e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.915933 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca672b224854e3eb0fd228da87bb8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.916646 1561 tablet_bootstrap.cc:492] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:21.916762 1561 ts_tablet_manager.cc:1397] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.258s user 0.025s sys 0.028s
I20260927 15:06:21.917447 1561 raft_consensus.cc:348] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.917634 1561 raft_consensus.cc:374] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.917680 1561 raft_consensus.cc:729] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.917841 1561 consensus_queue.cc:260] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.917922 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 33d39c222cc84cbfb02674d07ad09175 (DEFAULT_TABLE table=default.Table_cce809a4e7644a39b4ee97078ae8fc27 [id=7b0329a467bd4be19648f24f7a358b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.918215 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33d39c222cc84cbfb02674d07ad09175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.918303 1561 ts_tablet_manager.cc:1428] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260927 15:06:21.918516 1561 tablet_bootstrap.cc:492] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:21.918649 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 3ea6a502cce64a81b324a148973929c5 (DEFAULT_TABLE table=default.Table_eb88510bf8b741bbad0d2e49ca1a0b7d [id=d81b74d76a4142ef9b8c2f0f06fa70e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.918959 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ea6a502cce64a81b324a148973929c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.920014 1561 tablet_bootstrap.cc:654] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.925817 1404 tablet_service.cc:1467] Processing CreateTablet for tablet fb4a7b73fccc47d0a6bd6aeb7857b0bd (DEFAULT_TABLE table=default.Table_c536d97d54cd4c5295dbce537a19e1b5 [id=3fdf540655694d7bbcfe1cac75bce4f3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:21.927692 910 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.201.1:54519 (request call id 155) took 758 ms (client timeout 1000 ms). Trace:
I20260927 15:06:21.927879 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 089b6b5ac39d49fea744240261a8010e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:21.927837 910 rpcz_store.cc:269] 0927 15:06:21.168963 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.186783 (+ 17820us) service_pool.cc:227] Handling call
0927 15:06:21.927618 (+740835us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:21.894007 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:21.894098 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:21.894114 (+ 16us) write_op.cc:435] Acquired schema lock
0927 15:06:21.894116 (+ 2us) tablet.cc:660] Decoding operations
0927 15:06:21.894229 (+ 113us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:21.894241 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:21.894246 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:21.894350 (+ 104us) tablet.cc:699] Row locks acquired
0927 15:06:21.894354 (+ 4us) write_op.cc:260] PREPARE: finished
0927 15:06:21.894972 (+ 618us) write_op.cc:270] Start()
0927 15:06:21.895018 (+ 46us) write_op.cc:276] Timestamp: P: 1790521581894381 usec, L: 0
0927 15:06:21.895025 (+ 7us) op_driver.cc:331] REPLICATION: starting
0927 15:06:21.895263 (+ 238us) log.cc:842] Serialized 901 byte log entry
0927 15:06:21.924265 (+ 29002us) op_driver.cc:444] REPLICATION: finished
0927 15:06:21.924570 (+ 305us) write_op.cc:301] APPLY: starting
0927 15:06:21.924586 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:21.924626 (+ 40us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:21.924651 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:21.924721 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:21.924759 (+ 38us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 15:06:21.924766 (+ 7us) write_op.cc:312] APPLY: finished
0927 15:06:21.924838 (+ 72us) log.cc:842] Serialized 29 byte log entry
0927 15:06:21.924895 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:21.924913 (+ 18us) write_op.cc:454] Released schema lock
0927 15:06:21.924920 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:21.924972 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:21.924975 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":245,"apply.run_cpu_time_us":458,"apply.run_wall_time_us":458,"num_ops":2,"prepare.queue_time_us":333663,"prepare.run_cpu_time_us":789,"prepare.run_wall_time_us":2072,"replication_time_us":29210}]]}
I20260927 15:06:21.928689 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 0ae30595912943aaa58f1ebe9dc965e6 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:21.929207 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bf2c20ff67ba49a588bcd755ca7c12d9
I20260927 15:06:21.929491 1127 tablet_service.cc:1467] Processing CreateTablet for tablet fb4a7b73fccc47d0a6bd6aeb7857b0bd (DEFAULT_TABLE table=default.Table_c536d97d54cd4c5295dbce537a19e1b5 [id=3fdf540655694d7bbcfe1cac75bce4f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.929905 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb4a7b73fccc47d0a6bd6aeb7857b0bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.930307 1131 tablet_service.cc:1514] Processing DeleteTablet for tablet bf2c20ff67ba49a588bcd755ca7c12d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:21.932534 1561 tablet_bootstrap.cc:492] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:21.932667 1561 ts_tablet_manager.cc:1397] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260927 15:06:21.933190 1562 ts_tablet_manager.cc:1918] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:21.933674 1562 log.cc:1196] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/5e9b07ea3ec9457399e2b765580d06e7
I20260927 15:06:21.933460 1561 raft_consensus.cc:348] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.934263 1561 raft_consensus.cc:374] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.934353 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 224c237b0e9f4a15a78d1f4ae7eab864 (DEFAULT_TABLE table=default.Table_5b7595df893e4227849f96f42e5bc110 [id=a6f9ffa400b34051a76af71e78f72b9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.934448 1562 ts_tablet_manager.cc:1939] T 5e9b07ea3ec9457399e2b765580d06e7 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:21.934721 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 224c237b0e9f4a15a78d1f4ae7eab864. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:21.935009 1102 consensus_peers.cc:487] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:21.936031 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 979) took 5179 ms. Trace:
I20260927 15:06:21.936107 1562 rpcz_store.cc:276] 0927 15:06:16.756230 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.757377 (+ 1147us) service_pool.cc:227] Handling call
0927 15:06:21.912068 (+5154691us) ts_tablet_manager.cc:1145] Deleting tablet 5e9b07ea3ec9457399e2b765580d06e7
0927 15:06:21.912079 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:21.919975 (+ 7896us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.933100 (+ 13125us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:21.936015 (+ 2915us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8448,"tablet-delete.queue_time_us":5154552}
I20260927 15:06:21.936501 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 5e9b07ea3ec9457399e2b765580d06e7 (table default.Table_e09fcea174c647adb26c6caeacda55a6 [id=450ecac4fd094088b06f5d3add7acd2b]) successfully deleted
I20260927 15:06:21.937948 1562 tablet_replica.cc:330] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:21.938119 1562 raft_consensus.cc:2229] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:21.939858 1562 pending_rounds.cc:62] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:21.940531 1562 pending_rounds.cc:68] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976378704596992 op_type: NO_OP noop_request { }
I20260927 15:06:21.940992 1562 raft_consensus.cc:2866] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:21.941336 1562 raft_consensus.cc:2258] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:21.941843 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet bf2c20ff67ba49a588bcd755ca7c12d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:21.934419 1561 raft_consensus.cc:729] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.942194 1561 consensus_queue.cc:260] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:21.942883 1561 ts_tablet_manager.cc:1428] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260927 15:06:21.943164 1561 tablet_bootstrap.cc:492] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:21.944518 1561 tablet_bootstrap.cc:654] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:21.946056 1562 ts_tablet_manager.cc:1905] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:21.949332 1556 tablet_bootstrap.cc:492] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:21.949539 1556 ts_tablet_manager.cc:1397] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.275s user 0.006s sys 0.000s
I20260927 15:06:21.951000 1556 raft_consensus.cc:348] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.955827 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 084fbd393881418081df893e13f2fae8 (DEFAULT_TABLE table=default.Table_48f076a7b0434f4ea93a2657e399a765 [id=3e4e0b9b017d4bb1881781cc8a3bb597]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.956218 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084fbd393881418081df893e13f2fae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.955838 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 2fa55f2e72764ae8aba99757a173fdd0 (DEFAULT_TABLE table=default.Table_6466b0cace694f81bd2210b587284b7a [id=6e11215de83646f2ab2cbeb1deba7073]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.957763 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 7142c97a22e74bc8b93c7e9acb949073 (DEFAULT_TABLE table=default.Table_c272da8a59fe42d5a5a4bf88b8f3f3ce [id=abea2823a8134cc5815809cf36e3ef55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.957863 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fa55f2e72764ae8aba99757a173fdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.958088 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7142c97a22e74bc8b93c7e9acb949073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.959774 1279 tablet_service.cc:1467] Processing CreateTablet for tablet e808a583f8c74d8a80ec173eae69f2cc (DEFAULT_TABLE table=default.Table_74beb80739aa41539ec16812dd37761c [id=056840e50d5b497bb0b22822397a0864]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.960053 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e808a583f8c74d8a80ec173eae69f2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.960935 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 1909f8ec48cf42148720032de62db909 (DEFAULT_TABLE table=default.Table_4aa9e57d83634b47ad095defed34668e [id=a3a5cb4a5d33493b8f5af983cb6cf54e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.961225 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1909f8ec48cf42148720032de62db909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.963687 1283 tablet_service.cc:1467] Processing CreateTablet for tablet bcde406d88c64746ac5970d79d774c4d (DEFAULT_TABLE table=default.Table_ae7f349e69914d07b2857d4decf5b8f6 [id=3617e264501d443083baa532c80b8fbf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:21.963814 1099 leader_election.cc:341] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b44e2611d2bf40ae90c4fd857225e39e
I20260927 15:06:21.963918 1099 leader_election.cc:302] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.963984 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcde406d88c64746ac5970d79d774c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.964330 3073 raft_consensus.cc:2726] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:21.965039 1099 leader_election.cc:341] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 568ba79ea795403cba76fb6632efd7e2
I20260927 15:06:21.965137 1099 leader_election.cc:302] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:21.965670 3012 raft_consensus.cc:2726] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:21.966712 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 7c6a3584c1c844ff9279a5db36a78bf0 (DEFAULT_TABLE table=default.Table_37bb6ce46e864f588d2f5d01d8c88f9e [id=2d9ba6e026c84c238c71be19badacc6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.968216 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 46423c50fa7144f7a299765cd476bb18 (DEFAULT_TABLE table=default.Table_a559d7c784e0485bbd41c3a4dfbd34d2 [id=f9a2fca829af4eb5b882b493603c889b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.969609 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 35f08d9cb7314c769a49ae3010b98077 (DEFAULT_TABLE table=default.Table_3f53d3dc29354f54b93bebe7ab2330b5 [id=06a55a2694e349e2baffd7fefa22f960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.970860 1141 tablet_service.cc:1467] Processing CreateTablet for tablet ffaa856cb0b146dbb732762651e49912 (DEFAULT_TABLE table=default.Table_fb2ab3810f4e4052a01cd9f20f74aab4 [id=1ce7ed79569f4dd5bec9bf44df869ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.974893 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 45fbe474949344348cd2db98b75d4916 (DEFAULT_TABLE table=default.Table_452ab25734dc4aa9a28e08f23eb0d502 [id=aad2efe6b26447a1b398e70077eeffab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.976208 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 1f1056a308354ae8a980c08f211db65d (DEFAULT_TABLE table=default.Table_f82a62b3d6fa40c5ba2dfd33bb37ee52 [id=0b66ce15feb741e28eb6bfcbe0357dfb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:21.977906 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 87b54364a63b48e9981463d1019dad59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87b54364a63b48e9981463d1019dad59 already in progress: creating tablet
I20260927 15:06:21.979038 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 26150a10c75948bb9e5c37e46f772993 (DEFAULT_TABLE table=default.Table_0fb66217d0e64c60927679b2a228d43c [id=4386b7d2c535494d9b5ac2e58c267677]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:21.979136 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 4d4c717419864473b7cd47ece4ffd805 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d4c717419864473b7cd47ece4ffd805 already in progress: creating tablet
I20260927 15:06:21.980074 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 0521a9d171e047cba5578d15f4c61ab1 (DEFAULT_TABLE table=default.Table_2660ca6fcea7477b8da41e782e621c59 [id=af1ab07badb04080a2e5da28c9bd5924]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:21.980129 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bf2c20ff67ba49a588bcd755ca7c12d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf2c20ff67ba49a588bcd755ca7c12d9 already in progress: creating tablet
I20260927 15:06:21.982535 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 03ce59f22cd24295908c84ebbfc68ff6 (DEFAULT_TABLE table=default.Table_cc02889552444c75b532fd43df526684 [id=7ae0fdb7af364d8e8db30f04eb9d91d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.983245 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 5e04612637ac41c0a3b89b642823e9a1 (DEFAULT_TABLE table=default.Table_25c945ca9a864192a29061360e38dc1d [id=96266e4cf3f943a7b0a4210747d10d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.987519 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 5a8f1e81d7914ff585d3c77a2a1a99bc (DEFAULT_TABLE table=default.Table_587629fe75ba4c53b0146880ced51cfc [id=2b45e427c19749a6a9244ec7d05ac794]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.988576 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 01b31e13faed44088c5ad5e3e9fa6b3f (DEFAULT_TABLE table=default.Table_144247c8f6c749539a8c431dd3e74d17 [id=e8ef09e7d3114b19a5e62a4ff883166e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.953878 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 7142c97a22e74bc8b93c7e9acb949073 (DEFAULT_TABLE table=default.Table_c272da8a59fe42d5a5a4bf88b8f3f3ce [id=abea2823a8134cc5815809cf36e3ef55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.992933 1556 raft_consensus.cc:374] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:21.962900 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 7c6a3584c1c844ff9279a5db36a78bf0 (DEFAULT_TABLE table=default.Table_37bb6ce46e864f588d2f5d01d8c88f9e [id=2d9ba6e026c84c238c71be19badacc6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.993083 1556 raft_consensus.cc:729] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:21.965418 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca672b224854e3eb0fd228da87bb8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.993458 1128 tablet_service.cc:1467] Processing CreateTablet for tablet d62b162e23aa40d591dbfe134206182d (DEFAULT_TABLE table=default.Table_9ded0b1246144fb28700872f4ab1e728 [id=08c77551124e425c8c687581d7825db1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.993676 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcde406d88c64746ac5970d79d774c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.993829 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 9f15aea505f04c97be71921bcf0b1775 (DEFAULT_TABLE table=default.Table_b9d57ae6df614ca08fee1dc08d3e447e [id=b80ebd666d9e40e098f88e435670b7c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.994203 1137 tablet_service.cc:1467] Processing CreateTablet for tablet fae262d440df4c8c8d08d3cf4b57ffe8 (DEFAULT_TABLE table=default.Table_6a5f533041cd4f09be995950a5a4c79b [id=2979a19f8afe49db827a09e15d039eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.994447 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7478197a83254111bed69f1cb194db52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.994633 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c6a3584c1c844ff9279a5db36a78bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:21.993546 1556 consensus_queue.cc:260] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:21.975768 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 35f08d9cb7314c769a49ae3010b98077 (DEFAULT_TABLE table=default.Table_3f53d3dc29354f54b93bebe7ab2330b5 [id=06a55a2694e349e2baffd7fefa22f960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.982345 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 45fbe474949344348cd2db98b75d4916 (DEFAULT_TABLE table=default.Table_452ab25734dc4aa9a28e08f23eb0d502 [id=aad2efe6b26447a1b398e70077eeffab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.000269 3073 raft_consensus.cc:482] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.000392 3073 raft_consensus.cc:504] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.000952 3073 leader_election.cc:288] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.001075 3073 consensus_queue.cc:1035] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:21.991854 1403 tablet_service.cc:1467] Processing CreateTablet for tablet ffaa856cb0b146dbb732762651e49912 (DEFAULT_TABLE table=default.Table_fb2ab3810f4e4052a01cd9f20f74aab4 [id=1ce7ed79569f4dd5bec9bf44df869ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.994705 1413 tablet_service.cc:1467] Processing CreateTablet for tablet 46423c50fa7144f7a299765cd476bb18 (DEFAULT_TABLE table=default.Table_a559d7c784e0485bbd41c3a4dfbd34d2 [id=f9a2fca829af4eb5b882b493603c889b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.008216 1298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac64eacc7d924940aacc8779b5bfeae7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.009413 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 7478197a83254111bed69f1cb194db52 (DEFAULT_TABLE table=default.Table_6acef4be466846338bef3dfb9ef9cb17 [id=091cbf977c9a4cd58c7acdfad083eff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.009907 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7478197a83254111bed69f1cb194db52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.010192 1269 tablet_service.cc:1467] Processing CreateTablet for tablet fb4a7b73fccc47d0a6bd6aeb7857b0bd (DEFAULT_TABLE table=default.Table_c536d97d54cd4c5295dbce537a19e1b5 [id=3fdf540655694d7bbcfe1cac75bce4f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.010572 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d4c717419864473b7cd47ece4ffd805 with delete_type TABLET_DATA_DELETED (replaced by tablet dc1e9e92132c4ae588121644137ac70a) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:22.010668 1099 leader_election.cc:341] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ac64eacc7d924940aacc8779b5bfeae7
I20260927 15:06:21.996742 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1909f8ec48cf42148720032de62db909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.011140 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99f8fb206a1e428ca8098eb50a4accb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.011559 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45fbe474949344348cd2db98b75d4916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.011734 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084fbd393881418081df893e13f2fae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.011874 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7142c97a22e74bc8b93c7e9acb949073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.012064 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b3b4aa4811a4e0f8e245812da8f731a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.015611 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e808a583f8c74d8a80ec173eae69f2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.016995 3135 consensus_queue.cc:1035] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:22.017198 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3b4aa4811a4e0f8e245812da8f731a (DEFAULT_TABLE table=default.Table_d910172cef91481584bcb74ff261aa94 [id=7c9f2daa51c748d6a1e83368e5c86950]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:21.997318 1556 ts_tablet_manager.cc:1428] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.048s user 0.002s sys 0.000s
I20260927 15:06:22.018042 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f08d9cb7314c769a49ae3010b98077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.019341 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33d39c222cc84cbfb02674d07ad09175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.019531 1556 tablet_bootstrap.cc:492] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:22.022401 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffaa856cb0b146dbb732762651e49912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.024730 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fa55f2e72764ae8aba99757a173fdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.026552 3105 raft_consensus.cc:482] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.026911 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb4a7b73fccc47d0a6bd6aeb7857b0bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.027676 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb4a7b73fccc47d0a6bd6aeb7857b0bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.027937 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b3b4aa4811a4e0f8e245812da8f731a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.029434 3129 tablet.cc:1722] T 0702d9501ac047938d02ef2521dbf0d5 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:22.031057 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa3094d63be7471191e21a66a2e66dd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.034724 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ea6a502cce64a81b324a148973929c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.029044 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 7142c97a22e74bc8b93c7e9acb949073 (DEFAULT_TABLE table=default.Table_c272da8a59fe42d5a5a4bf88b8f3f3ce [id=abea2823a8134cc5815809cf36e3ef55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.029328 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet 87b54364a63b48e9981463d1019dad59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:21 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:22.040747 1485 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:22.041038 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7142c97a22e74bc8b93c7e9acb949073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.041494 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46423c50fa7144f7a299765cd476bb18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.027614 3105 raft_consensus.cc:504] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.044693 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "171ba98418b34aa283b7a7b243678fa9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:22.045264 1374 leader_election.cc:341] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.045831 3105 leader_election.cc:288] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:22.048756 1296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "171ba98418b34aa283b7a7b243678fa9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:22.049813 1376 leader_election.cc:341] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.049902 1376 leader_election.cc:302] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:22.051213 3131 tablet.cc:1722] T 0702d9501ac047938d02ef2521dbf0d5 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:22.052232 3106 raft_consensus.cc:2726] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:22.052951 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d15b7dfb83494d329ca75dd96a189c60 consensus state has no leader
I20260927 15:06:22.055749 1556 tablet_bootstrap.cc:654] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.056734 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1d4cfca9d3ab48fe81810a8d9c706cb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.057488 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d4cfca9d3ab48fe81810a8d9c706cb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.059486 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_74b2f73aa6ad4579968493afc74d80d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.059937 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74b2f73aa6ad4579968493afc74d80d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.064163 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f700aca14beb4e8a966b006c7a705676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.064754 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f700aca14beb4e8a966b006c7a705676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.069422 1562 ts_tablet_manager.cc:1918] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:22.071725 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 1f1056a308354ae8a980c08f211db65d (DEFAULT_TABLE table=default.Table_f82a62b3d6fa40c5ba2dfd33bb37ee52 [id=0b66ce15feb741e28eb6bfcbe0357dfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.072398 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 7c6a3584c1c844ff9279a5db36a78bf0 (DEFAULT_TABLE table=default.Table_37bb6ce46e864f588d2f5d01d8c88f9e [id=2d9ba6e026c84c238c71be19badacc6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.087616 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c6a3584c1c844ff9279a5db36a78bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.089082 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ce59f22cd24295908c84ebbfc68ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.091784 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet bf2c20ff67ba49a588bcd755ca7c12d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:20 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:22.088738 1561 tablet_bootstrap.cc:492] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:22.092414 1561 ts_tablet_manager.cc:1397] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.149s user 0.006s sys 0.002s
I20260927 15:06:22.092980 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e04612637ac41c0a3b89b642823e9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.093102 1562 log.cc:1196] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/0f4cff4a06db44269defca578af289d8
I20260927 15:06:22.093509 1562 ts_tablet_manager.cc:1939] T 0f4cff4a06db44269defca578af289d8 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:22.096405 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0521a9d171e047cba5578d15f4c61ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.093964 1561 raft_consensus.cc:348] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.098286 1561 raft_consensus.cc:374] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.098364 1561 raft_consensus.cc:729] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.098992 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f1056a308354ae8a980c08f211db65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.099390 1561 consensus_queue.cc:260] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.102938 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45fbe474949344348cd2db98b75d4916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.104058 913 catalog_manager.cc:5495] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:22.104501 913 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 (table default.Table_9f691e4415864362a0a11b7ef69d222c [id=b09765fbcc8e4859b112206dd59e8ee8]). Expected version 1 got 0
I20260927 15:06:22.104907 913 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:22.105497 913 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
I20260927 15:06:22.106949 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a8f1e81d7914ff585d3c77a2a1a99bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.110940 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46423c50fa7144f7a299765cd476bb18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.118505 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26150a10c75948bb9e5c37e46f772993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.122557 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f08d9cb7314c769a49ae3010b98077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.126469 3142 tablet.cc:1722] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:22.127048 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffaa856cb0b146dbb732762651e49912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.131271 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9fd946f328b8412b856c361de7314792"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.131862 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fd946f328b8412b856c361de7314792 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.145750 1561 ts_tablet_manager.cc:1428] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.053s user 0.001s sys 0.001s
I20260927 15:06:22.146008 3013 raft_consensus.cc:482] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.149219 3013 raft_consensus.cc:504] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.150626 3013 leader_election.cc:288] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.151557 3147 raft_consensus.cc:482] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:22.153457 3147 raft_consensus.cc:504] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.160734 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b31e13faed44088c5ad5e3e9fa6b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.166309 3147 leader_election.cc:288] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.169989 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d62b162e23aa40d591dbfe134206182d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.171036 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f15aea505f04c97be71921bcf0b1775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.175490 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 982) took 5418 ms. Trace:
I20260927 15:06:22.175613 1562 rpcz_store.cc:276] 0927 15:06:16.757426 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.757542 (+ 116us) service_pool.cc:227] Handling call
0927 15:06:21.937908 (+5180366us) ts_tablet_manager.cc:1145] Deleting tablet 0f4cff4a06db44269defca578af289d8
0927 15:06:21.937918 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.042880 (+104962us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.069309 (+ 26429us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.175476 (+106167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5180265}
I20260927 15:06:22.175956 1562 tablet_replica.cc:330] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:22.176169 1562 raft_consensus.cc:2229] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:22.177175 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 0f4cff4a06db44269defca578af289d8 (table default.Table_1b1639fc47724907a79f94e34f6b9469 [id=8be5c577dcb3490d883bede28c6b73ea]) successfully deleted
I20260927 15:06:22.177736 1562 pending_rounds.cc:62] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:22.177799 1562 pending_rounds.cc:68] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976375985188864 op_type: NO_OP noop_request { }
I20260927 15:06:22.177924 1562 raft_consensus.cc:2866] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:22.178016 1562 raft_consensus.cc:2258] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.178076 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fae262d440df4c8c8d08d3cf4b57ffe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.178622 1562 ts_tablet_manager.cc:1905] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.185627 1561 tablet_bootstrap.cc:492] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:22.187270 1561 tablet_bootstrap.cc:654] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.192855 1562 ts_tablet_manager.cc:1918] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:22.196945 1562 log.cc:1196] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/6b1f2143af1142eb9f3dbc777299c186
I20260927 15:06:22.201027 1562 ts_tablet_manager.cc:1939] T 6b1f2143af1142eb9f3dbc777299c186 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:22.201695 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 983) took 5443 ms. Trace:
I20260927 15:06:22.203125 1562 rpcz_store.cc:276] 0927 15:06:16.757805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.757850 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:22.175914 (+5418064us) ts_tablet_manager.cc:1145] Deleting tablet 6b1f2143af1142eb9f3dbc777299c186
0927 15:06:22.175926 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.182374 (+ 6448us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.192780 (+ 10406us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.201680 (+ 8900us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5417932}
I20260927 15:06:22.204000 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 6b1f2143af1142eb9f3dbc777299c186 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]) successfully deleted
I20260927 15:06:22.204816 1562 tablet_replica.cc:330] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:22.205093 1562 raft_consensus.cc:2229] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:22.205468 1562 raft_consensus.cc:2258] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.206792 1562 ts_tablet_manager.cc:1905] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.209867 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c6a3584c1c844ff9279a5db36a78bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.211050 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 46423c50fa7144f7a299765cd476bb18 (DEFAULT_TABLE table=default.Table_a559d7c784e0485bbd41c3a4dfbd34d2 [id=f9a2fca829af4eb5b882b493603c889b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.081621 3129 tablet.cc:1722] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:22.081959 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 01b31e13faed44088c5ad5e3e9fa6b3f (DEFAULT_TABLE table=default.Table_144247c8f6c749539a8c431dd3e74d17 [id=e8ef09e7d3114b19a5e62a4ff883166e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.215166 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b31e13faed44088c5ad5e3e9fa6b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.082201 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 26150a10c75948bb9e5c37e46f772993 (DEFAULT_TABLE table=default.Table_0fb66217d0e64c60927679b2a228d43c [id=4386b7d2c535494d9b5ac2e58c267677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.215971 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26150a10c75948bb9e5c37e46f772993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.085029 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 0521a9d171e047cba5578d15f4c61ab1 (DEFAULT_TABLE table=default.Table_2660ca6fcea7477b8da41e782e621c59 [id=af1ab07badb04080a2e5da28c9bd5924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.216370 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0521a9d171e047cba5578d15f4c61ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.088413 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 03ce59f22cd24295908c84ebbfc68ff6 (DEFAULT_TABLE table=default.Table_cc02889552444c75b532fd43df526684 [id=7ae0fdb7af364d8e8db30f04eb9d91d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.094077 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 5e04612637ac41c0a3b89b642823e9a1 (DEFAULT_TABLE table=default.Table_25c945ca9a864192a29061360e38dc1d [id=96266e4cf3f943a7b0a4210747d10d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.097078 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 5a8f1e81d7914ff585d3c77a2a1a99bc (DEFAULT_TABLE table=default.Table_587629fe75ba4c53b0146880ced51cfc [id=2b45e427c19749a6a9244ec7d05ac794]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.164731 1556 tablet_bootstrap.cc:492] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:22.171197 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 9f15aea505f04c97be71921bcf0b1775 (DEFAULT_TABLE table=default.Table_b9d57ae6df614ca08fee1dc08d3e447e [id=b80ebd666d9e40e098f88e435670b7c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.216775 1556 ts_tablet_manager.cc:1397] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.197s user 0.004s sys 0.000s
I20260927 15:06:22.197078 1412 tablet_service.cc:1467] Processing CreateTablet for tablet d62b162e23aa40d591dbfe134206182d (DEFAULT_TABLE table=default.Table_9ded0b1246144fb28700872f4ab1e728 [id=08c77551124e425c8c687581d7825db1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.219048 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 35f08d9cb7314c769a49ae3010b98077 (DEFAULT_TABLE table=default.Table_3f53d3dc29354f54b93bebe7ab2330b5 [id=06a55a2694e349e2baffd7fefa22f960]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.220793 1561 tablet_bootstrap.cc:492] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:22.220913 1561 ts_tablet_manager.cc:1397] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.000s
I20260927 15:06:22.221565 1561 raft_consensus.cc:348] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.221776 1561 raft_consensus.cc:374] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.221827 1561 raft_consensus.cc:729] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.221993 1561 consensus_queue.cc:260] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.222528 1561 ts_tablet_manager.cc:1428] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:22.223035 1561 tablet_bootstrap.cc:492] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:22.223874 1267 tablet_service.cc:1467] Processing CreateTablet for tablet ffaa856cb0b146dbb732762651e49912 (DEFAULT_TABLE table=default.Table_fb2ab3810f4e4052a01cd9f20f74aab4 [id=1ce7ed79569f4dd5bec9bf44df869ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.224738 1561 tablet_bootstrap.cc:654] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.224774 1562 ts_tablet_manager.cc:1918] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:22.224885 1562 log.cc:1196] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/278205071701447e8ee7457b2ee84be4
I20260927 15:06:22.225262 1562 ts_tablet_manager.cc:1939] T 278205071701447e8ee7457b2ee84be4 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:22.225559 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 981) took 5468 ms. Trace:
I20260927 15:06:22.227789 1562 rpcz_store.cc:276] 0927 15:06:16.757066 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.758030 (+ 964us) service_pool.cc:227] Handling call
0927 15:06:22.204761 (+5446731us) ts_tablet_manager.cc:1145] Deleting tablet 278205071701447e8ee7457b2ee84be4
0927 15:06:22.204774 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.216616 (+ 11842us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.224683 (+ 8067us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.225542 (+ 859us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5446611}
I20260927 15:06:22.228564 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 278205071701447e8ee7457b2ee84be4 (table default.Table_b3d8c342ab564cf8a14311ab99ac9615 [id=550aebac3b894a95ae6482fd0b422a8c]) successfully deleted
I20260927 15:06:22.229856 1556 raft_consensus.cc:348] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.230082 1556 raft_consensus.cc:374] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.230127 1556 raft_consensus.cc:729] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.230301 1556 consensus_queue.cc:260] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.230803 1556 ts_tablet_manager.cc:1428] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260927 15:06:22.231055 1556 tablet_bootstrap.cc:492] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:22.231743 1406 tablet_service.cc:1467] Processing CreateTablet for tablet fae262d440df4c8c8d08d3cf4b57ffe8 (DEFAULT_TABLE table=default.Table_6a5f533041cd4f09be995950a5a4c79b [id=2979a19f8afe49db827a09e15d039eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.229033 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 984) took 5241 ms. Trace:
I20260927 15:06:22.232679 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ce59f22cd24295908c84ebbfc68ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.232860 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e04612637ac41c0a3b89b642823e9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.232122 1562 rpcz_store.cc:276] 0927 15:06:16.987775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:16.987832 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:22.228898 (+5241066us) ts_tablet_manager.cc:1145] Deleting tablet 611e63080dcb474c8dde370c54a0e777
0927 15:06:22.228910 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.229016 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5240885}
I20260927 15:06:22.233110 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f15aea505f04c97be71921bcf0b1775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.233281 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f1056a308354ae8a980c08f211db65d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:22.233680 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 611e63080dcb474c8dde370c54a0e777 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 611e63080dcb474c8dde370c54a0e777 already in progress: creating tablet
I20260927 15:06:22.234010 1561 tablet_bootstrap.cc:492] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:22.234215 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 986) took 5088 ms. Trace:
I20260927 15:06:22.234236 1561 ts_tablet_manager.cc:1397] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.002s
I20260927 15:06:22.234503 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d62b162e23aa40d591dbfe134206182d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.234364 1562 rpcz_store.cc:276] 0927 15:06:17.145483 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.145528 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:22.234033 (+5088505us) ts_tablet_manager.cc:1145] Deleting tablet e67cf0526f3c45718312508b306d7089
0927 15:06:22.234042 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.234199 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5088338}
I20260927 15:06:22.234689 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a8f1e81d7914ff585d3c77a2a1a99bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:22.234985 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet e67cf0526f3c45718312508b306d7089 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e67cf0526f3c45718312508b306d7089 already in progress: creating tablet
I20260927 15:06:22.235746 1561 raft_consensus.cc:348] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.236321 1561 raft_consensus.cc:374] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.236461 1561 raft_consensus.cc:729] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.236980 1561 consensus_queue.cc:260] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.237565 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fae262d440df4c8c8d08d3cf4b57ffe8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:22.239491 1099 leader_election.cc:341] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 28f6bef5f000441090f73eb842450362
W20260927 15:06:22.239749 1099 leader_election.cc:341] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: a04caae16db84d8ea9050b648c1ba354
I20260927 15:06:22.238883 1561 ts_tablet_manager.cc:1428] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260927 15:06:22.241559 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 987) took 5089 ms. Trace:
I20260927 15:06:22.241559 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet cd76c49eda1c4b4ca0edf0f4d2790188 (table default.Table_024037ff57734bfa973dff7fd4f09896 [id=697526af76a54d6597dee1ac56eca889]) successfully deleted
W20260927 15:06:22.241547 1238 leader_election.cc:341] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: bc20a62bbd484c4e9e25cf1c15e1dde0
I20260927 15:06:22.242205 1562 rpcz_store.cc:276] 0927 15:06:17.151767 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.151819 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:22.241449 (+5089630us) ts_tablet_manager.cc:1145] Deleting tablet 547f5f0f1d444f348cf7efbbdf95523c
0927 15:06:22.241461 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.241543 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5083291}
I20260927 15:06:22.243005 1561 tablet_bootstrap.cc:492] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:22.243582 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46423c50fa7144f7a299765cd476bb18. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:22.243806 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 547f5f0f1d444f348cf7efbbdf95523c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 547f5f0f1d444f348cf7efbbdf95523c already in progress: creating tablet
I20260927 15:06:22.244127 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 988) took 5065 ms. Trace:
I20260927 15:06:22.244200 1562 rpcz_store.cc:276] 0927 15:06:17.179041 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.179210 (+ 169us) service_pool.cc:227] Handling call
0927 15:06:22.244032 (+5064822us) ts_tablet_manager.cc:1145] Deleting tablet e1770acc612f4924ba62ee20767a31c1
0927 15:06:22.244042 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.244112 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5064128}
I20260927 15:06:22.244900 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 989) took 5065 ms. Trace:
I20260927 15:06:22.245028 1562 rpcz_store.cc:276] 0927 15:06:17.179467 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.179519 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:22.244808 (+5065289us) ts_tablet_manager.cc:1145] Deleting tablet a4a48e08f69a4727924d006dc19b6ed1
0927 15:06:22.244818 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.244886 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5064463}
I20260927 15:06:22.245653 1561 tablet_bootstrap.cc:654] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.245678 1562 tablet_replica.cc:330] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:22.246728 1562 raft_consensus.cc:2229] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:22.247040 1562 pending_rounds.cc:62] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:22.247130 1562 pending_rounds.cc:68] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976381325352960 op_type: NO_OP noop_request { }
I20260927 15:06:22.247287 1562 raft_consensus.cc:2866] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:22.247411 1562 raft_consensus.cc:2258] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.247939 1562 ts_tablet_manager.cc:1905] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.252000 914 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49800 (request call id 1452) took 1049 ms. Trace:
I20260927 15:06:22.252152 914 rpcz_store.cc:276] 0927 15:06:21.202290 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.649711 (+447421us) service_pool.cc:227] Handling call
0927 15:06:21.860293 (+210582us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00007f2c3731827d 00007f2c37318373 00007f2c3413a361 00007f2c3baad66a 00007f2c3bc35313 00007f2c32f27466 00007f2c32f27195 00007f2c2f7379be 00007f2c2f73679e 00007f2c2f73cb25 00007f2c2f73d54f
0927 15:06:21.860878 (+ 585us) catalog_manager.cc:2075] Acquired catalog manager lock
0927 15:06:21.861235 (+ 357us) catalog_manager.cc:2121] Created new table and tablet info
0927 15:06:22.251724 (+390489us) catalog_manager.cc:2181] Wrote table and tablets to system table
0927 15:06:22.251845 (+ 121us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0927 15:06:22.251934 (+ 89us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:21.947615 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:21.947768 (+ 153us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:21.947777 (+ 9us) write_op.cc:435] Acquired schema lock
0927 15:06:21.947781 (+ 4us) tablet.cc:660] Decoding operations
0927 15:06:21.947917 (+ 136us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:21.947930 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:21.947936 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:21.948040 (+ 104us) tablet.cc:699] Row locks acquired
0927 15:06:21.948044 (+ 4us) write_op.cc:260] PREPARE: finished
0927 15:06:21.948110 (+ 66us) write_op.cc:270] Start()
0927 15:06:21.948158 (+ 48us) write_op.cc:276] Timestamp: P: 1790521581948087 usec, L: 0
0927 15:06:21.948164 (+ 6us) op_driver.cc:331] REPLICATION: starting
0927 15:06:22.060903 (+112739us) log.cc:842] Serialized 433 byte log entry
0927 15:06:22.061078 (+ 175us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f2c3410dd02 00007f2c354407f1 00007f2c3543f359 00007f2c354471bb 00007f2c35447038 00000000009edb7c 00007f2c28c41344 00007f2c28c4491b 00007f2c28c44798 00000000009edb7c
0927 15:06:22.249454 (+188376us) op_driver.cc:444] REPLICATION: finished
0927 15:06:22.249724 (+ 270us) write_op.cc:301] APPLY: starting
0927 15:06:22.249745 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:22.249795 (+ 50us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:22.249799 (+ 4us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:22.249969 (+ 170us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:22.250017 (+ 48us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0927 15:06:22.250024 (+ 7us) write_op.cc:312] APPLY: finished
0927 15:06:22.250138 (+ 114us) log.cc:842] Serialized 29 byte log entry
0927 15:06:22.250219 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.250244 (+ 25us) write_op.cc:454] Released schema lock
0927 15:06:22.250253 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:22.250322 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.250328 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":483754880,"child_traces":[["op",{"apply.queue_time_us":208,"apply.run_cpu_time_us":664,"apply.run_wall_time_us":664,"num_ops":2,"prepare.queue_time_us":85973,"prepare.run_cpu_time_us":2111,"prepare.run_wall_time_us":113539,"raft.queue_time_us":1284,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":231,"replication_time_us":301257,"spinlock_wait_cycles":258927872}]]}
I20260927 15:06:22.253233 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7ad6cbd2b08541d4974822f8b121d9c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.253863 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ad6cbd2b08541d4974822f8b121d9c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.255045 907 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet dc1e9e92132c4ae588121644137ac70a
I20260927 15:06:22.255218 907 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49800 (request call id 1418) took 1500 ms. Trace:
I20260927 15:06:22.255328 907 rpcz_store.cc:276] 0927 15:06:20.755065 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:20.755397 (+ 332us) service_pool.cc:227] Handling call
0927 15:06:20.755869 (+ 472us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0927 15:06:20.756173 (+ 304us) catalog_manager.cc:2752] Modifying in-memory table state
0927 15:06:20.756246 (+ 73us) catalog_manager.cc:2761] Locking tablets
0927 15:06:21.878323 (+1122077us) catalog_manager.cc:2775] Removing table and tablets from system table
0927 15:06:22.254890 (+376567us) catalog_manager.cc:2793] Removing table from by-name map
0927 15:06:22.254972 (+ 82us) catalog_manager.cc:2809] Committing in-memory state
0927 15:06:22.255017 (+ 45us) catalog_manager.cc:2813] Aborting table tasks
0927 15:06:22.255159 (+ 142us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:22.061186 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:22.061274 (+ 88us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:22.061279 (+ 5us) write_op.cc:435] Acquired schema lock
0927 15:06:22.061281 (+ 2us) tablet.cc:660] Decoding operations
0927 15:06:22.061390 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:22.061400 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:22.061404 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:22.061502 (+ 98us) tablet.cc:699] Row locks acquired
0927 15:06:22.061505 (+ 3us) write_op.cc:260] PREPARE: finished
0927 15:06:22.061539 (+ 34us) write_op.cc:270] Start()
0927 15:06:22.061570 (+ 31us) write_op.cc:276] Timestamp: P: 1790521582061514 usec, L: 0
0927 15:06:22.061573 (+ 3us) op_driver.cc:331] REPLICATION: starting
0927 15:06:22.061710 (+ 137us) log.cc:842] Serialized 756 byte log entry
0927 15:06:22.249542 (+187832us) op_driver.cc:444] REPLICATION: finished
0927 15:06:22.250427 (+ 885us) write_op.cc:301] APPLY: starting
0927 15:06:22.250440 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:22.250475 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:22.250505 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:22.250575 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:22.250610 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 15:06:22.250616 (+ 6us) write_op.cc:312] APPLY: finished
0927 15:06:22.250685 (+ 69us) log.cc:842] Serialized 29 byte log entry
0927 15:06:22.250734 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.250747 (+ 13us) write_op.cc:454] Released schema lock
0927 15:06:22.250752 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:22.250807 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.250810 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":849,"num_ops":2,"prepare.queue_time_us":182265,"prepare.run_cpu_time_us":599,"prepare.run_wall_time_us":598,"raft.queue_time_us":907,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":187949}]]}
I20260927 15:06:22.256348 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ae5225c2de1945e888122b6387e848ba" } new_table_name: "default.Table_ddd7c8d753fb4bbb936c56ec9fe101a3" modify_external_catalogs: true
W20260927 15:06:22.259215 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 723df898361144aeb16065868885d120 consensus state has no leader
I20260927 15:06:22.259722 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c03efef34acf46ee990e4763b68f064a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.260419 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c03efef34acf46ee990e4763b68f064a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.266614 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 45fbe474949344348cd2db98b75d4916 (DEFAULT_TABLE table=default.Table_452ab25734dc4aa9a28e08f23eb0d502 [id=aad2efe6b26447a1b398e70077eeffab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.275669 1562 ts_tablet_manager.cc:1918] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:22.275907 1562 log.cc:1196] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/d4f05da432f041378c5ab808536e6b6f
I20260927 15:06:22.276319 1562 ts_tablet_manager.cc:1939] T d4f05da432f041378c5ab808536e6b6f P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:22.276868 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 990) took 5067 ms. Trace:
I20260927 15:06:22.277016 1562 rpcz_store.cc:276] 0927 15:06:17.209282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.209349 (+ 67us) service_pool.cc:227] Handling call
0927 15:06:22.245643 (+5036294us) ts_tablet_manager.cc:1145] Deleting tablet d4f05da432f041378c5ab808536e6b6f
0927 15:06:22.245652 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.264501 (+ 18849us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.275551 (+ 11050us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.276851 (+ 1300us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5034578}
I20260927 15:06:22.277664 1238 leader_election.cc:302] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.277827 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet d4f05da432f041378c5ab808536e6b6f (table default.Table_e8855d7ecbd54e2eb65a1b2dd6addb4c [id=2386e9e051a140358b16dbe3d7add4c1]) successfully deleted
I20260927 15:06:22.278028 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffaa856cb0b146dbb732762651e49912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.278343 1562 tablet_replica.cc:330] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:22.278601 1562 raft_consensus.cc:2229] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:22.279076 1562 raft_consensus.cc:2258] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.248163 1561 tablet_bootstrap.cc:492] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:22.281890 3138 raft_consensus.cc:482] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.280534 1562 ts_tablet_manager.cc:1905] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.282153 3138 raft_consensus.cc:504] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.283175 3138 leader_election.cc:288] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.283557 3105 raft_consensus.cc:482] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.283720 3105 raft_consensus.cc:504] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.281467 1561 ts_tablet_manager.cc:1397] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.001s
I20260927 15:06:22.285878 1561 raft_consensus.cc:348] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.286710 1561 raft_consensus.cc:374] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.286859 1561 raft_consensus.cc:729] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.287348 1561 consensus_queue.cc:260] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:22.290307 1102 leader_election.cc:341] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.290468 1102 leader_election.cc:302] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.292594 3105 leader_election.cc:288] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:22.293179 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d2501a9f764790818426665e7f0340" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:22.293324 3147 raft_consensus.cc:2726] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.293584 3147 raft_consensus.cc:482] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.293699 3147 raft_consensus.cc:504] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:22.293852 1374 leader_election.cc:341] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.293812 1292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d2501a9f764790818426665e7f0340" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.294332 3147 leader_election.cc:288] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.294303 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3939bfd903d42e9bfaaf6ecdf50b8d4" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:22.294994 1376 leader_election.cc:341] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.295123 1376 leader_election.cc:302] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:22.295558 3105 raft_consensus.cc:2726] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:22.299512 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0cba2aca10e84d6c9ecb2a42000bba9d consensus state has no leader
I20260927 15:06:22.300359 906 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_215f907352cd4345ae56604d6322ded9 [id=1f51698c91d64bb38f760d13529935b6] alter complete (version 1)
I20260927 15:06:22.301344 1556 tablet_bootstrap.cc:654] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.304239 910 master_service.cc:946] ReplaceTablet: received request to replace tablet ad445390e18245f68430c0590a378a91 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:22.324257 1099 consensus_peers.cc:487] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8659865bf644458b3b5a78eae36a524. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:22.324848 1099 consensus_peers.cc:487] T 4658de7351e9423b83f393f7f7045eed P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4658de7351e9423b83f393f7f7045eed. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:22.325131 1099 leader_election.cc:341] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 727652500d9a47b68b7a0d0dcf583822
I20260927 15:06:22.326491 3147 raft_consensus.cc:482] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.326646 3147 raft_consensus.cc:504] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.327349 3147 leader_election.cc:288] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:22.335860 1145 consensus_meta.cc:287] T 684bf999658b4c0c9d66918921d98194 P c4264874db964ff2830b7894c2b3d61c: Time spent flushing consensus metadata: real 0.693s user 0.017s sys 0.000s
I20260927 15:06:22.339555 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 1f1056a308354ae8a980c08f211db65d (DEFAULT_TABLE table=default.Table_f82a62b3d6fa40c5ba2dfd33bb37ee52 [id=0b66ce15feb741e28eb6bfcbe0357dfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.344295 2119 ts_tablet_manager.cc:1918] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:22.344473 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45fbe474949344348cd2db98b75d4916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.344528 3148 raft_consensus.cc:482] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.344689 3148 raft_consensus.cc:504] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.334856 3144 raft_consensus.cc:482] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:22.347116 1099 leader_election.cc:341] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c6a248ec4ee64d0a8d986fdc683d69ba
I20260927 15:06:22.345979 3148 leader_election.cc:288] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.349045 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0076a3b473134965a5d828a3acf95007" } modify_external_catalogs: true
I20260927 15:06:22.349282 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0076a3b473134965a5d828a3acf95007" } modify_external_catalogs: true
I20260927 15:06:22.350356 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 26150a10c75948bb9e5c37e46f772993 (DEFAULT_TABLE table=default.Table_0fb66217d0e64c60927679b2a228d43c [id=4386b7d2c535494d9b5ac2e58c267677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.351111 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 01b31e13faed44088c5ad5e3e9fa6b3f (DEFAULT_TABLE table=default.Table_144247c8f6c749539a8c431dd3e74d17 [id=e8ef09e7d3114b19a5e62a4ff883166e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.351472 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5a81a62189ec499e91de04c9b60d73b5" } modify_external_catalogs: true
I20260927 15:06:22.351652 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5a81a62189ec499e91de04c9b60d73b5" } modify_external_catalogs: true
I20260927 15:06:22.351939 1562 ts_tablet_manager.cc:1918] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:22.352303 1562 log.cc:1196] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/58d6bdc1ac004d889aac36db65afbbbe
I20260927 15:06:22.352890 1562 ts_tablet_manager.cc:1939] T 58d6bdc1ac004d889aac36db65afbbbe P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:22.353526 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6ddc5e4aadc942d68b8e80a96575afbf" } new_table_name: "default.Table_05bc1b2ba2e145838d75ecf3be0d99f1" modify_external_catalogs: true
I20260927 15:06:22.354439 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 991) took 5123 ms. Trace:
I20260927 15:06:22.354813 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a499521b621d4eaab4527f2bf81b6258"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.355618 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a499521b621d4eaab4527f2bf81b6258 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.356259 1562 rpcz_store.cc:276] 0927 15:06:17.230996 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.231051 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:22.278290 (+5047239us) ts_tablet_manager.cc:1145] Deleting tablet 58d6bdc1ac004d889aac36db65afbbbe
0927 15:06:22.278305 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.308257 (+ 29952us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.351828 (+ 43571us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.354412 (+ 2584us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5047053}
I20260927 15:06:22.356887 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 58d6bdc1ac004d889aac36db65afbbbe (table default.Table_27a7140bf7c847d8acb10f2ac4c04bcf [id=a99492ccd2464bc2b1885ade4a76db9f]) successfully deleted
I20260927 15:06:22.357767 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 0521a9d171e047cba5578d15f4c61ab1 (DEFAULT_TABLE table=default.Table_2660ca6fcea7477b8da41e782e621c59 [id=af1ab07badb04080a2e5da28c9bd5924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.358002 3148 raft_consensus.cc:482] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.358229 3148 raft_consensus.cc:504] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.359328 3148 leader_election.cc:288] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:22.359598 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2e4f338ecf74608b6261d74cbd6db9b consensus state has no leader
I20260927 15:06:22.357726 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 992) took 5095 ms. Trace:
I20260927 15:06:22.360025 1562 rpcz_store.cc:276] 0927 15:06:17.261928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.261972 (+ 44us) service_pool.cc:227] Handling call
0927 15:06:22.357567 (+5095595us) ts_tablet_manager.cc:1145] Deleting tablet d9fecfb2325046f98e69797ff8342892
0927 15:06:22.357583 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.357705 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5095407}
I20260927 15:06:22.360587 1552 tablet_bootstrap.cc:654] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.354878 3144 raft_consensus.cc:504] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.360922 2119 log.cc:1196] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/cb859b43634c420382da5c201ce24dfc
W20260927 15:06:22.360939 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet d9fecfb2325046f98e69797ff8342892 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9fecfb2325046f98e69797ff8342892 already in progress: creating tablet
I20260927 15:06:22.361336 1562 tablet_replica.cc:330] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:22.362075 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f1056a308354ae8a980c08f211db65d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:22.362870 3125 log.cc:924] Time spent T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
I20260927 15:06:22.367020 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 5a8f1e81d7914ff585d3c77a2a1a99bc (DEFAULT_TABLE table=default.Table_587629fe75ba4c53b0146880ced51cfc [id=2b45e427c19749a6a9244ec7d05ac794]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.368957 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26150a10c75948bb9e5c37e46f772993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.371304 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ecb61742b1f74785ba7bc23a44e91dd3" } modify_external_catalogs: true
I20260927 15:06:22.371533 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ecb61742b1f74785ba7bc23a44e91dd3" } modify_external_catalogs: true
I20260927 15:06:22.371855 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 9f15aea505f04c97be71921bcf0b1775 (DEFAULT_TABLE table=default.Table_b9d57ae6df614ca08fee1dc08d3e447e [id=b80ebd666d9e40e098f88e435670b7c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.372886 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c7796298134942969fd69e2a3b071bfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.373426 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7796298134942969fd69e2a3b071bfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.373895 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 03ce59f22cd24295908c84ebbfc68ff6 (DEFAULT_TABLE table=default.Table_cc02889552444c75b532fd43df526684 [id=7ae0fdb7af364d8e8db30f04eb9d91d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.374531 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_40080b13414f408bb2af14042c50fd36" } modify_external_catalogs: true
I20260927 15:06:22.374706 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_40080b13414f408bb2af14042c50fd36" } modify_external_catalogs: true
I20260927 15:06:22.374771 2119 ts_tablet_manager.cc:1939] T cb859b43634c420382da5c201ce24dfc P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:22.375530 3148 raft_consensus.cc:482] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.375576 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1066) took 1381 ms. Trace:
I20260927 15:06:22.375695 2119 rpcz_store.cc:276] 0927 15:06:20.994545 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:20.994597 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:21.886220 (+891623us) ts_tablet_manager.cc:1145] Deleting tablet cb859b43634c420382da5c201ce24dfc
0927 15:06:21.886235 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.032862 (+146627us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.277452 (+244590us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.375527 (+ 98075us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":890468}
I20260927 15:06:22.375686 3148 raft_consensus.cc:504] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.376057 2119 tablet_replica.cc:330] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:22.376447 3148 leader_election.cc:288] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.370656 3144 leader_election.cc:288] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:22.381206 1266 tablet_service.cc:1467] Processing CreateTablet for tablet d62b162e23aa40d591dbfe134206182d (DEFAULT_TABLE table=default.Table_9ded0b1246144fb28700872f4ab1e728 [id=08c77551124e425c8c687581d7825db1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.397439 3148 raft_consensus.cc:482] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.397637 3148 raft_consensus.cc:504] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.398425 3148 leader_election.cc:288] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.404148 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01b31e13faed44088c5ad5e3e9fa6b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.409829 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a8f1e81d7914ff585d3c77a2a1a99bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.403685 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 5e04612637ac41c0a3b89b642823e9a1 (DEFAULT_TABLE table=default.Table_25c945ca9a864192a29061360e38dc1d [id=96266e4cf3f943a7b0a4210747d10d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.410844 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d62b162e23aa40d591dbfe134206182d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.415791 1268 tablet_service.cc:1467] Processing CreateTablet for tablet fae262d440df4c8c8d08d3cf4b57ffe8 (DEFAULT_TABLE table=default.Table_6a5f533041cd4f09be995950a5a4c79b [id=2979a19f8afe49db827a09e15d039eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:22.416059 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e04612637ac41c0a3b89b642823e9a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:22.421209 1238 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 173983us
I20260927 15:06:22.425869 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fae262d440df4c8c8d08d3cf4b57ffe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.427410 3023 raft_consensus.cc:482] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c4264874db964ff2830b7894c2b3d61c)
I20260927 15:06:22.430991 1238 leader_election.cc:302] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.432696 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet cb859b43634c420382da5c201ce24dfc (table default.Table_d30c425670fb48e8b23a840865bee28b [id=0303fc8be5ae400a87d56696b7b75994]) successfully deleted
I20260927 15:06:22.435657 3023 raft_consensus.cc:504] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.436122 1301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6bef5f000441090f73eb842450362" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.436527 3023 leader_election.cc:288] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.436897 1293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727652500d9a47b68b7a0d0dcf583822" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.437935 1302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd1f51cb124d4d20a9d6024e6eb6810f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.438256 1293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e7439320dd48aba25b5f7dc627964c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.438596 1562 raft_consensus.cc:2229] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:22.438678 1561 ts_tablet_manager.cc:1428] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.154s user 0.003s sys 0.000s
I20260927 15:06:22.438843 1562 raft_consensus.cc:2258] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.439008 1561 tablet_bootstrap.cc:492] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:22.439478 1562 ts_tablet_manager.cc:1905] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.441924 3147 raft_consensus.cc:482] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.442045 3147 raft_consensus.cc:504] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.442607 3147 leader_election.cc:288] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.447074 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0141fdf4d1ef47b8b3e758ea3ff8b7c8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.449822 1561 tablet_bootstrap.cc:654] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.453167 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0521a9d171e047cba5578d15f4c61ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.456490 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f15aea505f04c97be71921bcf0b1775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.456470 1290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e0be77dff645f795237ffe779ed684" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.456904 1290 raft_consensus.cc:2454] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:22.458266 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6a248ec4ee64d0a8d986fdc683d69ba" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.459020 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ce59f22cd24295908c84ebbfc68ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.460043 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f08d9cb7314c769a49ae3010b98077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:22.467785 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e0be77dff645f795237ffe779ed684" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:22.468015 1164 raft_consensus.cc:2454] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:22.468736 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "429088342b4743c39fb1e38d235024de" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:22.469290 1102 leader_election.cc:341] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.469420 1102 leader_election.cc:302] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:22.469951 1102 leader_election.cc:341] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.470044 1102 leader_election.cc:302] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.470166 1239 leader_election.cc:302] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
W20260927 15:06:22.470510 1102 leader_election.cc:341] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Not found: Tablet not found: a04caae16db84d8ea9050b648c1ba354
I20260927 15:06:22.470594 1102 leader_election.cc:302] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.471561 3162 raft_consensus.cc:2726] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.475698 3150 raft_consensus.cc:2726] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.475862 3150 raft_consensus.cc:2726] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.476167 3150 raft_consensus.cc:2726] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:22.477538 906 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_abb2a056a859472fb4d4b36dde2ff8d3 [id=40aeb63abca64c3a8d12f9085fd816d8] alter complete (version 4)
I20260927 15:06:22.477770 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8] alter complete (version 3)
I20260927 15:06:22.478889 3148 raft_consensus.cc:482] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.479022 3148 raft_consensus.cc:504] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.479238 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ad445390e18245f68430c0590a378a91
I20260927 15:06:22.479669 910 catalog_manager.cc:6565] ReplaceTablet: tablet ad445390e18245f68430c0590a378a91 deleted and replaced by tablet dd2ee92aa4cf4084af12c35a2d150bdf
I20260927 15:06:22.479650 3148 leader_election.cc:288] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.480068 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_71f8e9ca27cb44e88fb384749067af34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.480661 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71f8e9ca27cb44e88fb384749067af34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.482211 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c264c532db8249e5abe1dbef8ee8ffa0
I20260927 15:06:22.482815 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7343b42c802f450fa21fbd575b426e4a" } new_table_name: "default.Table_c5220091c1864117b21563a94b8b4af6" modify_external_catalogs: true
I20260927 15:06:22.483209 3106 raft_consensus.cc:482] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:22.483704 1102 leader_election.cc:341] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:22.483914 1102 leader_election.cc:341] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:22.484149 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a89ef5f07f67497c9093617557cc4ab7 consensus state has no leader
W20260927 15:06:22.484309 1102 consensus_peers.cc:487] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:22.484441 1102 leader_election.cc:341] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.484467 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a8cba3f530e84e4684b52d7098f44dde" } modify_external_catalogs: true
I20260927 15:06:22.484575 1102 leader_election.cc:302] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:22.484625 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a8cba3f530e84e4684b52d7098f44dde" } modify_external_catalogs: true
W20260927 15:06:22.484804 1102 leader_election.cc:341] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.484892 1102 leader_election.cc:302] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.485278 3013 raft_consensus.cc:2781] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:22.485352 3013 raft_consensus.cc:482] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:22.485417 3013 raft_consensus.cc:3037] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.486078 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_05c6737f66514e02a97cfc7e4a99cc7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.486605 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05c6737f66514e02a97cfc7e4a99cc7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.487165 3150 raft_consensus.cc:2726] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.487718 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a0152ed16fbe44c48e17c6bc34328df7
I20260927 15:06:22.488274 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_69a4bed2711242a2be679d44481b97b0" } new_table_name: "default.Table_8665d145e0aa44c49321bd1b8adff909" modify_external_catalogs: true
I20260927 15:06:22.488859 3013 raft_consensus.cc:504] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.489454 3013 leader_election.cc:288] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.489532 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet d827f6a3a6834ecd86d8722b1f1e4444
I20260927 15:06:22.499392 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet c264c532db8249e5abe1dbef8ee8ffa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.499408 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet a0152ed16fbe44c48e17c6bc34328df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.500428 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3939bfd903d42e9bfaaf6ecdf50b8d4" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:22.505529 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet d827f6a3a6834ecd86d8722b1f1e4444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.506879 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet a0152ed16fbe44c48e17c6bc34328df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:22.507625 3105 raft_consensus.cc:482] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.508546 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2204baab0bef45568d79ecaa4710ba99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.509147 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2204baab0bef45568d79ecaa4710ba99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.509795 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ca9820ae718c4a50b76a64d609cb2693" } new_table_name: "default.Table_bedfc54f30074f97848b965f2793de73" modify_external_catalogs: true
I20260927 15:06:22.511672 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet c264c532db8249e5abe1dbef8ee8ffa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:22.483361 3106 raft_consensus.cc:504] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.515285 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet d827f6a3a6834ecd86d8722b1f1e4444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:22.516419 3106 leader_election.cc:288] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:22.516919 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fecfb2325046f98e69797ff8342892" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:22.517458 1374 leader_election.cc:341] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.514701 3105 raft_consensus.cc:504] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.519021 3105 leader_election.cc:288] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:22.519390 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdcc55fb32b14935922e5870819bc266" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:22.519625 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet ad445390e18245f68430c0590a378a91 with delete_type TABLET_DATA_DELETED (replaced by tablet dd2ee92aa4cf4084af12c35a2d150bdf) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.515525 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0141fdf4d1ef47b8b3e758ea3ff8b7c8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:22.520025 1439 raft_consensus.cc:2454] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:22.522907 1374 leader_election.cc:341] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.506704 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet ad445390e18245f68430c0590a378a91 with delete_type TABLET_DATA_DELETED (replaced by tablet dd2ee92aa4cf4084af12c35a2d150bdf) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:22.540716 1407 consensus_meta.cc:287] T 3ea6a502cce64a81b324a148973929c5 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent flushing consensus metadata: real 0.503s user 0.006s sys 0.001s
I20260927 15:06:22.542739 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e7439320dd48aba25b5f7dc627964c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:22.543000 1436 raft_consensus.cc:2454] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:22.550746 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af25950fd08043f18a6eaaf46ded4378" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:22.551009 1436 raft_consensus.cc:2454] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:22.571216 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5f4a30bac94d72b5265c8a7a0d4d59" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:22.577375 1436 raft_consensus.cc:2454] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:22.578984 3105 raft_consensus.cc:482] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.579134 3105 raft_consensus.cc:504] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.579762 3105 leader_election.cc:288] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:22.580294 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ba3bdf50b14aec85a99742426e9298" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:22.580996 1374 leader_election.cc:341] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.582697 1099 leader_election.cc:302] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:22.583163 1099 leader_election.cc:341] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: fd1f51cb124d4d20a9d6024e6eb6810f
I20260927 15:06:22.583276 1099 leader_election.cc:302] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:22.583601 1099 leader_election.cc:341] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 81e0be77dff645f795237ffe779ed684
I20260927 15:06:22.583859 1099 leader_election.cc:302] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:22.584091 3148 raft_consensus.cc:2781] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:22.584190 3148 raft_consensus.cc:482] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:22.584255 3148 raft_consensus.cc:3037] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.584363 3147 raft_consensus.cc:2726] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.584529 3147 raft_consensus.cc:2781] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:22.584586 3147 raft_consensus.cc:482] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:22.584662 3147 raft_consensus.cc:3037] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.587327 1099 leader_election.cc:302] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:22.587592 3150 raft_consensus.cc:2781] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:22.587683 3150 raft_consensus.cc:482] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:22.587754 3150 raft_consensus.cc:3037] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.590430 3150 raft_consensus.cc:504] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.591945 3147 raft_consensus.cc:504] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.592876 3147 leader_election.cc:288] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.587610 3148 raft_consensus.cc:504] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.598771 3148 leader_election.cc:288] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.604657 3150 leader_election.cc:288] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.605538 1099 leader_election.cc:302] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
W20260927 15:06:22.605903 1099 leader_election.cc:341] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 81e0be77dff645f795237ffe779ed684
I20260927 15:06:22.606783 3147 raft_consensus.cc:2781] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:22.606971 3147 raft_consensus.cc:482] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:22.607124 3147 raft_consensus.cc:3037] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.610028 3147 raft_consensus.cc:504] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.618817 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e7439320dd48aba25b5f7dc627964c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:22.618884 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0141fdf4d1ef47b8b3e758ea3ff8b7c8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:22.619197 1436 raft_consensus.cc:3037] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.624138 1432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af25950fd08043f18a6eaaf46ded4378" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:22.624377 1432 raft_consensus.cc:3037] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.619091 1439 raft_consensus.cc:3037] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.631333 1432 raft_consensus.cc:2454] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:22.639438 1439 raft_consensus.cc:2454] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:22.648679 1436 raft_consensus.cc:2454] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:22.654371 1099 leader_election.cc:302] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:22.664645 3150 raft_consensus.cc:2781] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:22.664800 3150 raft_consensus.cc:686] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:22.665066 3150 consensus_queue.cc:237] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.667140 1099 leader_election.cc:302] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:22.667459 3148 raft_consensus.cc:2781] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:22.667586 3148 raft_consensus.cc:686] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:22.667793 3148 consensus_queue.cc:237] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.668725 1296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e7439320dd48aba25b5f7dc627964c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:22.523345 1299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fecfb2325046f98e69797ff8342892" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:22.670212 1102 leader_election.cc:341] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.670545 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e0be77dff645f795237ffe779ed684" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:22.662129 1561 tablet_bootstrap.cc:492] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:22.670946 1561 ts_tablet_manager.cc:1397] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.232s user 0.003s sys 0.000s
I20260927 15:06:22.671033 1305 raft_consensus.cc:3037] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.671581 1561 raft_consensus.cc:348] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.671792 1561 raft_consensus.cc:374] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.671835 1561 raft_consensus.cc:729] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.671977 1561 consensus_queue.cc:260] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.672511 1561 ts_tablet_manager.cc:1428] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260927 15:06:22.672752 1561 tablet_bootstrap.cc:492] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:22.674235 1561 tablet_bootstrap.cc:654] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:22.686442 1376 leader_election.cc:341] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.686601 1376 leader_election.cc:302] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:22.687036 1238 leader_election.cc:302] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.687255 3105 raft_consensus.cc:2726] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.695124 3023 raft_consensus.cc:2781] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:22.695168 1290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5f4a30bac94d72b5265c8a7a0d4d59" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.695853 1561 tablet_bootstrap.cc:492] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:22.695982 1561 ts_tablet_manager.cc:1397] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.000s
I20260927 15:06:22.695286 3023 raft_consensus.cc:482] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:22.696781 1561 raft_consensus.cc:348] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.697104 1561 raft_consensus.cc:374] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.697047 1303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ba3bdf50b14aec85a99742426e9298" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.697331 1561 raft_consensus.cc:729] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.697846 1561 consensus_queue.cc:260] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.698433 1561 ts_tablet_manager.cc:1428] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260927 15:06:22.698453 1376 leader_election.cc:341] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.698581 1376 leader_election.cc:302] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:22.699154 1561 tablet_bootstrap.cc:492] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:22.699136 1289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af25950fd08043f18a6eaaf46ded4378" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:22.699499 1286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5f4a30bac94d72b5265c8a7a0d4d59" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:22.699541 1297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af25950fd08043f18a6eaaf46ded4378" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.700140 1295 raft_consensus.cc:3037] T 4e2c5c3d0f574422be80b318395f199a P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.700743 3105 raft_consensus.cc:2726] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.676815 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdcc55fb32b14935922e5870819bc266" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.700742 1561 tablet_bootstrap.cc:654] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:22.701499 1376 leader_election.cc:341] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.701611 1376 leader_election.cc:302] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:22.702033 3105 raft_consensus.cc:2726] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.687440 3160 tablet.cc:1722] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:22.703649 1099 leader_election.cc:302] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:22.703989 3171 raft_consensus.cc:2781] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:22.704286 3171 raft_consensus.cc:686] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:22.704775 3171 consensus_queue.cc:237] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.706318 1292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0141fdf4d1ef47b8b3e758ea3ff8b7c8" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:22.706688 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet ad445390e18245f68430c0590a378a91 with delete_type TABLET_DATA_DELETED (replaced by tablet dd2ee92aa4cf4084af12c35a2d150bdf) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:22.706961 1238 leader_election.cc:341] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 81e0be77dff645f795237ffe779ed684
W20260927 15:06:22.707330 1238 leader_election.cc:341] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 429088342b4743c39fb1e38d235024de
I20260927 15:06:22.707476 1238 leader_election.cc:302] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.713944 3023 raft_consensus.cc:3037] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:22.715132 1239 consensus_peers.cc:487] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e -> Peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Couldn't send request to peer c4264874db964ff2830b7894c2b3d61c. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:22.715605 3165 raft_consensus.cc:2726] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:22.721469 1561 tablet_bootstrap.cc:492] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:22.721668 1561 ts_tablet_manager.cc:1397] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.005s
I20260927 15:06:22.722417 1561 raft_consensus.cc:348] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.722681 1561 raft_consensus.cc:374] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.722774 1561 raft_consensus.cc:729] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.723011 1561 consensus_queue.cc:260] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.723693 1561 ts_tablet_manager.cc:1428] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:22.724007 1561 tablet_bootstrap.cc:492] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:22.725579 3147 leader_election.cc:288] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.725937 1561 tablet_bootstrap.cc:654] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.728271 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5f4a30bac94d72b5265c8a7a0d4d59" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:22.728576 1439 raft_consensus.cc:3037] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:22.732139 1439 raft_consensus.cc:2454] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:22.732846 3023 raft_consensus.cc:504] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.733808 1300 raft_consensus.cc:2379] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c4264874db964ff2830b7894c2b3d61c in current term 1: Already voted for candidate 4769a710b72a4b49b816725a5921e86e in this term.
I20260927 15:06:22.735813 1099 leader_election.cc:302] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:22.736267 3166 tablet.cc:1722] T 0702d9501ac047938d02ef2521dbf0d5 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:22.736491 3149 raft_consensus.cc:2781] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:22.736613 3149 raft_consensus.cc:686] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:22.737139 3149 consensus_queue.cc:237] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.741012 3023 leader_election.cc:288] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:22.741295 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81e0be77dff645f795237ffe779ed684" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:22.741542 1164 raft_consensus.cc:2379] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate c4264874db964ff2830b7894c2b3d61c in this term.
I20260927 15:06:22.742347 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet d827f6a3a6834ecd86d8722b1f1e4444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:22.745179 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a0152ed16fbe44c48e17c6bc34328df7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0152ed16fbe44c48e17c6bc34328df7 already in progress: creating tablet
I20260927 15:06:22.745353 3167 tablet_replica.cc:330] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:22.746232 3167 raft_consensus.cc:2229] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:22.747016 3167 raft_consensus.cc:2258] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.747087 1271 tablet_service.cc:1514] Processing DeleteTablet for tablet a0152ed16fbe44c48e17c6bc34328df7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:22.748545 3162 raft_consensus.cc:2726] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.748843 3166 tablet.cc:1722] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:22.748581 3167 ts_tablet_manager.cc:1905] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.750679 3160 tablet.cc:1717] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e: Skipping requested alter to schema version 3, tablet already version 3
I20260927 15:06:22.752358 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet c264c532db8249e5abe1dbef8ee8ffa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:22.754886 3166 tablet.cc:1717] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: Skipping requested alter to schema version 3, tablet already version 3
I20260927 15:06:22.755556 1556 tablet_bootstrap.cc:492] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:22.755759 1556 ts_tablet_manager.cc:1397] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.525s user 0.017s sys 0.023s
I20260927 15:06:22.756719 1556 raft_consensus.cc:348] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.757102 1556 raft_consensus.cc:374] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.757225 1556 raft_consensus.cc:729] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.757524 1556 consensus_queue.cc:260] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.762621 1552 tablet_bootstrap.cc:492] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:22.762770 1552 ts_tablet_manager.cc:1397] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 1.100s user 0.050s sys 0.054s
W20260927 15:06:22.768817 1238 leader_election.cc:341] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 81e0be77dff645f795237ffe779ed684
I20260927 15:06:22.771636 1238 leader_election.cc:302] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.772032 3023 raft_consensus.cc:2726] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.772883 1552 raft_consensus.cc:348] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.773109 1552 raft_consensus.cc:374] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.773202 1552 raft_consensus.cc:729] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.773452 1552 consensus_queue.cc:260] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.774107 1552 ts_tablet_manager.cc:1428] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 15:06:22.774391 1552 tablet_bootstrap.cc:492] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:22.775094 3166 tablet.cc:1722] T 1ef93a120f00423d91664ce4eaf03803 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260927 15:06:22.775470 1238 consensus_peers.cc:487] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9576d1a36d7547bf81faabe9c362e3cb. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:22.792761 1304 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.513s user 0.022s sys 0.063s
W20260927 15:06:22.792950 1304 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.514s user 0.022s sys 0.064s
I20260927 15:06:22.793176 3138 raft_consensus.cc:2726] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.793956 1304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.201.1:45331 (request call id 629) took 1166 ms. Trace:
I20260927 15:06:22.794127 1304 rpcz_store.cc:276] 0927 15:06:21.627998 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.628432 (+ 434us) service_pool.cc:227] Handling call
0927 15:06:21.628572 (+ 140us) raft_consensus.cc:1457] Updating replica for 1 ops
0927 15:06:21.667182 (+ 38610us) raft_consensus.cc:1520] Early marking committed up to index 0
0927 15:06:21.667187 (+ 5us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0927 15:06:21.667342 (+ 155us) log.cc:842] Serialized 26 byte log entry
0927 15:06:22.045587 (+378245us) raft_consensus.cc:1631] Marking committed up to 1
0927 15:06:22.278956 (+233369us) log.cc:842] Serialized 14 byte log entry
0927 15:06:22.793093 (+514137us) raft_consensus.cc:1683] Filling consensus response to leader.
0927 15:06:22.793739 (+ 646us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x6150002c5c24. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d2c00f 00007fcdb8d27ee9 00007fcdbc8cea6c 00007fcdb71b9fa6 00007fcdb71b9cd5 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378
0927 15:06:22.793748 (+ 9us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0927 15:06:22.793759 (+ 11us) raft_consensus.cc:1671] finished
0927 15:06:22.793876 (+ 117us) raft_consensus.cc:1677] UpdateReplicas() finished
0927 15:06:22.793936 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":7532,"prepare.run_cpu_time_us":4,"prepare.run_wall_time_us":5,"raft.queue_time_us":4396,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"spinlock_wait_cycles":29560192,"thread_start_us":1124832,"threads_started":3,"wal-append.queue_time_us":403307}
I20260927 15:06:22.795300 2119 raft_consensus.cc:2229] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:22.795771 2119 raft_consensus.cc:2258] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.796768 2119 ts_tablet_manager.cc:1905] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:22.799203 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 128597us
W20260927 15:06:22.800904 1102 leader_election.cc:341] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:22.801339 1102 leader_election.cc:341] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:22.801685 1102 leader_election.cc:341] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:22.802054 1102 leader_election.cc:341] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:22.802385 1102 leader_election.cc:341] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:22.802688 1102 leader_election.cc:302] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:22.802997 3013 raft_consensus.cc:2726] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260927 15:06:22.807214 1552 tablet_bootstrap.cc:654] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.814577 1561 tablet_bootstrap.cc:492] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:22.814845 1561 ts_tablet_manager.cc:1397] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.091s user 0.003s sys 0.002s
I20260927 15:06:22.821189 2119 ts_tablet_manager.cc:1918] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:22.821368 2119 log.cc:1196] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/bc20a62bbd484c4e9e25cf1c15e1dde0
I20260927 15:06:22.821807 2119 ts_tablet_manager.cc:1939] T bc20a62bbd484c4e9e25cf1c15e1dde0 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:22.821480 3167 ts_tablet_manager.cc:1918] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:22.822240 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1067) took 1679 ms. Trace:
I20260927 15:06:22.822250 3167 log.cc:1196] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/c264c532db8249e5abe1dbef8ee8ffa0
I20260927 15:06:22.822383 2119 rpcz_store.cc:276] 0927 15:06:21.143207 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.143368 (+ 161us) service_pool.cc:227] Handling call
0927 15:06:22.376000 (+1232632us) ts_tablet_manager.cc:1145] Deleting tablet bc20a62bbd484c4e9e25cf1c15e1dde0
0927 15:06:22.376009 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.795643 (+419634us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x6150002c5c24. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d4604d 00007fcdb9fea5ec 00007fcdbc9792e6 00007fcdbc9ab404 00007fcdbc98c870 00007fcdbc98c5fd 00000000009edb7c 00007fcdad850344 00007fcdad85391b 00007fcdad853798
0927 15:06:22.818338 (+ 22695us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.821111 (+ 2773us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.822224 (+ 1113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":963767680,"tablet-delete.queue_time_us":1232421}
I20260927 15:06:22.823036 2119 tablet_replica.cc:330] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:22.823078 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet bc20a62bbd484c4e9e25cf1c15e1dde0 (table default.Table_565f7d1851f74565b073c0e1c74d9403 [id=3305179f942c4133896ea7b9b1bc898b]) successfully deleted
I20260927 15:06:22.823360 2119 raft_consensus.cc:2229] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:22.823556 2119 raft_consensus.cc:2258] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.824100 2119 ts_tablet_manager.cc:1905] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.824672 3167 ts_tablet_manager.cc:1939] T c264c532db8249e5abe1dbef8ee8ffa0 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:22.828042 1556 ts_tablet_manager.cc:1428] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.072s user 0.002s sys 0.000s
I20260927 15:06:22.828433 1556 tablet_bootstrap.cc:492] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:22.829849 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]) successfully deleted
I20260927 15:06:22.830430 1556 tablet_bootstrap.cc:654] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:22.830435 899 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet a50808126865423ab0303ef1667b7f2b (table default.Table_4249e024508544838076d00f351bbaed [id=4f10376a4fbb4b04b802daf33400708d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a50808126865423ab0303ef1667b7f2b consensus state has no leader
W20260927 15:06:22.831219 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet d827f6a3a6834ecd86d8722b1f1e4444 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d827f6a3a6834ecd86d8722b1f1e4444 already in progress: creating tablet
W20260927 15:06:22.832449 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ad445390e18245f68430c0590a378a91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad445390e18245f68430c0590a378a91 already in progress: creating tablet
I20260927 15:06:22.842969 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_9d78b6648ac548e586c621d86d1938ba [id=3fc04b4c774144dd85bbb92d05883018] alter complete (version 1)
I20260927 15:06:22.845963 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fa143466f2bd4185887d6ccfcbbe8dd8
W20260927 15:06:22.846165 913 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.201.1:54519 (request call id 156) took 908 ms (client timeout 1000 ms). Trace:
W20260927 15:06:22.847141 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1950cd7a2dc48a3ac03a7dc61f7e546 consensus state has no leader
W20260927 15:06:22.847698 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aa3094d63be7471191e21a66a2e66dd2 consensus state has no leader
I20260927 15:06:22.847637 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b699cc7bf8b7489583daddae8edf7c9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:22.848073 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1409c4adee7d404dabbb49569c1ef638"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.848333 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b699cc7bf8b7489583daddae8edf7c9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:22.848584 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1409c4adee7d404dabbb49569c1ef638 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:22.849936 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a34174b7fc08427b821660028e6edba5 has no consensus state
I20260927 15:06:22.849872 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f700aca14beb4e8a966b006c7a705676" } new_table_name: "default.Table_905f2cbb1c5e4c5fb9ab52f2bb184109" modify_external_catalogs: true
I20260927 15:06:22.850273 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b07276756da348cfb9c1781447600490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.850700 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b07276756da348cfb9c1781447600490 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:22.851783 906 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.201.3:60991 (request call id 166) took 1287 ms (client timeout 1000 ms). Trace:
I20260927 15:06:22.852155 1284 tablet_service.cc:1514] Processing DeleteTablet for tablet fa143466f2bd4185887d6ccfcbbe8dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:22.851905 906 rpcz_store.cc:269] 0927 15:06:21.564415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.570799 (+ 6384us) service_pool.cc:227] Handling call
0927 15:06:22.851740 (+1280941us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:21.897959 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:21.898071 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:21.898078 (+ 7us) write_op.cc:435] Acquired schema lock
0927 15:06:21.898082 (+ 4us) tablet.cc:660] Decoding operations
0927 15:06:21.898184 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:21.898194 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:21.898201 (+ 7us) tablet.cc:683] Acquiring locks for 1 operations
0927 15:06:21.898260 (+ 59us) tablet.cc:699] Row locks acquired
0927 15:06:21.898263 (+ 3us) write_op.cc:260] PREPARE: finished
0927 15:06:21.898292 (+ 29us) write_op.cc:270] Start()
0927 15:06:21.898320 (+ 28us) write_op.cc:276] Timestamp: P: 1790521581898281 usec, L: 0
0927 15:06:21.898326 (+ 6us) op_driver.cc:331] REPLICATION: starting
0927 15:06:21.898481 (+ 155us) log.cc:842] Serialized 527 byte log entry
0927 15:06:21.924376 (+ 25895us) op_driver.cc:444] REPLICATION: finished
0927 15:06:21.925546 (+ 1170us) write_op.cc:301] APPLY: starting
0927 15:06:21.925555 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:21.925577 (+ 22us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:21.925595 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:21.925637 (+ 42us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:21.925659 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 15:06:21.925664 (+ 5us) write_op.cc:312] APPLY: finished
0927 15:06:21.925712 (+ 48us) log.cc:842] Serialized 23 byte log entry
0927 15:06:21.925747 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:21.925758 (+ 11us) write_op.cc:454] Released schema lock
0927 15:06:21.925763 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:21.925807 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:21.925810 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0927 15:06:22.135166 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:22.135264 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:22.135269 (+ 5us) write_op.cc:435] Acquired schema lock
0927 15:06:22.135271 (+ 2us) tablet.cc:660] Decoding operations
0927 15:06:22.135346 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:22.135354 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:22.135358 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0927 15:06:22.135409 (+ 51us) tablet.cc:699] Row locks acquired
0927 15:06:22.135411 (+ 2us) write_op.cc:260] PREPARE: finished
0927 15:06:22.135439 (+ 28us) write_op.cc:270] Start()
0927 15:06:22.135466 (+ 27us) write_op.cc:276] Timestamp: P: 1790521582135410 usec, L: 0
0927 15:06:22.135470 (+ 4us) op_driver.cc:331] REPLICATION: starting
0927 15:06:22.135629 (+ 159us) log.cc:842] Serialized 356 byte log entry
0927 15:06:22.296985 (+161356us) op_driver.cc:444] REPLICATION: finished
0927 15:06:22.297939 (+ 954us) write_op.cc:301] APPLY: starting
0927 15:06:22.297950 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:22.297985 (+ 35us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:22.298008 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:22.298051 (+ 43us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:22.298081 (+ 30us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 15:06:22.298087 (+ 6us) write_op.cc:312] APPLY: finished
0927 15:06:22.298164 (+ 77us) log.cc:842] Serialized 23 byte log entry
0927 15:06:22.298202 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.298214 (+ 12us) write_op.cc:454] Released schema lock
0927 15:06:22.298219 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:22.298264 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.298267 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0927 15:06:22.302069 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:22.302178 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:22.302183 (+ 5us) write_op.cc:435] Acquired schema lock
0927 15:06:22.302186 (+ 3us) tablet.cc:660] Decoding operations
0927 15:06:22.302292 (+ 106us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:22.302303 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:22.302308 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
0927 15:06:22.302370 (+ 62us) tablet.cc:699] Row locks acquired
0927 15:06:22.302373 (+ 3us) write_op.cc:260] PREPARE: finished
0927 15:06:22.302409 (+ 36us) write_op.cc:270] Start()
0927 15:06:22.302438 (+ 29us) write_op.cc:276] Timestamp: P: 1790521582302365 usec, L: 0
0927 15:06:22.302441 (+ 3us) op_driver.cc:331] REPLICATION: starting
0927 15:06:22.349823 (+ 47382us) log.cc:842] Serialized 356 byte log entry
0927 15:06:22.349993 (+ 170us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f2c3410dd02 00007f2c354407f1 00007f2c3543f359 00007f2c354471bb 00007f2c35447038 00000000009edb7c 00007f2c28c41344 00007f2c28c4491b 00007f2c28c44798 00000000009edb7c
0927 15:06:22.472855 (+122862us) op_driver.cc:444] REPLICATION: finished
0927 15:06:22.473270 (+ 415us) write_op.cc:301] APPLY: starting
0927 15:06:22.473288 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:22.473358 (+ 70us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:22.473361 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:22.473421 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:22.473467 (+ 46us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 15:06:22.473474 (+ 7us) write_op.cc:312] APPLY: finished
0927 15:06:22.473629 (+ 155us) log.cc:842] Serialized 23 byte log entry
0927 15:06:22.473696 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.473717 (+ 21us) write_op.cc:454] Released schema lock
0927 15:06:22.473724 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:22.473790 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.473794 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":1145,"apply.run_cpu_time_us":301,"apply.run_wall_time_us":300,"num_ops":1,"prepare.queue_time_us":321269,"prepare.run_cpu_time_us":593,"prepare.run_wall_time_us":1480,"replication_time_us":26037,"thread_start_us":126474,"threads_started":1}],["op",{"apply.queue_time_us":926,"apply.run_cpu_time_us":365,"apply.run_wall_time_us":363,"num_ops":1,"prepare.queue_time_us":204235,"prepare.run_cpu_time_us":523,"prepare.run_wall_time_us":799,"replication_time_us":161502}],["op",{"apply.queue_time_us":353,"apply.run_cpu_time_us":575,"apply.run_wall_time_us":574,"num_ops":1,"prepare.queue_time_us":738,"prepare.run_cpu_time_us":1407,"prepare.run_wall_time_us":47958,"replication_time_us":170383,"spinlock_wait_cycles":108489088}]]}
I20260927 15:06:22.853190 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2d8a930a9263401db2c395efc4959a7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.853665 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d8a930a9263401db2c395efc4959a7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:22.846287 913 rpcz_store.cc:269] 0927 15:06:21.938012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.053176 (+115164us) service_pool.cc:227] Handling call
0927 15:06:22.066503 (+ 13327us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00007f2c3731827d 00007f2c37318373 00007f2c3413a361 00007f2c3baad66a 00007f2c3bc2fd8f 00007f2c32f24946 00007f2c32f24675 00007f2c2f7379be 00007f2c2f73679e 00007f2c2f73cb25 00007f2c2f73d54f
0927 15:06:22.846095 (+779592us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:22.141643 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:22.141740 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:22.141747 (+ 7us) write_op.cc:435] Acquired schema lock
0927 15:06:22.141750 (+ 3us) tablet.cc:660] Decoding operations
0927 15:06:22.141846 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:22.141862 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:22.141866 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0927 15:06:22.141911 (+ 45us) tablet.cc:699] Row locks acquired
0927 15:06:22.141913 (+ 2us) write_op.cc:260] PREPARE: finished
0927 15:06:22.141935 (+ 22us) write_op.cc:270] Start()
0927 15:06:22.141956 (+ 21us) write_op.cc:276] Timestamp: P: 1790521582141908 usec, L: 0
0927 15:06:22.141961 (+ 5us) op_driver.cc:331] REPLICATION: starting
0927 15:06:22.142076 (+ 115us) log.cc:842] Serialized 527 byte log entry
0927 15:06:22.326526 (+184450us) op_driver.cc:444] REPLICATION: finished
0927 15:06:22.327273 (+ 747us) write_op.cc:301] APPLY: starting
0927 15:06:22.327282 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:22.327312 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:22.327334 (+ 22us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:22.327373 (+ 39us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:22.327395 (+ 22us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 15:06:22.327401 (+ 6us) write_op.cc:312] APPLY: finished
0927 15:06:22.327450 (+ 49us) log.cc:842] Serialized 23 byte log entry
0927 15:06:22.327503 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.327513 (+ 10us) write_op.cc:454] Released schema lock
0927 15:06:22.327518 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:22.327559 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.327564 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0927 15:06:22.350059 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:22.350170 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:22.350175 (+ 5us) write_op.cc:435] Acquired schema lock
0927 15:06:22.350177 (+ 2us) tablet.cc:660] Decoding operations
0927 15:06:22.350279 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:22.350291 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:22.350295 (+ 4us) tablet.cc:683] Acquiring locks for 1 operations
0927 15:06:22.350360 (+ 65us) tablet.cc:699] Row locks acquired
0927 15:06:22.350362 (+ 2us) write_op.cc:260] PREPARE: finished
0927 15:06:22.350396 (+ 34us) write_op.cc:270] Start()
0927 15:06:22.350427 (+ 31us) write_op.cc:276] Timestamp: P: 1790521582350349 usec, L: 0
0927 15:06:22.350430 (+ 3us) op_driver.cc:331] REPLICATION: starting
0927 15:06:22.350573 (+ 143us) log.cc:842] Serialized 356 byte log entry
0927 15:06:22.472926 (+122353us) op_driver.cc:444] REPLICATION: finished
0927 15:06:22.473869 (+ 943us) write_op.cc:301] APPLY: starting
0927 15:06:22.473878 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:22.473905 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:22.473931 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:22.473968 (+ 37us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:22.473994 (+ 26us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 15:06:22.473999 (+ 5us) write_op.cc:312] APPLY: finished
0927 15:06:22.474046 (+ 47us) log.cc:842] Serialized 23 byte log entry
0927 15:06:22.474079 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.474089 (+ 10us) write_op.cc:454] Released schema lock
0927 15:06:22.474093 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:22.474132 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.474136 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0927 15:06:22.490136 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:22.490276 (+ 140us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:22.490282 (+ 6us) write_op.cc:435] Acquired schema lock
0927 15:06:22.490284 (+ 2us) tablet.cc:660] Decoding operations
0927 15:06:22.490414 (+ 130us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:22.490433 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:22.490441 (+ 8us) tablet.cc:683] Acquiring locks for 1 operations
0927 15:06:22.490523 (+ 82us) tablet.cc:699] Row locks acquired
0927 15:06:22.490527 (+ 4us) write_op.cc:260] PREPARE: finished
0927 15:06:22.490572 (+ 45us) write_op.cc:270] Start()
0927 15:06:22.490615 (+ 43us) write_op.cc:276] Timestamp: P: 1790521582490548 usec, L: 0
0927 15:06:22.490620 (+ 5us) op_driver.cc:331] REPLICATION: starting
0927 15:06:22.490879 (+ 259us) log.cc:842] Serialized 356 byte log entry
0927 15:06:22.839338 (+348459us) op_driver.cc:444] REPLICATION: finished
0927 15:06:22.839732 (+ 394us) write_op.cc:301] APPLY: starting
0927 15:06:22.839752 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:22.839797 (+ 45us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:22.839825 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:22.839887 (+ 62us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:22.839929 (+ 42us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0927 15:06:22.839936 (+ 7us) write_op.cc:312] APPLY: finished
0927 15:06:22.840036 (+ 100us) log.cc:842] Serialized 23 byte log entry
0927 15:06:22.840124 (+ 88us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.840147 (+ 23us) write_op.cc:454] Released schema lock
0927 15:06:22.840156 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:22.840222 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:22.840226 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":33,"spinlock_wait_cycles":27359616,"child_traces":[["op",{"apply.queue_time_us":721,"apply.run_cpu_time_us":324,"apply.run_wall_time_us":323,"num_ops":1,"prepare.queue_time_us":35305,"prepare.run_cpu_time_us":503,"prepare.run_wall_time_us":1748,"replication_time_us":184545}],["op",{"apply.queue_time_us":918,"apply.run_cpu_time_us":300,"apply.run_wall_time_us":300,"num_ops":1,"prepare.queue_time_us":20295,"prepare.run_cpu_time_us":562,"prepare.run_wall_time_us":560,"replication_time_us":122481}],["op",{"apply.queue_time_us":339,"apply.run_cpu_time_us":551,"apply.run_wall_time_us":551,"num_ops":1,"prepare.queue_time_us":11087,"prepare.run_cpu_time_us":835,"prepare.run_wall_time_us":835,"replication_time_us":348684}]]}
I20260927 15:06:22.860001 1552 tablet_bootstrap.cc:492] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:22.860127 1552 ts_tablet_manager.cc:1397] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.000s
I20260927 15:06:22.860663 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6d463c2d83eb44d08f558d1760002e04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:22.860801 1552 raft_consensus.cc:348] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.861120 1552 raft_consensus.cc:374] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.861177 1552 raft_consensus.cc:729] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.861495 1552 consensus_queue.cc:260] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.862177 1552 ts_tablet_manager.cc:1428] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:22.868726 1552 tablet_bootstrap.cc:492] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:22.870019 1552 tablet_bootstrap.cc:654] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.877175 2119 ts_tablet_manager.cc:1918] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:22.877358 2119 log.cc:1196] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/f271c76b5f2447239d3d014fbde4e8b2
I20260927 15:06:22.877771 2119 ts_tablet_manager.cc:1939] T f271c76b5f2447239d3d014fbde4e8b2 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:22.878110 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1068) took 1691 ms. Trace:
I20260927 15:06:22.878237 2119 rpcz_store.cc:276] 0927 15:06:21.186968 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.187019 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:22.822993 (+1635974us) ts_tablet_manager.cc:1145] Deleting tablet f271c76b5f2447239d3d014fbde4e8b2
0927 15:06:22.823005 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.848220 (+ 25215us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.877074 (+ 28854us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.878094 (+ 1020us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1635779}
I20260927 15:06:22.878773 2119 tablet_replica.cc:330] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:22.879424 2119 raft_consensus.cc:2229] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:22.880296 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0ec92996e56b40ccb42f05e74a483762" } modify_external_catalogs: true
I20260927 15:06:22.880748 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0ec92996e56b40ccb42f05e74a483762" } modify_external_catalogs: true
W20260927 15:06:22.886924 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdd7bbf588ea4f259cb815683636c7dd has no consensus state
I20260927 15:06:22.887310 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7156da92993b44a09d20d69c14974466" } modify_external_catalogs: true
I20260927 15:06:22.887506 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7156da92993b44a09d20d69c14974466" } modify_external_catalogs: true
I20260927 15:06:22.888571 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_759abb041bb145f8957dce2f2b9a7cbe" } modify_external_catalogs: true
I20260927 15:06:22.888773 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_759abb041bb145f8957dce2f2b9a7cbe" } modify_external_catalogs: true
I20260927 15:06:22.879068 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet f271c76b5f2447239d3d014fbde4e8b2 (table default.Table_e54284c6f69f46a58add5dfc7c9bec4a [id=6b5a311a2ea347fb8e51feecb8e01b7c]) successfully deleted
I20260927 15:06:22.894586 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_886573ce4aa14fe9a0f82db4701853ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:22.895195 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_886573ce4aa14fe9a0f82db4701853ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:22.900847 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d463c2d83eb44d08f558d1760002e04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.904906 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet b44e2611d2bf40ae90c4fd857225e39e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.905333 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 79a3125723034cb48bc1a05fc4abbb82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.905265 1561 raft_consensus.cc:348] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.905457 1561 raft_consensus.cc:374] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.905503 1561 raft_consensus.cc:729] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.905723 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet ac64eacc7d924940aacc8779b5bfeae7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.905665 1561 consensus_queue.cc:260] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.906019 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 727652500d9a47b68b7a0d0dcf583822 with delete_type TABLET_DATA_DELETED (replaced by tablet decee14b5d7a4aef9989051dcaeb5a7b) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.906165 1561 ts_tablet_manager.cc:1428] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.091s user 0.001s sys 0.000s
I20260927 15:06:22.906306 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet c6a248ec4ee64d0a8d986fdc683d69ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.906399 1561 tablet_bootstrap.cc:492] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:22.907281 3147 raft_consensus.cc:482] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:22.907400 3147 raft_consensus.cc:504] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.907738 1561 tablet_bootstrap.cc:654] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.908001 3147 leader_election.cc:288] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:22.908430 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b1f2143af1142eb9f3dbc777299c186 with delete_type TABLET_DATA_DELETED (replaced by tablet 99d4707e599840b3bdc2ab13c348ea80) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:22.913236 809 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 72771.5us
I20260927 15:06:22.917197 1561 tablet_bootstrap.cc:492] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:22.917449 1561 ts_tablet_manager.cc:1397] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20260927 15:06:22.918812 1561 raft_consensus.cc:348] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.919196 1561 raft_consensus.cc:374] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.919322 1561 raft_consensus.cc:729] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.919675 1561 consensus_queue.cc:260] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:22.926326 1561 ts_tablet_manager.cc:1428] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260927 15:06:22.927019 2119 raft_consensus.cc:2258] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.928185 2119 ts_tablet_manager.cc:1905] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.928051 1561 tablet_bootstrap.cc:492] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:22.913122 1552 tablet_bootstrap.cc:492] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:22.928516 1552 ts_tablet_manager.cc:1397] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.001s
I20260927 15:06:22.929149 1552 raft_consensus.cc:348] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.929342 1552 raft_consensus.cc:374] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.929392 1552 raft_consensus.cc:729] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.929651 1552 consensus_queue.cc:260] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.930274 1552 ts_tablet_manager.cc:1428] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:22.934140 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e9b07ea3ec9457399e2b765580d06e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.934520 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4cff4a06db44269defca578af289d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.934857 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.935161 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet d4f05da432f041378c5ab808536e6b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.935467 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 278205071701447e8ee7457b2ee84be4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.935763 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet fa143466f2bd4185887d6ccfcbbe8dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:22.936740 1552 tablet_bootstrap.cc:492] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:22.937450 1561 tablet_bootstrap.cc:654] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.938046 1552 tablet_bootstrap.cc:654] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.938105 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1ef5c0dde2d24da99ce5912661473b85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:22.938452 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ebe623a52b764344bff82915aa08835f" } new_table_name: "default.Table_18383daf6fca4eef84dcd729245544ef" modify_external_catalogs: true
W20260927 15:06:22.938680 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ef5c0dde2d24da99ce5912661473b85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:22.939293 906 master_service.cc:946] ReplaceTablet: received request to replace tablet d827f6a3a6834ecd86d8722b1f1e4444 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:22.945822 913 master_service.cc:946] ReplaceTablet: received request to replace tablet 997c93bdf78b49709130d97a8d96a5a5 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:22.946233 2985 log.cc:824] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: Log is configured to *not* fsync() on all Append() calls
W20260927 15:06:22.946472 1099 leader_election.cc:341] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 289bea546c8a41bf97edfdc9a453a024
I20260927 15:06:22.951161 1552 tablet_bootstrap.cc:492] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:22.951288 1552 ts_tablet_manager.cc:1397] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260927 15:06:22.954124 2119 ts_tablet_manager.cc:1918] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:22.954285 2119 log.cc:1196] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/429088342b4743c39fb1e38d235024de
I20260927 15:06:22.954712 2119 ts_tablet_manager.cc:1939] T 429088342b4743c39fb1e38d235024de P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:22.955087 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1069) took 1593 ms. Trace:
I20260927 15:06:22.955215 2119 rpcz_store.cc:276] 0927 15:06:21.362024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.362198 (+ 174us) service_pool.cc:227] Handling call
0927 15:06:22.878732 (+1516534us) ts_tablet_manager.cc:1145] Deleting tablet 429088342b4743c39fb1e38d235024de
0927 15:06:22.878743 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.949540 (+ 70797us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.954044 (+ 4504us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.955073 (+ 1029us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1516338}
I20260927 15:06:22.955735 2119 tablet_replica.cc:330] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:22.955683 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 429088342b4743c39fb1e38d235024de (table default.Table_9a6330b2000f4bb5a7817b924f99ad53 [id=09a85e91664d444eab58b705a3be138d]) successfully deleted
I20260927 15:06:22.955981 2119 raft_consensus.cc:2229] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:22.956194 2119 raft_consensus.cc:2258] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.956974 2119 ts_tablet_manager.cc:1905] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.959707 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289bea546c8a41bf97edfdc9a453a024" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:22.853432 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fff31ceb379400bbfa4586c749e6d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:22.855316 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet af25950fd08043f18a6eaaf46ded4378 with delete_type TABLET_DATA_DELETED (replaced by tablet 571072536098420d8b5bdddc9aaa4161) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:22.961906 3167 tablet_replica.cc:330] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:22.962136 3167 raft_consensus.cc:2229] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:22.962323 3167 raft_consensus.cc:2258] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.962393 1552 raft_consensus.cc:348] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.962590 1552 raft_consensus.cc:374] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.962643 1552 raft_consensus.cc:729] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.962802 1552 consensus_queue.cc:260] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.962910 3167 ts_tablet_manager.cc:1905] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.964241 2119 ts_tablet_manager.cc:1918] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:22.964323 2119 log.cc:1196] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/58d6bdc1ac004d889aac36db65afbbbe
I20260927 15:06:22.964628 2119 ts_tablet_manager.cc:1939] T 58d6bdc1ac004d889aac36db65afbbbe P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:22.965289 1552 ts_tablet_manager.cc:1428] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260927 15:06:22.857076 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet cdcc55fb32b14935922e5870819bc266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:22.857738 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d4487cbbce24e60ae76ec0aca2760f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:22.863751 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet fa143466f2bd4185887d6ccfcbbe8dd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:22.967923 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1070) took 1605 ms. Trace:
I20260927 15:06:22.968267 2119 rpcz_store.cc:276] 0927 15:06:21.362148 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.362424 (+ 276us) service_pool.cc:227] Handling call
0927 15:06:22.955693 (+1593269us) ts_tablet_manager.cc:1145] Deleting tablet 58d6bdc1ac004d889aac36db65afbbbe
0927 15:06:22.955703 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.961180 (+ 5477us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.964172 (+ 2992us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.967908 (+ 3736us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1593162}
I20260927 15:06:22.968215 1552 tablet_bootstrap.cc:492] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:22.968765 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 58d6bdc1ac004d889aac36db65afbbbe (table default.Table_27a7140bf7c847d8acb10f2ac4c04bcf [id=a99492ccd2464bc2b1885ade4a76db9f]) successfully deleted
I20260927 15:06:22.970103 3167 ts_tablet_manager.cc:1918] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:22.970223 3167 log.cc:1196] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/3fff31ceb379400bbfa4586c749e6d6e
I20260927 15:06:22.970541 3167 ts_tablet_manager.cc:1939] T 3fff31ceb379400bbfa4586c749e6d6e P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:22.971925 3167 tablet_replica.cc:330] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:22.972015 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 3fff31ceb379400bbfa4586c749e6d6e (table default.Table_017e45d4e58a4ee7963c291a4aa901c7 [id=5b1a6c0ccb0541acbcbea845dd239b61]) successfully deleted
I20260927 15:06:22.972229 3167 raft_consensus.cc:2229] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:22.972414 3167 raft_consensus.cc:2258] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.972698 1552 tablet_bootstrap.cc:654] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:22.973057 3167 ts_tablet_manager.cc:1905] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.982188 2119 tablet_replica.cc:330] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:22.982429 2119 raft_consensus.cc:2229] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:22.982720 2119 pending_rounds.cc:62] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:22.982883 2119 pending_rounds.cc:68] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976397473505280 op_type: NO_OP noop_request { }
I20260927 15:06:22.983067 2119 raft_consensus.cc:2866] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:22.983192 2119 raft_consensus.cc:2258] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:22.983736 2119 ts_tablet_manager.cc:1905] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:22.985724 1562 ts_tablet_manager.cc:1918] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:22.991756 1552 tablet_bootstrap.cc:492] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:22.991909 1552 ts_tablet_manager.cc:1397] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260927 15:06:22.992561 1552 raft_consensus.cc:348] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.992771 1552 raft_consensus.cc:374] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:22.992871 1552 raft_consensus.cc:729] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:22.993100 1552 consensus_queue.cc:260] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:22.993780 1552 ts_tablet_manager.cc:1428] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:22.994045 1552 tablet_bootstrap.cc:492] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:22.995608 1552 tablet_bootstrap.cc:654] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:23.002892 2119 ts_tablet_manager.cc:1918] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:23.003998 1556 tablet_bootstrap.cc:492] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:23.004195 1556 ts_tablet_manager.cc:1397] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.176s user 0.002s sys 0.001s
I20260927 15:06:23.005095 1556 raft_consensus.cc:348] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.005365 1556 raft_consensus.cc:374] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.005471 1556 raft_consensus.cc:729] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.005498 2119 log.cc:1196] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/9576d1a36d7547bf81faabe9c362e3cb
I20260927 15:06:23.005975 2119 ts_tablet_manager.cc:1939] T 9576d1a36d7547bf81faabe9c362e3cb P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:23.005843 1556 consensus_queue.cc:260] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.008522 1556 ts_tablet_manager.cc:1428] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:23.008860 1556 tablet_bootstrap.cc:492] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:23.010362 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1071) took 1621 ms. Trace:
I20260927 15:06:23.015724 1562 log.cc:1196] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/9576d1a36d7547bf81faabe9c362e3cb
W20260927 15:06:22.987435 1102 leader_election.cc:341] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.015910 1102 leader_election.cc:302] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.017115 3148 raft_consensus.cc:2726] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:23.019362 2119 rpcz_store.cc:276] 0927 15:06:21.389177 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.389398 (+ 221us) service_pool.cc:227] Handling call
0927 15:06:22.982146 (+1592748us) ts_tablet_manager.cc:1145] Deleting tablet 9576d1a36d7547bf81faabe9c362e3cb
0927 15:06:22.982156 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.996233 (+ 14077us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.002788 (+ 6555us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.010344 (+ 7556us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1592566}
I20260927 15:06:23.022684 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
I20260927 15:06:23.023066 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 078ba40ca56745b2a2b86402a1519011 (table default.Table_4e61792c99664faca894de841edc089d [id=f8a991083fb74bfc9d9969214ac7108f]). Expected version 2 got 0
I20260927 15:06:23.023290 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 (table default.Table_9f691e4415864362a0a11b7ef69d222c [id=b09765fbcc8e4859b112206dd59e8ee8]). Expected version 1 got 0
I20260927 15:06:23.023618 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:23.025048 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 2e17bfecdba1442bad2f56dea3dd384d (DEFAULT_TABLE table=default.Table_5b325959fd7c4c07a329ca3d6d65f01b [id=e9b0cd5a6d244ff98d023563af12a619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.025538 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e17bfecdba1442bad2f56dea3dd384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.028254 909 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 1ef93a120f00423d91664ce4eaf03803 (table default.Table_abb2a056a859472fb4d4b36dde2ff8d3 [id=40aeb63abca64c3a8d12f9085fd816d8]). Expected version 4 got 0
I20260927 15:06:23.031935 1414 tablet_service.cc:1467] Processing CreateTablet for tablet bfe65f205f4e477b8c3b65d5b5c1b1c0 (DEFAULT_TABLE table=default.Table_630d1e22ffd640d5b7d2221a21e388b9 [id=bbb4b23e643d4548bdcd75e208a0996c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.032145 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 9dfa0642fa2645818b0dd76526f88433 (DEFAULT_TABLE table=default.Table_eae443c27a234a5c8378e6b41e9b8d2e [id=768d8078af494d448015c5acbb25cd3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.032348 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfe65f205f4e477b8c3b65d5b5c1b1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.032651 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 5913f16553034abca8267162482ed90d (DEFAULT_TABLE table=default.Table_a7dd25df190042b99672a95502aa1b2c [id=bfe6909c66cd47fab8ab4eab42fd0bae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.032992 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5913f16553034abca8267162482ed90d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.035125 1418 tablet_service.cc:1467] Processing CreateTablet for tablet a4cc28b977ad4ed3bfe1672fbe44ec03 (DEFAULT_TABLE table=default.Table_fac46c3377064415bbb90be5ca23da6b [id=94837f920b494a00a88db37bc5ba85fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.035346 3150 raft_consensus.cc:482] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.035475 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4cc28b977ad4ed3bfe1672fbe44ec03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.035480 3150 raft_consensus.cc:504] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.036074 3150 leader_election.cc:288] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.038726 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 2e17bfecdba1442bad2f56dea3dd384d (DEFAULT_TABLE table=default.Table_5b325959fd7c4c07a329ca3d6d65f01b [id=e9b0cd5a6d244ff98d023563af12a619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.038782 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 9dfa0642fa2645818b0dd76526f88433 (DEFAULT_TABLE table=default.Table_eae443c27a234a5c8378e6b41e9b8d2e [id=768d8078af494d448015c5acbb25cd3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.039146 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e17bfecdba1442bad2f56dea3dd384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.039085 1413 tablet_service.cc:1467] Processing CreateTablet for tablet abd61cdee83442d4811382febbaae888 (DEFAULT_TABLE table=default.Table_637b66b95fd240b384ff0cf64aa51cd6 [id=109c1503537d4cbc9821b14e231715bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.039405 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abd61cdee83442d4811382febbaae888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.039422 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dfa0642fa2645818b0dd76526f88433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.043119 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 6cac7646e1e4497daa184b2662736053 (DEFAULT_TABLE table=default.Table_b518b0bdc28d4894b2a09ef80c2e8d27 [id=3a1a031613aa4d90bedcfd2ce7a2b61f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.043468 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cac7646e1e4497daa184b2662736053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.044240 1146 tablet_service.cc:1467] Processing CreateTablet for tablet bfe65f205f4e477b8c3b65d5b5c1b1c0 (DEFAULT_TABLE table=default.Table_630d1e22ffd640d5b7d2221a21e388b9 [id=bbb4b23e643d4548bdcd75e208a0996c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.044548 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfe65f205f4e477b8c3b65d5b5c1b1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.023958 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 2e17bfecdba1442bad2f56dea3dd384d (DEFAULT_TABLE table=default.Table_5b325959fd7c4c07a329ca3d6d65f01b [id=e9b0cd5a6d244ff98d023563af12a619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.045202 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e17bfecdba1442bad2f56dea3dd384d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.047057 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 6395122812b54620af71aacfbb48400f (DEFAULT_TABLE table=default.Table_f77beb2ccd334371b7601efae663c779 [id=8bad324631f047319a52a164b1938abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.047097 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 06db1457612a4796a62fb9ef6ec638c6 (DEFAULT_TABLE table=default.Table_7363e92dbea54253b766246d2941b7c1 [id=380bcdd2b22c4e2687fdeff70748cff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.047360 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6395122812b54620af71aacfbb48400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.047425 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06db1457612a4796a62fb9ef6ec638c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.047574 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fecfb2325046f98e69797ff8342892" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:23.047798 1439 raft_consensus.cc:2454] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:23.025645 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 9dfa0642fa2645818b0dd76526f88433 (DEFAULT_TABLE table=default.Table_eae443c27a234a5c8378e6b41e9b8d2e [id=768d8078af494d448015c5acbb25cd3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.050711 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dfa0642fa2645818b0dd76526f88433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.051051 1279 tablet_service.cc:1467] Processing CreateTablet for tablet f23a89f9537740b6bf7dbdf08a16e32d (DEFAULT_TABLE table=default.Table_834708d11c7f4f0bb805f814699fb90c [id=2809a0556ce041f8a1c7a8004dda6585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.051095 1409 tablet_service.cc:1467] Processing CreateTablet for tablet a300094edeef4290962868effaa78490 (DEFAULT_TABLE table=default.Table_fd1cf18051124d5fab0d547ea32c4f4a [id=fdc0c1cba9da45179d6a11922c718c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.051345 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23a89f9537740b6bf7dbdf08a16e32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.051458 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a300094edeef4290962868effaa78490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.051971 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fecfb2325046f98e69797ff8342892" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:23.052670 1102 leader_election.cc:341] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.052968 1099 leader_election.cc:302] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:23.053346 3173 raft_consensus.cc:2781] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:23.053426 3173 raft_consensus.cc:482] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:23.053488 3173 raft_consensus.cc:3037] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.027626 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 5913f16553034abca8267162482ed90d (DEFAULT_TABLE table=default.Table_a7dd25df190042b99672a95502aa1b2c [id=bfe6909c66cd47fab8ab4eab42fd0bae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.054008 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5913f16553034abca8267162482ed90d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.029579 1271 tablet_service.cc:1467] Processing CreateTablet for tablet bfe65f205f4e477b8c3b65d5b5c1b1c0 (DEFAULT_TABLE table=default.Table_630d1e22ffd640d5b7d2221a21e388b9 [id=bbb4b23e643d4548bdcd75e208a0996c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.055070 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfe65f205f4e477b8c3b65d5b5c1b1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.057199 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9dfa0642fa2645818b0dd76526f88433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.034946 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 81e0be77dff645f795237ffe779ed684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.057659 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 8837e5156c9a43ac94ce86174a8f17e1 (DEFAULT_TABLE table=default.Table_1c3f3f4c12b24ecc9c57dccef288bd6b [id=a0f04509b0814d46a39f5b6990ab330e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.057945 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8837e5156c9a43ac94ce86174a8f17e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.060036 1407 tablet_service.cc:1467] Processing CreateTablet for tablet b9610c28efba48cfbce277639142393a (DEFAULT_TABLE table=default.Table_c0035dfe43e54606883fdc82c180334c [id=8ea1fbc30af14d8f9762c733a7491fe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.060423 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9610c28efba48cfbce277639142393a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.060526 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 1af8b4fa71d54bb2b83a0a81ef43d269 (DEFAULT_TABLE table=default.Table_04806c4d169c477aa076124ac18c17f1 [id=3d6c47a8a43b409d80b768796571f2d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.060883 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1af8b4fa71d54bb2b83a0a81ef43d269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.035270 1269 tablet_service.cc:1467] Processing CreateTablet for tablet a4cc28b977ad4ed3bfe1672fbe44ec03 (DEFAULT_TABLE table=default.Table_fac46c3377064415bbb90be5ca23da6b [id=94837f920b494a00a88db37bc5ba85fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.062865 1405 tablet_service.cc:1467] Processing CreateTablet for tablet 8837e5156c9a43ac94ce86174a8f17e1 (DEFAULT_TABLE table=default.Table_1c3f3f4c12b24ecc9c57dccef288bd6b [id=a0f04509b0814d46a39f5b6990ab330e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.063066 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4cc28b977ad4ed3bfe1672fbe44ec03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.063213 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8837e5156c9a43ac94ce86174a8f17e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.063126 1417 tablet_service.cc:1467] Processing CreateTablet for tablet b3b3d88a076e4af98f233d76a37fd455 (DEFAULT_TABLE table=default.Table_3786977bb6a8472a9e3474d78d5ec9f7 [id=23bef7e96eaa4f10b0cd590e8e65037a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.063380 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 42ffbde9f20d4e86a6c01713f396a67a (DEFAULT_TABLE table=default.Table_5d152fad078948fb9fbf120a0c415c6d [id=d7ab347706274b77b1562e87658ec898]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.063506 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3b3d88a076e4af98f233d76a37fd455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.063719 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ffbde9f20d4e86a6c01713f396a67a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.063127 1410 tablet_service.cc:1467] Processing CreateTablet for tablet bfe929545bfa478fbddaf8d2e6038a5f (DEFAULT_TABLE table=default.Table_580922ee309b4853930fddfdff7d2904 [id=df462b691a6d447199037db8f230df9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.064374 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfe929545bfa478fbddaf8d2e6038a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.035439 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 58d6bdc1ac004d889aac36db65afbbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.067134 1281 tablet_service.cc:1467] Processing CreateTablet for tablet b3b3d88a076e4af98f233d76a37fd455 (DEFAULT_TABLE table=default.Table_3786977bb6a8472a9e3474d78d5ec9f7 [id=23bef7e96eaa4f10b0cd590e8e65037a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.067135 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 6395122812b54620af71aacfbb48400f (DEFAULT_TABLE table=default.Table_f77beb2ccd334371b7601efae663c779 [id=8bad324631f047319a52a164b1938abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.067452 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3b3d88a076e4af98f233d76a37fd455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.067484 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6395122812b54620af71aacfbb48400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.036321 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 with delete_type TABLET_DATA_DELETED (replaced by tablet b2d2501a9f764790818426665e7f0340) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.036652 1268 tablet_service.cc:1467] Processing CreateTablet for tablet abd61cdee83442d4811382febbaae888 (DEFAULT_TABLE table=default.Table_637b66b95fd240b384ff0cf64aa51cd6 [id=109c1503537d4cbc9821b14e231715bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.070813 1142 tablet_service.cc:1467] Processing CreateTablet for tablet a4cc28b977ad4ed3bfe1672fbe44ec03 (DEFAULT_TABLE table=default.Table_fac46c3377064415bbb90be5ca23da6b [id=94837f920b494a00a88db37bc5ba85fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.071143 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abd61cdee83442d4811382febbaae888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.071110 1412 tablet_service.cc:1467] Processing CreateTablet for tablet f23a89f9537740b6bf7dbdf08a16e32d (DEFAULT_TABLE table=default.Table_834708d11c7f4f0bb805f814699fb90c [id=2809a0556ce041f8a1c7a8004dda6585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.071206 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4cc28b977ad4ed3bfe1672fbe44ec03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.071466 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23a89f9537740b6bf7dbdf08a16e32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.036980 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 6cac7646e1e4497daa184b2662736053 (DEFAULT_TABLE table=default.Table_b518b0bdc28d4894b2a09ef80c2e8d27 [id=3a1a031613aa4d90bedcfd2ce7a2b61f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.075088 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cac7646e1e4497daa184b2662736053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.076143 1144 tablet_service.cc:1467] Processing CreateTablet for tablet abd61cdee83442d4811382febbaae888 (DEFAULT_TABLE table=default.Table_637b66b95fd240b384ff0cf64aa51cd6 [id=109c1503537d4cbc9821b14e231715bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.076449 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abd61cdee83442d4811382febbaae888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.037251 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 06db1457612a4796a62fb9ef6ec638c6 (DEFAULT_TABLE table=default.Table_7363e92dbea54253b766246d2941b7c1 [id=380bcdd2b22c4e2687fdeff70748cff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.078572 3173 raft_consensus.cc:504] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.079102 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06db1457612a4796a62fb9ef6ec638c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.079388 3173 leader_election.cc:288] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.079948 1138 tablet_service.cc:1467] Processing CreateTablet for tablet bfe929545bfa478fbddaf8d2e6038a5f (DEFAULT_TABLE table=default.Table_580922ee309b4853930fddfdff7d2904 [id=df462b691a6d447199037db8f230df9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.080297 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfe929545bfa478fbddaf8d2e6038a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.081135 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 42ffbde9f20d4e86a6c01713f396a67a (DEFAULT_TABLE table=default.Table_5d152fad078948fb9fbf120a0c415c6d [id=d7ab347706274b77b1562e87658ec898]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.081449 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ffbde9f20d4e86a6c01713f396a67a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.083036 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 06db1457612a4796a62fb9ef6ec638c6 (DEFAULT_TABLE table=default.Table_7363e92dbea54253b766246d2941b7c1 [id=380bcdd2b22c4e2687fdeff70748cff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.083328 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06db1457612a4796a62fb9ef6ec638c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.084607 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 6395122812b54620af71aacfbb48400f (DEFAULT_TABLE table=default.Table_f77beb2ccd334371b7601efae663c779 [id=8bad324631f047319a52a164b1938abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.084926 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6395122812b54620af71aacfbb48400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.087049 1133 tablet_service.cc:1467] Processing CreateTablet for tablet a300094edeef4290962868effaa78490 (DEFAULT_TABLE table=default.Table_fd1cf18051124d5fab0d547ea32c4f4a [id=fdc0c1cba9da45179d6a11922c718c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.087108 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 8837e5156c9a43ac94ce86174a8f17e1 (DEFAULT_TABLE table=default.Table_1c3f3f4c12b24ecc9c57dccef288bd6b [id=a0f04509b0814d46a39f5b6990ab330e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.087324 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a300094edeef4290962868effaa78490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.087997 1139 tablet_service.cc:1467] Processing CreateTablet for tablet b9610c28efba48cfbce277639142393a (DEFAULT_TABLE table=default.Table_c0035dfe43e54606883fdc82c180334c [id=8ea1fbc30af14d8f9762c733a7491fe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.088308 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9610c28efba48cfbce277639142393a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.090991 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8837e5156c9a43ac94ce86174a8f17e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.091063 1141 tablet_service.cc:1467] Processing CreateTablet for tablet fb8e95f350f249ac85c5df42afe4a90d (DEFAULT_TABLE table=default.Table_1098d7de1c054e21abb4fe1e91309fd9 [id=dad7f10cbda14de4adda3e4acdcee5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.091347 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8e95f350f249ac85c5df42afe4a90d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.095119 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 1af8b4fa71d54bb2b83a0a81ef43d269 (DEFAULT_TABLE table=default.Table_04806c4d169c477aa076124ac18c17f1 [id=3d6c47a8a43b409d80b768796571f2d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.095490 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1af8b4fa71d54bb2b83a0a81ef43d269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.096158 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 (table default.Table_9f691e4415864362a0a11b7ef69d222c [id=b09765fbcc8e4859b112206dd59e8ee8]). Expected version 1 got 0
I20260927 15:06:23.096562 906 catalog_manager.cc:5495] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:23.096959 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (table default.Table_9421c4a3c84e449ea9e86594f7342489 [id=239ff5a7776c4a469e14137b23b6544a]). Expected version 1 got 0
I20260927 15:06:23.097455 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 078ba40ca56745b2a2b86402a1519011 (table default.Table_4e61792c99664faca894de841edc089d [id=f8a991083fb74bfc9d9969214ac7108f]). Expected version 2 got 0
I20260927 15:06:23.097675 906 catalog_manager.cc:5495] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:23.098002 906 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 52e7439320dd48aba25b5f7dc627964c (table default.Table_1f2da6475c904f0d8aec8dea13410524 [id=6ae561a83b5543a89dd0dedc630d9e47]). Expected version 1 got 0
I20260927 15:06:23.098325 906 catalog_manager.cc:5495] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:23.099105 1137 tablet_service.cc:1467] Processing CreateTablet for tablet f23a89f9537740b6bf7dbdf08a16e32d (DEFAULT_TABLE table=default.Table_834708d11c7f4f0bb805f814699fb90c [id=2809a0556ce041f8a1c7a8004dda6585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.099865 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23a89f9537740b6bf7dbdf08a16e32d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.103137 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 65293368b6884f87bd2053ca2d399e8c (DEFAULT_TABLE table=default.Table_6f019b4793f74cf5940bc17afa1bacaf [id=06d7ac688adf46699e322f7e51ce0fbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.103415 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65293368b6884f87bd2053ca2d399e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.037556 1278 tablet_service.cc:1467] Processing CreateTablet for tablet a300094edeef4290962868effaa78490 (DEFAULT_TABLE table=default.Table_fd1cf18051124d5fab0d547ea32c4f4a [id=fdc0c1cba9da45179d6a11922c718c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.107558 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a300094edeef4290962868effaa78490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.037945 1266 tablet_service.cc:1467] Processing CreateTablet for tablet fb8e95f350f249ac85c5df42afe4a90d (DEFAULT_TABLE table=default.Table_1098d7de1c054e21abb4fe1e91309fd9 [id=dad7f10cbda14de4adda3e4acdcee5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.111078 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8e95f350f249ac85c5df42afe4a90d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.111740 1140 tablet_service.cc:1467] Processing CreateTablet for tablet b3b3d88a076e4af98f233d76a37fd455 (DEFAULT_TABLE table=default.Table_3786977bb6a8472a9e3474d78d5ec9f7 [id=23bef7e96eaa4f10b0cd590e8e65037a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.112052 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3b3d88a076e4af98f233d76a37fd455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.038206 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 65293368b6884f87bd2053ca2d399e8c (DEFAULT_TABLE table=default.Table_6f019b4793f74cf5940bc17afa1bacaf [id=06d7ac688adf46699e322f7e51ce0fbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.114236 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65293368b6884f87bd2053ca2d399e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.038494 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 1af8b4fa71d54bb2b83a0a81ef43d269 (DEFAULT_TABLE table=default.Table_04806c4d169c477aa076124ac18c17f1 [id=3d6c47a8a43b409d80b768796571f2d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.115057 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1af8b4fa71d54bb2b83a0a81ef43d269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.115978 1409 tablet_service.cc:1467] Processing CreateTablet for tablet fb8e95f350f249ac85c5df42afe4a90d (DEFAULT_TABLE table=default.Table_1098d7de1c054e21abb4fe1e91309fd9 [id=dad7f10cbda14de4adda3e4acdcee5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.116343 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8e95f350f249ac85c5df42afe4a90d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.038767 1285 tablet_service.cc:1467] Processing CreateTablet for tablet bfe929545bfa478fbddaf8d2e6038a5f (DEFAULT_TABLE table=default.Table_580922ee309b4853930fddfdff7d2904 [id=df462b691a6d447199037db8f230df9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.118141 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfe929545bfa478fbddaf8d2e6038a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.044452 1275 tablet_service.cc:1467] Processing CreateTablet for tablet b9610c28efba48cfbce277639142393a (DEFAULT_TABLE table=default.Table_c0035dfe43e54606883fdc82c180334c [id=8ea1fbc30af14d8f9762c733a7491fe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.119187 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9610c28efba48cfbce277639142393a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.119956 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 65293368b6884f87bd2053ca2d399e8c (DEFAULT_TABLE table=default.Table_6f019b4793f74cf5940bc17afa1bacaf [id=06d7ac688adf46699e322f7e51ce0fbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.120354 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65293368b6884f87bd2053ca2d399e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.044782 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 42ffbde9f20d4e86a6c01713f396a67a (DEFAULT_TABLE table=default.Table_5d152fad078948fb9fbf120a0c415c6d [id=d7ab347706274b77b1562e87658ec898]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.122107 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42ffbde9f20d4e86a6c01713f396a67a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.082762 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 6cac7646e1e4497daa184b2662736053 (DEFAULT_TABLE table=default.Table_b518b0bdc28d4894b2a09ef80c2e8d27 [id=3a1a031613aa4d90bedcfd2ce7a2b61f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.126951 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 5913f16553034abca8267162482ed90d (DEFAULT_TABLE table=default.Table_a7dd25df190042b99672a95502aa1b2c [id=bfe6909c66cd47fab8ab4eab42fd0bae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.127102 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cac7646e1e4497daa184b2662736053. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.127343 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5913f16553034abca8267162482ed90d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.129760 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df (DEFAULT_TABLE table=default.Table_437d2682e5f7473fa0056683c1d8babc [id=b365a95b5ca04401b6efbe9f6c6fad04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.130359 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.135167 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fecfb2325046f98e69797ff8342892" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:23.135347 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df (DEFAULT_TABLE table=default.Table_437d2682e5f7473fa0056683c1d8babc [id=b365a95b5ca04401b6efbe9f6c6fad04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.135417 1439 raft_consensus.cc:3037] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.135713 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.137481 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9fecfb2325046f98e69797ff8342892" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:23.137948 1439 raft_consensus.cc:2454] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:23.139516 1102 leader_election.cc:341] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.140369 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df (DEFAULT_TABLE table=default.Table_437d2682e5f7473fa0056683c1d8babc [id=b365a95b5ca04401b6efbe9f6c6fad04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.140497 1561 tablet_bootstrap.cc:492] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:23.140755 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.141119 1561 ts_tablet_manager.cc:1397] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.213s user 0.005s sys 0.007s
I20260927 15:06:23.141846 1561 raft_consensus.cc:348] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.142047 1561 raft_consensus.cc:374] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.142104 1561 raft_consensus.cc:729] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.142387 1561 consensus_queue.cc:260] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.142562 1419 tablet_service.cc:1467] Processing CreateTablet for tablet fe3b59d611b14a0fb191f3f0d9c528e6 (DEFAULT_TABLE table=default.Table_c8dff83721c444da9087a669433462b5 [id=8e1c1e201e96423eb26de3855a91c81b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.142935 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3b59d611b14a0fb191f3f0d9c528e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.142980 1561 ts_tablet_manager.cc:1428] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:23.143242 1561 tablet_bootstrap.cc:492] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:23.143292 3138 raft_consensus.cc:482] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.143395 3138 raft_consensus.cc:504] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.143929 3138 leader_election.cc:288] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.143795 1099 leader_election.cc:302] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:23.144302 3173 raft_consensus.cc:2781] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:23.144404 3173 raft_consensus.cc:686] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:23.144861 1561 tablet_bootstrap.cc:654] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:23.145624 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d7670381b49bb927943b2ee920c84" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:23.146654 1271 tablet_service.cc:1467] Processing CreateTablet for tablet fe3b59d611b14a0fb191f3f0d9c528e6 (DEFAULT_TABLE table=default.Table_c8dff83721c444da9087a669433462b5 [id=8e1c1e201e96423eb26de3855a91c81b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.146981 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3b59d611b14a0fb191f3f0d9c528e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.148736 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6958e870017a475db49b5dd499a2fed7" } new_table_name: "default.Table_05d06f1bf65243da9370135bea2fbf3c" modify_external_catalogs: true
I20260927 15:06:23.149453 1562 ts_tablet_manager.cc:1939] T 9576d1a36d7547bf81faabe9c362e3cb P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
W20260927 15:06:23.150040 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5bc2abbed22e4bacb31e11ff60593c20 consensus state has no leader
I20260927 15:06:23.150177 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 993) took 5884 ms. Trace:
I20260927 15:06:23.150254 1562 rpcz_store.cc:276] 0927 15:06:17.265505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.265556 (+ 51us) service_pool.cc:227] Handling call
0927 15:06:22.361285 (+5095729us) ts_tablet_manager.cc:1145] Deleting tablet 9576d1a36d7547bf81faabe9c362e3cb
0927 15:06:22.361301 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:22.982359 (+621058us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:22.985632 (+ 3273us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.150155 (+164523us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":71332,"tablet-delete.queue_time_us":5095530}
I20260927 15:06:23.150342 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c792c8cddcc548b387f79c4664d664a4" } new_table_name: "default.Table_204b853f46d742a6a6903e95d452c5b2" modify_external_catalogs: true
I20260927 15:06:23.150640 1562 tablet_replica.cc:330] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:23.150807 1562 raft_consensus.cc:2229] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:23.151136 1562 raft_consensus.cc:2258] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.151734 1562 ts_tablet_manager.cc:1905] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.152207 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 9576d1a36d7547bf81faabe9c362e3cb (table default.Table_7c7824484c624468a8ccbd47f7ea4ca8 [id=9c08749b7a9241a9870e1b13ae17aece]) successfully deleted
I20260927 15:06:23.153795 1143 tablet_service.cc:1467] Processing CreateTablet for tablet fe3b59d611b14a0fb191f3f0d9c528e6 (DEFAULT_TABLE table=default.Table_c8dff83721c444da9087a669433462b5 [id=8e1c1e201e96423eb26de3855a91c81b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.154141 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3b59d611b14a0fb191f3f0d9c528e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.155187 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 9acb4aeece7b4c448f8f2406535a631f (DEFAULT_TABLE table=default.Table_6aff014daf0b4f4486aca13d6a669f20 [id=c5eb438257ff44a2a3bcf75af105a41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.155504 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9acb4aeece7b4c448f8f2406535a631f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.160123 3173 consensus_queue.cc:237] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.160781 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 0ab013d613824f45abfdc250f1f6f1a1 (DEFAULT_TABLE table=default.Table_ebda84dc8d2e4e3fa11fee32f4a35223 [id=7d0cdd35c0a34ea99043cd0a177cd21b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.161101 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ab013d613824f45abfdc250f1f6f1a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:23.164170 1238 leader_election.cc:341] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: df6d7670381b49bb927943b2ee920c84
I20260927 15:06:23.164283 1238 leader_election.cc:302] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.164484 3138 raft_consensus.cc:2726] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:23.165815 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 9acb4aeece7b4c448f8f2406535a631f (DEFAULT_TABLE table=default.Table_6aff014daf0b4f4486aca13d6a669f20 [id=c5eb438257ff44a2a3bcf75af105a41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.167081 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9acb4aeece7b4c448f8f2406535a631f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.169621 1284 tablet_service.cc:1467] Processing CreateTablet for tablet dc1e9e92132c4ae588121644137ac70a (DEFAULT_TABLE table=default.Table_d430acf08a154178b69c4d6f2f4cce5c [id=64b1a2a1b0e348ea8aa3b61f14053bdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.169948 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc1e9e92132c4ae588121644137ac70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.175293 1556 tablet_bootstrap.cc:654] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:23.176455 1133 tablet_service.cc:1467] Processing CreateTablet for tablet dc1e9e92132c4ae588121644137ac70a (DEFAULT_TABLE table=default.Table_d430acf08a154178b69c4d6f2f4cce5c [id=64b1a2a1b0e348ea8aa3b61f14053bdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.176826 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc1e9e92132c4ae588121644137ac70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.177881 3167 ts_tablet_manager.cc:1918] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:23.178054 3167 log.cc:1196] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/af25950fd08043f18a6eaaf46ded4378
I20260927 15:06:23.178494 3167 ts_tablet_manager.cc:1939] T af25950fd08043f18a6eaaf46ded4378 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:23.179697 3167 tablet_replica.cc:330] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:23.179996 3167 raft_consensus.cc:2229] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:23.180244 3167 raft_consensus.cc:2258] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.180626 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet af25950fd08043f18a6eaaf46ded4378 (table default.Table_e30ce3bcbfeb47af9835850576ade0d0 [id=79d05bf7ebaf49db86db1dd40492e4ef]) successfully deleted
I20260927 15:06:23.180856 3167 ts_tablet_manager.cc:1905] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.186554 910 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_2b6fbd502fb743878cddd5371cf5e109 [id=1fceed220c0041ecbcb20d2ee5c0dadc] alter complete (version 3)
I20260927 15:06:23.188093 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 4470df4cd407401ab03b6f62452c0dc7
I20260927 15:06:23.188727 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fadb670c1dd2403fa66f5b718023dfd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.189213 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fadb670c1dd2403fa66f5b718023dfd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.189396 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_42a4e7e8f5f9481282232f76d1eec254"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.189822 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42a4e7e8f5f9481282232f76d1eec254 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.190261 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 997c93bdf78b49709130d97a8d96a5a5
I20260927 15:06:23.190557 913 catalog_manager.cc:6565] ReplaceTablet: tablet 997c93bdf78b49709130d97a8d96a5a5 deleted and replaced by tablet 05babe326fa44773be6878abfb175770
I20260927 15:06:23.190873 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0c18b4cd27df497a8722e0a3c4a8e8e4" } new_table_name: "default.Table_6aca87d6b2564afdb4688d743aaa59c8" modify_external_catalogs: true
I20260927 15:06:23.192116 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 99e672c109e144b09193f916f8c5d516
I20260927 15:06:23.192440 911 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49800 (request call id 1468) took 1339 ms. Trace:
I20260927 15:06:23.192504 911 rpcz_store.cc:276] 0927 15:06:21.853127 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.346275 (+493148us) service_pool.cc:227] Handling call
0927 15:06:22.348984 (+ 2709us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x615000033024. stack: 00007f2c28bfb66e 00007f2c28bfb430 00007f2c27c825ed 00000000008ea064 00000000008ea02d 00007f2c3731827d 00007f2c37318373 00007f2c3413a361 00007f2c3baad66a 00007f2c3bc362e6 00007f2c32f29126 00007f2c32f28e55 00007f2c2f7379be 00007f2c2f73679e 00007f2c2f73cb25 00007f2c2f73d54f
0927 15:06:22.349420 (+ 436us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0927 15:06:22.349538 (+ 118us) catalog_manager.cc:2752] Modifying in-memory table state
0927 15:06:22.349593 (+ 55us) catalog_manager.cc:2761] Locking tablets
0927 15:06:23.026107 (+676514us) catalog_manager.cc:2775] Removing table and tablets from system table
0927 15:06:23.191918 (+165811us) catalog_manager.cc:2793] Removing table from by-name map
0927 15:06:23.192014 (+ 96us) catalog_manager.cc:2809] Committing in-memory state
0927 15:06:23.192065 (+ 51us) catalog_manager.cc:2813] Aborting table tasks
0927 15:06:23.192425 (+ 360us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:23.030015 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:23.030110 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:23.030115 (+ 5us) write_op.cc:435] Acquired schema lock
0927 15:06:23.030118 (+ 3us) tablet.cc:660] Decoding operations
0927 15:06:23.030220 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:23.030228 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:23.030232 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:23.030318 (+ 86us) tablet.cc:699] Row locks acquired
0927 15:06:23.030321 (+ 3us) write_op.cc:260] PREPARE: finished
0927 15:06:23.030349 (+ 28us) write_op.cc:270] Start()
0927 15:06:23.030374 (+ 25us) write_op.cc:276] Timestamp: P: 1790521583030325 usec, L: 0
0927 15:06:23.030378 (+ 4us) op_driver.cc:331] REPLICATION: starting
0927 15:06:23.030508 (+ 130us) log.cc:842] Serialized 725 byte log entry
0927 15:06:23.185603 (+155095us) op_driver.cc:444] REPLICATION: finished
0927 15:06:23.186906 (+ 1303us) write_op.cc:301] APPLY: starting
0927 15:06:23.186916 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:23.186943 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:23.186985 (+ 42us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:23.187031 (+ 46us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:23.187056 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 15:06:23.187062 (+ 6us) write_op.cc:312] APPLY: finished
0927 15:06:23.187120 (+ 58us) log.cc:842] Serialized 29 byte log entry
0927 15:06:23.187155 (+ 35us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:23.187168 (+ 13us) write_op.cc:454] Released schema lock
0927 15:06:23.187173 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:23.187216 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:23.187220 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":5562112,"child_traces":[["op",{"apply.queue_time_us":1268,"apply.run_cpu_time_us":353,"apply.run_wall_time_us":354,"num_ops":2,"prepare.queue_time_us":3415,"prepare.run_cpu_time_us":537,"prepare.run_wall_time_us":536,"replication_time_us":155213}]]}
I20260927 15:06:23.193158 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9d80b52d671c4ba582ca662849267880" } modify_external_catalogs: true
I20260927 15:06:23.193321 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9d80b52d671c4ba582ca662849267880" } modify_external_catalogs: true
I20260927 15:06:23.194576 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet d35282079d4f4ab3a6093385244236eb
I20260927 15:06:23.195230 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ac0b4bfd2a9c4193b4006e1d124bfa1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.195715 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac0b4bfd2a9c4193b4006e1d124bfa1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.201861 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 0ab013d613824f45abfdc250f1f6f1a1 (DEFAULT_TABLE table=default.Table_ebda84dc8d2e4e3fa11fee32f4a35223 [id=7d0cdd35c0a34ea99043cd0a177cd21b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.202476 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 997c93bdf78b49709130d97a8d96a5a5 with delete_type TABLET_DATA_DELETED (replaced by tablet 05babe326fa44773be6878abfb175770) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.202723 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 99e672c109e144b09193f916f8c5d516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.203105 1132 tablet_service.cc:1467] Processing CreateTablet for tablet ba42f1c2016249e995e8968ee3a91c1a (DEFAULT_TABLE table=default.Table_382bd6f970f646b1ab7b6f695f39a80f [id=70461295104548019f98513577335a44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.203258 1144 tablet_service.cc:1467] Processing CreateTablet for tablet d5dd733a4009406180147e3aa39129e5 (DEFAULT_TABLE table=default.Table_493099c0cf6c40a7b6990f7f49812696 [id=32301fe8aeef4855a27870aa5302a476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.203401 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet d35282079d4f4ab3a6093385244236eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.203504 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9b782face64ca0a82dd48106afe312 (DEFAULT_TABLE table=default.Table_a534c7930d764771b5f4712ba616bb73 [id=51c3b34d87144029a2e83f2c01edf49e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.203743 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 52555162ccaa455ca6c43b6c79f513ae (DEFAULT_TABLE table=default.Table_3897e840376a41e09ba83d5f96f1dd34 [id=5a9b3184e51f4a369a673ee3ac9d4747]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.204542 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 0bce4a4948f4408fb272d05cff200fbf (DEFAULT_TABLE table=default.Table_0c8f72e3b67048b9a9fad7b19b50a42a [id=614d0eb5de284585b77521174224a38d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.204200 1137 tablet_service.cc:1467] Processing CreateTablet for tablet b3596ff7a1b14a0cb213b0826a8e4a00 (DEFAULT_TABLE table=default.Table_10fe8b78b2894efa9727654ba2eebcfe [id=15acf300f8934f4f8de6c9d1472a1fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.205065 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 214229a8283b43c4916a5db7ba120e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.205438 1267 tablet_service.cc:1514] Processing DeleteTablet for tablet 568ba79ea795403cba76fb6632efd7e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 925d256cb28f496889ad7b3c6b1f6f10) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.205693 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet d35282079d4f4ab3a6093385244236eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.206085 1267 tablet_service.cc:1467] Processing CreateTablet for tablet ba42f1c2016249e995e8968ee3a91c1a (DEFAULT_TABLE table=default.Table_382bd6f970f646b1ab7b6f695f39a80f [id=70461295104548019f98513577335a44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.206477 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba42f1c2016249e995e8968ee3a91c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.206089 1285 tablet_service.cc:1467] Processing CreateTablet for tablet d5dd733a4009406180147e3aa39129e5 (DEFAULT_TABLE table=default.Table_493099c0cf6c40a7b6990f7f49812696 [id=32301fe8aeef4855a27870aa5302a476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.211193 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5dd733a4009406180147e3aa39129e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:23.212342 809 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 93474.8us
I20260927 15:06:23.212486 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet 4470df4cd407401ab03b6f62452c0dc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.215322 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9b782face64ca0a82dd48106afe312 (DEFAULT_TABLE table=default.Table_a534c7930d764771b5f4712ba616bb73 [id=51c3b34d87144029a2e83f2c01edf49e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.215716 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9b782face64ca0a82dd48106afe312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.216121 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet df6d7670381b49bb927943b2ee920c84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.216449 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet a8de6246f7904f6c80df624f3631db17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:01 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.216806 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 0bce4a4948f4408fb272d05cff200fbf (DEFAULT_TABLE table=default.Table_0c8f72e3b67048b9a9fad7b19b50a42a [id=614d0eb5de284585b77521174224a38d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.217247 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bce4a4948f4408fb272d05cff200fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.217430 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 99e672c109e144b09193f916f8c5d516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.217772 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 52555162ccaa455ca6c43b6c79f513ae (DEFAULT_TABLE table=default.Table_3897e840376a41e09ba83d5f96f1dd34 [id=5a9b3184e51f4a369a673ee3ac9d4747]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.218142 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 997c93bdf78b49709130d97a8d96a5a5 with delete_type TABLET_DATA_DELETED (replaced by tablet 05babe326fa44773be6878abfb175770) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.219826 2119 tablet_replica.cc:330] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:23.220170 2119 raft_consensus.cc:2229] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:23.220296 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 4470df4cd407401ab03b6f62452c0dc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.220803 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 9576d1a36d7547bf81faabe9c362e3cb (table default.Table_7c7824484c624468a8ccbd47f7ea4ca8 [id=9c08749b7a9241a9870e1b13ae17aece]) successfully deleted
I20260927 15:06:23.222958 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52555162ccaa455ca6c43b6c79f513ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.223460 2119 pending_rounds.cc:62] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:23.223524 2119 pending_rounds.cc:68] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976381325352960 op_type: NO_OP noop_request { }
I20260927 15:06:23.223650 2119 raft_consensus.cc:2866] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:23.223743 2119 raft_consensus.cc:2258] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.224653 2119 ts_tablet_manager.cc:1905] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.225775 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 3042c17580d54082971b761433a7dca9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.226019 1275 tablet_service.cc:1467] Processing CreateTablet for tablet b3596ff7a1b14a0cb213b0826a8e4a00 (DEFAULT_TABLE table=default.Table_10fe8b78b2894efa9727654ba2eebcfe [id=15acf300f8934f4f8de6c9d1472a1fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.226302 1552 tablet_bootstrap.cc:492] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:23.226426 1552 ts_tablet_manager.cc:1397] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.232s user 0.003s sys 0.000s
I20260927 15:06:23.226317 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3596ff7a1b14a0cb213b0826a8e4a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.230202 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 048a1713b6054024959a9bdc245f71a4
W20260927 15:06:23.230273 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0c54768b4f18467787d5e9894cb083d0 consensus state has no leader
W20260927 15:06:23.230463 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9a1d9c742204cd3b7c0e0bd3c1d7e69 consensus state has no leader
I20260927 15:06:23.230640 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b7595df893e4227849f96f42e5bc110" } new_table_name: "default.Table_78f3af40c2ab4321941ebac14d78c724" modify_external_catalogs: true
I20260927 15:06:23.230734 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_653ad280559f40a4b498dc5c94535595"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.231248 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_653ad280559f40a4b498dc5c94535595 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.231992 1552 raft_consensus.cc:348] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.232210 1552 raft_consensus.cc:374] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.232262 1552 raft_consensus.cc:729] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.232448 1552 consensus_queue.cc:260] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.232885 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5e6b229a59aa4dd2827c0eb9629b5d2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.233474 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e6b229a59aa4dd2827c0eb9629b5d2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.233937 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 048a1713b6054024959a9bdc245f71a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.169283 1418 tablet_service.cc:1467] Processing CreateTablet for tablet dc1e9e92132c4ae588121644137ac70a (DEFAULT_TABLE table=default.Table_d430acf08a154178b69c4d6f2f4cce5c [id=64b1a2a1b0e348ea8aa3b61f14053bdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.235850 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc1e9e92132c4ae588121644137ac70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.236558 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 048a1713b6054024959a9bdc245f71a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.191746 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 0ab013d613824f45abfdc250f1f6f1a1 (DEFAULT_TABLE table=default.Table_ebda84dc8d2e4e3fa11fee32f4a35223 [id=7d0cdd35c0a34ea99043cd0a177cd21b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.238009 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ab013d613824f45abfdc250f1f6f1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.238131 3201 tablet.cc:1722] T 078ba40ca56745b2a2b86402a1519011 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:23.200451 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 9acb4aeece7b4c448f8f2406535a631f (DEFAULT_TABLE table=default.Table_6aff014daf0b4f4486aca13d6a669f20 [id=c5eb438257ff44a2a3bcf75af105a41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.208335 1404 tablet_service.cc:1467] Processing CreateTablet for tablet ba42f1c2016249e995e8968ee3a91c1a (DEFAULT_TABLE table=default.Table_382bd6f970f646b1ab7b6f695f39a80f [id=70461295104548019f98513577335a44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.208730 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 0bce4a4948f4408fb272d05cff200fbf (DEFAULT_TABLE table=default.Table_0c8f72e3b67048b9a9fad7b19b50a42a [id=614d0eb5de284585b77521174224a38d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.209043 1401 tablet_service.cc:1467] Processing CreateTablet for tablet d5dd733a4009406180147e3aa39129e5 (DEFAULT_TABLE table=default.Table_493099c0cf6c40a7b6990f7f49812696 [id=32301fe8aeef4855a27870aa5302a476]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.209095 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9b782face64ca0a82dd48106afe312 (DEFAULT_TABLE table=default.Table_a534c7930d764771b5f4712ba616bb73 [id=51c3b34d87144029a2e83f2c01edf49e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.209321 1406 tablet_service.cc:1467] Processing CreateTablet for tablet b3596ff7a1b14a0cb213b0826a8e4a00 (DEFAULT_TABLE table=default.Table_10fe8b78b2894efa9727654ba2eebcfe [id=15acf300f8934f4f8de6c9d1472a1fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.209584 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 52555162ccaa455ca6c43b6c79f513ae (DEFAULT_TABLE table=default.Table_3897e840376a41e09ba83d5f96f1dd34 [id=5a9b3184e51f4a369a673ee3ac9d4747]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.209760 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 99e672c109e144b09193f916f8c5d516 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.209877 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 997c93bdf78b49709130d97a8d96a5a5 with delete_type TABLET_DATA_DELETED (replaced by tablet 05babe326fa44773be6878abfb175770) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.209980 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet d35282079d4f4ab3a6093385244236eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.210954 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 4470df4cd407401ab03b6f62452c0dc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.239570 3138 raft_consensus.cc:482] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.239689 3138 raft_consensus.cc:504] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.240229 3138 leader_election.cc:288] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.240335 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:23.240923 1552 ts_tablet_manager.cc:1428] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.014s user 0.002s sys 0.001s
I20260927 15:06:23.243018 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8de6246f7904f6c80df624f3631db17" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:23.254531 1552 tablet_bootstrap.cc:492] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:23.257748 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5dd733a4009406180147e3aa39129e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.257949 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bce4a4948f4408fb272d05cff200fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.258111 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9b782face64ca0a82dd48106afe312. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:23.258879 1238 leader_election.cc:341] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: a8de6246f7904f6c80df624f3631db17
I20260927 15:06:23.259055 1238 leader_election.cc:302] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.259464 3138 raft_consensus.cc:2726] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:23.260280 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ab013d613824f45abfdc250f1f6f1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.260725 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba42f1c2016249e995e8968ee3a91c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.261118 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52555162ccaa455ca6c43b6c79f513ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.261485 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3596ff7a1b14a0cb213b0826a8e4a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.261693 3173 raft_consensus.cc:482] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.261874 3173 raft_consensus.cc:504] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.262543 3173 leader_election.cc:288] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.263317 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdcc55fb32b14935922e5870819bc266" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:23.265344 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdcc55fb32b14935922e5870819bc266" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:23.265893 1099 leader_election.cc:341] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: Tablet not RUNNING: STOPPED
W20260927 15:06:23.272662 1102 leader_election.cc:341] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.272874 1102 leader_election.cc:302] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.273358 3173 raft_consensus.cc:2726] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:23.273351 3202 tablet.cc:1722] T 078ba40ca56745b2a2b86402a1519011 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:23.275923 910 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_5b7e58750e9a481cab2abf34e5753a5e [id=ed34d1e88ae54c6086ae3a7cbfdf7861] alter complete (version 1)
I20260927 15:06:23.276887 3148 raft_consensus.cc:482] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:23.277077 3148 raft_consensus.cc:504] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.277750 3148 leader_election.cc:288] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:23.278501 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49ed368c4c784802beba044514deb777 consensus state has no leader
I20260927 15:06:23.278568 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 12403ee769904d389f180ccb13d86270 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:23.278861 1099 leader_election.cc:341] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 2268d824f5324cd1b81879e2fe4fd027
I20260927 15:06:23.278920 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9e90adcb591248778787025fe8fc700b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:23.279285 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_525948009d514445be28f583ecc833d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.279457 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e90adcb591248778787025fe8fc700b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:23.279739 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_525948009d514445be28f583ecc833d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.280591 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9f5c8e8865a34f01addbb505cf777a0d
I20260927 15:06:23.281564 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a385512b84d24842bdcbff63148fc2dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.281975 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a385512b84d24842bdcbff63148fc2dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.283134 906 master_service.cc:946] ReplaceTablet: received request to replace tablet 34e40bea0cd04d3f8ff17b518f50b859 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:23.284879 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet 3540982dd7544e60af6c153fc41a412c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.285197 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fecfb2325046f98e69797ff8342892 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.285410 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet af25950fd08043f18a6eaaf46ded4378 with delete_type TABLET_DATA_DELETED (replaced by tablet 571072536098420d8b5bdddc9aaa4161) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.285578 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet fd1f51cb124d4d20a9d6024e6eb6810f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.285877 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fff31ceb379400bbfa4586c749e6d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.286110 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 289bea546c8a41bf97edfdc9a453a024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.286038 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3b979fe89b604e5bb269f000a48f04f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:23.286435 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5c8e8865a34f01addbb505cf777a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:23.286523 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b979fe89b604e5bb269f000a48f04f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.288065 1562 ts_tablet_manager.cc:1918] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:23.288645 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fff31ceb379400bbfa4586c749e6d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.288856 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 171ba98418b34aa283b7a7b243678fa9 with delete_type TABLET_DATA_DELETED (replaced by tablet 28feaad311b14ea58144fc1417826186) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.289039 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d2501a9f764790818426665e7f0340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.289113 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ba3bdf50b14aec85a99742426e9298 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.289208 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet af25950fd08043f18a6eaaf46ded4378 with delete_type TABLET_DATA_DELETED (replaced by tablet 571072536098420d8b5bdddc9aaa4161) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.289366 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5c8e8865a34f01addbb505cf777a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.289517 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet d9fecfb2325046f98e69797ff8342892 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.290927 1562 log.cc:1196] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/3efc44686be2407cbcdca61909301539
I20260927 15:06:23.291172 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2268d824f5324cd1b81879e2fe4fd027" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:23.289367 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet e2ba3bdf50b14aec85a99742426e9298 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.291467 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet cdcc55fb32b14935922e5870819bc266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.291657 1562 ts_tablet_manager.cc:1939] T 3efc44686be2407cbcdca61909301539 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:23.228816 1556 tablet_bootstrap.cc:492] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:23.234616 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 048a1713b6054024959a9bdc245f71a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:22 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.239389 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9acb4aeece7b4c448f8f2406535a631f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.294229 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5dd733a4009406180147e3aa39129e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.294894 1561 tablet_bootstrap.cc:492] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:23.295063 1561 ts_tablet_manager.cc:1397] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.152s user 0.004s sys 0.001s
I20260927 15:06:23.296370 1561 raft_consensus.cc:348] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.296759 1561 raft_consensus.cc:374] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.296901 1561 raft_consensus.cc:729] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.297355 1561 consensus_queue.cc:260] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.298032 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba42f1c2016249e995e8968ee3a91c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.298866 1561 ts_tablet_manager.cc:1428] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:23.302932 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3596ff7a1b14a0cb213b0826a8e4a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.305193 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.310086 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9b782face64ca0a82dd48106afe312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.311030 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52555162ccaa455ca6c43b6c79f513ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.314127 3167 ts_tablet_manager.cc:1918] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:23.314221 3167 log.cc:1196] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/cdcc55fb32b14935922e5870819bc266
I20260927 15:06:23.314599 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bce4a4948f4408fb272d05cff200fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.314806 3167 ts_tablet_manager.cc:1939] T cdcc55fb32b14935922e5870819bc266 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:23.319665 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 994) took 6020 ms. Trace:
I20260927 15:06:23.319792 1562 rpcz_store.cc:276] 0927 15:06:17.299555 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.299603 (+ 48us) service_pool.cc:227] Handling call
0927 15:06:23.150573 (+5850970us) ts_tablet_manager.cc:1145] Deleting tablet 3efc44686be2407cbcdca61909301539
0927 15:06:23.150587 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.257831 (+107244us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.287981 (+ 30150us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.319639 (+ 31658us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5846566}
I20260927 15:06:23.320452 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 995) took 5860 ms. Trace:
I20260927 15:06:23.320557 1562 rpcz_store.cc:276] 0927 15:06:17.459523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.459578 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:23.320311 (+5860733us) ts_tablet_manager.cc:1145] Deleting tablet 9a695b4fd5294f32a6644154487c1486
0927 15:06:23.320325 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.320430 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5860545}
I20260927 15:06:23.320976 1562 tablet_replica.cc:330] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:23.321218 1562 raft_consensus.cc:2229] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:23.321556 1562 raft_consensus.cc:2258] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:23.321996 1102 leader_election.cc:341] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.322124 1102 leader_election.cc:302] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.322157 1562 ts_tablet_manager.cc:1905] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.322458 3148 raft_consensus.cc:2726] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:23.327957 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 3efc44686be2407cbcdca61909301539 (table default.Table_90059eaac20f42eead7d864d2e91a12e [id=20050d0c476441cc882540df66f162fb]) successfully deleted
I20260927 15:06:23.328226 1562 ts_tablet_manager.cc:1918] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:23.328287 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9a695b4fd5294f32a6644154487c1486 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a695b4fd5294f32a6644154487c1486 already in progress: creating tablet
I20260927 15:06:23.328336 1562 log.cc:1196] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/fb2a8e788b71451da4a18f52b643e5e2
I20260927 15:06:23.328717 1562 ts_tablet_manager.cc:1939] T fb2a8e788b71451da4a18f52b643e5e2 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:23.334841 1561 tablet_bootstrap.cc:492] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:23.335006 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 996) took 5805 ms. Trace:
I20260927 15:06:23.336130 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5c8e8865a34f01addbb505cf777a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.335274 1562 rpcz_store.cc:276] 0927 15:06:17.529332 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.529378 (+ 46us) service_pool.cc:227] Handling call
0927 15:06:23.320933 (+5791555us) ts_tablet_manager.cc:1145] Deleting tablet fb2a8e788b71451da4a18f52b643e5e2
0927 15:06:23.320942 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.325397 (+ 4455us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.328149 (+ 2752us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.334990 (+ 6841us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5790715}
I20260927 15:06:23.337253 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet fb2a8e788b71451da4a18f52b643e5e2 (table default.Table_9f5054d45b8e4f9cbdd73c3a7709ba6e [id=db7af27293544752bbe914164e4e9d3b]) successfully deleted
I20260927 15:06:23.337340 1561 tablet_bootstrap.cc:654] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:23.338280 1562 tablet_replica.cc:330] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:23.338929 1562 raft_consensus.cc:2229] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:23.340776 1556 ts_tablet_manager.cc:1397] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.332s user 0.005s sys 0.001s
I20260927 15:06:23.340533 1562 raft_consensus.cc:2258] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.349368 1552 tablet_bootstrap.cc:654] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:23.349720 2119 ts_tablet_manager.cc:1918] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:23.349808 2119 log.cc:1196] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/d4f05da432f041378c5ab808536e6b6f
I20260927 15:06:23.351930 1556 raft_consensus.cc:348] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.352246 3150 raft_consensus.cc:482] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.352373 3150 raft_consensus.cc:504] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.352797 2119 ts_tablet_manager.cc:1939] T d4f05da432f041378c5ab808536e6b6f P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:23.352938 3150 leader_election.cc:288] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:23.353057 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 224c237b0e9f4a15a78d1f4ae7eab864 consensus state has no leader
I20260927 15:06:23.353538 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d349cb04314c388e2f72b243c629ba" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:23.353931 1102 leader_election.cc:341] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.359093 1562 ts_tablet_manager.cc:1905] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.364787 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1072) took 1975 ms. Trace:
I20260927 15:06:23.364949 2119 rpcz_store.cc:276] 0927 15:06:21.389345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.389666 (+ 321us) service_pool.cc:227] Handling call
0927 15:06:23.219767 (+1830101us) ts_tablet_manager.cc:1145] Deleting tablet d4f05da432f041378c5ab808536e6b6f
0927 15:06:23.219777 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.342705 (+122928us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.346819 (+ 4114us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.364767 (+ 17948us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1829954}
I20260927 15:06:23.365499 2119 tablet_replica.cc:330] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:23.365825 2119 raft_consensus.cc:2229] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:23.366024 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet d4f05da432f041378c5ab808536e6b6f (table default.Table_e8855d7ecbd54e2eb65a1b2dd6addb4c [id=2386e9e051a140358b16dbe3d7add4c1]) successfully deleted
I20260927 15:06:23.366058 2119 raft_consensus.cc:2258] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.366587 2119 ts_tablet_manager.cc:1905] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.368178 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_dfc4be005c6149929b7d3560013be223"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.368718 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfc4be005c6149929b7d3560013be223 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.369740 3138 raft_consensus.cc:482] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.369854 3138 raft_consensus.cc:504] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.370421 3138 leader_election.cc:288] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.370694 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_188cad16a13a4aabb2ce4cd74b0c41a6" } new_table_name: "default.Table_c28d498257e24a9da0bd0a67c9e5a953" modify_external_catalogs: true
I20260927 15:06:23.371289 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5f2ab9677c4598b0b8d9a93a6a23c7" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:23.373306 1238 leader_election.cc:341] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: fd5f2ab9677c4598b0b8d9a93a6a23c7
I20260927 15:06:23.373410 1238 leader_election.cc:302] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.374543 3138 raft_consensus.cc:2726] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:23.383023 1562 ts_tablet_manager.cc:1918] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:23.383723 1562 log.cc:1196] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/a04caae16db84d8ea9050b648c1ba354
I20260927 15:06:23.360140 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d349cb04314c388e2f72b243c629ba" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:23.384003 1436 raft_consensus.cc:2454] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:23.384243 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet fb2a8e788b71451da4a18f52b643e5e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d6f44391d6147ddb221c35205a2c335) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.384578 1099 leader_election.cc:302] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:23.384657 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 796eef27ca8341b1a1ccc95770892e04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.384999 3150 raft_consensus.cc:2781] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:23.385076 3150 raft_consensus.cc:482] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:23.385151 3150 raft_consensus.cc:3037] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.385263 1562 ts_tablet_manager.cc:1939] T a04caae16db84d8ea9050b648c1ba354 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:23.387907 3150 raft_consensus.cc:504] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.389143 3150 leader_election.cc:288] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.389582 914 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 20d349cb04314c388e2f72b243c629ba (table default.Table_fe611237a8bb400a86751f2eed953ea9 [id=afca5fe4316b4f5f97dfaf1ce641d832]). Expected version 1 got 0
I20260927 15:06:23.390659 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 7b4fcc653fa14fb58f4b7456a96cb297 (DEFAULT_TABLE table=default.Table_6d463c2d83eb44d08f558d1760002e04 [id=baf82f06d76a4feab84b5c69d1ea5aca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.390739 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d349cb04314c388e2f72b243c629ba" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:23.390930 1436 raft_consensus.cc:3037] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.391076 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b4fcc653fa14fb58f4b7456a96cb297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.392812 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 997) took 5835 ms. Trace:
I20260927 15:06:23.392892 1562 rpcz_store.cc:276] 0927 15:06:17.557035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.557522 (+ 487us) service_pool.cc:227] Handling call
0927 15:06:23.337669 (+5780147us) ts_tablet_manager.cc:1145] Deleting tablet a04caae16db84d8ea9050b648c1ba354
0927 15:06:23.337778 (+ 109us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.372022 (+ 34244us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.382754 (+ 10732us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.392795 (+ 10041us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5779926}
I20260927 15:06:23.393319 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet a04caae16db84d8ea9050b648c1ba354 (table default.Table_9e1c88622f89474285f6bdb98faffffb [id=32293fa2bff246dba3dfe47a3fcaf310]) successfully deleted
I20260927 15:06:23.393640 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 998) took 5754 ms. Trace:
I20260927 15:06:23.393649 1436 raft_consensus.cc:2454] T 20d349cb04314c388e2f72b243c629ba P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:23.393709 1562 rpcz_store.cc:276] 0927 15:06:17.638944 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.639243 (+ 299us) service_pool.cc:227] Handling call
0927 15:06:23.393531 (+5754288us) ts_tablet_manager.cc:1145] Deleting tablet 03ce4e8370634ff4967865be6caafab2
0927 15:06:23.393541 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.393625 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5754114}
W20260927 15:06:23.394042 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 03ce4e8370634ff4967865be6caafab2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03ce4e8370634ff4967865be6caafab2 already in progress: creating tablet
I20260927 15:06:23.394364 1562 tablet_replica.cc:330] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:23.394537 1099 leader_election.cc:302] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:23.394968 1562 raft_consensus.cc:2229] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:23.394994 3173 raft_consensus.cc:2781] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:23.395102 1562 raft_consensus.cc:2258] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.395133 3173 raft_consensus.cc:686] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:23.395327 3173 consensus_queue.cc:237] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.395382 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 7b4fcc653fa14fb58f4b7456a96cb297 (DEFAULT_TABLE table=default.Table_6d463c2d83eb44d08f558d1760002e04 [id=baf82f06d76a4feab84b5c69d1ea5aca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.395782 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b4fcc653fa14fb58f4b7456a96cb297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.397595 3167 tablet_replica.cc:330] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:23.397789 3167 raft_consensus.cc:2229] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:23.397917 3167 raft_consensus.cc:2258] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.398059 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 796eef27ca8341b1a1ccc95770892e04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.398377 3167 ts_tablet_manager.cc:1905] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.398442 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 092f1616c5e24505b9ca600c599bd351 (DEFAULT_TABLE table=default.Table_2d8a930a9263401db2c395efc4959a7a [id=6aa648800d8d4aa0ab7a88ad8e3c702e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.398950 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 092f1616c5e24505b9ca600c599bd351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.399091 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 092f1616c5e24505b9ca600c599bd351 (DEFAULT_TABLE table=default.Table_2d8a930a9263401db2c395efc4959a7a [id=6aa648800d8d4aa0ab7a88ad8e3c702e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.399418 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 092f1616c5e24505b9ca600c599bd351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.400377 1562 ts_tablet_manager.cc:1905] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.403183 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1f2da6475c904f0d8aec8dea13410524" } modify_external_catalogs: true
I20260927 15:06:23.403367 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1f2da6475c904f0d8aec8dea13410524" } modify_external_catalogs: true
I20260927 15:06:23.403200 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet cdcc55fb32b14935922e5870819bc266 (table default.Table_7f32f20313364f5787a4bb5c09f5ca22 [id=bd365b2e211141e197d5a42c429e7d19]) successfully deleted
I20260927 15:06:23.405268 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 7b4fcc653fa14fb58f4b7456a96cb297 (DEFAULT_TABLE table=default.Table_6d463c2d83eb44d08f558d1760002e04 [id=baf82f06d76a4feab84b5c69d1ea5aca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.405319 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 092f1616c5e24505b9ca600c599bd351 (DEFAULT_TABLE table=default.Table_2d8a930a9263401db2c395efc4959a7a [id=6aa648800d8d4aa0ab7a88ad8e3c702e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.405644 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b4fcc653fa14fb58f4b7456a96cb297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.405716 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 092f1616c5e24505b9ca600c599bd351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.406011 1304 raft_consensus.cc:3037] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.410377 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20d349cb04314c388e2f72b243c629ba" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:23.411113 1102 leader_election.cc:341] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.411103 1285 tablet_service.cc:1467] Processing CreateTablet for tablet b99792cdea714e9d874fc39722e7d26d (DEFAULT_TABLE table=default.Table_886573ce4aa14fe9a0f82db4701853ce [id=765a6d2fdc594a18aab768cf5deae36a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.411470 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b99792cdea714e9d874fc39722e7d26d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.412932 3138 raft_consensus.cc:482] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.413044 3138 raft_consensus.cc:504] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.413620 3138 leader_election.cc:288] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:23.414412 1238 leader_election.cc:341] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3042c17580d54082971b761433a7dca9
W20260927 15:06:23.415231 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 925d256cb28f496889ad7b3c6b1f6f10 consensus state has no leader
I20260927 15:06:23.418210 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3042c17580d54082971b761433a7dca9" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:23.420047 1099 consensus_peers.cc:487] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c264c532db8249e5abe1dbef8ee8ffa0. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:23.420696 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ec248855083540d8a7656d2a1ac39508" } modify_external_catalogs: true
I20260927 15:06:23.420866 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ec248855083540d8a7656d2a1ac39508" } modify_external_catalogs: true
I20260927 15:06:23.421195 1239 leader_election.cc:302] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.421414 3138 raft_consensus.cc:2726] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:23.422297 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_77aaa5739f804cd985c9096b2b908d21" } modify_external_catalogs: true
I20260927 15:06:23.422462 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_77aaa5739f804cd985c9096b2b908d21" } modify_external_catalogs: true
I20260927 15:06:23.424088 1144 tablet_service.cc:1467] Processing CreateTablet for tablet ec758b674b674456940ff90b2b7770a3 (DEFAULT_TABLE table=default.Table_1409c4adee7d404dabbb49569c1ef638 [id=69a33ffcf64645a3aea072d824fb2739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.424486 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec758b674b674456940ff90b2b7770a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.424512 1419 tablet_service.cc:1467] Processing CreateTablet for tablet b99792cdea714e9d874fc39722e7d26d (DEFAULT_TABLE table=default.Table_886573ce4aa14fe9a0f82db4701853ce [id=765a6d2fdc594a18aab768cf5deae36a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.424489 1409 tablet_service.cc:1467] Processing CreateTablet for tablet ec758b674b674456940ff90b2b7770a3 (DEFAULT_TABLE table=default.Table_1409c4adee7d404dabbb49569c1ef638 [id=69a33ffcf64645a3aea072d824fb2739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.426158 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b99792cdea714e9d874fc39722e7d26d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.427701 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 0ab3c0efc43e43d0a20738daac7f5a97 (DEFAULT_TABLE table=default.Table_05c6737f66514e02a97cfc7e4a99cc7f [id=c9710b465c214aedbfc9fc6af8e0ce33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.428110 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ab3c0efc43e43d0a20738daac7f5a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.431025 3105 raft_consensus.cc:482] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.431170 3105 raft_consensus.cc:504] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.431761 3105 leader_election.cc:288] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:23.432122 1279 tablet_service.cc:1467] Processing CreateTablet for tablet ec758b674b674456940ff90b2b7770a3 (DEFAULT_TABLE table=default.Table_1409c4adee7d404dabbb49569c1ef638 [id=69a33ffcf64645a3aea072d824fb2739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.432540 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec758b674b674456940ff90b2b7770a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.433758 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_62afe99bf9fe40a2bce5968ced72f01d" } new_table_name: "default.Table_61407775ebd24ff48bb2f1515f93442e" modify_external_catalogs: true
I20260927 15:06:23.435081 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 0ab3c0efc43e43d0a20738daac7f5a97 (DEFAULT_TABLE table=default.Table_05c6737f66514e02a97cfc7e4a99cc7f [id=c9710b465c214aedbfc9fc6af8e0ce33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.435231 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_515f136ead0e4616b67cf687feeb61d8" } new_table_name: "default.Table_8e46dc9150ec457b971ac1048d393976" modify_external_catalogs: true
I20260927 15:06:23.435441 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ab3c0efc43e43d0a20738daac7f5a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.437705 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec758b674b674456940ff90b2b7770a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.439659 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "796eef27ca8341b1a1ccc95770892e04" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:23.439687 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "796eef27ca8341b1a1ccc95770892e04" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:23.439880 1164 raft_consensus.cc:2454] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
W20260927 15:06:23.440173 1376 leader_election.cc:341] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.440330 1374 leader_election.cc:302] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:23.440670 3105 raft_consensus.cc:2781] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:23.440627 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dbed284830c64bdcb8e42eaa73a92b47" } modify_external_catalogs: true
I20260927 15:06:23.440761 3105 raft_consensus.cc:482] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:23.440780 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dbed284830c64bdcb8e42eaa73a92b47" } modify_external_catalogs: true
I20260927 15:06:23.440845 3105 raft_consensus.cc:3037] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.442216 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 0ab3c0efc43e43d0a20738daac7f5a97 (DEFAULT_TABLE table=default.Table_05c6737f66514e02a97cfc7e4a99cc7f [id=c9710b465c214aedbfc9fc6af8e0ce33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.442555 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ab3c0efc43e43d0a20738daac7f5a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.443295 3105 raft_consensus.cc:504] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.444208 3105 leader_election.cc:288] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:23.444243 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "796eef27ca8341b1a1ccc95770892e04" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:23.444901 1376 leader_election.cc:341] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.445165 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "796eef27ca8341b1a1ccc95770892e04" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:23.445315 1164 raft_consensus.cc:3037] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.447134 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 4891a90ecd36456ab875732b3f2770c4 (DEFAULT_TABLE table=default.Table_b07276756da348cfb9c1781447600490 [id=20908bccf0824defb9ffa02b223d51df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.447428 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4891a90ecd36456ab875732b3f2770c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.447922 1164 raft_consensus.cc:2454] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:23.448391 1374 leader_election.cc:302] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:23.449744 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 4891a90ecd36456ab875732b3f2770c4 (DEFAULT_TABLE table=default.Table_b07276756da348cfb9c1781447600490 [id=20908bccf0824defb9ffa02b223d51df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.450085 3105 raft_consensus.cc:2781] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:23.451048 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4891a90ecd36456ab875732b3f2770c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.462567 1556 raft_consensus.cc:374] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.462677 1556 raft_consensus.cc:729] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.462599 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 4891a90ecd36456ab875732b3f2770c4 (DEFAULT_TABLE table=default.Table_b07276756da348cfb9c1781447600490 [id=20908bccf0824defb9ffa02b223d51df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.463472 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4891a90ecd36456ab875732b3f2770c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.465372 1556 consensus_queue.cc:260] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.466313 3167 ts_tablet_manager.cc:1918] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:23.467803 1562 ts_tablet_manager.cc:1918] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:23.468145 3167 log.cc:1196] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/9d4487cbbce24e60ae76ec0aca2760f4
I20260927 15:06:23.468710 3167 ts_tablet_manager.cc:1939] T 9d4487cbbce24e60ae76ec0aca2760f4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:23.469696 1562 log.cc:1196] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/7f8744e2349e49d3a821eca42c7f89a2
I20260927 15:06:23.470156 1562 ts_tablet_manager.cc:1939] T 7f8744e2349e49d3a821eca42c7f89a2 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:23.470988 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 9d4487cbbce24e60ae76ec0aca2760f4 (table default.Table_ee79d927d2a24080beb4354086ce00f6 [id=0b25a43ed4b5477d96c9d8def871a63b]) successfully deleted
I20260927 15:06:23.471875 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1004) took 5606 ms. Trace:
W20260927 15:06:23.472734 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fa143466f2bd4185887d6ccfcbbe8dd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa143466f2bd4185887d6ccfcbbe8dd8 already in progress: creating tablet
I20260927 15:06:23.473147 1562 rpcz_store.cc:276] 0927 15:06:17.865464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.865932 (+ 468us) service_pool.cc:227] Handling call
0927 15:06:23.394258 (+5528326us) ts_tablet_manager.cc:1145] Deleting tablet 7f8744e2349e49d3a821eca42c7f89a2
0927 15:06:23.394336 (+ 78us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.450612 (+ 56276us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.467723 (+ 17111us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.471858 (+ 4135us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5423964}
I20260927 15:06:23.474841 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 7f8744e2349e49d3a821eca42c7f89a2 (table default.Table_2ad5d2ac920c40f197a7134129b64442 [id=4d9dd505f13d4b63ac2b4ea898c9eac0]) successfully deleted
I20260927 15:06:23.474582 1561 tablet_bootstrap.cc:492] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:23.475167 1561 ts_tablet_manager.cc:1397] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.140s user 0.006s sys 0.005s
I20260927 15:06:23.475955 1561 raft_consensus.cc:348] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.476256 1561 raft_consensus.cc:374] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.476356 1561 raft_consensus.cc:729] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.476610 1561 consensus_queue.cc:260] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.477291 1561 ts_tablet_manager.cc:1428] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:23.477615 1561 tablet_bootstrap.cc:492] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:23.483122 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 34e40bea0cd04d3f8ff17b518f50b859
I20260927 15:06:23.483469 906 catalog_manager.cc:6565] ReplaceTablet: tablet 34e40bea0cd04d3f8ff17b518f50b859 deleted and replaced by tablet 1c7e8c06bda94cad8325c81578ce8421
I20260927 15:06:23.483911 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 12403ee769904d389f180ccb13d86270
I20260927 15:06:23.484257 910 catalog_manager.cc:6565] ReplaceTablet: tablet 12403ee769904d389f180ccb13d86270 deleted and replaced by tablet aa68e03d7d33434890fbc0075be1593d
I20260927 15:06:23.484179 913 catalog_manager.cc:5495] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to c4264874db964ff2830b7894c2b3d61c (127.0.201.1). New cstate: current_term: 1 leader_uuid: "c4264874db964ff2830b7894c2b3d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: HEALTHY } } }
I20260927 15:06:23.484572 913 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 20d349cb04314c388e2f72b243c629ba (table default.Table_fe611237a8bb400a86751f2eed953ea9 [id=afca5fe4316b4f5f97dfaf1ce641d832]). Expected version 1 got 0
I20260927 15:06:23.485752 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 12403ee769904d389f180ccb13d86270 with delete_type TABLET_DATA_DELETED (replaced by tablet aa68e03d7d33434890fbc0075be1593d) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.485733 1137 tablet_service.cc:1467] Processing CreateTablet for tablet b99792cdea714e9d874fc39722e7d26d (DEFAULT_TABLE table=default.Table_886573ce4aa14fe9a0f82db4701853ce [id=765a6d2fdc594a18aab768cf5deae36a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.486263 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b99792cdea714e9d874fc39722e7d26d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.486514 3138 raft_consensus.cc:482] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.486666 3138 raft_consensus.cc:504] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.487277 3138 leader_election.cc:288] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.488106 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214229a8283b43c4916a5db7ba120e03" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:23.489269 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e40bea0cd04d3f8ff17b518f50b859 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c7e8c06bda94cad8325c81578ce8421) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:23.489352 1238 leader_election.cc:341] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 214229a8283b43c4916a5db7ba120e03
I20260927 15:06:23.489467 1238 leader_election.cc:302] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.489434 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0a5ef9df79a8459a9a40b31713179aed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:23.489650 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 12403ee769904d389f180ccb13d86270 with delete_type TABLET_DATA_DELETED (replaced by tablet aa68e03d7d33434890fbc0075be1593d) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.489790 3138 raft_consensus.cc:2726] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:23.489945 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a5ef9df79a8459a9a40b31713179aed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.490568 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 6f743145bcf647bebf7a12c23d7fe62f (DEFAULT_TABLE table=default.Table_71f8e9ca27cb44e88fb384749067af34 [id=66f8286854a64517a666aa31b89f8ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.490931 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 12403ee769904d389f180ccb13d86270 with delete_type TABLET_DATA_DELETED (replaced by tablet aa68e03d7d33434890fbc0075be1593d) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.490993 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f743145bcf647bebf7a12c23d7fe62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.491108 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e40bea0cd04d3f8ff17b518f50b859 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c7e8c06bda94cad8325c81578ce8421) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.491565 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b53965e2c83840f69a3e40fd19021f01" } new_table_name: "default.Table_a6d4b1dd1ed943698d7230cb6c35c272" modify_external_catalogs: true
W20260927 15:06:23.491824 1102 consensus_peers.cc:487] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 429088342b4743c39fb1e38d235024de. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:23.494024 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 6f743145bcf647bebf7a12c23d7fe62f (DEFAULT_TABLE table=default.Table_71f8e9ca27cb44e88fb384749067af34 [id=66f8286854a64517a666aa31b89f8ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.494320 3105 raft_consensus.cc:686] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:23.494406 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f743145bcf647bebf7a12c23d7fe62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.496060 3105 consensus_queue.cc:237] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.498543 3150 consensus_queue.cc:1035] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:23.499100 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 34e40bea0cd04d3f8ff17b518f50b859 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c7e8c06bda94cad8325c81578ce8421) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.499898 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 7e889ae85db14a87b394b3b5f6899769 (DEFAULT_TABLE table=default.Table_c7796298134942969fd69e2a3b071bfd [id=08d388b46e854eb3aee759984c9b9011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.500314 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e889ae85db14a87b394b3b5f6899769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.501433 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 7e889ae85db14a87b394b3b5f6899769 (DEFAULT_TABLE table=default.Table_c7796298134942969fd69e2a3b071bfd [id=08d388b46e854eb3aee759984c9b9011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.501935 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e889ae85db14a87b394b3b5f6899769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.505223 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 52e7439320dd48aba25b5f7dc627964c
I20260927 15:06:23.505575 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2e85b83758e44de4894d3101465bb47e
I20260927 15:06:23.505811 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e8caf345c40647388db061fb73564023"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:23.506127 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f745fe0a2f4e460a911af99e6c157b85" } modify_external_catalogs: true
I20260927 15:06:23.506275 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f745fe0a2f4e460a911af99e6c157b85" } modify_external_catalogs: true
W20260927 15:06:23.507400 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfcef74b1b014f57820bf0f4076e8b13 consensus state has no leader
I20260927 15:06:23.507462 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c3939bfd903d42e9bfaaf6ecdf50b8d4
I20260927 15:06:23.507735 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ab5b7a803a4f4b56a397ddfcf0b541c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:23.507903 912 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_4e61792c99664faca894de841edc089d [id=f8a991083fb74bfc9d9969214ac7108f] alter complete (version 2)
W20260927 15:06:23.508167 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab5b7a803a4f4b56a397ddfcf0b541c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.508555 3150 raft_consensus.cc:482] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.508661 3150 raft_consensus.cc:504] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:23.509181 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 467cda952ec4492f9206ee4847abc3bc consensus state has no leader
I20260927 15:06:23.509382 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 52e7439320dd48aba25b5f7dc627964c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.509496 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ca9bb98aab8c4ec087412248cd28a86f
I20260927 15:06:23.509986 3150 leader_election.cc:288] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.510412 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet ca9bb98aab8c4ec087412248cd28a86f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.510588 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97f72ddef5346c297d73589e926260c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:23.510344 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.510869 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 52e7439320dd48aba25b5f7dc627964c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:23.511067 1102 leader_election.cc:341] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.508065 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e85b83758e44de4894d3101465bb47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.511058 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e85b83758e44de4894d3101465bb47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.513077 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet ca9bb98aab8c4ec087412248cd28a86f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.512992 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e85b83758e44de4894d3101465bb47e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.512989 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.513440 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 8de30c45e3fb4f1e834094cd59864af9 (DEFAULT_TABLE table=default.Table_b699cc7bf8b7489583daddae8edf7c9a [id=67229a0772f040a98404054eb49418a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.513641 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 1420c48901a44c719f35bbb1f22add41 (DEFAULT_TABLE table=default.Table_a499521b621d4eaab4527f2bf81b6258 [id=e3bc2af75ea545a39348c9e42c3efd85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.513806 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8de30c45e3fb4f1e834094cd59864af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.513739 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 8de30c45e3fb4f1e834094cd59864af9 (DEFAULT_TABLE table=default.Table_b699cc7bf8b7489583daddae8edf7c9a [id=67229a0772f040a98404054eb49418a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.514026 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1420c48901a44c719f35bbb1f22add41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.514286 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8de30c45e3fb4f1e834094cd59864af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.514384 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 52e7439320dd48aba25b5f7dc627964c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.514708 1417 tablet_service.cc:1467] Processing CreateTablet for tablet a34174b7fc08427b821660028e6edba5 (DEFAULT_TABLE table=default.Table_bedfc54f30074f97848b965f2793de73 [id=604a0ca23f294a428475a91c6c704609]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.515825 1552 tablet_bootstrap.cc:492] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:23.515950 1552 ts_tablet_manager.cc:1397] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.261s user 0.004s sys 0.004s
I20260927 15:06:23.516655 1552 raft_consensus.cc:348] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.516798 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a34174b7fc08427b821660028e6edba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.516846 1552 raft_consensus.cc:374] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.516891 1552 raft_consensus.cc:729] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.520359 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 1420c48901a44c719f35bbb1f22add41 (DEFAULT_TABLE table=default.Table_a499521b621d4eaab4527f2bf81b6258 [id=e3bc2af75ea545a39348c9e42c3efd85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.520788 1128 tablet_service.cc:1467] Processing CreateTablet for tablet a34174b7fc08427b821660028e6edba5 (DEFAULT_TABLE table=default.Table_bedfc54f30074f97848b965f2793de73 [id=604a0ca23f294a428475a91c6c704609]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.520196 1266 tablet_service.cc:1467] Processing CreateTablet for tablet a34174b7fc08427b821660028e6edba5 (DEFAULT_TABLE table=default.Table_bedfc54f30074f97848b965f2793de73 [id=604a0ca23f294a428475a91c6c704609]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.521682 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.521862 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet ca9bb98aab8c4ec087412248cd28a86f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.522281 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 1420c48901a44c719f35bbb1f22add41 (DEFAULT_TABLE table=default.Table_a499521b621d4eaab4527f2bf81b6258 [id=e3bc2af75ea545a39348c9e42c3efd85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.522727 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a34174b7fc08427b821660028e6edba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.522924 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 7e889ae85db14a87b394b3b5f6899769 (DEFAULT_TABLE table=default.Table_c7796298134942969fd69e2a3b071bfd [id=08d388b46e854eb3aee759984c9b9011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.524363 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1420c48901a44c719f35bbb1f22add41. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:23.506284 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8caf345c40647388db061fb73564023 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.508423 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 6f743145bcf647bebf7a12c23d7fe62f (DEFAULT_TABLE table=default.Table_71f8e9ca27cb44e88fb384749067af34 [id=66f8286854a64517a666aa31b89f8ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.531320 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f743145bcf647bebf7a12c23d7fe62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.539995 1556 ts_tablet_manager.cc:1428] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.199s user 0.004s sys 0.000s
I20260927 15:06:23.540412 1556 tablet_bootstrap.cc:492] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:23.543285 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da2cdd6c478a4c0989b9317d0206550c consensus state has no leader
I20260927 15:06:23.544857 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97f72ddef5346c297d73589e926260c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
W20260927 15:06:23.545697 1099 leader_election.cc:341] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.545827 1099 leader_election.cc:302] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:23.549701 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 99e672c109e144b09193f916f8c5d516 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99e672c109e144b09193f916f8c5d516 already in progress: creating tablet
W20260927 15:06:23.550346 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 997c93bdf78b49709130d97a8d96a5a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 997c93bdf78b49709130d97a8d96a5a5 already in progress: creating tablet
W20260927 15:06:23.550949 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet d35282079d4f4ab3a6093385244236eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d35282079d4f4ab3a6093385244236eb already in progress: creating tablet
W20260927 15:06:23.551843 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 4470df4cd407401ab03b6f62452c0dc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4470df4cd407401ab03b6f62452c0dc7 already in progress: creating tablet
I20260927 15:06:23.551803 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 8de30c45e3fb4f1e834094cd59864af9 (DEFAULT_TABLE table=default.Table_b699cc7bf8b7489583daddae8edf7c9a [id=67229a0772f040a98404054eb49418a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.552328 3167 tablet_replica.cc:330] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:23.552608 3167 raft_consensus.cc:2229] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:23.552649 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3fff31ceb379400bbfa4586c749e6d6e because the tablet was not found. No further retry: Not found: Tablet not found: 3fff31ceb379400bbfa4586c749e6d6e
I20260927 15:06:23.552901 3167 raft_consensus.cc:2258] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.553604 3167 ts_tablet_manager.cc:1905] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.554416 3150 raft_consensus.cc:2726] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:23.556318 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 6c195d8161e24a2bb02b98c89aaa8d24
I20260927 15:06:23.557403 1275 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c195d8161e24a2bb02b98c89aaa8d24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.560043 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c195d8161e24a2bb02b98c89aaa8d24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.561214 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 65124bc7c4324528b330c16921d9bba1 (DEFAULT_TABLE table=default.Table_1ef5c0dde2d24da99ce5912661473b85 [id=cb41063dd85a4dc490ef3fc5f2bdf04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.561414 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 65124bc7c4324528b330c16921d9bba1 (DEFAULT_TABLE table=default.Table_1ef5c0dde2d24da99ce5912661473b85 [id=cb41063dd85a4dc490ef3fc5f2bdf04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.561631 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65124bc7c4324528b330c16921d9bba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.561874 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c195d8161e24a2bb02b98c89aaa8d24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.563002 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 8f65acfcfe19494fbe821f1f1d5415b5 (DEFAULT_TABLE table=default.Table_f5ddecd47cad4c52ac5cefff1443300b [id=667d20d02e3b4d9da76ddcd0e06211cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.563830 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_881d734c76514d67aba45cce6f1aa4fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:23.563925 1404 tablet_service.cc:1467] Processing CreateTablet for tablet ba079299ba9a4902bf802beb7ae0d3bf (DEFAULT_TABLE table=default.Table_1d4cfca9d3ab48fe81810a8d9c706cb5 [id=11bef6a470aa439ab00cc9e23c247f40]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:23.564342 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_881d734c76514d67aba45cce6f1aa4fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.565574 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_51239a0c5e8d4e6db8ead49f4f9d291a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.565982 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51239a0c5e8d4e6db8ead49f4f9d291a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.567104 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 2f971ae7ece847d68d74024e1039b2bc (DEFAULT_TABLE table=default.Table_74b2f73aa6ad4579968493afc74d80d4 [id=c36090319a704524997e35eed4bd777d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.567342 1273 tablet_service.cc:1467] Processing CreateTablet for tablet ba079299ba9a4902bf802beb7ae0d3bf (DEFAULT_TABLE table=default.Table_1d4cfca9d3ab48fe81810a8d9c706cb5 [id=11bef6a470aa439ab00cc9e23c247f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.567545 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 8f65acfcfe19494fbe821f1f1d5415b5 (DEFAULT_TABLE table=default.Table_f5ddecd47cad4c52ac5cefff1443300b [id=667d20d02e3b4d9da76ddcd0e06211cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.567672 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba079299ba9a4902bf802beb7ae0d3bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.568123 1416 tablet_service.cc:1467] Processing CreateTablet for tablet aca6c48d82d54844a9cc0ff340058b7f (DEFAULT_TABLE table=default.Table_9fd946f328b8412b856c361de7314792 [id=8ee1f2433ae94e619cecae6401130e90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.569231 1268 tablet_service.cc:1467] Processing CreateTablet for tablet aca6c48d82d54844a9cc0ff340058b7f (DEFAULT_TABLE table=default.Table_9fd946f328b8412b856c361de7314792 [id=8ee1f2433ae94e619cecae6401130e90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.569541 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aca6c48d82d54844a9cc0ff340058b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.569682 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3e1e307a7d7b4b18b5bd6c7912667eba" } new_table_name: "default.Table_12dc0dafae0d4a02b4577d258244750a" modify_external_catalogs: true
I20260927 15:06:23.572008 1145 tablet_service.cc:1467] Processing CreateTablet for tablet ba079299ba9a4902bf802beb7ae0d3bf (DEFAULT_TABLE table=default.Table_1d4cfca9d3ab48fe81810a8d9c706cb5 [id=11bef6a470aa439ab00cc9e23c247f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.572122 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 65124bc7c4324528b330c16921d9bba1 (DEFAULT_TABLE table=default.Table_1ef5c0dde2d24da99ce5912661473b85 [id=cb41063dd85a4dc490ef3fc5f2bdf04a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.572551 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_216a89010265461aa19718009e1b88ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.573009 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_216a89010265461aa19718009e1b88ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.574779 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_eab1905b1d1a49b2af41750fd3ba225e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:23.575024 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 2f971ae7ece847d68d74024e1039b2bc (DEFAULT_TABLE table=default.Table_74b2f73aa6ad4579968493afc74d80d4 [id=c36090319a704524997e35eed4bd777d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:23.575239 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eab1905b1d1a49b2af41750fd3ba225e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.576452 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d4a1038521b54049ad08293502431f1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:23.576601 3171 consensus_queue.cc:1035] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:06:23.576866 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4a1038521b54049ad08293502431f1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.578181 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d49ae3f101fb45edb529b9404930cf1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.578578 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d49ae3f101fb45edb529b9404930cf1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.586758 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet a97f72ddef5346c297d73589e926260c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.587890 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1420c48901a44c719f35bbb1f22add41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.591480 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_616f100c38db4553831992c16c88809c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.592073 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_616f100c38db4553831992c16c88809c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.593974 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a34174b7fc08427b821660028e6edba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.594261 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba079299ba9a4902bf802beb7ae0d3bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:23.597237 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d9562d917b74db9aa4a9678b9d32841 consensus state has no leader
I20260927 15:06:23.598598 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 8f65acfcfe19494fbe821f1f1d5415b5 (DEFAULT_TABLE table=default.Table_f5ddecd47cad4c52ac5cefff1443300b [id=667d20d02e3b4d9da76ddcd0e06211cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.599093 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f65acfcfe19494fbe821f1f1d5415b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.600276 1130 tablet_service.cc:1467] Processing CreateTablet for tablet aca6c48d82d54844a9cc0ff340058b7f (DEFAULT_TABLE table=default.Table_9fd946f328b8412b856c361de7314792 [id=8ee1f2433ae94e619cecae6401130e90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.600642 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aca6c48d82d54844a9cc0ff340058b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.603061 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f971ae7ece847d68d74024e1039b2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.605366 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 5ee5431ca9644fb9b4823f4387401d74 (DEFAULT_TABLE table=default.Table_7ad6cbd2b08541d4974822f8b121d9c3 [id=a148cc533e5c4bd0ba2267cfe304e5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.605500 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1001) took 5740 ms. Trace:
I20260927 15:06:23.605945 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e889ae85db14a87b394b3b5f6899769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.606591 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65124bc7c4324528b330c16921d9bba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.608173 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8de30c45e3fb4f1e834094cd59864af9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.605589 1562 rpcz_store.cc:276] 0927 15:06:17.865154 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.867033 (+ 1879us) service_pool.cc:227] Handling call
0927 15:06:23.549337 (+5682304us) ts_tablet_manager.cc:1145] Deleting tablet 4ebacc9c2fca45ff92635e41a19e5bd8
0927 15:06:23.605360 (+ 56023us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.605481 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5578121}
W20260927 15:06:23.608973 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 4ebacc9c2fca45ff92635e41a19e5bd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ebacc9c2fca45ff92635e41a19e5bd8 already in progress: creating tablet
I20260927 15:06:23.609474 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1016) took 5662 ms. Trace:
I20260927 15:06:23.609627 1562 rpcz_store.cc:276] 0927 15:06:17.947299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.947361 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:23.609352 (+5661991us) ts_tablet_manager.cc:1145] Deleting tablet 4febf85191d04dd98db55c5730232e1c
0927 15:06:23.609365 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.609458 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5635233}
W20260927 15:06:23.610548 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 4febf85191d04dd98db55c5730232e1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4febf85191d04dd98db55c5730232e1c already in progress: creating tablet
I20260927 15:06:23.611653 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 5ee5431ca9644fb9b4823f4387401d74 (DEFAULT_TABLE table=default.Table_7ad6cbd2b08541d4974822f8b121d9c3 [id=a148cc533e5c4bd0ba2267cfe304e5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.612038 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ee5431ca9644fb9b4823f4387401d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.612402 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ee5431ca9644fb9b4823f4387401d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.612614 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f65acfcfe19494fbe821f1f1d5415b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.613991 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f971ae7ece847d68d74024e1039b2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.614770 1562 tablet_replica.cc:330] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:23.617472 1562 raft_consensus.cc:2229] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:23.620054 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aca6c48d82d54844a9cc0ff340058b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.623492 1275 tablet_service.cc:1467] Processing CreateTablet for tablet cdd7bbf588ea4f259cb815683636c7dd (DEFAULT_TABLE table=default.Table_905f2cbb1c5e4c5fb9ab52f2bb184109 [id=67d4df7f26b54163b3519a4dc133e430]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.623869 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd7bbf588ea4f259cb815683636c7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.624990 1562 raft_consensus.cc:2258] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.625597 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0c13e1b918e8461fb684b657939d128c" } new_table_name: "default.Table_df9ffa6e6ecd41918ed985059a5de3a6" modify_external_catalogs: true
I20260927 15:06:23.612064 1279 tablet_service.cc:1467] Processing CreateTablet for tablet 2f971ae7ece847d68d74024e1039b2bc (DEFAULT_TABLE table=default.Table_74b2f73aa6ad4579968493afc74d80d4 [id=c36090319a704524997e35eed4bd777d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.635161 1143 tablet_service.cc:1467] Processing CreateTablet for tablet dd2ee92aa4cf4084af12c35a2d150bdf (DEFAULT_TABLE table=default.Table_e63f743dfca44a18bed170b2cd50f413 [id=43b7f5a1d5a3459a92ae578c475a7bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.635596 1282 tablet_service.cc:1467] Processing CreateTablet for tablet dd2ee92aa4cf4084af12c35a2d150bdf (DEFAULT_TABLE table=default.Table_e63f743dfca44a18bed170b2cd50f413 [id=43b7f5a1d5a3459a92ae578c475a7bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.635735 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd2ee92aa4cf4084af12c35a2d150bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.635861 1561 tablet_bootstrap.cc:654] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:23.635931 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd2ee92aa4cf4084af12c35a2d150bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.637614 1562 ts_tablet_manager.cc:1905] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:23.642256 1134 tablet_service.cc:1467] Processing CreateTablet for tablet cdd7bbf588ea4f259cb815683636c7dd (DEFAULT_TABLE table=default.Table_905f2cbb1c5e4c5fb9ab52f2bb184109 [id=67d4df7f26b54163b3519a4dc133e430]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.642691 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd7bbf588ea4f259cb815683636c7dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:23.643214 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8034812bd8b44d97bc63b7d65b8f83d1 consensus state has no leader
I20260927 15:06:23.650050 1211 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:23.654469 1130 tablet_service.cc:1467] Processing CreateTablet for tablet b094ef443e354cc7b5cbf5da78282610 (DEFAULT_TABLE table=default.Table_c03efef34acf46ee990e4763b68f064a [id=3253c397cf004fb8be4964392670d85a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.654950 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b094ef443e354cc7b5cbf5da78282610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.659044 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 7b27376706474f34be5acf9e5bba4ec5 (DEFAULT_TABLE table=default.Table_2204baab0bef45568d79ecaa4710ba99 [id=396ef5b635b94a9cb1b6c25f7770cf64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.659394 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b27376706474f34be5acf9e5bba4ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.665098 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 5ee5431ca9644fb9b4823f4387401d74 (DEFAULT_TABLE table=default.Table_7ad6cbd2b08541d4974822f8b121d9c3 [id=a148cc533e5c4bd0ba2267cfe304e5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.665448 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ee5431ca9644fb9b4823f4387401d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.671249 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f971ae7ece847d68d74024e1039b2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.673136 3173 raft_consensus.cc:482] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.673377 3173 raft_consensus.cc:504] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.674206 3173 leader_election.cc:288] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.674533 1561 tablet_bootstrap.cc:492] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:23.674968 1561 ts_tablet_manager.cc:1397] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.197s user 0.002s sys 0.002s
I20260927 15:06:23.676930 1561 raft_consensus.cc:348] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.677377 1561 raft_consensus.cc:374] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.677587 1561 raft_consensus.cc:729] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.678088 1561 consensus_queue.cc:260] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.680810 1561 ts_tablet_manager.cc:1428] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260927 15:06:23.681726 1561 tablet_bootstrap.cc:492] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:23.684626 1562 ts_tablet_manager.cc:1918] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:23.686041 1561 tablet_bootstrap.cc:654] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:23.688061 3173 raft_consensus.cc:482] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:23.688205 3173 raft_consensus.cc:504] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.688344 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fff31ceb379400bbfa4586c749e6d6e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:23.688735 3173 leader_election.cc:288] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.688386 1562 log.cc:1196] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/df6d7670381b49bb927943b2ee920c84
W20260927 15:06:23.689096 1102 consensus_peers.cc:487] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:23.689348 1102 leader_election.cc:341] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.689338 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae003f1ca76472cbaa8b577b66fe84c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:23.690004 1102 leader_election.cc:341] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.690387 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 7b27376706474f34be5acf9e5bba4ec5 (DEFAULT_TABLE table=default.Table_2204baab0bef45568d79ecaa4710ba99 [id=396ef5b635b94a9cb1b6c25f7770cf64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.690889 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b27376706474f34be5acf9e5bba4ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.691516 1562 ts_tablet_manager.cc:1939] T df6d7670381b49bb927943b2ee920c84 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:23.691761 1291 raft_consensus.cc:3037] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.692384 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 05babe326fa44773be6878abfb175770 (DEFAULT_TABLE table=default.Table_279db08831174124bf691a8cad553e81 [id=5de6f33b4fa24254a432ee069ed91324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.692557 1282 tablet_service.cc:1467] Processing CreateTablet for tablet b094ef443e354cc7b5cbf5da78282610 (DEFAULT_TABLE table=default.Table_c03efef34acf46ee990e4763b68f064a [id=3253c397cf004fb8be4964392670d85a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.692906 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b094ef443e354cc7b5cbf5da78282610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.692932 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05babe326fa44773be6878abfb175770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.695611 2119 ts_tablet_manager.cc:1918] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:23.695752 2119 log.cc:1196] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/3efc44686be2407cbcdca61909301539
I20260927 15:06:23.696219 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1017) took 5732 ms. Trace:
I20260927 15:06:23.696738 1562 rpcz_store.cc:276] 0927 15:06:17.963862 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.964122 (+ 260us) service_pool.cc:227] Handling call
0927 15:06:23.614727 (+5650605us) ts_tablet_manager.cc:1145] Deleting tablet df6d7670381b49bb927943b2ee920c84
0927 15:06:23.614737 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.640958 (+ 26221us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.684534 (+ 43576us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.696094 (+ 11560us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7185,"tablet-delete.queue_time_us":5640502}
I20260927 15:06:23.699230 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet df6d7670381b49bb927943b2ee920c84 (table default.Table_c10827cf92b44050bf8d4dc379b26be3 [id=2125b2fb567a43128346e08a4370ace2]) successfully deleted
I20260927 15:06:23.699429 3173 raft_consensus.cc:482] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.699079 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1018) took 5734 ms. Trace:
I20260927 15:06:23.699627 3138 raft_consensus.cc:482] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.699745 3138 raft_consensus.cc:504] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.699510 1562 rpcz_store.cc:276] 0927 15:06:17.964022 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.964083 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:23.698286 (+5734203us) ts_tablet_manager.cc:1145] Deleting tablet 171ba98418b34aa283b7a7b243678fa9
0927 15:06:23.698297 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.698944 (+ 647us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5723647}
I20260927 15:06:23.700369 3138 leader_election.cc:288] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:23.700786 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 171ba98418b34aa283b7a7b243678fa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 171ba98418b34aa283b7a7b243678fa9 already in progress: creating tablet
I20260927 15:06:23.699539 3173 raft_consensus.cc:504] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.705682 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 05babe326fa44773be6878abfb175770 (DEFAULT_TABLE table=default.Table_279db08831174124bf691a8cad553e81 [id=5de6f33b4fa24254a432ee069ed91324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.706054 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05babe326fa44773be6878abfb175770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.707778 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3540982dd7544e60af6c153fc41a412c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:23.595173 1552 consensus_queue.cc:260] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.709545 1552 ts_tablet_manager.cc:1428] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.194s user 0.001s sys 0.001s
I20260927 15:06:23.709860 1552 tablet_bootstrap.cc:492] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:23.702414 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1002) took 5837 ms. Trace:
I20260927 15:06:23.703274 3173 leader_election.cc:288] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.707378 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568ba79ea795403cba76fb6632efd7e2" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:23.714408 1164 raft_consensus.cc:2454] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
W20260927 15:06:23.708601 1102 leader_election.cc:341] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.711658 3150 raft_consensus.cc:482] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.715108 3150 raft_consensus.cc:504] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.715677 3150 leader_election.cc:288] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.717703 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:23.718082 1239 leader_election.cc:302] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:23.714301 1562 rpcz_store.cc:276] 0927 15:06:17.865244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.865303 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:23.701459 (+5836156us) ts_tablet_manager.cc:1145] Deleting tablet 51f0744f9d804b84a958916c2dd04503
0927 15:06:23.701582 (+ 123us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.702217 (+ 635us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5725096}
W20260927 15:06:23.719523 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 51f0744f9d804b84a958916c2dd04503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 51f0744f9d804b84a958916c2dd04503 already in progress: creating tablet
I20260927 15:06:23.720175 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1003) took 5854 ms. Trace:
I20260927 15:06:23.720309 3150 raft_consensus.cc:482] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:23.720425 3150 raft_consensus.cc:504] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.720371 1562 rpcz_store.cc:276] 0927 15:06:17.865342 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.865398 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:23.719892 (+5854494us) ts_tablet_manager.cc:1145] Deleting tablet 58d7e01486e941f9a6a5f691ae6c7d68
0927 15:06:23.719943 (+ 51us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.720156 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5743291}
I20260927 15:06:23.720942 3150 leader_election.cc:288] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:23.720992 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 58d7e01486e941f9a6a5f691ae6c7d68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58d7e01486e941f9a6a5f691ae6c7d68 already in progress: creating tablet
I20260927 15:06:23.721518 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1015) took 5776 ms. Trace:
I20260927 15:06:23.721728 1562 rpcz_store.cc:276] 0927 15:06:17.944717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:17.944772 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:23.721297 (+5776525us) ts_tablet_manager.cc:1145] Deleting tablet d25d98b148a94de4bba78a6969e81430
0927 15:06:23.721307 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.721494 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5737984}
W20260927 15:06:23.722425 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet d25d98b148a94de4bba78a6969e81430 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d25d98b148a94de4bba78a6969e81430 already in progress: creating tablet
I20260927 15:06:23.722941 1561 tablet_bootstrap.cc:492] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:23.723215 1561 ts_tablet_manager.cc:1397] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.000s
I20260927 15:06:23.724680 1561 raft_consensus.cc:348] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.725138 1561 raft_consensus.cc:374] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.725289 1561 raft_consensus.cc:729] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.725754 1561 consensus_queue.cc:260] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.722954 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1039) took 5218 ms. Trace:
I20260927 15:06:23.728019 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3c1f35d7f77541faa816fcfc1c4ecf0a" } modify_external_catalogs: true
I20260927 15:06:23.728209 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3c1f35d7f77541faa816fcfc1c4ecf0a" } modify_external_catalogs: true
I20260927 15:06:23.729581 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fac46c3377064415bbb90be5ca23da6b" } new_table_name: "default.Table_f9c63ae6bd6a449e82b7b67428a51e48" modify_external_catalogs: true
I20260927 15:06:23.728211 1562 rpcz_store.cc:276] 0927 15:06:18.504968 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.505118 (+ 150us) service_pool.cc:227] Handling call
0927 15:06:23.722748 (+5217630us) ts_tablet_manager.cc:1145] Deleting tablet 832bf0ee6cbf4c639d2ea569c565ca20
0927 15:06:23.722758 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.722941 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5217364}
I20260927 15:06:23.730309 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b07276756da348cfb9c1781447600490" } modify_external_catalogs: true
I20260927 15:06:23.730579 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_fda01f3dcccb42e389ebcbb8c30b2b6c" } new_table_name: "default.Table_83fad230fc02478d978d4c302780347b" modify_external_catalogs: true
W20260927 15:06:23.730705 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 832bf0ee6cbf4c639d2ea569c565ca20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 832bf0ee6cbf4c639d2ea569c565ca20 already in progress: creating tablet
I20260927 15:06:23.730868 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1b7d8a5621484fb7bd0ca283901aaaf8" } modify_external_catalogs: true
I20260927 15:06:23.731894 1561 ts_tablet_manager.cc:1428] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260927 15:06:23.732707 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1040) took 5227 ms. Trace:
I20260927 15:06:23.734598 1561 tablet_bootstrap.cc:492] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:23.733403 1562 rpcz_store.cc:276] 0927 15:06:18.505075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.505374 (+ 299us) service_pool.cc:227] Handling call
0927 15:06:23.731691 (+5226317us) ts_tablet_manager.cc:1145] Deleting tablet 35a09718f15147f59575a7ea6f24573b
0927 15:06:23.731707 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.732395 (+ 688us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5225829}
I20260927 15:06:23.735098 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4684e67831e24d74947a894ad899f3be" } modify_external_catalogs: true
W20260927 15:06:23.735754 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 35a09718f15147f59575a7ea6f24573b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35a09718f15147f59575a7ea6f24573b already in progress: creating tablet
I20260927 15:06:23.737995 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1038) took 5232 ms. Trace:
I20260927 15:06:23.738741 1562 rpcz_store.cc:276] 0927 15:06:18.504859 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.506958 (+ 2099us) service_pool.cc:227] Handling call
0927 15:06:23.736625 (+5229667us) ts_tablet_manager.cc:1145] Deleting tablet b0b25e485f3d4e6780cd34d9e13fa807
0927 15:06:23.736934 (+ 309us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.737687 (+ 753us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5229467}
W20260927 15:06:23.740909 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet b0b25e485f3d4e6780cd34d9e13fa807 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0b25e485f3d4e6780cd34d9e13fa807 already in progress: creating tablet
I20260927 15:06:23.743064 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1041) took 5234 ms. Trace:
I20260927 15:06:23.745366 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1098d7de1c054e21abb4fe1e91309fd9" } new_table_name: "default.Table_1a39199f87b749d292c7fd5ee7e3f601" modify_external_catalogs: true
I20260927 15:06:23.744275 1562 rpcz_store.cc:276] 0927 15:06:18.508800 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.509414 (+ 614us) service_pool.cc:227] Handling call
0927 15:06:23.742119 (+5232705us) ts_tablet_manager.cc:1145] Deleting tablet bc47ec18419c42c5bf64a3a9a414d771
0927 15:06:23.742138 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.743045 (+ 907us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5232153}
W20260927 15:06:23.746165 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet bc47ec18419c42c5bf64a3a9a414d771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc47ec18419c42c5bf64a3a9a414d771 already in progress: creating tablet
I20260927 15:06:23.746193 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3d792d3d9dea4547ab9154b89a6e27bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.746707 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d792d3d9dea4547ab9154b89a6e27bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.748138 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1042) took 5028 ms. Trace:
I20260927 15:06:23.748760 1562 rpcz_store.cc:276] 0927 15:06:18.719832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:18.719892 (+ 60us) service_pool.cc:227] Handling call
0927 15:06:23.747028 (+5027136us) ts_tablet_manager.cc:1145] Deleting tablet f052aaaa3793455bb19d7cceb4e127c4
0927 15:06:23.747347 (+ 319us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.747894 (+ 547us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5026907}
W20260927 15:06:23.750619 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet f052aaaa3793455bb19d7cceb4e127c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f052aaaa3793455bb19d7cceb4e127c4 already in progress: creating tablet
I20260927 15:06:23.751101 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1b7d8a5621484fb7bd0ca283901aaaf8" } modify_external_catalogs: true
I20260927 15:06:23.751772 1562 tablet_replica.cc:330] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:23.752210 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b07276756da348cfb9c1781447600490" } modify_external_catalogs: true
I20260927 15:06:23.752995 1561 tablet_bootstrap.cc:654] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:23.753453 1562 raft_consensus.cc:2229] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:23.753763 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 57580db090ad4e4e94a3d22063e57ad4
I20260927 15:06:23.753877 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4684e67831e24d74947a894ad899f3be" } modify_external_catalogs: true
I20260927 15:06:23.755658 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 57580db090ad4e4e94a3d22063e57ad4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.756247 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 57580db090ad4e4e94a3d22063e57ad4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.756283 1562 pending_rounds.cc:62] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:23.756708 1562 pending_rounds.cc:68] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976384917790720 op_type: NO_OP noop_request { }
I20260927 15:06:23.757011 1562 raft_consensus.cc:2866] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:23.757288 1562 raft_consensus.cc:2258] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:23.758569 1562 ts_tablet_manager.cc:1905] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:23.760567 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb8e95f350f249ac85c5df42afe4a90d consensus state has no leader
W20260927 15:06:23.761376 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4cc28b977ad4ed3bfe1672fbe44ec03 consensus state has no leader
I20260927 15:06:23.765502 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_cb1085ae25974c8e995da51377c70d9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.766058 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb1085ae25974c8e995da51377c70d9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.768191 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a048688bb36f4b2899e026be85424bd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.768680 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a048688bb36f4b2899e026be85424bd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.769922 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_646b4123f3f64322ae6a01a54206087b" } modify_external_catalogs: true
I20260927 15:06:23.770093 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_646b4123f3f64322ae6a01a54206087b" } modify_external_catalogs: true
I20260927 15:06:23.776757 3150 raft_consensus.cc:482] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:23.776894 3150 raft_consensus.cc:504] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.777472 3150 leader_election.cc:288] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.791340 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65124bc7c4324528b330c16921d9bba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.795836 1402 tablet_service.cc:1467] Processing CreateTablet for tablet dd2ee92aa4cf4084af12c35a2d150bdf (DEFAULT_TABLE table=default.Table_e63f743dfca44a18bed170b2cd50f413 [id=43b7f5a1d5a3459a92ae578c475a7bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.796224 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba079299ba9a4902bf802beb7ae0d3bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:23.796774 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9cd4941f342d41f6a0b4d9c1c42a983d consensus state has no leader
I20260927 15:06:23.797580 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 4891a90ecd36456ab875732b3f2770c4
I20260927 15:06:23.797744 1406 tablet_service.cc:1467] Processing CreateTablet for tablet b094ef443e354cc7b5cbf5da78282610 (DEFAULT_TABLE table=default.Table_c03efef34acf46ee990e4763b68f064a [id=3253c397cf004fb8be4964392670d85a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.799151 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 4891a90ecd36456ab875732b3f2770c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.799394 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1d83cf0b359b45299f5cdebdc7dee7d4
I20260927 15:06:23.800253 1414 tablet_service.cc:1467] Processing CreateTablet for tablet cdd7bbf588ea4f259cb815683636c7dd (DEFAULT_TABLE table=default.Table_905f2cbb1c5e4c5fb9ab52f2bb184109 [id=67d4df7f26b54163b3519a4dc133e430]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.800665 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d83cf0b359b45299f5cdebdc7dee7d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.802006 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d83cf0b359b45299f5cdebdc7dee7d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.803188 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd2ee92aa4cf4084af12c35a2d150bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.803058 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_812e7ef245f6471f891fce0cb1b2efdc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.803627 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_812e7ef245f6471f891fce0cb1b2efdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.804953 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1f39a648b6374960b2afb9fca519938a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.805392 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f39a648b6374960b2afb9fca519938a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.807207 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b6f5a16e230c47b0bf30927e7d65089f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:23.807266 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_db5c6a9f297841d4ba1c1c50e0450d20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.807610 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6f5a16e230c47b0bf30927e7d65089f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:23.807734 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db5c6a9f297841d4ba1c1c50e0450d20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.808740 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_51bee0b9728a4d70b9f61fe1cb39f4c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.809126 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51bee0b9728a4d70b9f61fe1cb39f4c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.810101 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6415984e90b9420d867c66eae3dabdee" } new_table_name: "default.Table_c4dd12d29bc04a84822989fcb7fd5c27" modify_external_catalogs: true
I20260927 15:06:23.811929 1556 tablet_bootstrap.cc:654] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:23.818665 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2f7eb13bbf1d470f9b516fa89311eb68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.819162 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f7eb13bbf1d470f9b516fa89311eb68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.820359 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet bd0e035cec844fe789fdc815644fc025
I20260927 15:06:23.820434 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 05babe326fa44773be6878abfb175770 (DEFAULT_TABLE table=default.Table_279db08831174124bf691a8cad553e81 [id=5de6f33b4fa24254a432ee069ed91324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.821419 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet bd0e035cec844fe789fdc815644fc025 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.822180 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ab3440adf5ea4156a2259aed40ff1db8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:23.822669 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab3440adf5ea4156a2259aed40ff1db8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:23.825448 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b5ffe51b1b834bf4af262dc70b9206f8
I20260927 15:06:23.826470 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet b5ffe51b1b834bf4af262dc70b9206f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:23.834920 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet decee14b5d7a4aef9989051dcaeb5a7b consensus state has no leader
I20260927 15:06:23.840626 1552 tablet_bootstrap.cc:654] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:23.841590 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 10b19de22dd74d74bdf619c75fc17762 (table default.Table_204b853f46d742a6a6903e95d452c5b2 [id=d4b50c4eac27403fb94efa8aa7ef901c], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 10b19de22dd74d74bdf619c75fc17762 consensus state has no leader
I20260927 15:06:23.841771 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b094ef443e354cc7b5cbf5da78282610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.841974 3138 raft_consensus.cc:2781] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:23.842064 3138 raft_consensus.cc:482] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:23.842137 3138 raft_consensus.cc:3037] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.842141 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05babe326fa44773be6878abfb175770. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:23.842612 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 124546us
W20260927 15:06:23.843261 1102 leader_election.cc:341] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:23.845134 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 7b27376706474f34be5acf9e5bba4ec5 (DEFAULT_TABLE table=default.Table_2204baab0bef45568d79ecaa4710ba99 [id=396ef5b635b94a9cb1b6c25f7770cf64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.846309 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2804c8e3cffa4b3db7b87ebed56475b3" } new_table_name: "default.Table_33c6327ce3b5419baa3d9a309a4db65a" modify_external_catalogs: true
I20260927 15:06:23.846773 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 4891a90ecd36456ab875732b3f2770c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.847388 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd7bbf588ea4f259cb815683636c7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.848295 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b27376706474f34be5acf9e5bba4ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.848321 1436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ba3bdf50b14aec85a99742426e9298" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:23.850510 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 57580db090ad4e4e94a3d22063e57ad4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.850618 1415 tablet_service.cc:1514] Processing DeleteTablet for tablet bd0e035cec844fe789fdc815644fc025 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.850868 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d83cf0b359b45299f5cdebdc7dee7d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:23.858281 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6481b87f90c7482b9c7598fb3ffd39dc consensus state has no leader
I20260927 15:06:23.858526 1436 raft_consensus.cc:2454] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
W20260927 15:06:23.858219 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 300180us
I20260927 15:06:23.863785 1143 tablet_service.cc:1467] Processing CreateTablet for tablet ece11a9f130c4a869cd9d775246b82ce (DEFAULT_TABLE table=default.Table_d49ae3f101fb45edb529b9404930cf1d [id=a9e6b7cb1e804aee8c9103f1b367fe9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.864657 1130 tablet_service.cc:1467] Processing CreateTablet for tablet 8d831ff2584a402182f80130eda4fc24 (DEFAULT_TABLE table=default.Table_eab1905b1d1a49b2af41750fd3ba225e [id=8d6690869fd1473d8c601b694daff6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.864899 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 9425d443354c49819e2d0eb88db05085 (DEFAULT_TABLE table=default.Table_216a89010265461aa19718009e1b88ba [id=cf432312d3a84f9a915c2bd285e09fc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.865793 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet b5ffe51b1b834bf4af262dc70b9206f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.866496 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 8d831ff2584a402182f80130eda4fc24 (DEFAULT_TABLE table=default.Table_eab1905b1d1a49b2af41750fd3ba225e [id=8d6690869fd1473d8c601b694daff6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.867072 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d831ff2584a402182f80130eda4fc24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.867234 1415 tablet_service.cc:1467] Processing CreateTablet for tablet ece11a9f130c4a869cd9d775246b82ce (DEFAULT_TABLE table=default.Table_d49ae3f101fb45edb529b9404930cf1d [id=a9e6b7cb1e804aee8c9103f1b367fe9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.867645 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ece11a9f130c4a869cd9d775246b82ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.868979 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 671eacb9cde9411c9abbf4273d697506 (DEFAULT_TABLE table=default.Table_dfc4be005c6149929b7d3560013be223 [id=55b52d0c53c74c02b6a8d9948c4c02dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.869299 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 671eacb9cde9411c9abbf4273d697506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.870643 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 671eacb9cde9411c9abbf4273d697506 (DEFAULT_TABLE table=default.Table_dfc4be005c6149929b7d3560013be223 [id=55b52d0c53c74c02b6a8d9948c4c02dc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:23.871083 1099 leader_election.cc:341] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3fff31ceb379400bbfa4586c749e6d6e
I20260927 15:06:23.871201 1099 leader_election.cc:302] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:23.871541 1099 leader_election.cc:341] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9ae003f1ca76472cbaa8b577b66fe84c
I20260927 15:06:23.871654 1099 leader_election.cc:302] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:23.872078 1099 leader_election.cc:341] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3540982dd7544e60af6c153fc41a412c
I20260927 15:06:23.872167 1099 leader_election.cc:302] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.872198 1145 tablet_service.cc:1467] Processing CreateTablet for tablet e46ce30693f64de6866d5466db692044 (DEFAULT_TABLE table=default.Table_a385512b84d24842bdcbff63148fc2dc [id=a1621be7b1844bd8a3fb9d6f45d90f3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.872391 3148 raft_consensus.cc:2726] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:23.872444 1099 leader_election.cc:341] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: efa42545da374ca989199433ce1284c3
I20260927 15:06:23.872514 1099 leader_election.cc:302] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:23.872816 3170 raft_consensus.cc:2726] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:23.872841 1099 leader_election.cc:302] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:23.872934 3171 raft_consensus.cc:2726] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:23.873212 3171 raft_consensus.cc:2781] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:23.873297 3171 raft_consensus.cc:482] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:23.873360 3171 raft_consensus.cc:3037] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:23.873524 1238 leader_election.cc:341] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 568ba79ea795403cba76fb6632efd7e2
W20260927 15:06:23.873972 1099 consensus_peers.cc:487] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af25950fd08043f18a6eaaf46ded4378. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:23.874081 1099 leader_election.cc:341] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 1ba163e0f6164d65b09da684ee4872e0
I20260927 15:06:23.874202 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet bd0e035cec844fe789fdc815644fc025 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.874303 3150 consensus_queue.cc:1035] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:23.874403 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet b5ffe51b1b834bf4af262dc70b9206f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.872524 3148 raft_consensus.cc:2726] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:23.875586 2119 ts_tablet_manager.cc:1939] T 3efc44686be2407cbcdca61909301539 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:23.876845 1141 tablet_service.cc:1467] Processing CreateTablet for tablet c979537c24c64f31932aa6beed8347e7 (DEFAULT_TABLE table=default.Table_9e90adcb591248778787025fe8fc700b [id=0be4c4fbc16f47fd9aa0c63bc22c7fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.876924 3171 raft_consensus.cc:504] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:23.877683 3171 leader_election.cc:288] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:23.877959 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 12f6403cde734c1394aabfc92c093290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:23.878453 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 0e3a61df17ad4682ab34bbf6e9ae8010 (DEFAULT_TABLE table=default.Table_525948009d514445be28f583ecc833d5 [id=982b45e545c54af49a209821c1e3638e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.878491 1405 tablet_service.cc:1467] Processing CreateTablet for tablet e46ce30693f64de6866d5466db692044 (DEFAULT_TABLE table=default.Table_a385512b84d24842bdcbff63148fc2dc [id=a1621be7b1844bd8a3fb9d6f45d90f3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.878880 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e46ce30693f64de6866d5466db692044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.879189 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 9425d443354c49819e2d0eb88db05085 (DEFAULT_TABLE table=default.Table_216a89010265461aa19718009e1b88ba [id=cf432312d3a84f9a915c2bd285e09fc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.879604 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9425d443354c49819e2d0eb88db05085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.882813 1137 tablet_service.cc:1467] Processing CreateTablet for tablet c5ae86a2467048b4868af383b532f356 (DEFAULT_TABLE table=default.Table_653ad280559f40a4b498dc5c94535595 [id=900b277df9db40848c61087f96a163e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.884080 1305 raft_consensus.cc:3037] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:23.885187 1128 tablet_service.cc:1467] Processing CreateTablet for tablet cd508c73859c4f4ea316c7d08e73db63 (DEFAULT_TABLE table=default.Table_ac0b4bfd2a9c4193b4006e1d124bfa1b [id=337127b6dffa42c994d6b2c9a4737ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.887501 1132 tablet_service.cc:1467] Processing CreateTablet for tablet fbbf08cdf14a4b0aa725af2c840070f2 (DEFAULT_TABLE table=default.Table_fadb670c1dd2403fa66f5b718023dfd8 [id=4baac753bdaf4fffaa9d8c8c1b67548e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.887712 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7e8c06bda94cad8325c81578ce8421 (DEFAULT_TABLE table=default.Table_766da62d2f6e4daab98bca846d688515 [id=429539baf2a54a1aba8b2c3e7716dfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.892244 1413 tablet_service.cc:1467] Processing CreateTablet for tablet c979537c24c64f31932aa6beed8347e7 (DEFAULT_TABLE table=default.Table_9e90adcb591248778787025fe8fc700b [id=0be4c4fbc16f47fd9aa0c63bc22c7fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.872347 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ba3bdf50b14aec85a99742426e9298" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:23.899701 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 8c71ea482f204c5f884f708db4ba4fdf (DEFAULT_TABLE table=default.Table_0a5ef9df79a8459a9a40b31713179aed [id=2368de7719fe4da68dd02692e327c981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.900063 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9a7dfdd3e04b51a8a825980f37128e (DEFAULT_TABLE table=default.Table_ab5b7a803a4f4b56a397ddfcf0b541c1 [id=05e140e2fc8749f5b2dd9ffc39738e37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.900466 1133 tablet_service.cc:1467] Processing CreateTablet for tablet aa68e03d7d33434890fbc0075be1593d (DEFAULT_TABLE table=default.Table_afbe9ff64484483c8622302f8239c274 [id=0e0b535f11ff435b88a57402493ff2be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.901930 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 8034812bd8b44d97bc63b7d65b8f83d1 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:23.905591 1562 ts_tablet_manager.cc:1918] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:23.905702 1562 log.cc:1196] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/fd5f2ab9677c4598b0b8d9a93a6a23c7
I20260927 15:06:23.906006 1562 ts_tablet_manager.cc:1939] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:23.909469 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 75aee73186104fedbafa5175721e2fda (DEFAULT_TABLE table=default.Table_616f100c38db4553831992c16c88809c [id=b0d5b81c43a94ca8b7162e54833e3dab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.909744 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ece11a9f130c4a869cd9d775246b82ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.909677 1136 tablet_service.cc:1467] Processing CreateTablet for tablet d4416ab42f084a6892c76b7d2654e314 (DEFAULT_TABLE table=default.Table_5e6b229a59aa4dd2827c0eb9629b5d2c [id=dd0ba280ca0344edac1f9a4d239d72e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.909991 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4416ab42f084a6892c76b7d2654e314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.909948 1127 tablet_service.cc:1467] Processing CreateTablet for tablet c0a3bb7337a84d3f8353d7ef47723fde (DEFAULT_TABLE table=default.Table_51239a0c5e8d4e6db8ead49f4f9d291a [id=1a455f4e1abb4f898ce36d41e548578e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.910231 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0a3bb7337a84d3f8353d7ef47723fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.913089 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 581416f6c2cc434d8ee3ae1428d94f1c (DEFAULT_TABLE table=default.Table_3b979fe89b604e5bb269f000a48f04f5 [id=6f01999e4e714ac19496344ee4c19aaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.913388 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581416f6c2cc434d8ee3ae1428d94f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.915155 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d831ff2584a402182f80130eda4fc24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.918689 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 38408dd02ac24febb130b5cb5f7fccb6 (DEFAULT_TABLE table=default.Table_881d734c76514d67aba45cce6f1aa4fb [id=08057bd33d054931919aa1616ca51df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.919106 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38408dd02ac24febb130b5cb5f7fccb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.923071 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 80dfdd852c674f60b47383c72fdf95f3 (DEFAULT_TABLE table=default.Table_42a4e7e8f5f9481282232f76d1eec254 [id=d12114e3a42d4177baeb1a97861287cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.923357 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80dfdd852c674f60b47383c72fdf95f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.923803 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 9425d443354c49819e2d0eb88db05085 (DEFAULT_TABLE table=default.Table_216a89010265461aa19718009e1b88ba [id=cf432312d3a84f9a915c2bd285e09fc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.923949 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 671eacb9cde9411c9abbf4273d697506 (DEFAULT_TABLE table=default.Table_dfc4be005c6149929b7d3560013be223 [id=55b52d0c53c74c02b6a8d9948c4c02dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.924129 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9425d443354c49819e2d0eb88db05085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.924309 1279 tablet_service.cc:1514] Processing DeleteTablet for tablet 4891a90ecd36456ab875732b3f2770c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:23.927205 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9425d443354c49819e2d0eb88db05085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.931031 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 671eacb9cde9411c9abbf4273d697506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.932370 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1073) took 2480 ms. Trace:
I20260927 15:06:23.932928 2119 rpcz_store.cc:276] 0927 15:06:21.451410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.451482 (+ 72us) service_pool.cc:227] Handling call
0927 15:06:23.365457 (+1913975us) ts_tablet_manager.cc:1145] Deleting tablet 3efc44686be2407cbcdca61909301539
0927 15:06:23.365467 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.460900 (+ 95433us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.695521 (+234621us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.932242 (+236721us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1913724}
I20260927 15:06:23.935119 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e46ce30693f64de6866d5466db692044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.936300 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1083) took 2275 ms. Trace:
I20260927 15:06:23.939191 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c979537c24c64f31932aa6beed8347e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.944137 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e3a61df17ad4682ab34bbf6e9ae8010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.945024 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5ae86a2467048b4868af383b532f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.946959 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75aee73186104fedbafa5175721e2fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.950394 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd508c73859c4f4ea316c7d08e73db63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.954816 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbbf08cdf14a4b0aa725af2c840070f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.954996 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7e8c06bda94cad8325c81578ce8421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.955160 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa68e03d7d33434890fbc0075be1593d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.959214 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d9a7dfdd3e04b51a8a825980f37128e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.961979 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2df9a1dcdfdc4adaa653c52a6c069c0f" } new_table_name: "default.Table_c86e5471fe7b4b768f8d44582dd240f0" modify_external_catalogs: true
I20260927 15:06:23.962956 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c71ea482f204c5f884f708db4ba4fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.963729 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 4c8babe6f5e74fe8ad79c786473ac931 (DEFAULT_TABLE table=default.Table_e8caf345c40647388db061fb73564023 [id=d748e93415534c1a8dd9b4f77d38bfbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.964057 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c8babe6f5e74fe8ad79c786473ac931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.964323 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_74beb80739aa41539ec16812dd37761c" } new_table_name: "default.Table_3a84b286650f4796b164a959aeff7923" modify_external_catalogs: true
W20260927 15:06:23.973650 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 180c347e066f4d9a897825bad8a32d69 consensus state has no leader
W20260927 15:06:23.974404 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e808a583f8c74d8a80ec173eae69f2cc consensus state has no leader
I20260927 15:06:23.974668 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8034812bd8b44d97bc63b7d65b8f83d1
I20260927 15:06:23.975180 911 catalog_manager.cc:6565] ReplaceTablet: tablet 8034812bd8b44d97bc63b7d65b8f83d1 deleted and replaced by tablet 084cf0ba45e647d7893a24c0d779f78a
I20260927 15:06:23.976652 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 8034812bd8b44d97bc63b7d65b8f83d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 084cf0ba45e647d7893a24c0d779f78a) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:23.980367 1561 tablet_bootstrap.cc:492] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:23.986217 1413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c979537c24c64f31932aa6beed8347e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.986490 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c4dd12d29bc04a84822989fcb7fd5c27" } modify_external_catalogs: true
I20260927 15:06:23.986682 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c4dd12d29bc04a84822989fcb7fd5c27" } modify_external_catalogs: true
I20260927 15:06:23.986943 1561 ts_tablet_manager.cc:1397] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.253s user 0.011s sys 0.028s
I20260927 15:06:23.990049 1561 raft_consensus.cc:348] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.993472 1561 raft_consensus.cc:374] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:23.993729 1561 raft_consensus.cc:729] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:23.995833 1561 consensus_queue.cc:260] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:23.997035 1403 tablet_service.cc:1467] Processing CreateTablet for tablet cd508c73859c4f4ea316c7d08e73db63 (DEFAULT_TABLE table=default.Table_ac0b4bfd2a9c4193b4006e1d124bfa1b [id=337127b6dffa42c994d6b2c9a4737ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.997484 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd508c73859c4f4ea316c7d08e73db63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.998075 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ba3bdf50b14aec85a99742426e9298" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:23.999445 1300 raft_consensus.cc:3037] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:23.999831 1102 consensus_peers.cc:487] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:24.000025 1102 leader_election.cc:341] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:24.000284 1102 leader_election.cc:341] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:24.000447 1102 consensus_peers.cc:487] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:24.000380 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 9de29ca570b74c52a1a7f22fdcc4b185 (DEFAULT_TABLE table=default.Table_d4a1038521b54049ad08293502431f1e [id=ead91e52309441b49122a3f161cd1256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.000731 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de29ca570b74c52a1a7f22fdcc4b185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.003110 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet decee14b5d7a4aef9989051dcaeb5a7b
I20260927 15:06:24.003852 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1b5c4193626947399ca6e784e8e68b27" } modify_external_catalogs: true
I20260927 15:06:24.003803 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f5a8babbf25c4a88865463b6d4178ac0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.003975 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1b5c4193626947399ca6e784e8e68b27" } modify_external_catalogs: true
W20260927 15:06:24.004340 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5a8babbf25c4a88865463b6d4178ac0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.004412 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dc3aebebe1c247758fe1662d344f0ab7" } modify_external_catalogs: true
I20260927 15:06:24.004549 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dc3aebebe1c247758fe1662d344f0ab7" } modify_external_catalogs: true
I20260927 15:06:24.006402 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet decee14b5d7a4aef9989051dcaeb5a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.005339 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_16300d973fed4a26a7baa92b0de64def" } new_table_name: "default.Table_0e9c3d26fe564af7b61f6cdf7317d97a" modify_external_catalogs: true
W20260927 15:06:24.010501 1102 consensus_peers.cc:487] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:24.018319 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b26f0d253a7f4df780a1f91ceb7d82b8 consensus state has no leader
I20260927 15:06:24.020002 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 0e3a61df17ad4682ab34bbf6e9ae8010 (DEFAULT_TABLE table=default.Table_525948009d514445be28f583ecc833d5 [id=982b45e545c54af49a209821c1e3638e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.020622 1404 tablet_service.cc:1467] Processing CreateTablet for tablet c5ae86a2467048b4868af383b532f356 (DEFAULT_TABLE table=default.Table_653ad280559f40a4b498dc5c94535595 [id=900b277df9db40848c61087f96a163e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.021991 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_73cee218630c48adb25b948ee481b5ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.022588 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73cee218630c48adb25b948ee481b5ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.025549 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_12dc0dafae0d4a02b4577d258244750a" } modify_external_catalogs: true
I20260927 15:06:24.025761 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_12dc0dafae0d4a02b4577d258244750a" } modify_external_catalogs: true
I20260927 15:06:24.027115 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_723d8087a23648db9fb6a3ec2057a0d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.027560 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_723d8087a23648db9fb6a3ec2057a0d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.034219 1432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2ba3bdf50b14aec85a99742426e9298" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:24.036870 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a1245949d6d04b80aaa4ff762ae2378f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.037318 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1245949d6d04b80aaa4ff762ae2378f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.038897 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e3a61df17ad4682ab34bbf6e9ae8010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.039322 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f7fc5c58ba38473fb7c455c7f70df51b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.039774 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7fc5c58ba38473fb7c455c7f70df51b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.042469 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1e1f79806e5f47c2bf23aa1ff20b5ec4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.042999 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e1f79806e5f47c2bf23aa1ff20b5ec4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.044528 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ed147abba8034b5091bdb534333b0f85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.045073 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed147abba8034b5091bdb534333b0f85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.045312 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 12f6403cde734c1394aabfc92c093290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.045707 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet b2d2501a9f764790818426665e7f0340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.044528 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_826c1efeddc74a17ad2db271286974ac" } new_table_name: "default.Table_a7eb534e289543168d49435edd522753" modify_external_catalogs: true
I20260927 15:06:24.047137 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 171ba98418b34aa283b7a7b243678fa9 with delete_type TABLET_DATA_DELETED (replaced by tablet 28feaad311b14ea58144fc1417826186) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.048225 1403 tablet_service.cc:1467] Processing CreateTablet for tablet fbbf08cdf14a4b0aa725af2c840070f2 (DEFAULT_TABLE table=default.Table_fadb670c1dd2403fa66f5b718023dfd8 [id=4baac753bdaf4fffaa9d8c8c1b67548e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.048954 1561 ts_tablet_manager.cc:1428] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.060s user 0.001s sys 0.001s
I20260927 15:06:24.050312 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_db7331205e7f4b2f8b1e833b7ee59616" } modify_external_catalogs: true
I20260927 15:06:24.050493 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_db7331205e7f4b2f8b1e833b7ee59616" } modify_external_catalogs: true
I20260927 15:06:24.052670 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9a7dfdd3e04b51a8a825980f37128e (DEFAULT_TABLE table=default.Table_ab5b7a803a4f4b56a397ddfcf0b541c1 [id=05e140e2fc8749f5b2dd9ffc39738e37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.054505 1561 tablet_bootstrap.cc:492] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:24.055259 1432 raft_consensus.cc:3037] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:24.056888 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5ae86a2467048b4868af383b532f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.059870 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ae5aa5d2625f49e08bee7bf4367028e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.059953 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7e8c06bda94cad8325c81578ce8421 (DEFAULT_TABLE table=default.Table_766da62d2f6e4daab98bca846d688515 [id=429539baf2a54a1aba8b2c3e7716dfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.060168 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_70a27f63944a4753a0b0f1ed37cb83c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.060355 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae5aa5d2625f49e08bee7bf4367028e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:24.060534 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70a27f63944a4753a0b0f1ed37cb83c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.061751 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 75aee73186104fedbafa5175721e2fda (DEFAULT_TABLE table=default.Table_616f100c38db4553831992c16c88809c [id=b0d5b81c43a94ca8b7162e54833e3dab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.064672 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a13b57205a8b490ab36e73f4b3140397" } new_table_name: "default.Table_1d5c40395c8d4d6cb534dd132800f7da" modify_external_catalogs: true
I20260927 15:06:24.067312 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75aee73186104fedbafa5175721e2fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.067564 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7e8c06bda94cad8325c81578ce8421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.067821 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d9a7dfdd3e04b51a8a825980f37128e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.068133 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1046) took 4897 ms. Trace:
I20260927 15:06:24.068269 1562 rpcz_store.cc:276] 0927 15:06:19.170343 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.170399 (+ 56us) service_pool.cc:227] Handling call
0927 15:06:23.751169 (+4580770us) ts_tablet_manager.cc:1145] Deleting tablet fd5f2ab9677c4598b0b8d9a93a6a23c7
0927 15:06:23.751506 (+ 337us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.902534 (+151028us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:23.905516 (+ 2982us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.068109 (+162593us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4580573}
I20260927 15:06:24.068535 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1f98a30d539142d0a9569a275a0692a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.068758 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 (table default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]) successfully deleted
W20260927 15:06:24.069130 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f98a30d539142d0a9569a275a0692a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.070256 1562 tablet_replica.cc:330] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:24.070528 1562 raft_consensus.cc:2229] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:24.070899 1562 raft_consensus.cc:2258] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.070858 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 8c71ea482f204c5f884f708db4ba4fdf (DEFAULT_TABLE table=default.Table_0a5ef9df79a8459a9a40b31713179aed [id=2368de7719fe4da68dd02692e327c981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.071547 1562 ts_tablet_manager.cc:1905] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:24.073539 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c71ea482f204c5f884f708db4ba4fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.074261 1420 tablet_service.cc:1467] Processing CreateTablet for tablet aa68e03d7d33434890fbc0075be1593d (DEFAULT_TABLE table=default.Table_afbe9ff64484483c8622302f8239c274 [id=0e0b535f11ff435b88a57402493ff2be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.074568 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa68e03d7d33434890fbc0075be1593d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.072338 1561 tablet_bootstrap.cc:654] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:24.081102 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24c2ad19ae734066a5914f6c95b192fd consensus state has no leader
I20260927 15:06:24.081343 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 581416f6c2cc434d8ee3ae1428d94f1c (DEFAULT_TABLE table=default.Table_3b979fe89b604e5bb269f000a48f04f5 [id=6f01999e4e714ac19496344ee4c19aaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.082389 1417 tablet_service.cc:1467] Processing CreateTablet for tablet c0a3bb7337a84d3f8353d7ef47723fde (DEFAULT_TABLE table=default.Table_51239a0c5e8d4e6db8ead49f4f9d291a [id=1a455f4e1abb4f898ce36d41e548578e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.082738 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0a3bb7337a84d3f8353d7ef47723fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.086913 1275 tablet_service.cc:1467] Processing CreateTablet for tablet 8d831ff2584a402182f80130eda4fc24 (DEFAULT_TABLE table=default.Table_eab1905b1d1a49b2af41750fd3ba225e [id=8d6690869fd1473d8c601b694daff6b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:23.895519 3138 raft_consensus.cc:504] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:24.088172 1561 tablet_bootstrap.cc:492] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:24.088290 1561 ts_tablet_manager.cc:1397] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20260927 15:06:24.088739 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d831ff2584a402182f80130eda4fc24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.089067 1561 raft_consensus.cc:348] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.089498 1266 tablet_service.cc:1467] Processing CreateTablet for tablet ece11a9f130c4a869cd9d775246b82ce (DEFAULT_TABLE table=default.Table_d49ae3f101fb45edb529b9404930cf1d [id=a9e6b7cb1e804aee8c9103f1b367fe9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.091377 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 38408dd02ac24febb130b5cb5f7fccb6 (DEFAULT_TABLE table=default.Table_881d734c76514d67aba45cce6f1aa4fb [id=08057bd33d054931919aa1616ca51df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.093341 1432 raft_consensus.cc:2454] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:24.095183 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 671eacb9cde9411c9abbf4273d697506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:23.937180 2119 rpcz_store.cc:276] 0927 15:06:21.660548 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.660588 (+ 40us) service_pool.cc:227] Handling call
0927 15:06:23.935363 (+2274775us) ts_tablet_manager.cc:1145] Deleting tablet 56f3c6a79b0e43769368693b493d73f1
0927 15:06:23.935485 (+ 122us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:23.936169 (+ 684us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2274623}
I20260927 15:06:24.098942 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1082) took 2438 ms. Trace:
I20260927 15:06:24.099050 2119 rpcz_store.cc:276] 0927 15:06:21.660439 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:21.662869 (+ 2430us) service_pool.cc:227] Handling call
0927 15:06:24.098769 (+2435900us) ts_tablet_manager.cc:1145] Deleting tablet 04483a489f254123a1ccd69667acb0b1
0927 15:06:24.098788 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.098922 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2435725}
I20260927 15:06:24.099416 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1112) took 2091 ms. Trace:
I20260927 15:06:24.099494 2119 rpcz_store.cc:276] 0927 15:06:22.008276 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.010514 (+ 2238us) service_pool.cc:227] Handling call
0927 15:06:24.099301 (+2088787us) ts_tablet_manager.cc:1145] Deleting tablet 4d4c717419864473b7cd47ece4ffd805
0927 15:06:24.099313 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.099399 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2088608}
I20260927 15:06:24.099799 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1113) took 2071 ms. Trace:
I20260927 15:06:24.099875 2119 rpcz_store.cc:276] 0927 15:06:22.028594 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.029279 (+ 685us) service_pool.cc:227] Handling call
0927 15:06:24.099702 (+2070423us) ts_tablet_manager.cc:1145] Deleting tablet 87b54364a63b48e9981463d1019dad59
0927 15:06:24.099712 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.099784 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2058973}
I20260927 15:06:24.102774 3138 leader_election.cc:288] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:24.103089 3138 raft_consensus.cc:482] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:24.103251 3138 raft_consensus.cc:504] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.104008 3138 leader_election.cc:288] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:24.104463 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ece11a9f130c4a869cd9d775246b82ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.104287 1282 tablet_service.cc:1467] Processing CreateTablet for tablet e46ce30693f64de6866d5466db692044 (DEFAULT_TABLE table=default.Table_a385512b84d24842bdcbff63148fc2dc [id=a1621be7b1844bd8a3fb9d6f45d90f3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.105397 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e46ce30693f64de6866d5466db692044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.102003 1295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba163e0f6164d65b09da684ee4872e0" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:24.111335 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 0e3a61df17ad4682ab34bbf6e9ae8010 (DEFAULT_TABLE table=default.Table_525948009d514445be28f583ecc833d5 [id=982b45e545c54af49a209821c1e3638e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.111363 1279 tablet_service.cc:1467] Processing CreateTablet for tablet c979537c24c64f31932aa6beed8347e7 (DEFAULT_TABLE table=default.Table_9e90adcb591248778787025fe8fc700b [id=0be4c4fbc16f47fd9aa0c63bc22c7fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.111702 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e3a61df17ad4682ab34bbf6e9ae8010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.119679 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c979537c24c64f31932aa6beed8347e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.121860 1556 tablet_bootstrap.cc:492] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:24.122045 1556 ts_tablet_manager.cc:1397] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.582s user 0.004s sys 0.007s
I20260927 15:06:24.122906 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1115) took 2054 ms. Trace:
I20260927 15:06:24.123044 2119 rpcz_store.cc:276] 0927 15:06:22.068168 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.068230 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:24.100097 (+2031867us) ts_tablet_manager.cc:1145] Deleting tablet bf2c20ff67ba49a588bcd755ca7c12d9
0927 15:06:24.100109 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.122878 (+ 22769us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2008137}
I20260927 15:06:24.123276 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 80dfdd852c674f60b47383c72fdf95f3 (DEFAULT_TABLE table=default.Table_42a4e7e8f5f9481282232f76d1eec254 [id=d12114e3a42d4177baeb1a97861287cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.123564 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1131) took 1461 ms. Trace:
I20260927 15:06:24.123677 2119 rpcz_store.cc:276] 0927 15:06:22.662597 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.674762 (+ 12165us) service_pool.cc:227] Handling call
0927 15:06:24.123410 (+1448648us) ts_tablet_manager.cc:1145] Deleting tablet ad445390e18245f68430c0590a378a91
0927 15:06:24.123429 (+ 19us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.123544 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1416538}
I20260927 15:06:24.124466 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1134) took 1382 ms. Trace:
I20260927 15:06:24.124608 2119 rpcz_store.cc:276] 0927 15:06:22.741474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.742296 (+ 822us) service_pool.cc:227] Handling call
0927 15:06:24.123888 (+1381592us) ts_tablet_manager.cc:1145] Deleting tablet d827f6a3a6834ecd86d8722b1f1e4444
0927 15:06:24.123899 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.123974 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381421}
I20260927 15:06:24.125018 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1133) took 1383 ms. Trace:
I20260927 15:06:24.125120 2119 rpcz_store.cc:276] 0927 15:06:22.741369 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.741859 (+ 490us) service_pool.cc:227] Handling call
0927 15:06:24.124888 (+1383029us) ts_tablet_manager.cc:1145] Deleting tablet a0152ed16fbe44c48e17c6bc34328df7
0927 15:06:24.124903 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.125000 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1377662}
I20260927 15:06:24.125427 2119 tablet_replica.cc:330] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:24.125674 2119 raft_consensus.cc:2229] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:24.125907 2119 raft_consensus.cc:2258] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.128154 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1d9562d917b74db9aa4a9678b9d32841
I20260927 15:06:24.130101 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbbf08cdf14a4b0aa725af2c840070f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.130937 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581416f6c2cc434d8ee3ae1428d94f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.131145 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80dfdd852c674f60b47383c72fdf95f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.131250 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8c2b6f278ef64476b1f4a1f1c69e45d1
I20260927 15:06:24.131624 2119 ts_tablet_manager.cc:1905] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:24.132251 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0617b596022e48e7a2913762ae39251e
I20260927 15:06:24.133080 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 04fe5b9e0d7747a185c1666664cb4378
I20260927 15:06:24.136164 1273 tablet_service.cc:1467] Processing CreateTablet for tablet c5ae86a2467048b4868af383b532f356 (DEFAULT_TABLE table=default.Table_653ad280559f40a4b498dc5c94535595 [id=900b277df9db40848c61087f96a163e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.136548 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5ae86a2467048b4868af383b532f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.138223 1281 tablet_service.cc:1467] Processing CreateTablet for tablet cd508c73859c4f4ea316c7d08e73db63 (DEFAULT_TABLE table=default.Table_ac0b4bfd2a9c4193b4006e1d124bfa1b [id=337127b6dffa42c994d6b2c9a4737ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.138622 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd508c73859c4f4ea316c7d08e73db63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.138978 1269 tablet_service.cc:1467] Processing CreateTablet for tablet fbbf08cdf14a4b0aa725af2c840070f2 (DEFAULT_TABLE table=default.Table_fadb670c1dd2403fa66f5b718023dfd8 [id=4baac753bdaf4fffaa9d8c8c1b67548e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.139333 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbbf08cdf14a4b0aa725af2c840070f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.139657 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7e8c06bda94cad8325c81578ce8421 (DEFAULT_TABLE table=default.Table_766da62d2f6e4daab98bca846d688515 [id=429539baf2a54a1aba8b2c3e7716dfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.140002 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7e8c06bda94cad8325c81578ce8421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.145931 1274 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9a7dfdd3e04b51a8a825980f37128e (DEFAULT_TABLE table=default.Table_ab5b7a803a4f4b56a397ddfcf0b541c1 [id=05e140e2fc8749f5b2dd9ffc39738e37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.146323 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d9a7dfdd3e04b51a8a825980f37128e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.148452 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 8c71ea482f204c5f884f708db4ba4fdf (DEFAULT_TABLE table=default.Table_0a5ef9df79a8459a9a40b31713179aed [id=2368de7719fe4da68dd02692e327c981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.148830 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c71ea482f204c5f884f708db4ba4fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.153085 911 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (table default.Table_9421c4a3c84e449ea9e86594f7342489 [id=239ff5a7776c4a469e14137b23b6544a]). Expected version 1 got 0
I20260927 15:06:24.164917 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38408dd02ac24febb130b5cb5f7fccb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.166278 1556 raft_consensus.cc:348] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.166493 1556 raft_consensus.cc:374] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:24.166538 1556 raft_consensus.cc:729] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:24.166695 1556 consensus_queue.cc:260] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.167160 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 8034812bd8b44d97bc63b7d65b8f83d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 084cf0ba45e647d7893a24c0d779f78a) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.167240 1556 ts_tablet_manager.cc:1428] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260927 15:06:24.167315 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet decee14b5d7a4aef9989051dcaeb5a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.167469 1556 tablet_bootstrap.cc:492] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:24.167728 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d9562d917b74db9aa4a9678b9d32841 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.167855 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.167951 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 0617b596022e48e7a2913762ae39251e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.168046 1410 tablet_service.cc:1514] Processing DeleteTablet for tablet 04fe5b9e0d7747a185c1666664cb4378 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.168684 1556 tablet_bootstrap.cc:654] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:24.170027 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 75aee73186104fedbafa5175721e2fda (DEFAULT_TABLE table=default.Table_616f100c38db4553831992c16c88809c [id=b0d5b81c43a94ca8b7162e54833e3dab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.170528 1284 tablet_service.cc:1467] Processing CreateTablet for tablet c0a3bb7337a84d3f8353d7ef47723fde (DEFAULT_TABLE table=default.Table_51239a0c5e8d4e6db8ead49f4f9d291a [id=1a455f4e1abb4f898ce36d41e548578e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.170894 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0a3bb7337a84d3f8353d7ef47723fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.171451 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 581416f6c2cc434d8ee3ae1428d94f1c (DEFAULT_TABLE table=default.Table_3b979fe89b604e5bb269f000a48f04f5 [id=6f01999e4e714ac19496344ee4c19aaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.171866 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 581416f6c2cc434d8ee3ae1428d94f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.172248 1276 tablet_service.cc:1467] Processing CreateTablet for tablet 38408dd02ac24febb130b5cb5f7fccb6 (DEFAULT_TABLE table=default.Table_881d734c76514d67aba45cce6f1aa4fb [id=08057bd33d054931919aa1616ca51df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.172621 1276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38408dd02ac24febb130b5cb5f7fccb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.175104 3214 raft_consensus.cc:482] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:24.175247 3214 raft_consensus.cc:504] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.175480 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_bd8ee120888747a5a5cf6623783c7562" } new_table_name: "default.Table_74fbe471d5eb4d269beb17d03c01cb10" modify_external_catalogs: true
I20260927 15:06:24.176249 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3a84b286650f4796b164a959aeff7923" } new_table_name: "default.Table_93ed425d39c042dda2f51d3a30b2f2c9" modify_external_catalogs: true
I20260927 15:06:24.177748 1279 tablet_service.cc:1467] Processing CreateTablet for tablet aa68e03d7d33434890fbc0075be1593d (DEFAULT_TABLE table=default.Table_afbe9ff64484483c8622302f8239c274 [id=0e0b535f11ff435b88a57402493ff2be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.178079 1279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa68e03d7d33434890fbc0075be1593d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.178867 3214 leader_election.cc:288] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:24.181190 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df186082f2ee46768b9a5d77f19f8e2e consensus state has no leader
I20260927 15:06:24.182963 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 80dfdd852c674f60b47383c72fdf95f3 (DEFAULT_TABLE table=default.Table_42a4e7e8f5f9481282232f76d1eec254 [id=d12114e3a42d4177baeb1a97861287cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.183256 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80dfdd852c674f60b47383c72fdf95f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.184054 1270 tablet_service.cc:1467] Processing CreateTablet for tablet d4416ab42f084a6892c76b7d2654e314 (DEFAULT_TABLE table=default.Table_5e6b229a59aa4dd2827c0eb9629b5d2c [id=dd0ba280ca0344edac1f9a4d239d72e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.184342 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4416ab42f084a6892c76b7d2654e314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.186273 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 9de29ca570b74c52a1a7f22fdcc4b185 (DEFAULT_TABLE table=default.Table_d4a1038521b54049ad08293502431f1e [id=ead91e52309441b49122a3f161cd1256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.186558 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de29ca570b74c52a1a7f22fdcc4b185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.187021 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 9de29ca570b74c52a1a7f22fdcc4b185 (DEFAULT_TABLE table=default.Table_d4a1038521b54049ad08293502431f1e [id=ead91e52309441b49122a3f161cd1256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.187371 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de29ca570b74c52a1a7f22fdcc4b185. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:24.190747 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e808a583f8c74d8a80ec173eae69f2cc consensus state has no leader
I20260927 15:06:24.193349 1407 tablet_service.cc:1467] Processing CreateTablet for tablet d4416ab42f084a6892c76b7d2654e314 (DEFAULT_TABLE table=default.Table_5e6b229a59aa4dd2827c0eb9629b5d2c [id=dd0ba280ca0344edac1f9a4d239d72e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.193958 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4416ab42f084a6892c76b7d2654e314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.195250 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 4c8babe6f5e74fe8ad79c786473ac931 (DEFAULT_TABLE table=default.Table_e8caf345c40647388db061fb73564023 [id=d748e93415534c1a8dd9b4f77d38bfbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.199571 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c8babe6f5e74fe8ad79c786473ac931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.199250 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 8034812bd8b44d97bc63b7d65b8f83d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 084cf0ba45e647d7893a24c0d779f78a) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.200700 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet decee14b5d7a4aef9989051dcaeb5a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.200943 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d9562d917b74db9aa4a9678b9d32841 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.201121 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.203164 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75aee73186104fedbafa5175721e2fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.093775 1099 leader_election.cc:302] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:24.102555 1102 consensus_peers.cc:487] T af25950fd08043f18a6eaaf46ded4378 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:24.208252 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 105738us
W20260927 15:06:24.208388 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 114638us
W20260927 15:06:24.208873 1102 leader_election.cc:341] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.208978 3149 raft_consensus.cc:2781] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:24.209002 1102 leader_election.cc:302] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:24.103124 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568ba79ea795403cba76fb6632efd7e2" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:24.209276 1164 raft_consensus.cc:3037] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:24.210284 3148 raft_consensus.cc:2726] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:24.212154 1164 raft_consensus.cc:2454] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:24.212390 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f65acfcfe19494fbe821f1f1d5415b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.104578 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6bef5f000441090f73eb842450362" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:24.213809 1166 raft_consensus.cc:2454] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:24.213913 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f189d9738b5f4830bd6b915aac52b785"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.129848 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d9562d917b74db9aa4a9678b9d32841 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:24.214457 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f189d9738b5f4830bd6b915aac52b785 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.132408 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.133270 1146 tablet_service.cc:1514] Processing DeleteTablet for tablet 0617b596022e48e7a2913762ae39251e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.134114 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 04fe5b9e0d7747a185c1666664cb4378 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.180191 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12f6403cde734c1394aabfc92c093290" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:24.214798 1161 raft_consensus.cc:2454] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:24.216979 1374 leader_election.cc:302] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:24.217329 3214 raft_consensus.cc:2781] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:24.217410 3214 raft_consensus.cc:482] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:24.217486 3214 raft_consensus.cc:3037] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:24.218993 1239 leader_election.cc:302] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:24.219076 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 4c8babe6f5e74fe8ad79c786473ac931 (DEFAULT_TABLE table=default.Table_e8caf345c40647388db061fb73564023 [id=d748e93415534c1a8dd9b4f77d38bfbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.219285 1239 leader_election.cc:302] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:24.219528 3138 raft_consensus.cc:2781] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:24.219604 3138 raft_consensus.cc:482] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:24.219678 3138 raft_consensus.cc:3037] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:24.220593 3223 raft_consensus.cc:2781] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:24.220779 3223 raft_consensus.cc:686] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:24.221115 3223 consensus_queue.cc:237] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:24.222954 1141 tablet_service.cc:1467] Processing CreateTablet for tablet bbc4e34624894aac9a185aacb563216f (DEFAULT_TABLE table=default.Table_2f7eb13bbf1d470f9b516fa89311eb68 [id=f2ccc5bbad46419bab1518f04bb879c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.223220 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4e10fab03983407786ee13b92602fb52" } new_table_name: "default.Table_184ab2f33372446a8f36f2a4c6687c6b" modify_external_catalogs: true
I20260927 15:06:24.227217 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 53e22a7e5a1d4282ab4e901542dac2de (DEFAULT_TABLE table=default.Table_ab3440adf5ea4156a2259aed40ff1db8 [id=f143513338714584a4a521829a285240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.231988 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 0064aec39c4d4fea98f600536c44999e (DEFAULT_TABLE table=default.Table_812e7ef245f6471f891fce0cb1b2efdc [id=996c26fe98b5442487a76079950123d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.234467 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fbd12309639f4a0f9016d062cc94c910"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.235199 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbd12309639f4a0f9016d062cc94c910 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.237370 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_382bd6f970f646b1ab7b6f695f39a80f" } modify_external_catalogs: true
I20260927 15:06:24.237550 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_382bd6f970f646b1ab7b6f695f39a80f" } modify_external_catalogs: true
I20260927 15:06:24.237692 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5528261ab72441bc9dfacac538a82f90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.238118 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5528261ab72441bc9dfacac538a82f90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:24.242702 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49f6f839939042838a24e234a21eacb6 consensus state has no leader
I20260927 15:06:24.243153 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 6147c8de7e2e447c94bbbc1053ee2b57 (DEFAULT_TABLE table=default.Table_1f39a648b6374960b2afb9fca519938a [id=41f0bca44e7f41048b979468df1693c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.246932 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 8985827c04bb4175bccf32111c5c45a9 (DEFAULT_TABLE table=default.Table_51bee0b9728a4d70b9f61fe1cb39f4c5 [id=537c66c019c34f2882d3c328fc44743a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.249799 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ba42f1c2016249e995e8968ee3a91c1a
I20260927 15:06:24.250936 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet ba42f1c2016249e995e8968ee3a91c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.253159 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 0d00ffcb6d49480ba78df3094f7b2e0f (DEFAULT_TABLE table=default.Table_db5c6a9f297841d4ba1c1c50e0450d20 [id=4dad84d38e49460fbe59258be31646df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.256788 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 4443d7dc02f34891a8fe6d5be986252e (DEFAULT_TABLE table=default.Table_b6f5a16e230c47b0bf30927e7d65089f [id=f9e933449a5f4807a308814cde96469b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.261103 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 36fd3460440f4403b3e33951f515bb7f (DEFAULT_TABLE table=default.Table_a048688bb36f4b2899e026be85424bd5 [id=27106700d470431e95b0b7b183df6241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.262707 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet a97f72ddef5346c297d73589e926260c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.265143 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0b53e259ee1c4a8e976aaf01c97b0b33" } new_table_name: "default.Table_06f1472df46047f2907992c78e0a8255" modify_external_catalogs: true
I20260927 15:06:24.271425 1561 raft_consensus.cc:374] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:24.271526 1561 raft_consensus.cc:729] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:24.271818 1561 consensus_queue.cc:260] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.272403 1561 ts_tablet_manager.cc:1428] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.184s user 0.002s sys 0.000s
I20260927 15:06:24.275072 1276 tablet_service.cc:1514] Processing DeleteTablet for tablet 04fe5b9e0d7747a185c1666664cb4378 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.275561 1268 tablet_service.cc:1467] Processing CreateTablet for tablet bbc4e34624894aac9a185aacb563216f (DEFAULT_TABLE table=default.Table_2f7eb13bbf1d470f9b516fa89311eb68 [id=f2ccc5bbad46419bab1518f04bb879c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.276021 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbc4e34624894aac9a185aacb563216f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.278393 1562 ts_tablet_manager.cc:1918] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:24.278487 1562 log.cc:1196] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/429088342b4743c39fb1e38d235024de
I20260927 15:06:24.279114 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 53e22a7e5a1d4282ab4e901542dac2de (DEFAULT_TABLE table=default.Table_ab3440adf5ea4156a2259aed40ff1db8 [id=f143513338714584a4a521829a285240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.279565 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53e22a7e5a1d4282ab4e901542dac2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.281658 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e19deccfb7dc44078fcf98a1e21b17b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.281883 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b66c74413fe44a7e8496cda55f74553b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.282196 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e19deccfb7dc44078fcf98a1e21b17b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:24.282462 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b66c74413fe44a7e8496cda55f74553b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.283011 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_187050ab0a8942c5ae6a320d92c0fc8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.283466 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_187050ab0a8942c5ae6a320d92c0fc8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.284482 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_70d475b134d141fe82c809e821292681"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.284691 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ab3440adf5ea4156a2259aed40ff1db8" } new_table_name: "default.Table_dcd9af74989a47d68e624f28fa3b265e" modify_external_catalogs: true
W20260927 15:06:24.284873 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70d475b134d141fe82c809e821292681 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.285787 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bc258b071781424b96bf06deca6719b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.286296 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc258b071781424b96bf06deca6719b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.287417 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7cf889c98d404ae3a154e409b954e1b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.287818 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cf889c98d404ae3a154e409b954e1b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.290990 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 4443d7dc02f34891a8fe6d5be986252e (DEFAULT_TABLE table=default.Table_b6f5a16e230c47b0bf30927e7d65089f [id=f9e933449a5f4807a308814cde96469b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.291572 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 6147c8de7e2e447c94bbbc1053ee2b57 (DEFAULT_TABLE table=default.Table_1f39a648b6374960b2afb9fca519938a [id=41f0bca44e7f41048b979468df1693c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.291659 1282 tablet_service.cc:1514] Processing DeleteTablet for tablet 0617b596022e48e7a2913762ae39251e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.292076 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 0064aec39c4d4fea98f600536c44999e (DEFAULT_TABLE table=default.Table_812e7ef245f6471f891fce0cb1b2efdc [id=996c26fe98b5442487a76079950123d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.292547 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 53e22a7e5a1d4282ab4e901542dac2de (DEFAULT_TABLE table=default.Table_ab3440adf5ea4156a2259aed40ff1db8 [id=f143513338714584a4a521829a285240]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:24.296556 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2b5f866646d4da9a0d0881a3bf6bd83 consensus state has no leader
I20260927 15:06:24.300621 3138 raft_consensus.cc:504] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.301275 3138 leader_election.cc:288] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:24.304773 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53e22a7e5a1d4282ab4e901542dac2de consensus state has no leader
I20260927 15:06:24.307327 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6bef5f000441090f73eb842450362" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:24.307525 1161 raft_consensus.cc:3037] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:24.309615 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 0064aec39c4d4fea98f600536c44999e (DEFAULT_TABLE table=default.Table_812e7ef245f6471f891fce0cb1b2efdc [id=996c26fe98b5442487a76079950123d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.309962 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0064aec39c4d4fea98f600536c44999e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.310250 1161 raft_consensus.cc:2454] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:24.310704 1239 leader_election.cc:302] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:24.312570 3138 raft_consensus.cc:2781] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:24.312678 3138 raft_consensus.cc:686] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:24.312866 3138 consensus_queue.cc:237] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.313570 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6a02199b3e1e42b19095921cdb387890"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.314079 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a02199b3e1e42b19095921cdb387890 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:24.266960 1304 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.789s user 0.001s sys 0.020s
W20260927 15:06:24.314779 1304 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.837s user 0.001s sys 0.020s
I20260927 15:06:24.316058 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbc4e34624894aac9a185aacb563216f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.319056 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53e22a7e5a1d4282ab4e901542dac2de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:24.319702 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 110836us
I20260927 15:06:24.322757 1404 tablet_service.cc:1467] Processing CreateTablet for tablet 29e7f363678a4026ae124b2f939d59c0 (DEFAULT_TABLE table=default.Table_3d792d3d9dea4547ab9154b89a6e27bf [id=7c3f14c51f8e471f941499ba054cd3e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.323065 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0064aec39c4d4fea98f600536c44999e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.327044 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6147c8de7e2e447c94bbbc1053ee2b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.327266 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d00ffcb6d49480ba78df3094f7b2e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.329643 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 29e7f363678a4026ae124b2f939d59c0 (DEFAULT_TABLE table=default.Table_3d792d3d9dea4547ab9154b89a6e27bf [id=7c3f14c51f8e471f941499ba054cd3e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.329936 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e7f363678a4026ae124b2f939d59c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:24.330343 1102 consensus_peers.cc:487] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:24.331048 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4443d7dc02f34891a8fe6d5be986252e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.335052 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36fd3460440f4403b3e33951f515bb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.335808 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 0d00ffcb6d49480ba78df3094f7b2e0f (DEFAULT_TABLE table=default.Table_db5c6a9f297841d4ba1c1c50e0450d20 [id=4dad84d38e49460fbe59258be31646df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.335959 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 8985827c04bb4175bccf32111c5c45a9 (DEFAULT_TABLE table=default.Table_51bee0b9728a4d70b9f61fe1cb39f4c5 [id=537c66c019c34f2882d3c328fc44743a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.336166 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d00ffcb6d49480ba78df3094f7b2e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.336472 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet ba42f1c2016249e995e8968ee3a91c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.337014 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 6147c8de7e2e447c94bbbc1053ee2b57 (DEFAULT_TABLE table=default.Table_1f39a648b6374960b2afb9fca519938a [id=41f0bca44e7f41048b979468df1693c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.338111 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_18fc1dad83b24245966b3502992719e8" } modify_external_catalogs: true
I20260927 15:06:24.338313 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_18fc1dad83b24245966b3502992719e8" } modify_external_catalogs: true
W20260927 15:06:24.337034 1102 consensus_peers.cc:487] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:24.339368 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1a39199f87b749d292c7fd5ee7e3f601" } modify_external_catalogs: true
I20260927 15:06:24.339520 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1a39199f87b749d292c7fd5ee7e3f601" } modify_external_catalogs: true
I20260927 15:06:24.339644 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b7e58750e9a481cab2abf34e5753a5e" } modify_external_catalogs: true
I20260927 15:06:24.339789 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b7e58750e9a481cab2abf34e5753a5e" } modify_external_catalogs: true
I20260927 15:06:24.340907 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_452ab25734dc4aa9a28e08f23eb0d502" } modify_external_catalogs: true
I20260927 15:06:24.341043 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_452ab25734dc4aa9a28e08f23eb0d502" } modify_external_catalogs: true
I20260927 15:06:24.341475 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8985827c04bb4175bccf32111c5c45a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.342901 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 4443d7dc02f34891a8fe6d5be986252e (DEFAULT_TABLE table=default.Table_b6f5a16e230c47b0bf30927e7d65089f [id=f9e933449a5f4807a308814cde96469b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.345369 3234 raft_consensus.cc:482] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:24.347544 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c8babe6f5e74fe8ad79c786473ac931. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.347782 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e7f363678a4026ae124b2f939d59c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.347962 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0064aec39c4d4fea98f600536c44999e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:24.346724 1291 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s user 0.021s sys 0.056s
I20260927 15:06:24.348757 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ec3d823781234015aa8a48421a23bbd2
I20260927 15:06:24.346287 3234 raft_consensus.cc:504] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:24.349225 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4443d7dc02f34891a8fe6d5be986252e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:24.349049 1291 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s user 0.021s sys 0.056s
I20260927 15:06:24.349896 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6147c8de7e2e447c94bbbc1053ee2b57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.352896 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 36fd3460440f4403b3e33951f515bb7f (DEFAULT_TABLE table=default.Table_a048688bb36f4b2899e026be85424bd5 [id=27106700d470431e95b0b7b183df6241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.353821 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53e22a7e5a1d4282ab4e901542dac2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.354064 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fb8e95f350f249ac85c5df42afe4a90d
I20260927 15:06:24.354346 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet ec3d823781234015aa8a48421a23bbd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.355443 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet fb8e95f350f249ac85c5df42afe4a90d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.356190 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet db09498a395b4570a34d32fbfc71e8ed
I20260927 15:06:24.356984 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 45fbe474949344348cd2db98b75d4916
I20260927 15:06:24.364014 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 3efc44686be2407cbcdca61909301539 (table default.Table_90059eaac20f42eead7d864d2e91a12e [id=20050d0c476441cc882540df66f162fb]) successfully deleted
I20260927 15:06:24.364334 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8985827c04bb4175bccf32111c5c45a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:24.364329 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 56f3c6a79b0e43769368693b493d73f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56f3c6a79b0e43769368693b493d73f1 already in progress: creating tablet
I20260927 15:06:24.364522 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4443d7dc02f34891a8fe6d5be986252e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:24.364529 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 04483a489f254123a1ccd69667acb0b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04483a489f254123a1ccd69667acb0b1 already in progress: creating tablet
W20260927 15:06:24.364770 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 87b54364a63b48e9981463d1019dad59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87b54364a63b48e9981463d1019dad59 already in progress: creating tablet
W20260927 15:06:24.364923 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bf2c20ff67ba49a588bcd755ca7c12d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf2c20ff67ba49a588bcd755ca7c12d9 already in progress: creating tablet
I20260927 15:06:24.365012 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6147c8de7e2e447c94bbbc1053ee2b57. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:24.365079 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ad445390e18245f68430c0590a378a91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad445390e18245f68430c0590a378a91 already in progress: creating tablet
W20260927 15:06:24.365250 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet d827f6a3a6834ecd86d8722b1f1e4444 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d827f6a3a6834ecd86d8722b1f1e4444 already in progress: creating tablet
I20260927 15:06:24.365222 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 29e7f363678a4026ae124b2f939d59c0 (DEFAULT_TABLE table=default.Table_3d792d3d9dea4547ab9154b89a6e27bf [id=7c3f14c51f8e471f941499ba054cd3e6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:24.365387 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a0152ed16fbe44c48e17c6bc34328df7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0152ed16fbe44c48e17c6bc34328df7 already in progress: creating tablet
I20260927 15:06:24.365536 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e7f363678a4026ae124b2f939d59c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.365785 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36fd3460440f4403b3e33951f515bb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.366344 1561 tablet_bootstrap.cc:492] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:24.367151 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet ec3d823781234015aa8a48421a23bbd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.367302 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet fb8e95f350f249ac85c5df42afe4a90d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.370297 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet ec3d823781234015aa8a48421a23bbd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.371295 3149 raft_consensus.cc:686] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:24.371523 3149 consensus_queue.cc:237] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.372450 1270 tablet_service.cc:1467] Processing CreateTablet for tablet e252293656d44b4cb364dc9ca1bf7a83 (DEFAULT_TABLE table=default.Table_cb1085ae25974c8e995da51377c70d9c [id=29440dde571f4952b82fcfdb477082ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.372849 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e252293656d44b4cb364dc9ca1bf7a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.382391 1272 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fbe474949344348cd2db98b75d4916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.382521 1274 tablet_service.cc:1514] Processing DeleteTablet for tablet db09498a395b4570a34d32fbfc71e8ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.384418 2119 ts_tablet_manager.cc:1918] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:24.384553 2119 log.cc:1196] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/c264c532db8249e5abe1dbef8ee8ffa0
I20260927 15:06:24.388164 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5d152fad078948fb9fbf120a0c415c6d" } new_table_name: "default.Table_35e8edba758e42ba888cef500b2e714a" modify_external_catalogs: true
I20260927 15:06:24.392206 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8ba96fdd979f408489e269fdd20a3ddb" } new_table_name: "default.Table_69229b4961634f1398fed24cd84ce919" modify_external_catalogs: true
W20260927 15:06:24.393803 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42ffbde9f20d4e86a6c01713f396a67a consensus state has no leader
W20260927 15:06:24.397884 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0feb5ba11c943b0a1e97e493ddcb9e2 consensus state has no leader
I20260927 15:06:24.384826 1280 tablet_service.cc:1514] Processing DeleteTablet for tablet fb8e95f350f249ac85c5df42afe4a90d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.402648 2119 ts_tablet_manager.cc:1939] T c264c532db8249e5abe1dbef8ee8ffa0 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:24.403076 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1132) took 1674 ms. Trace:
I20260927 15:06:24.403167 2119 rpcz_store.cc:276] 0927 15:06:22.728148 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.752284 (+ 24136us) service_pool.cc:227] Handling call
0927 15:06:24.125373 (+1373089us) ts_tablet_manager.cc:1145] Deleting tablet c264c532db8249e5abe1dbef8ee8ffa0
0927 15:06:24.125386 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.368760 (+243374us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.384338 (+ 15578us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.403058 (+ 18720us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1372859}
I20260927 15:06:24.403618 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1135) took 1551 ms. Trace:
I20260927 15:06:24.403699 2119 rpcz_store.cc:276] 0927 15:06:22.852017 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:22.852093 (+ 76us) service_pool.cc:227] Handling call
0927 15:06:24.403493 (+1551400us) ts_tablet_manager.cc:1145] Deleting tablet fa143466f2bd4185887d6ccfcbbe8dd8
0927 15:06:24.403503 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.403602 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1551209}
I20260927 15:06:24.403965 2119 tablet_replica.cc:330] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:24.404151 2119 raft_consensus.cc:2229] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:24.404292 2119 raft_consensus.cc:2258] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.404814 2119 ts_tablet_manager.cc:1905] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:24.405922 1295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12f6403cde734c1394aabfc92c093290" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:24.406682 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet c264c532db8249e5abe1dbef8ee8ffa0 (table default.Table_5a81a62189ec499e91de04c9b60d73b5 [id=63fa9c7455a147acac68561c09363d69]) successfully deleted
W20260927 15:06:24.406955 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet fa143466f2bd4185887d6ccfcbbe8dd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa143466f2bd4185887d6ccfcbbe8dd8 already in progress: creating tablet
I20260927 15:06:24.413609 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 8985827c04bb4175bccf32111c5c45a9 (DEFAULT_TABLE table=default.Table_51bee0b9728a4d70b9f61fe1cb39f4c5 [id=537c66c019c34f2882d3c328fc44743a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.414132 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8985827c04bb4175bccf32111c5c45a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.414744 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet ba42f1c2016249e995e8968ee3a91c1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.418586 1404 tablet_service.cc:1467] Processing CreateTablet for tablet e252293656d44b4cb364dc9ca1bf7a83 (DEFAULT_TABLE table=default.Table_cb1085ae25974c8e995da51377c70d9c [id=29440dde571f4952b82fcfdb477082ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.419060 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e252293656d44b4cb364dc9ca1bf7a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.422077 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 36fd3460440f4403b3e33951f515bb7f (DEFAULT_TABLE table=default.Table_a048688bb36f4b2899e026be85424bd5 [id=27106700d470431e95b0b7b183df6241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.422416 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36fd3460440f4403b3e33951f515bb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.422678 1562 ts_tablet_manager.cc:1939] T 429088342b4743c39fb1e38d235024de P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:24.423348 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1047) took 5252 ms. Trace:
I20260927 15:06:24.423445 1562 rpcz_store.cc:276] 0927 15:06:19.170465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.170627 (+ 162us) service_pool.cc:227] Handling call
0927 15:06:24.069421 (+4898794us) ts_tablet_manager.cc:1145] Deleting tablet 429088342b4743c39fb1e38d235024de
0927 15:06:24.070221 (+ 800us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.274934 (+204713us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.278312 (+ 3378us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.423332 (+145020us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4898622}
I20260927 15:06:24.423952 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1048) took 5253 ms. Trace:
I20260927 15:06:24.424034 1562 rpcz_store.cc:276] 0927 15:06:19.170558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.170840 (+ 282us) service_pool.cc:227] Handling call
0927 15:06:24.423863 (+5253023us) ts_tablet_manager.cc:1145] Deleting tablet 9a7989e2b91044dab1d3e327958a051a
0927 15:06:24.423873 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.423935 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5252893}
I20260927 15:06:24.424271 1562 tablet_replica.cc:330] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:24.424589 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 0d00ffcb6d49480ba78df3094f7b2e0f (DEFAULT_TABLE table=default.Table_db5c6a9f297841d4ba1c1c50e0450d20 [id=4dad84d38e49460fbe59258be31646df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.424924 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d00ffcb6d49480ba78df3094f7b2e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.432518 1401 tablet_service.cc:1467] Processing CreateTablet for tablet bbc4e34624894aac9a185aacb563216f (DEFAULT_TABLE table=default.Table_2f7eb13bbf1d470f9b516fa89311eb68 [id=f2ccc5bbad46419bab1518f04bb879c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.433725 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbc4e34624894aac9a185aacb563216f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.440186 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet db09498a395b4570a34d32fbfc71e8ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.441586 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7a3f92ab32c24543a706b0bd262a2dc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.442232 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a3f92ab32c24543a706b0bd262a2dc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.442165 3214 raft_consensus.cc:504] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.442612 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fbe474949344348cd2db98b75d4916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.446905 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7ad6cbd2b08541d4974822f8b121d9c3" } new_table_name: "default.Table_ff65300415384e8d848db0d3d9ec9da7" modify_external_catalogs: true
I20260927 15:06:24.453454 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_41b0eed35d19455ba973069a70acbc64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.454005 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41b0eed35d19455ba973069a70acbc64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.454164 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7006597b352b41a3b4586f2af6d635ae" } modify_external_catalogs: true
I20260927 15:06:24.454329 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7006597b352b41a3b4586f2af6d635ae" } modify_external_catalogs: true
W20260927 15:06:24.456302 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ee5431ca9644fb9b4823f4387401d74 consensus state has no leader
I20260927 15:06:24.458122 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8a91020bbdf74fca974b5a6d451ea784"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.458544 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a91020bbdf74fca974b5a6d451ea784 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.459282 1304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.201.1:45331 (request call id 718) took 1053 ms. Trace:
I20260927 15:06:24.459376 1304 rpcz_store.cc:276] 0927 15:06:23.405783 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.405832 (+ 49us) service_pool.cc:227] Handling call
0927 15:06:23.405950 (+ 118us) raft_consensus.cc:1457] Updating replica for 1 ops
0927 15:06:23.408769 (+ 2819us) raft_consensus.cc:1520] Early marking committed up to index 0
0927 15:06:23.408774 (+ 5us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0927 15:06:23.408928 (+ 154us) log.cc:842] Serialized 26 byte log entry
0927 15:06:23.477795 (+ 68867us) raft_consensus.cc:1631] Marking committed up to 1
0927 15:06:24.315093 (+837298us) log.cc:842] Serialized 14 byte log entry
0927 15:06:24.456842 (+141749us) raft_consensus.cc:1683] Filling consensus response to leader.
0927 15:06:24.459198 (+ 2356us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0927 15:06:24.459210 (+ 12us) raft_consensus.cc:1671] finished
0927 15:06:24.459212 (+ 2us) raft_consensus.cc:1677] UpdateReplicas() finished
0927 15:06:24.459262 (+ 50us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":730770,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":21,"raft.queue_time_us":48731,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83,"thread_start_us":1047449,"threads_started":3,"wal-append.queue_time_us":67521}
I20260927 15:06:24.471650 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 723df898361144aeb16065868885d120
I20260927 15:06:24.475816 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 723df898361144aeb16065868885d120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.478150 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 723df898361144aeb16065868885d120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:24.484149 3234 leader_election.cc:288] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:24.495581 3214 leader_election.cc:288] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:24.495754 3214 raft_consensus.cc:482] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:24.495847 3214 raft_consensus.cc:504] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.496312 3214 leader_election.cc:288] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:24.499168 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_81f0d439c6f4400abf00d3fbfb715ee1" } new_table_name: "default.Table_749c50932d62431aae2a9328719b9e3b" modify_external_catalogs: true
I20260927 15:06:24.499584 3170 raft_consensus.cc:482] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:24.499715 3170 raft_consensus.cc:504] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.505327 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d2501a9f764790818426665e7f0340" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:24.505960 1102 leader_election.cc:341] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.506798 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12f6403cde734c1394aabfc92c093290" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:24.507021 1161 raft_consensus.cc:3037] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:24.507407 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71dcc9a493bb46399ac7e38afc2bfef0 consensus state has no leader
I20260927 15:06:24.507676 3171 raft_consensus.cc:482] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:24.507815 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 429088342b4743c39fb1e38d235024de (table default.Table_9a6330b2000f4bb5a7817b924f99ad53 [id=09a85e91664d444eab58b705a3be138d]) successfully deleted
W20260927 15:06:24.508054 899 catalog_manager.cc:4808] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9a7989e2b91044dab1d3e327958a051a because the tablet was not found. No further retry: Not found: Tablet not found: 9a7989e2b91044dab1d3e327958a051a
I20260927 15:06:24.510327 3170 leader_election.cc:288] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:24.507802 3171 raft_consensus.cc:504] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:24.514360 3171 leader_election.cc:288] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:24.517217 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_42a3d94c0b8941159390c7b63237c540"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.517274 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_919553c2f3764db79a9723eef628899d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.517897 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42a3d94c0b8941159390c7b63237c540 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.519065 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a1576e767b1042379532c20177c72f68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.514192 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97f72ddef5346c297d73589e926260c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:24.519586 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1576e767b1042379532c20177c72f68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.519690 1166 raft_consensus.cc:2454] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:24.520877 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c66d128c837e453d9ed283938dcc7449"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.521378 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c66d128c837e453d9ed283938dcc7449 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.522557 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_72023c794c384d78b2f120771a8d6e94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.523036 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72023c794c384d78b2f120771a8d6e94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.524497 1374 leader_election.cc:302] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
W20260927 15:06:24.517876 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_919553c2f3764db79a9723eef628899d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.529606 3214 raft_consensus.cc:2781] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:24.529716 3214 raft_consensus.cc:482] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:24.529795 3214 raft_consensus.cc:3037] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:24.530232 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b473384d24f249f3ae8bafb57472b121" } new_table_name: "default.Table_9d4b20907c524d09a90eea70b399d554" modify_external_catalogs: true
I20260927 15:06:24.532209 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a18d94cec70e4ebd817697122070733b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.532737 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a18d94cec70e4ebd817697122070733b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.534773 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3876e0af15fc4aa9bc1ea98a63734e89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.535396 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3876e0af15fc4aa9bc1ea98a63734e89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.542235 1561 tablet_bootstrap.cc:654] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:24.546178 1161 raft_consensus.cc:2454] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:24.546765 1374 leader_election.cc:302] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:24.554986 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_494cc901cfea41ac870c2ab69ac3d54b" } modify_external_catalogs: true
I20260927 15:06:24.555225 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_494cc901cfea41ac870c2ab69ac3d54b" } modify_external_catalogs: true
I20260927 15:06:24.557770 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet db09498a395b4570a34d32fbfc71e8ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:24.562954 3227 log.cc:924] Time spent T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20260927 15:06:24.564637 1556 tablet_bootstrap.cc:492] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:24.564788 1556 ts_tablet_manager.cc:1397] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.397s user 0.010s sys 0.019s
I20260927 15:06:24.565691 1556 raft_consensus.cc:348] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.565979 1556 raft_consensus.cc:374] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:24.566041 1556 raft_consensus.cc:729] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:24.566210 3167 ts_tablet_manager.cc:1918] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:24.566308 3167 log.cc:1196] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/171ba98418b34aa283b7a7b243678fa9
I20260927 15:06:24.566278 1556 consensus_queue.cc:260] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.566612 3167 ts_tablet_manager.cc:1939] T 171ba98418b34aa283b7a7b243678fa9 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:24.568167 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_02f2c729f727498b8942dc5b6ddcbf70" } modify_external_catalogs: true
I20260927 15:06:24.568065 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_928c6a3f3fcc44c2a6e5b11a7eea812b" } modify_external_catalogs: true
I20260927 15:06:24.568291 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_02f2c729f727498b8942dc5b6ddcbf70" } modify_external_catalogs: true
I20260927 15:06:24.568305 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_928c6a3f3fcc44c2a6e5b11a7eea812b" } modify_external_catalogs: true
I20260927 15:06:24.568118 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_28e8e636179842d8bc64b5a47b5a2ec5" } modify_external_catalogs: true
I20260927 15:06:24.569746 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_28e8e636179842d8bc64b5a47b5a2ec5" } modify_external_catalogs: true
I20260927 15:06:24.570513 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1250) took 1281 ms. Trace:
I20260927 15:06:24.570619 3167 rpcz_store.cc:276] 0927 15:06:23.288695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.288814 (+ 119us) service_pool.cc:227] Handling call
0927 15:06:23.552260 (+263446us) ts_tablet_manager.cc:1145] Deleting tablet 171ba98418b34aa283b7a7b243678fa9
0927 15:06:23.552269 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.088669 (+536400us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.566079 (+477410us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.570497 (+ 4418us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":263297}
I20260927 15:06:24.570998 3167 tablet_replica.cc:330] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:24.571111 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 171ba98418b34aa283b7a7b243678fa9 (table default.Table_0ddd6f86b89744419bea8584de27933c [id=66558f7d9e01442dba714f4d9cd27f0e]) successfully deleted
I20260927 15:06:24.571187 3167 raft_consensus.cc:2229] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:24.571319 3167 raft_consensus.cc:2258] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.573665 1562 raft_consensus.cc:2229] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:24.573977 1562 raft_consensus.cc:2258] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.580103 3167 ts_tablet_manager.cc:1905] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:24.584899 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 538a0577d6ce4898828aa0d1ea2a1c85 consensus state has no leader
I20260927 15:06:24.587283 1562 ts_tablet_manager.cc:1905] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:24.592856 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 723df898361144aeb16065868885d120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.593187 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 45fbe474949344348cd2db98b75d4916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:24.593647 3170 raft_consensus.cc:482] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:24.593787 3170 raft_consensus.cc:504] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.594447 3170 leader_election.cc:288] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:24.596496 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6aff014daf0b4f4486aca13d6a669f20" } new_table_name: "default.Table_dfa36e6768b6488a9fd9ecbe8802f376" modify_external_catalogs: true
I20260927 15:06:24.599427 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7d8a934f4d0446f898f867fac907a053" } new_table_name: "default.Table_09898ac5f1ae45a4a06f87dc82fe10c5" modify_external_catalogs: true
W20260927 15:06:24.594736 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 84843.7us
I20260927 15:06:24.602406 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "171ba98418b34aa283b7a7b243678fa9" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:24.604100 1144 tablet_service.cc:1467] Processing CreateTablet for tablet e252293656d44b4cb364dc9ca1bf7a83 (DEFAULT_TABLE table=default.Table_cb1085ae25974c8e995da51377c70d9c [id=29440dde571f4952b82fcfdb477082ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.606061 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e252293656d44b4cb364dc9ca1bf7a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.615732 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d4487cbbce24e60ae76ec0aca2760f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:24.619118 1099 leader_election.cc:341] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 63fbd388210d4a1aabfcf27c7533efbf
W20260927 15:06:24.619374 1099 leader_election.cc:341] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 171ba98418b34aa283b7a7b243678fa9
I20260927 15:06:24.619962 3173 consensus_queue.cc:1035] T 20d349cb04314c388e2f72b243c629ba P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:24.619383 3170 consensus_queue.cc:1035] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260927 15:06:24.624351 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9e357fa70ef4e15ba46f5fc12026e5a consensus state has no leader
W20260927 15:06:24.624517 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9acb4aeece7b4c448f8f2406535a631f consensus state has no leader
I20260927 15:06:24.627019 1432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d2501a9f764790818426665e7f0340" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:24.631222 3255 tablet.cc:1722] T 75645963963e4091af0edfcbc794fb2d P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:24.634930 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (table default.Table_9421c4a3c84e449ea9e86594f7342489 [id=239ff5a7776c4a469e14137b23b6544a]). Expected version 1 got 0
I20260927 15:06:24.640683 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d4487cbbce24e60ae76ec0aca2760f4" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:24.642052 3214 raft_consensus.cc:504] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:24.643222 1102 consensus_peers.cc:487] T c264c532db8249e5abe1dbef8ee8ffa0 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c264c532db8249e5abe1dbef8ee8ffa0. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:24.643486 1102 leader_election.cc:341] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.643589 1102 leader_election.cc:302] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:24.643801 3248 raft_consensus.cc:2726] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:24.644095 3214 leader_election.cc:288] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:24.644196 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97f72ddef5346c297d73589e926260c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:24.644371 3214 raft_consensus.cc:2781] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:24.644375 1164 raft_consensus.cc:3037] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:24.644472 3214 raft_consensus.cc:686] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:24.644697 3214 consensus_queue.cc:237] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:24.645147 1102 leader_election.cc:341] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.647138 1561 tablet_bootstrap.cc:492] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:24.647255 1561 ts_tablet_manager.cc:1397] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.281s user 0.008s sys 0.004s
I20260927 15:06:24.647883 1561 raft_consensus.cc:348] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.648062 1561 raft_consensus.cc:374] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:24.648113 1561 raft_consensus.cc:729] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:24.649263 1164 raft_consensus.cc:2454] T a97f72ddef5346c297d73589e926260c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:24.650207 1562 ts_tablet_manager.cc:1918] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:24.650457 1561 consensus_queue.cc:260] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.651192 1561 ts_tablet_manager.cc:1428] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:24.651329 1562 log.cc:1196] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/568ba79ea795403cba76fb6632efd7e2
I20260927 15:06:24.651729 1562 ts_tablet_manager.cc:1939] T 568ba79ea795403cba76fb6632efd7e2 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:24.652477 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1051) took 5481 ms. Trace:
I20260927 15:06:24.653115 1562 rpcz_store.cc:276] 0927 15:06:19.170925 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.170999 (+ 74us) service_pool.cc:227] Handling call
0927 15:06:24.424233 (+5253234us) ts_tablet_manager.cc:1145] Deleting tablet 568ba79ea795403cba76fb6632efd7e2
0927 15:06:24.424242 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.590911 (+166669us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.650121 (+ 59210us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.652460 (+ 2339us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":149043,"tablet-delete.queue_time_us":5253097}
I20260927 15:06:24.653831 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 568ba79ea795403cba76fb6632efd7e2 (table default.Table_c28d498257e24a9da0bd0a67c9e5a953 [id=f66d759455bb472e9ec7816c859d2811]) successfully deleted
I20260927 15:06:24.650657 1374 leader_election.cc:302] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:24.655620 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_036c6a31c1554c64b2d42d657c5a8dea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.656714 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_036c6a31c1554c64b2d42d657c5a8dea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:24.656816 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 240744us
W20260927 15:06:24.657541 1376 leader_election.cc:341] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.657696 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5712683f610a4b13a4581e60061c83b0" } new_table_name: "default.Table_dc6c7f72b1fc4149a867fefa9d1beed2" modify_external_catalogs: true
I20260927 15:06:24.659127 3210 raft_consensus.cc:2781] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:24.659247 3210 raft_consensus.cc:686] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:24.659183 3259 tablet.cc:1722] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:24.659523 3210 consensus_queue.cc:237] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.663043 3256 consensus_queue.cc:1035] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:06:24.666461 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c065746a11f42819334325a3a166d45 consensus state has no leader
I20260927 15:06:24.667413 3251 raft_consensus.cc:482] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:24.667670 3251 raft_consensus.cc:504] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.668515 3251 leader_election.cc:288] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:24.669556 1295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b911b7f278ce4e5f8946fe8381fd9ba7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:24.672207 1562 tablet_replica.cc:330] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:24.672873 1562 raft_consensus.cc:2229] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:24.673744 3167 ts_tablet_manager.cc:1918] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:24.673877 3167 log.cc:1196] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/b2d2501a9f764790818426665e7f0340
I20260927 15:06:24.673820 1562 raft_consensus.cc:2258] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.674069 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c946f1a657fc4cb492c7a26c19312a94" } modify_external_catalogs: true
I20260927 15:06:24.674276 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c946f1a657fc4cb492c7a26c19312a94" } modify_external_catalogs: true
W20260927 15:06:24.675062 1102 leader_election.cc:341] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.675374 1562 ts_tablet_manager.cc:1905] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:24.677629 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_429d443b5fb143fe98b4859408b4ee8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.674264 3167 ts_tablet_manager.cc:1939] T b2d2501a9f764790818426665e7f0340 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:24.678294 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_429d443b5fb143fe98b4859408b4ee8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.678632 1561 tablet_bootstrap.cc:492] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:24.680089 1561 tablet_bootstrap.cc:654] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:24.684793 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1249) took 1396 ms. Trace:
I20260927 15:06:24.684892 3167 rpcz_store.cc:276] 0927 15:06:23.288611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.289009 (+ 398us) service_pool.cc:227] Handling call
0927 15:06:24.570914 (+1281905us) ts_tablet_manager.cc:1145] Deleting tablet b2d2501a9f764790818426665e7f0340
0927 15:06:24.570925 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.670205 (+ 99280us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.673640 (+ 3435us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.684776 (+ 11136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1281760}
I20260927 15:06:24.686178 3167 tablet_replica.cc:330] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:24.687666 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet b2d2501a9f764790818426665e7f0340 (table default.Table_565f7d1851f74565b073c0e1c74d9403 [id=3305179f942c4133896ea7b9b1bc898b]) successfully deleted
I20260927 15:06:24.638012 1292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63fbd388210d4a1aabfcf27c7533efbf" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:24.695775 1102 leader_election.cc:341] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.695961 1102 leader_election.cc:302] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:24.696539 3150 raft_consensus.cc:2726] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:24.699627 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97f72ddef5346c297d73589e926260c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:24.700222 1292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a97f72ddef5346c297d73589e926260c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:24.699857 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12f6403cde734c1394aabfc92c093290" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:24.700287 1376 leader_election.cc:341] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:24.705607 1376 leader_election.cc:341] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.710341 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_921a441eef1349e181bf8edd1c83b96b" } new_table_name: "default.Table_71dcaaf9b80c40ccae29e0d8cdccc495" modify_external_catalogs: true
I20260927 15:06:24.711134 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_794e803c168b4dc5a020c370b62ddc2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.711783 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_794e803c168b4dc5a020c370b62ddc2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:24.718484 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3e75e26747f40a8b5f6ba37254516b3 consensus state has no leader
I20260927 15:06:24.720896 3259 tablet.cc:1722] T 75645963963e4091af0edfcbc794fb2d P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:24.727029 1561 tablet_bootstrap.cc:492] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:24.727458 1561 ts_tablet_manager.cc:1397] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.001s
I20260927 15:06:24.728317 1561 raft_consensus.cc:348] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.729597 1561 raft_consensus.cc:374] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:24.729877 1561 raft_consensus.cc:729] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:24.709621 1562 ts_tablet_manager.cc:1918] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:24.730316 1562 log.cc:1196] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/214229a8283b43c4916a5db7ba120e03
I20260927 15:06:24.730372 1552 tablet_bootstrap.cc:492] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:24.730515 1552 ts_tablet_manager.cc:1397] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 1.021s user 0.023s sys 0.014s
I20260927 15:06:24.731009 1562 ts_tablet_manager.cc:1939] T 214229a8283b43c4916a5db7ba120e03 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:24.732349 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1053) took 5561 ms. Trace:
I20260927 15:06:24.732615 1562 rpcz_store.cc:276] 0927 15:06:19.171108 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.171163 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:24.672159 (+5500996us) ts_tablet_manager.cc:1145] Deleting tablet 214229a8283b43c4916a5db7ba120e03
0927 15:06:24.672171 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.697238 (+ 25067us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.709514 (+ 12276us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.732333 (+ 22819us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5500871}
I20260927 15:06:24.733016 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b911b7f278ce4e5f8946fe8381fd9ba7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:24.733666 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 214229a8283b43c4916a5db7ba120e03 (table default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce [id=9b5989d83cc345ba90e2adfcc86f3925]) successfully deleted
W20260927 15:06:24.734256 1099 leader_election.cc:341] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: Tablet not RUNNING: STOPPED
I20260927 15:06:24.734370 1099 leader_election.cc:302] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:24.734995 1099 leader_election.cc:341] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9d4487cbbce24e60ae76ec0aca2760f4
I20260927 15:06:24.735110 1099 leader_election.cc:302] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:24.735635 1099 leader_election.cc:341] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.735725 1099 leader_election.cc:302] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:24.736119 3150 raft_consensus.cc:2726] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:24.736529 3251 raft_consensus.cc:2726] T 9d4487cbbce24e60ae76ec0aca2760f4 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:24.736620 3150 raft_consensus.cc:2726] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:24.731482 1561 consensus_queue.cc:260] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:24.737775 1561 ts_tablet_manager.cc:1428] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
W20260927 15:06:24.738960 1238 leader_election.cc:341] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 568ba79ea795403cba76fb6632efd7e2
I20260927 15:06:24.738811 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_98a757a95a984780a58b5621784bf721"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.739490 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98a757a95a984780a58b5621784bf721 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:24.742926 1376 leader_election.cc:341] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.744002 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0f659a8971134327870326b1abbd02ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.744606 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f659a8971134327870326b1abbd02ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.744004 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5aa7437a03474a359e81a00987b02ccf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.746668 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5aa7437a03474a359e81a00987b02ccf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:24.739248 1238 leader_election.cc:341] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 28f6bef5f000441090f73eb842450362
W20260927 15:06:24.747866 1238 leader_election.cc:341] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 28f6bef5f000441090f73eb842450362
W20260927 15:06:24.750216 1376 consensus_peers.cc:487] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:24.758440 1405 consensus_meta.cc:287] T e46ce30693f64de6866d5466db692044 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent flushing consensus metadata: real 0.705s user 0.022s sys 0.000s
I20260927 15:06:24.748859 1552 raft_consensus.cc:348] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:24.763027 1552 raft_consensus.cc:374] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:24.763132 1552 raft_consensus.cc:729] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:24.786715 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_66e6745812d34935870c1ccdcfe5a816"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.787338 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66e6745812d34935870c1ccdcfe5a816 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.787305 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_de0f24579fff4970bcb165b09f879d44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.787716 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de0f24579fff4970bcb165b09f879d44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.788741 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_881d734c76514d67aba45cce6f1aa4fb" } new_table_name: "default.Table_5694f90b806a404a92f70d0efd7d9383" modify_external_catalogs: true
I20260927 15:06:24.793855 2119 ts_tablet_manager.cc:1918] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:24.793983 2119 log.cc:1196] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/81e0be77dff645f795237ffe779ed684
I20260927 15:06:24.794369 2119 ts_tablet_manager.cc:1939] T 81e0be77dff645f795237ffe779ed684 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:24.796290 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e7201c95f3774e8d9f1d97fafd16cb63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.797001 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7201c95f3774e8d9f1d97fafd16cb63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.707572 3167 raft_consensus.cc:2229] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:24.811610 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 38408dd02ac24febb130b5cb5f7fccb6 consensus state has no leader
I20260927 15:06:24.811983 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_54073bf7dec94c5e8db9a20eff4fb711"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.812503 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54073bf7dec94c5e8db9a20eff4fb711 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.816100 3167 raft_consensus.cc:2258] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.816737 3167 ts_tablet_manager.cc:1905] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:24.825493 1556 ts_tablet_manager.cc:1428] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.261s user 0.002s sys 0.019s
I20260927 15:06:24.826121 1556 tablet_bootstrap.cc:492] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:24.826283 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_184ab2f33372446a8f36f2a4c6687c6b" } new_table_name: "default.Table_e981892a4ed34c849cdde0cead54dadb" modify_external_catalogs: true
I20260927 15:06:24.790326 1552 consensus_queue.cc:260] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:24.836664 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_493099c0cf6c40a7b6990f7f49812696" } new_table_name: "default.Table_a7d8577214db4351b63d07e3973ea842" modify_external_catalogs: true
I20260927 15:06:24.838268 1556 tablet_bootstrap.cc:654] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:24.845909 1552 ts_tablet_manager.cc:1428] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.115s user 0.001s sys 0.001s
I20260927 15:06:24.846377 1268 tablet_service.cc:1467] Processing CreateTablet for tablet fbc81d8904234d9aab9ac8003d5aafb9 (DEFAULT_TABLE table=default.Table_b66c74413fe44a7e8496cda55f74553b [id=59e953421bf6427dbc45958657465698]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.846695 1552 tablet_bootstrap.cc:492] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:24.851308 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1140) took 1816 ms. Trace:
I20260927 15:06:24.851451 2119 rpcz_store.cc:276] 0927 15:06:23.034500 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.034882 (+ 382us) service_pool.cc:227] Handling call
0927 15:06:24.403915 (+1369033us) ts_tablet_manager.cc:1145] Deleting tablet 81e0be77dff645f795237ffe779ed684
0927 15:06:24.403924 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.488706 (+ 84782us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.793747 (+305041us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.851293 (+ 57546us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1346477}
I20260927 15:06:24.851879 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1142) took 1817 ms. Trace:
I20260927 15:06:24.851987 2119 rpcz_store.cc:276] 0927 15:06:23.034746 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.035404 (+ 658us) service_pool.cc:227] Handling call
0927 15:06:24.851795 (+1816391us) ts_tablet_manager.cc:1145] Deleting tablet 58d6bdc1ac004d889aac36db65afbbbe
0927 15:06:24.851805 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.851865 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1784878}
I20260927 15:06:24.852324 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1143) took 1817 ms. Trace:
I20260927 15:06:24.852861 1294 raft_consensus.cc:3037] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:24.854471 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 81e0be77dff645f795237ffe779ed684 (table default.Table_806abc9f7da043179a751515c37b1170 [id=2602f6dfc6ac49a8ac3f4af47b38f21b]) successfully deleted
W20260927 15:06:24.854802 901 catalog_manager.cc:4808] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 58d6bdc1ac004d889aac36db65afbbbe because the tablet was not found. No further retry: Not found: Tablet not found: 58d6bdc1ac004d889aac36db65afbbbe
I20260927 15:06:24.852433 2119 rpcz_store.cc:276] 0927 15:06:23.035516 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.036269 (+ 753us) service_pool.cc:227] Handling call
0927 15:06:24.852239 (+1815970us) ts_tablet_manager.cc:1145] Deleting tablet bc20a62bbd484c4e9e25cf1c15e1dde0
0927 15:06:24.852251 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.852311 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1781326}
W20260927 15:06:24.860078 901 catalog_manager.cc:4808] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bc20a62bbd484c4e9e25cf1c15e1dde0 because the tablet was not found. No further retry: Not found: Tablet not found: bc20a62bbd484c4e9e25cf1c15e1dde0
I20260927 15:06:24.860394 2119 tablet_replica.cc:330] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:24.860620 2119 raft_consensus.cc:2229] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:24.861610 2119 raft_consensus.cc:2258] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.863088 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f6bef5f000441090f73eb842450362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:02 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:24.863130 2119 ts_tablet_manager.cc:1905] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:24.864799 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 79c983d3119f4754a33a1ec3a84665c1 (table default.Table_a97f2a9983ab4e67ae1fc5edb4afbef2 [id=ff900aafe4f94663a9633fc0fbec0a06], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 79c983d3119f4754a33a1ec3a84665c1 consensus state has no leader
I20260927 15:06:24.868125 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6c4c26664bee4787987ec6c3e462d871" } new_table_name: "default.Table_512664414a0d42c2bfc8085ef10142e9" modify_external_catalogs: true
W20260927 15:06:24.872572 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49f6f839939042838a24e234a21eacb6 consensus state has no leader
I20260927 15:06:24.877779 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_66e72649acdf4638aade652ed153d286"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:24.878394 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66e72649acdf4638aade652ed153d286 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.878456 1556 tablet_bootstrap.cc:492] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:24.880373 1552 tablet_bootstrap.cc:654] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:24.885679 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 054a2bad826446f48480e0039cd753d9 (DEFAULT_TABLE table=default.Table_1e1f79806e5f47c2bf23aa1ff20b5ec4 [id=cc04f0a23e17494ea3aa0b6e9cec4b29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.886019 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 054a2bad826446f48480e0039cd753d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.886493 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 93f90df7984947b2926a98c9978c333a (DEFAULT_TABLE table=default.Table_ae5aa5d2625f49e08bee7bf4367028e2 [id=306ef6cd640540bd87d4e528fe38b477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.887156 1275 tablet_service.cc:1467] Processing CreateTablet for tablet eb4376f0439d4ecaaee51c3963843cc5 (DEFAULT_TABLE table=default.Table_f7fc5c58ba38473fb7c455c7f70df51b [id=a78c51cf6a98468f97bd356d3547eeb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.887552 1275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb4376f0439d4ecaaee51c3963843cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.887725 3167 ts_tablet_manager.cc:1918] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:24.887841 3167 log.cc:1196] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/e2ba3bdf50b14aec85a99742426e9298
I20260927 15:06:24.888134 3167 ts_tablet_manager.cc:1939] T e2ba3bdf50b14aec85a99742426e9298 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:24.888435 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1252) took 1599 ms. Trace:
I20260927 15:06:24.888506 3167 rpcz_store.cc:276] 0927 15:06:23.288852 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.289078 (+ 226us) service_pool.cc:227] Handling call
0927 15:06:24.686135 (+1397057us) ts_tablet_manager.cc:1145] Deleting tablet e2ba3bdf50b14aec85a99742426e9298
0927 15:06:24.686147 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.820081 (+133934us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.887586 (+ 67505us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.888420 (+ 834us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1396940}
I20260927 15:06:24.890347 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 73fbb8371d0f4f5083cd93a673e8df0c (DEFAULT_TABLE table=default.Table_73cee218630c48adb25b948ee481b5ea [id=e41cc2569dc140b2982192f32e423e26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.890636 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73fbb8371d0f4f5083cd93a673e8df0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.891165 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 3c03e74bcb304257a10686dfbf680c21 (DEFAULT_TABLE table=default.Table_723d8087a23648db9fb6a3ec2057a0d6 [id=a9d8617ea0984353abb56a4ef19ffe69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.891505 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1251) took 1602 ms. Trace:
I20260927 15:06:24.891592 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c03e74bcb304257a10686dfbf680c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.891585 3167 rpcz_store.cc:276] 0927 15:06:23.288774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.289179 (+ 405us) service_pool.cc:227] Handling call
0927 15:06:24.891396 (+1602217us) ts_tablet_manager.cc:1145] Deleting tablet af25950fd08043f18a6eaaf46ded4378
0927 15:06:24.891409 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.891488 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1602090}
I20260927 15:06:24.893350 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1253) took 1604 ms. Trace:
I20260927 15:06:24.893422 3167 rpcz_store.cc:276] 0927 15:06:23.288959 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.289325 (+ 366us) service_pool.cc:227] Handling call
0927 15:06:24.893224 (+1603899us) ts_tablet_manager.cc:1145] Deleting tablet 9f5c8e8865a34f01addbb505cf777a0d
0927 15:06:24.893234 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.893335 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1603761}
I20260927 15:06:24.893819 3167 tablet_replica.cc:330] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:24.894004 3167 raft_consensus.cc:2229] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:24.894170 3167 raft_consensus.cc:2258] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.895102 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 9b607cf9d471430ba34938ebf721b135 (DEFAULT_TABLE table=default.Table_6a02199b3e1e42b19095921cdb387890 [id=1b7359fd08df445fb1d7406612d7f01e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.895552 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b607cf9d471430ba34938ebf721b135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.899049 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 029dd50c4f8d46d489cc499fa11ed2bb (DEFAULT_TABLE table=default.Table_187050ab0a8942c5ae6a320d92c0fc8c [id=bacd218660cd4ee6aa66cf7a733dcfd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.899385 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029dd50c4f8d46d489cc499fa11ed2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.903110 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 5eba6540fde844fd99ed674203f71b8b (DEFAULT_TABLE table=default.Table_1f98a30d539142d0a9569a275a0692a9 [id=ad604b5d131c45468e9a51ea718dac1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.903530 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eba6540fde844fd99ed674203f71b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.904415 1556 ts_tablet_manager.cc:1397] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
I20260927 15:06:24.906435 3167 ts_tablet_manager.cc:1905] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:24.907107 1277 tablet_service.cc:1467] Processing CreateTablet for tablet b924a9a0b5f14c2e9a481b27c5c585a0 (DEFAULT_TABLE table=default.Table_5528261ab72441bc9dfacac538a82f90 [id=c8bed9575198439da53ff5803c13b93d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.907455 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b924a9a0b5f14c2e9a481b27c5c585a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.912418 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93f90df7984947b2926a98c9978c333a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.920830 2119 ts_tablet_manager.cc:1918] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:24.922173 2119 log.cc:1196] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/214229a8283b43c4916a5db7ba120e03
I20260927 15:06:24.923687 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_953bcb72d20a4a17b4928ada000259fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:24.921551 1556 raft_consensus.cc:348] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:24.924356 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_953bcb72d20a4a17b4928ada000259fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:24.924405 1556 raft_consensus.cc:374] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:24.925108 1556 raft_consensus.cc:729] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:24.926620 2119 ts_tablet_manager.cc:1939] T 214229a8283b43c4916a5db7ba120e03 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:24.927428 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 6262c184816f40178ae10c1c938f16e6 (DEFAULT_TABLE table=default.Table_70d475b134d141fe82c809e821292681 [id=82fda99420964a9e80ca6fa13c34e49c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.927802 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6262c184816f40178ae10c1c938f16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.927332 1556 consensus_queue.cc:260] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:24.929826 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1164) took 1724 ms. Trace:
I20260927 15:06:24.930590 2119 rpcz_store.cc:276] 0927 15:06:23.204884 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.204973 (+ 89us) service_pool.cc:227] Handling call
0927 15:06:24.860347 (+1655374us) ts_tablet_manager.cc:1145] Deleting tablet 214229a8283b43c4916a5db7ba120e03
0927 15:06:24.860359 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.883334 (+ 22975us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.919982 (+ 36648us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.929806 (+ 9824us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1655054}
I20260927 15:06:24.933086 2119 tablet_replica.cc:330] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:24.933615 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 1986b5efb0fe475898a4872101d85757 (DEFAULT_TABLE table=default.Table_f189d9738b5f4830bd6b915aac52b785 [id=d36fbaf189204da2acb794c259d45c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.934037 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1986b5efb0fe475898a4872101d85757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.934310 2119 raft_consensus.cc:2229] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:24.935551 2119 pending_rounds.cc:62] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:24.935781 2119 pending_rounds.cc:68] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976408972378112 op_type: NO_OP noop_request { }
I20260927 15:06:24.936431 2119 raft_consensus.cc:2866] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:24.936894 2119 raft_consensus.cc:2258] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.940905 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 0f64257a5c944985993f61cc4852fc6b (DEFAULT_TABLE table=default.Table_bc258b071781424b96bf06deca6719b4 [id=6fed3defcd3b428f9e5677cfbd4edf65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.940982 1272 tablet_service.cc:1467] Processing CreateTablet for tablet 084cf0ba45e647d7893a24c0d779f78a (DEFAULT_TABLE table=default.Table_df9ffa6e6ecd41918ed985059a5de3a6 [id=36c94caa49714fd5919e5105143e130e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.940968 1274 tablet_service.cc:1467] Processing CreateTablet for tablet f12e766beac74b8c868a39c98324eb8b (DEFAULT_TABLE table=default.Table_ed147abba8034b5091bdb534333b0f85 [id=87c4891884bd4f43a0d50d79c57bc7ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.941116 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 91d3f636671b4aa5825397cb97f6e909 (DEFAULT_TABLE table=default.Table_f5a8babbf25c4a88865463b6d4178ac0 [id=e796089097ec43599c0b708640802be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.941264 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f64257a5c944985993f61cc4852fc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.941439 1274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f12e766beac74b8c868a39c98324eb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.941598 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084cf0ba45e647d7893a24c0d779f78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.941825 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 2e2ede1f49d3465497678fea08a805ce (DEFAULT_TABLE table=default.Table_7cf889c98d404ae3a154e409b954e1b4 [id=f7b6f5070a7e443286197f62d7039dca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.942188 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e2ede1f49d3465497678fea08a805ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.947021 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91d3f636671b4aa5825397cb97f6e909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.951421 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 2534c634bba84459a9751345136d82a0 (DEFAULT_TABLE table=default.Table_a1245949d6d04b80aaa4ff762ae2378f [id=ff329c52dcf1496b8b357a8150f238ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.951730 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 3466bbb35b814f0992df6d1e653f2c5a (DEFAULT_TABLE table=default.Table_fbd12309639f4a0f9016d062cc94c910 [id=648f11deaf0140bfa819f699aed8f44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.952188 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2534c634bba84459a9751345136d82a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.953418 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 214229a8283b43c4916a5db7ba120e03 (table default.Table_2ed14c9f6f1446fb930cb6ff85d6d7ce [id=9b5989d83cc345ba90e2adfcc86f3925]) successfully deleted
I20260927 15:06:24.954053 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3466bbb35b814f0992df6d1e653f2c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.967073 1556 ts_tablet_manager.cc:1428] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.062s user 0.002s sys 0.001s
I20260927 15:06:24.967435 1556 tablet_bootstrap.cc:492] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:24.968889 1556 tablet_bootstrap.cc:654] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:24.970364 1428 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.504s user 0.011s sys 0.011s
W20260927 15:06:24.970486 1428 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.504s user 0.011s sys 0.011s
I20260927 15:06:24.971444 3167 ts_tablet_manager.cc:1918] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:24.971974 3167 log.cc:1196] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/d9fecfb2325046f98e69797ff8342892
I20260927 15:06:24.972596 3167 ts_tablet_manager.cc:1939] T d9fecfb2325046f98e69797ff8342892 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:24.974587 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1247) took 1686 ms. Trace:
I20260927 15:06:24.974740 3167 rpcz_store.cc:276] 0927 15:06:23.288412 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.289488 (+ 1076us) service_pool.cc:227] Handling call
0927 15:06:24.893777 (+1604289us) ts_tablet_manager.cc:1145] Deleting tablet d9fecfb2325046f98e69797ff8342892
0927 15:06:24.893788 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.966140 (+ 72352us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.971376 (+ 5236us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:24.974543 (+ 3167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1604163}
I20260927 15:06:24.977698 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1246) took 1743 ms. Trace:
I20260927 15:06:24.978355 3167 rpcz_store.cc:276] 0927 15:06:23.233853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.234527 (+ 674us) service_pool.cc:227] Handling call
0927 15:06:24.976635 (+1742108us) ts_tablet_manager.cc:1145] Deleting tablet 048a1713b6054024959a9bdc245f71a4
0927 15:06:24.976645 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:24.977439 (+ 794us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1682535}
I20260927 15:06:24.981366 3167 tablet_replica.cc:330] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:24.983644 3167 raft_consensus.cc:2229] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:24.985699 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc81d8904234d9aab9ac8003d5aafb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.989629 1405 tablet_service.cc:1467] Processing CreateTablet for tablet fbc81d8904234d9aab9ac8003d5aafb9 (DEFAULT_TABLE table=default.Table_b66c74413fe44a7e8496cda55f74553b [id=59e953421bf6427dbc45958657465698]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.990033 1405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc81d8904234d9aab9ac8003d5aafb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.991436 3167 raft_consensus.cc:2258] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:24.995745 1408 tablet_service.cc:1467] Processing CreateTablet for tablet fff7b6f9ffa946bcb3a5facb348fa363 (DEFAULT_TABLE table=default.Table_e19deccfb7dc44078fcf98a1e21b17b4 [id=a3e66879b1c249c398ebef130458e6f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.996104 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fff7b6f9ffa946bcb3a5facb348fa363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.999794 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 6262c184816f40178ae10c1c938f16e6 (DEFAULT_TABLE table=default.Table_70d475b134d141fe82c809e821292681 [id=82fda99420964a9e80ca6fa13c34e49c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.000203 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6262c184816f40178ae10c1c938f16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.000771 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 1986b5efb0fe475898a4872101d85757 (DEFAULT_TABLE table=default.Table_f189d9738b5f4830bd6b915aac52b785 [id=d36fbaf189204da2acb794c259d45c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.001041 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1986b5efb0fe475898a4872101d85757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.001097 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 0760e7dc54dd4a23bfe7f8e9102ab49e (DEFAULT_TABLE table=default.Table_70a27f63944a4753a0b0f1ed37cb83c8 [id=fdec6d899e21448880f56002a942b491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.001418 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0760e7dc54dd4a23bfe7f8e9102ab49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.000011 3167 ts_tablet_manager.cc:1905] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:25.007783 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 054a2bad826446f48480e0039cd753d9 (DEFAULT_TABLE table=default.Table_1e1f79806e5f47c2bf23aa1ff20b5ec4 [id=cc04f0a23e17494ea3aa0b6e9cec4b29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.007910 1407 tablet_service.cc:1467] Processing CreateTablet for tablet eb4376f0439d4ecaaee51c3963843cc5 (DEFAULT_TABLE table=default.Table_f7fc5c58ba38473fb7c455c7f70df51b [id=a78c51cf6a98468f97bd356d3547eeb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.008172 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 3c03e74bcb304257a10686dfbf680c21 (DEFAULT_TABLE table=default.Table_723d8087a23648db9fb6a3ec2057a0d6 [id=a9d8617ea0984353abb56a4ef19ffe69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.008684 1417 tablet_service.cc:1467] Processing CreateTablet for tablet 73fbb8371d0f4f5083cd93a673e8df0c (DEFAULT_TABLE table=default.Table_73cee218630c48adb25b948ee481b5ea [id=e41cc2569dc140b2982192f32e423e26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.009191 1415 tablet_service.cc:1467] Processing CreateTablet for tablet 9b607cf9d471430ba34938ebf721b135 (DEFAULT_TABLE table=default.Table_6a02199b3e1e42b19095921cdb387890 [id=1b7359fd08df445fb1d7406612d7f01e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.009716 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 029dd50c4f8d46d489cc499fa11ed2bb (DEFAULT_TABLE table=default.Table_187050ab0a8942c5ae6a320d92c0fc8c [id=bacd218660cd4ee6aa66cf7a733dcfd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.009819 1419 tablet_service.cc:1467] Processing CreateTablet for tablet 3466bbb35b814f0992df6d1e653f2c5a (DEFAULT_TABLE table=default.Table_fbd12309639f4a0f9016d062cc94c910 [id=648f11deaf0140bfa819f699aed8f44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.010084 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 5eba6540fde844fd99ed674203f71b8b (DEFAULT_TABLE table=default.Table_1f98a30d539142d0a9569a275a0692a9 [id=ad604b5d131c45468e9a51ea718dac1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.826426 3250 raft_consensus.cc:482] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.010648 1412 tablet_service.cc:1467] Processing CreateTablet for tablet b924a9a0b5f14c2e9a481b27c5c585a0 (DEFAULT_TABLE table=default.Table_5528261ab72441bc9dfacac538a82f90 [id=c8bed9575198439da53ff5803c13b93d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.010548 3250 raft_consensus.cc:504] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.010885 1404 tablet_service.cc:1467] Processing CreateTablet for tablet f12e766beac74b8c868a39c98324eb8b (DEFAULT_TABLE table=default.Table_ed147abba8034b5091bdb534333b0f85 [id=87c4891884bd4f43a0d50d79c57bc7ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.011246 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 0f64257a5c944985993f61cc4852fc6b (DEFAULT_TABLE table=default.Table_bc258b071781424b96bf06deca6719b4 [id=6fed3defcd3b428f9e5677cfbd4edf65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.011294 3250 leader_election.cc:288] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:24.874636 1145 tablet_service.cc:1467] Processing CreateTablet for tablet fff7b6f9ffa946bcb3a5facb348fa363 (DEFAULT_TABLE table=default.Table_e19deccfb7dc44078fcf98a1e21b17b4 [id=a3e66879b1c249c398ebef130458e6f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.011718 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fff7b6f9ffa946bcb3a5facb348fa363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.011757 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 084cf0ba45e647d7893a24c0d779f78a (DEFAULT_TABLE table=default.Table_df9ffa6e6ecd41918ed985059a5de3a6 [id=36c94caa49714fd5919e5105143e130e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.011920 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 2534c634bba84459a9751345136d82a0 (DEFAULT_TABLE table=default.Table_a1245949d6d04b80aaa4ff762ae2378f [id=ff329c52dcf1496b8b357a8150f238ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.012290 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 91d3f636671b4aa5825397cb97f6e909 (DEFAULT_TABLE table=default.Table_f5a8babbf25c4a88865463b6d4178ac0 [id=e796089097ec43599c0b708640802be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.012751 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 2e2ede1f49d3465497678fea08a805ce (DEFAULT_TABLE table=default.Table_7cf889c98d404ae3a154e409b954e1b4 [id=f7b6f5070a7e443286197f62d7039dca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.013581 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0d667472ee4f1481c213e03403461e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:25.014315 1102 leader_election.cc:341] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:24.879994 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 6262c184816f40178ae10c1c938f16e6 (DEFAULT_TABLE table=default.Table_70d475b134d141fe82c809e821292681 [id=82fda99420964a9e80ca6fa13c34e49c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.015496 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6262c184816f40178ae10c1c938f16e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.017189 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb4376f0439d4ecaaee51c3963843cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.880353 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 1986b5efb0fe475898a4872101d85757 (DEFAULT_TABLE table=default.Table_f189d9738b5f4830bd6b915aac52b785 [id=d36fbaf189204da2acb794c259d45c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.880694 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 0760e7dc54dd4a23bfe7f8e9102ab49e (DEFAULT_TABLE table=default.Table_70a27f63944a4753a0b0f1ed37cb83c8 [id=fdec6d899e21448880f56002a942b491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.880995 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 93f90df7984947b2926a98c9978c333a (DEFAULT_TABLE table=default.Table_ae5aa5d2625f49e08bee7bf4367028e2 [id=306ef6cd640540bd87d4e528fe38b477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.881376 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 054a2bad826446f48480e0039cd753d9 (DEFAULT_TABLE table=default.Table_1e1f79806e5f47c2bf23aa1ff20b5ec4 [id=cc04f0a23e17494ea3aa0b6e9cec4b29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.881951 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 3c03e74bcb304257a10686dfbf680c21 (DEFAULT_TABLE table=default.Table_723d8087a23648db9fb6a3ec2057a0d6 [id=a9d8617ea0984353abb56a4ef19ffe69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.882308 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 73fbb8371d0f4f5083cd93a673e8df0c (DEFAULT_TABLE table=default.Table_73cee218630c48adb25b948ee481b5ea [id=e41cc2569dc140b2982192f32e423e26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.882586 1135 tablet_service.cc:1467] Processing CreateTablet for tablet eb4376f0439d4ecaaee51c3963843cc5 (DEFAULT_TABLE table=default.Table_f7fc5c58ba38473fb7c455c7f70df51b [id=a78c51cf6a98468f97bd356d3547eeb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.019253 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0760e7dc54dd4a23bfe7f8e9102ab49e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.021775 1099 leader_election.cc:341] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 7f0d667472ee4f1481c213e03403461e
I20260927 15:06:25.021889 1099 leader_election.cc:302] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.022372 3150 raft_consensus.cc:2726] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.022775 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93f90df7984947b2926a98c9978c333a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.024523 1419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3466bbb35b814f0992df6d1e653f2c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.024641 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 2534c634bba84459a9751345136d82a0 (DEFAULT_TABLE table=default.Table_a1245949d6d04b80aaa4ff762ae2378f [id=ff329c52dcf1496b8b357a8150f238ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.024964 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2534c634bba84459a9751345136d82a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.027004 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73fbb8371d0f4f5083cd93a673e8df0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.027052 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029dd50c4f8d46d489cc499fa11ed2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.031123 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e2ede1f49d3465497678fea08a805ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.031160 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb4376f0439d4ecaaee51c3963843cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.035027 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c03e74bcb304257a10686dfbf680c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.035070 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eba6540fde844fd99ed674203f71b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.038304 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91d3f636671b4aa5825397cb97f6e909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.039034 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 054a2bad826446f48480e0039cd753d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.039206 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 0760e7dc54dd4a23bfe7f8e9102ab49e (DEFAULT_TABLE table=default.Table_70a27f63944a4753a0b0f1ed37cb83c8 [id=fdec6d899e21448880f56002a942b491]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.039589 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0760e7dc54dd4a23bfe7f8e9102ab49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.043016 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1986b5efb0fe475898a4872101d85757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.043056 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084cf0ba45e647d7893a24c0d779f78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.045518 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 93f90df7984947b2926a98c9978c333a (DEFAULT_TABLE table=default.Table_ae5aa5d2625f49e08bee7bf4367028e2 [id=306ef6cd640540bd87d4e528fe38b477]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.045857 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93f90df7984947b2926a98c9978c333a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.047130 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c03e74bcb304257a10686dfbf680c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.919356 1144 tablet_service.cc:1467] Processing CreateTablet for tablet fbc81d8904234d9aab9ac8003d5aafb9 (DEFAULT_TABLE table=default.Table_b66c74413fe44a7e8496cda55f74553b [id=59e953421bf6427dbc45958657465698]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.050181 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc81d8904234d9aab9ac8003d5aafb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.051045 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b607cf9d471430ba34938ebf721b135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.920059 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 9b607cf9d471430ba34938ebf721b135 (DEFAULT_TABLE table=default.Table_6a02199b3e1e42b19095921cdb387890 [id=1b7359fd08df445fb1d7406612d7f01e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.055051 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2534c634bba84459a9751345136d82a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.055101 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b607cf9d471430ba34938ebf721b135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.057217 1266 tablet_service.cc:1467] Processing CreateTablet for tablet fff7b6f9ffa946bcb3a5facb348fa363 (DEFAULT_TABLE table=default.Table_e19deccfb7dc44078fcf98a1e21b17b4 [id=a3e66879b1c249c398ebef130458e6f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.057570 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fff7b6f9ffa946bcb3a5facb348fa363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.920360 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 029dd50c4f8d46d489cc499fa11ed2bb (DEFAULT_TABLE table=default.Table_187050ab0a8942c5ae6a320d92c0fc8c [id=bacd218660cd4ee6aa66cf7a733dcfd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.059065 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b924a9a0b5f14c2e9a481b27c5c585a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.059301 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029dd50c4f8d46d489cc499fa11ed2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.920512 3248 raft_consensus.cc:482] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.062930 3248 raft_consensus.cc:504] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.063503 3248 leader_election.cc:288] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:25.063925 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f12e766beac74b8c868a39c98324eb8b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.064661 1099 leader_election.cc:341] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 79a3125723034cb48bc1a05fc4abbb82
I20260927 15:06:24.920744 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 5eba6540fde844fd99ed674203f71b8b (DEFAULT_TABLE table=default.Table_1f98a30d539142d0a9569a275a0692a9 [id=ad604b5d131c45468e9a51ea718dac1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.931470 1127 tablet_service.cc:1467] Processing CreateTablet for tablet b924a9a0b5f14c2e9a481b27c5c585a0 (DEFAULT_TABLE table=default.Table_5528261ab72441bc9dfacac538a82f90 [id=c8bed9575198439da53ff5803c13b93d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.066133 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b924a9a0b5f14c2e9a481b27c5c585a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.067063 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f64257a5c944985993f61cc4852fc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.067770 1417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73fbb8371d0f4f5083cd93a673e8df0c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.068291 898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.62:41167, user_credentials={real_user=slave}} blocked reactor thread for 57983.8us
I20260927 15:06:25.068578 3148 raft_consensus.cc:482] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.068635 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet e2ba3bdf50b14aec85a99742426e9298 (table default.Table_539b633d448c40e6bc9134a8ab4dd16f [id=15667aae5a2449ad8c392b8883db7ea6]) successfully deleted
I20260927 15:06:25.068703 3148 raft_consensus.cc:504] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:25.068866 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet af25950fd08043f18a6eaaf46ded4378 because the tablet was not found. No further retry: Not found: Tablet not found: af25950fd08043f18a6eaaf46ded4378
W20260927 15:06:25.069178 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9f5c8e8865a34f01addbb505cf777a0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f5c8e8865a34f01addbb505cf777a0d already in progress: creating tablet
I20260927 15:06:25.069345 3148 leader_election.cc:288] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:25.069356 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet d9fecfb2325046f98e69797ff8342892 (table default.Table_37218c1a7b094f29ab2a481292650fb5 [id=9fd363aa53b74b68a9537af688cbb110]) successfully deleted
W20260927 15:06:25.069525 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 048a1713b6054024959a9bdc245f71a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 048a1713b6054024959a9bdc245f71a4 already in progress: creating tablet
I20260927 15:06:25.069589 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79a3125723034cb48bc1a05fc4abbb82" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:25.070288 1099 leader_election.cc:341] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 769e9b5c08cd44cc8a0d681500d64f54
W20260927 15:06:25.070621 1102 leader_election.cc:341] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.070706 1102 leader_election.cc:302] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:24.931499 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 3466bbb35b814f0992df6d1e653f2c5a (DEFAULT_TABLE table=default.Table_fbd12309639f4a0f9016d062cc94c910 [id=648f11deaf0140bfa819f699aed8f44d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.070992 3236 raft_consensus.cc:2726] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.071002 2119 ts_tablet_manager.cc:1905] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:24.931792 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 0f64257a5c944985993f61cc4852fc6b (DEFAULT_TABLE table=default.Table_bc258b071781424b96bf06deca6719b4 [id=6fed3defcd3b428f9e5677cfbd4edf65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.071266 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "769e9b5c08cd44cc8a0d681500d64f54" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:25.071372 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3466bbb35b814f0992df6d1e653f2c5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.071707 1102 leader_election.cc:341] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.071791 1102 leader_election.cc:302] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.072116 3236 raft_consensus.cc:2726] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.075031 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f64257a5c944985993f61cc4852fc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.079432 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eba6540fde844fd99ed674203f71b8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.931941 1130 tablet_service.cc:1467] Processing CreateTablet for tablet f12e766beac74b8c868a39c98324eb8b (DEFAULT_TABLE table=default.Table_ed147abba8034b5091bdb534333b0f85 [id=87c4891884bd4f43a0d50d79c57bc7ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.082248 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f12e766beac74b8c868a39c98324eb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.932329 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 084cf0ba45e647d7893a24c0d779f78a (DEFAULT_TABLE table=default.Table_df9ffa6e6ecd41918ed985059a5de3a6 [id=36c94caa49714fd5919e5105143e130e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.932874 1131 tablet_service.cc:1467] Processing CreateTablet for tablet 91d3f636671b4aa5825397cb97f6e909 (DEFAULT_TABLE table=default.Table_f5a8babbf25c4a88865463b6d4178ac0 [id=e796089097ec43599c0b708640802be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.933358 1136 tablet_service.cc:1467] Processing CreateTablet for tablet 2e2ede1f49d3465497678fea08a805ce (DEFAULT_TABLE table=default.Table_7cf889c98d404ae3a154e409b954e1b4 [id=f7b6f5070a7e443286197f62d7039dca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:24.980575 3255 tablet.cc:1722] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260927 15:06:25.085161 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91d3f636671b4aa5825397cb97f6e909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.085433 1136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e2ede1f49d3465497678fea08a805ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.089951 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084cf0ba45e647d7893a24c0d779f78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:24.984773 3235 raft_consensus.cc:482] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.094957 3235 raft_consensus.cc:504] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.095649 3235 leader_election.cc:288] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:25.096514 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955461f27b6444d4b4c3f9a9f629d5e3" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:25.097052 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 054a2bad826446f48480e0039cd753d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.097193 1102 leader_election.cc:341] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:25.097750 1099 leader_election.cc:341] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 955461f27b6444d4b4c3f9a9f629d5e3
I20260927 15:06:25.097865 1099 leader_election.cc:302] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.101227 3250 raft_consensus.cc:2726] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.117357 1261 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:54594 (request call id 179) took 1343 ms. Trace:
I20260927 15:06:25.123026 1261 rpcz_store.cc:276] 0927 15:06:23.774147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.774574 (+ 427us) service_pool.cc:227] Handling call
0927 15:06:24.458880 (+684306us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x6150000acba4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d16630 00007fcdbc8eec7f 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378 00000000009edb7c
0927 15:06:24.743346 (+284466us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x6150003235a4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d16630 00007fcdbc8eec7f 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378 00000000009edb7c
0927 15:06:25.089090 (+345744us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x61700009688c. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdba1ead6e 00007fcdb9ff415e 00007fcdbc8eea88 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378
0927 15:06:25.117328 (+ 28238us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1702776576}
I20260927 15:06:25.121887 1265 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:54594 (request call id 178) took 1348 ms. Trace:
I20260927 15:06:25.123883 1265 rpcz_store.cc:276] 0927 15:06:23.773759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.773822 (+ 63us) service_pool.cc:227] Handling call
0927 15:06:24.461369 (+687547us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x6150000acba4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d16630 00007fcdbc8eec7f 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378 00000000009edb7c
0927 15:06:24.467625 (+ 6256us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x6150003604a4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d16630 00007fcdbc8eec7f 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378 00000000009edb7c
0927 15:06:24.744139 (+276514us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x6150003235a4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d16630 00007fcdbc8eec7f 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378 00000000009edb7c
0927 15:06:25.094255 (+350116us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x61700009688c. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdba1ead6e 00007fcdb9ff415e 00007fcdbc8eea88 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378
0927 15:06:25.121861 (+ 27606us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2183216896}
I20260927 15:06:25.122918 1262 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:54594 (request call id 177) took 1349 ms. Trace:
I20260927 15:06:25.124446 1262 rpcz_store.cc:276] 0927 15:06:23.773239 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.773326 (+ 87us) service_pool.cc:227] Handling call
0927 15:06:24.481462 (+708136us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x6150000acba4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d16630 00007fcdbc8eec7f 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378 00000000009edb7c
0927 15:06:24.741466 (+260004us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x6150003235a4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d16630 00007fcdbc8eec7f 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378 00000000009edb7c
0927 15:06:25.122893 (+381427us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1391823872}
I20260927 15:06:25.137619 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda
I20260927 15:06:25.139236 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 33bbd34a3c6148b5a49aa92d54aad36d
I20260927 15:06:25.140132 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 50d786631fc849789164e83efaca333d
I20260927 15:06:25.140810 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.141155 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7fc551eab48542029c50a300b33dab5f
I20260927 15:06:25.143960 1268 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d786631fc849789164e83efaca333d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.144178 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fc551eab48542029c50a300b33dab5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.148731 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bbd34a3c6148b5a49aa92d54aad36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.148964 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.149103 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.149832 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bbd34a3c6148b5a49aa92d54aad36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.150940 1266 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bbd34a3c6148b5a49aa92d54aad36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.151284 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d786631fc849789164e83efaca333d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.151801 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fc551eab48542029c50a300b33dab5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.158384 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet d9c032a06c0b497fa21a3553375978ca
I20260927 15:06:25.159060 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet d9c032a06c0b497fa21a3553375978ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:25.159853 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5dd733a4009406180147e3aa39129e5 consensus state has no leader
I20260927 15:06:25.161317 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet d9c032a06c0b497fa21a3553375978ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.161516 908 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b] alter complete (version 1)
W20260927 15:06:25.163434 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9363b28f91804bb2a8667e0b107499a2 consensus state has no leader
I20260927 15:06:25.164269 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_61407775ebd24ff48bb2f1515f93442e" } new_table_name: "default.Table_d9bf946a9c40412abe358044509f5821" modify_external_catalogs: true
I20260927 15:06:25.164695 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b1f46b4fd15b41debe963417e6c9fbd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.165251 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1f46b4fd15b41debe963417e6c9fbd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.165668 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_051d42f317f34540a90b5fc0ed638420"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:25.165975 907 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (table default.Table_9421c4a3c84e449ea9e86594f7342489 [id=239ff5a7776c4a469e14137b23b6544a]). Expected version 1 got 0
W20260927 15:06:25.166086 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_051d42f317f34540a90b5fc0ed638420 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.167235 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_309f95d9eb8a4aa4ad1c9c5d1604ac78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.167771 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_309f95d9eb8a4aa4ad1c9c5d1604ac78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.167701 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_3c0029ef42144b28bbae10e7f7c78b34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.168082 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c0029ef42144b28bbae10e7f7c78b34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.169055 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d11b170221294649b651d1a165da5341"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:25.169440 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fc551eab48542029c50a300b33dab5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:25.169487 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d11b170221294649b651d1a165da5341 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.170143 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 50d786631fc849789164e83efaca333d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.170593 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b7180c38c8244e5590c1af88dee592c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.171022 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7180c38c8244e5590c1af88dee592c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.170604 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_78f3af40c2ab4321941ebac14d78c724" } new_table_name: "default.Table_64b0ca9e191440e49280d1c8d2d46208" modify_external_catalogs: true
I20260927 15:06:25.180402 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet d9c032a06c0b497fa21a3553375978ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.184222 1562 tablet_replica.cc:330] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:25.184444 1562 raft_consensus.cc:2229] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:25.185318 1561 tablet_bootstrap.cc:492] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:25.187577 913 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 20d349cb04314c388e2f72b243c629ba (table default.Table_fe611237a8bb400a86751f2eed953ea9 [id=afca5fe4316b4f5f97dfaf1ce641d832]). Expected version 1 got 0
I20260927 15:06:25.187925 1561 tablet_bootstrap.cc:654] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.193835 914 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 20d349cb04314c388e2f72b243c629ba (table default.Table_fe611237a8bb400a86751f2eed953ea9 [id=afca5fe4316b4f5f97dfaf1ce641d832]). Expected version 1 got 0
I20260927 15:06:25.198071 1562 raft_consensus.cc:2258] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.210652 1562 ts_tablet_manager.cc:1905] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:25.215140 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_b0c45348a1b546099e1f986fb96860e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.215703 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0c45348a1b546099e1f986fb96860e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.216131 3268 tablet.cc:1722] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260927 15:06:25.216784 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfcef74b1b014f57820bf0f4076e8b13 consensus state has no leader
I20260927 15:06:25.217221 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cc3a42843c734375a3ab18a970b34402" } new_table_name: "default.Table_882fd4451b0447209843814222b1ede3" modify_external_catalogs: true
I20260927 15:06:25.217154 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ee20f668fb634c218b0c8869c513a936"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.217597 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee20f668fb634c218b0c8869c513a936 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:25.218886 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 224c237b0e9f4a15a78d1f4ae7eab864 consensus state has no leader
I20260927 15:06:25.220113 1552 tablet_bootstrap.cc:492] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.220270 1552 ts_tablet_manager.cc:1397] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.374s user 0.019s sys 0.023s
I20260927 15:06:25.220971 1552 raft_consensus.cc:348] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.221359 1552 raft_consensus.cc:374] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.221478 1552 raft_consensus.cc:729] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.221807 1552 consensus_queue.cc:260] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.222479 1552 ts_tablet_manager.cc:1428] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:25.230072 1556 tablet_bootstrap.cc:492] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:25.230271 1556 ts_tablet_manager.cc:1397] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.263s user 0.006s sys 0.006s
I20260927 15:06:25.231029 1556 raft_consensus.cc:348] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.231307 1556 raft_consensus.cc:374] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.231400 1556 raft_consensus.cc:729] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.231670 1556 consensus_queue.cc:260] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.232370 1556 ts_tablet_manager.cc:1428] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:25.233621 1561 tablet_bootstrap.cc:492] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:25.233686 1485 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:25.233778 1561 ts_tablet_manager.cc:1397] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.001s
I20260927 15:06:25.234470 1561 raft_consensus.cc:348] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.234748 1561 raft_consensus.cc:374] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.234861 1561 raft_consensus.cc:729] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.222786 1552 tablet_bootstrap.cc:492] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:25.235092 1561 consensus_queue.cc:260] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.235776 1561 ts_tablet_manager.cc:1428] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:25.236063 1561 tablet_bootstrap.cc:492] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:25.234994 3167 ts_tablet_manager.cc:1918] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:25.236358 3167 log.cc:1196] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/796eef27ca8341b1a1ccc95770892e04
I20260927 15:06:25.236565 1552 tablet_bootstrap.cc:654] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.236807 3167 ts_tablet_manager.cc:1939] T 796eef27ca8341b1a1ccc95770892e04 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:25.243160 913 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_a7eb534e289543168d49435edd522753 [id=67762455acad44448ba24d18c2863816] alter complete (version 4)
W20260927 15:06:25.244252 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8a230f146e74977a7b7b740a6ac770a consensus state has no leader
I20260927 15:06:25.247185 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd8311955974e1cbcdda1961c318588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.250025 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet ea3220df595848258d0f53fa941b2beb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.250818 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1255) took 1852 ms. Trace:
I20260927 15:06:25.250974 3167 rpcz_store.cc:276] 0927 15:06:23.397850 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.397981 (+ 131us) service_pool.cc:227] Handling call
0927 15:06:24.980858 (+1582877us) ts_tablet_manager.cc:1145] Deleting tablet 796eef27ca8341b1a1ccc95770892e04
0927 15:06:24.981094 (+ 236us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.201682 (+220588us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.234887 (+ 33205us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.250798 (+ 15911us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1582664}
I20260927 15:06:25.251446 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 796eef27ca8341b1a1ccc95770892e04 (table default.Table_6fefd73ed6c6478da6538b5b9c48e998 [id=32d3cd5a0cf6490ba3b2567d39e29cc3]) successfully deleted
I20260927 15:06:25.256798 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2843bf6dbf4117b3f44cd39c328b99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.222891 3211 mvcc.cc:205] Tried to move back new op lower bound from 7333976408110354432 to 7333976384217083904. Current Snapshot: MvccSnapshot[applied={T|T < 7333976408110354432}]
I20260927 15:06:25.257095 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1262) took 1771 ms. Trace:
I20260927 15:06:25.257217 3167 rpcz_store.cc:276] 0927 15:06:23.485621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.485663 (+ 42us) service_pool.cc:227] Handling call
0927 15:06:25.251751 (+1766088us) ts_tablet_manager.cc:1145] Deleting tablet 12403ee769904d389f180ccb13d86270
0927 15:06:25.256950 (+ 5199us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.257075 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1765858}
W20260927 15:06:25.257694 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 12403ee769904d389f180ccb13d86270 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12403ee769904d389f180ccb13d86270 already in progress: creating tablet
I20260927 15:06:25.258131 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1261) took 1772 ms. Trace:
I20260927 15:06:25.258252 3167 rpcz_store.cc:276] 0927 15:06:23.485488 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.499028 (+ 13540us) service_pool.cc:227] Handling call
0927 15:06:25.258008 (+1758980us) ts_tablet_manager.cc:1145] Deleting tablet 34e40bea0cd04d3f8ff17b518f50b859
0927 15:06:25.258021 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.258111 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1758683}
W20260927 15:06:25.258759 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 34e40bea0cd04d3f8ff17b518f50b859 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34e40bea0cd04d3f8ff17b518f50b859 already in progress: creating tablet
I20260927 15:06:25.259140 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1268) took 1746 ms. Trace:
I20260927 15:06:25.259253 3167 rpcz_store.cc:276] 0927 15:06:23.512739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.513025 (+ 286us) service_pool.cc:227] Handling call
0927 15:06:25.259046 (+1746021us) ts_tablet_manager.cc:1145] Deleting tablet ca9bb98aab8c4ec087412248cd28a86f
0927 15:06:25.259056 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.259125 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1745830}
W20260927 15:06:25.259721 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ca9bb98aab8c4ec087412248cd28a86f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca9bb98aab8c4ec087412248cd28a86f already in progress: creating tablet
I20260927 15:06:25.260126 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1266) took 1747 ms. Trace:
I20260927 15:06:25.260629 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5c8e8865a34f01addbb505cf777a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.260694 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.260803 3167 rpcz_store.cc:276] 0927 15:06:23.512586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.512900 (+ 314us) service_pool.cc:227] Handling call
0927 15:06:25.260008 (+1747108us) ts_tablet_manager.cc:1145] Deleting tablet 2e85b83758e44de4894d3101465bb47e
0927 15:06:25.260019 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.260105 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1746676}
W20260927 15:06:25.261200 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2e85b83758e44de4894d3101465bb47e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e85b83758e44de4894d3101465bb47e already in progress: creating tablet
I20260927 15:06:25.261499 3167 tablet_replica.cc:330] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:25.261758 3167 raft_consensus.cc:2229] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:25.262022 3167 raft_consensus.cc:2258] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.262804 3167 ts_tablet_manager.cc:1905] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:25.266698 3210 raft_consensus.cc:482] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.266888 3210 raft_consensus.cc:504] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.267449 3210 leader_election.cc:288] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:25.268190 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa58fa9a1384013ac1674bc7d53c3b1" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:25.268800 1376 leader_election.cc:341] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.269716 3236 raft_consensus.cc:482] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.269793 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa58fa9a1384013ac1674bc7d53c3b1" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:25.269838 3236 raft_consensus.cc:504] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.270354 3236 leader_election.cc:288] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:25.270934 1432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea3220df595848258d0f53fa941b2beb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:25.271780 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea3220df595848258d0f53fa941b2beb" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:25.272212 1099 leader_election.cc:341] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:25.272588 1374 leader_election.cc:341] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.272688 1374 leader_election.cc:302] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:25.272881 3210 raft_consensus.cc:2726] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.273144 3167 ts_tablet_manager.cc:1918] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
W20260927 15:06:25.273223 1102 leader_election.cc:341] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.273339 1102 leader_election.cc:302] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.273721 3236 raft_consensus.cc:2726] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.275266 910 master_service.cc:946] ReplaceTablet: received request to replace tablet 8f95d664f1134ac9bbb62c1a3d4b5617 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:25.277505 3167 log.cc:1196] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/c3939bfd903d42e9bfaaf6ecdf50b8d4
I20260927 15:06:25.277678 914 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
I20260927 15:06:25.282884 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8f95d664f1134ac9bbb62c1a3d4b5617
I20260927 15:06:25.283691 910 catalog_manager.cc:6565] ReplaceTablet: tablet 8f95d664f1134ac9bbb62c1a3d4b5617 deleted and replaced by tablet 425a19227aba4612a06b6ba78872f6b7
I20260927 15:06:25.284160 3167 ts_tablet_manager.cc:1939] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:25.284507 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1267) took 1771 ms. Trace:
I20260927 15:06:25.284613 3167 rpcz_store.cc:276] 0927 15:06:23.512665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.512943 (+ 278us) service_pool.cc:227] Handling call
0927 15:06:25.261461 (+1748518us) ts_tablet_manager.cc:1145] Deleting tablet c3939bfd903d42e9bfaaf6ecdf50b8d4
0927 15:06:25.261470 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.268108 (+ 6638us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.273051 (+ 4943us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.284490 (+ 11439us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1748114}
I20260927 15:06:25.285018 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (table default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8]) successfully deleted
I20260927 15:06:25.285398 3167 tablet_replica.cc:330] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:25.286425 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 with delete_type TABLET_DATA_DELETED (replaced by tablet 425a19227aba4612a06b6ba78872f6b7) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.286744 3167 raft_consensus.cc:2229] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:25.286972 3167 raft_consensus.cc:2258] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.287525 3167 ts_tablet_manager.cc:1905] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:25.288751 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 with delete_type TABLET_DATA_DELETED (replaced by tablet 425a19227aba4612a06b6ba78872f6b7) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.291224 914 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 75645963963e4091af0edfcbc794fb2d (table default.Table_1edfa5a3ee694409bba96890df52a19e [id=da5cb53dfb334293a19963596688240b]). Expected version 1 got 0
I20260927 15:06:25.289049 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 with delete_type TABLET_DATA_DELETED (replaced by tablet 425a19227aba4612a06b6ba78872f6b7) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.293761 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 2268d824f5324cd1b81879e2fe4fd027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.294160 1556 tablet_bootstrap.cc:492] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:25.295791 1556 tablet_bootstrap.cc:654] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.297011 3268 tablet.cc:1722] T 75645963963e4091af0edfcbc794fb2d P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:25.298079 1552 tablet_bootstrap.cc:492] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.298250 1552 ts_tablet_manager.cc:1397] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.076s user 0.000s sys 0.003s
I20260927 15:06:25.298964 1552 raft_consensus.cc:348] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.299193 1552 raft_consensus.cc:374] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.299288 1552 raft_consensus.cc:729] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.299535 1552 consensus_queue.cc:260] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.301345 3167 ts_tablet_manager.cc:1918] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:25.302196 1562 ts_tablet_manager.cc:1918] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:25.302356 1562 log.cc:1196] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/a8de6246f7904f6c80df624f3631db17
I20260927 15:06:25.302727 1562 ts_tablet_manager.cc:1939] T a8de6246f7904f6c80df624f3631db17 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:25.303107 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1050) took 6132 ms. Trace:
I20260927 15:06:25.303231 1562 rpcz_store.cc:276] 0927 15:06:19.170805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.171611 (+ 806us) service_pool.cc:227] Handling call
0927 15:06:24.738064 (+5566453us) ts_tablet_manager.cc:1145] Deleting tablet a8de6246f7904f6c80df624f3631db17
0927 15:06:24.738074 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.223039 (+484965us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.302106 (+ 79067us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.303078 (+ 972us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5566301}
I20260927 15:06:25.303727 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet a8de6246f7904f6c80df624f3631db17 (table default.Table_e18064a8c28446469b9ea854acda2a65 [id=f4b1254299c64997962c71b810f7cc67]) successfully deleted
I20260927 15:06:25.304049 1562 tablet_replica.cc:330] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:25.304292 1562 raft_consensus.cc:2229] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:25.305773 3235 raft_consensus.cc:482] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.305889 3235 raft_consensus.cc:504] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.306255 1264 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:54594 (request call id 176) took 1678 ms. Trace:
I20260927 15:06:25.306356 1264 rpcz_store.cc:276] 0927 15:06:23.627419 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.627495 (+ 76us) service_pool.cc:227] Handling call
0927 15:06:24.486139 (+858644us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x6150000acba4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d16630 00007fcdbc8eec7f 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378 00000000009edb7c
0927 15:06:24.745368 (+259229us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x6150003235a4. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdb8d16630 00007fcdbc8eec7f 00007fcdb745a016 00007fcdb7459d45 00007fcdb43469be 00007fcdb434579e 00007fcdb434bb25 00007fcdb434c54f 00007fcdb434c378 00000000009edb7c
0927 15:06:25.306232 (+560864us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1497455616}
I20260927 15:06:25.306479 3235 leader_election.cc:288] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:25.307653 3167 log.cc:1196] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/52e7439320dd48aba25b5f7dc627964c
I20260927 15:06:25.308055 3167 ts_tablet_manager.cc:1939] T 52e7439320dd48aba25b5f7dc627964c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:25.308840 1428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2843bf6dbf4117b3f44cd39c328b99" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:25.308972 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1265) took 1796 ms. Trace:
I20260927 15:06:25.309108 3167 rpcz_store.cc:276] 0927 15:06:23.512491 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.514307 (+ 1816us) service_pool.cc:227] Handling call
0927 15:06:25.285354 (+1771047us) ts_tablet_manager.cc:1145] Deleting tablet 52e7439320dd48aba25b5f7dc627964c
0927 15:06:25.285364 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.296918 (+ 11554us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.301272 (+ 4354us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.308951 (+ 7679us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1770866}
W20260927 15:06:25.309391 1099 leader_election.cc:341] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.309547 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 52e7439320dd48aba25b5f7dc627964c (table default.Table_1f2da6475c904f0d8aec8dea13410524 [id=6ae561a83b5543a89dd0dedc630d9e47]) successfully deleted
I20260927 15:06:25.309912 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1273) took 1750 ms. Trace:
I20260927 15:06:25.310035 3167 rpcz_store.cc:276] 0927 15:06:23.559923 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.559978 (+ 55us) service_pool.cc:227] Handling call
0927 15:06:25.309804 (+1749826us) ts_tablet_manager.cc:1145] Deleting tablet 6c195d8161e24a2bb02b98c89aaa8d24
0927 15:06:25.309813 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.309895 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1749606}
W20260927 15:06:25.310415 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 6c195d8161e24a2bb02b98c89aaa8d24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c195d8161e24a2bb02b98c89aaa8d24 already in progress: creating tablet
I20260927 15:06:25.310766 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1285) took 1464 ms. Trace:
I20260927 15:06:25.310896 3167 rpcz_store.cc:276] 0927 15:06:23.846660 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.846713 (+ 53us) service_pool.cc:227] Handling call
0927 15:06:25.310656 (+1463943us) ts_tablet_manager.cc:1145] Deleting tablet 4891a90ecd36456ab875732b3f2770c4
0927 15:06:25.310665 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.310748 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1463727}
W20260927 15:06:25.311314 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 4891a90ecd36456ab875732b3f2770c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4891a90ecd36456ab875732b3f2770c4 already in progress: creating tablet
I20260927 15:06:25.311666 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1284) took 1466 ms. Trace:
I20260927 15:06:25.311805 3167 rpcz_store.cc:276] 0927 15:06:23.845644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.845694 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:25.311555 (+1465861us) ts_tablet_manager.cc:1145] Deleting tablet 57580db090ad4e4e94a3d22063e57ad4
0927 15:06:25.311565 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.311651 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1460898}
W20260927 15:06:25.312151 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 57580db090ad4e4e94a3d22063e57ad4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57580db090ad4e4e94a3d22063e57ad4 already in progress: creating tablet
I20260927 15:06:25.312470 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1287) took 1462 ms. Trace:
I20260927 15:06:25.312563 3167 rpcz_store.cc:276] 0927 15:06:23.850247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.850341 (+ 94us) service_pool.cc:227] Handling call
0927 15:06:25.312375 (+1462034us) ts_tablet_manager.cc:1145] Deleting tablet bd0e035cec844fe789fdc815644fc025
0927 15:06:25.312383 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.312456 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1461668}
W20260927 15:06:25.312929 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet bd0e035cec844fe789fdc815644fc025 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd0e035cec844fe789fdc815644fc025 already in progress: creating tablet
I20260927 15:06:25.313238 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1286) took 1466 ms. Trace:
I20260927 15:06:25.313359 3167 rpcz_store.cc:276] 0927 15:06:23.847237 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.847275 (+ 38us) service_pool.cc:227] Handling call
0927 15:06:25.313146 (+1465871us) ts_tablet_manager.cc:1145] Deleting tablet 1d83cf0b359b45299f5cdebdc7dee7d4
0927 15:06:25.313155 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.313224 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1462189}
W20260927 15:06:25.313720 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1d83cf0b359b45299f5cdebdc7dee7d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d83cf0b359b45299f5cdebdc7dee7d4 already in progress: creating tablet
I20260927 15:06:25.314167 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2843bf6dbf4117b3f44cd39c328b99" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:25.314697 1102 leader_election.cc:341] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.314806 1102 leader_election.cc:302] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.315193 3236 raft_consensus.cc:2726] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.315414 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1288) took 1457 ms. Trace:
I20260927 15:06:25.317428 1552 ts_tablet_manager.cc:1428] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.019s user 0.001s sys 0.000s
I20260927 15:06:25.325562 1552 tablet_bootstrap.cc:492] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:25.327739 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 63fbd388210d4a1aabfcf27c7533efbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:25.327797 1238 consensus_peers.cc:487] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28f6bef5f000441090f73eb842450362. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:25.330873 3167 rpcz_store.cc:276] 0927 15:06:23.857783 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.858017 (+ 234us) service_pool.cc:227] Handling call
0927 15:06:25.315316 (+1457299us) ts_tablet_manager.cc:1145] Deleting tablet b5ffe51b1b834bf4af262dc70b9206f8
0927 15:06:25.315327 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.315399 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1449376}
W20260927 15:06:25.331386 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b5ffe51b1b834bf4af262dc70b9206f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ffe51b1b834bf4af262dc70b9206f8 already in progress: creating tablet
I20260927 15:06:25.331712 3167 tablet_replica.cc:330] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:25.331930 3167 raft_consensus.cc:2229] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:25.332156 3167 pending_rounds.cc:62] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:25.332219 3167 pending_rounds.cc:68] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976410707333120 op_type: NO_OP noop_request { }
I20260927 15:06:25.332384 3167 raft_consensus.cc:2866] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:25.332508 3167 raft_consensus.cc:2258] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.334189 1552 tablet_bootstrap.cc:654] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.336184 3167 ts_tablet_manager.cc:1905] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:25.338490 1102 consensus_peers.cc:487] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:25.341923 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9f691e4415864362a0a11b7ef69d222c" } modify_external_catalogs: true
I20260927 15:06:25.342236 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b0c45348a1b546099e1f986fb96860e9" } modify_external_catalogs: true
I20260927 15:06:25.342397 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b0c45348a1b546099e1f986fb96860e9" } modify_external_catalogs: true
I20260927 15:06:25.342340 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9f691e4415864362a0a11b7ef69d222c" } modify_external_catalogs: true
I20260927 15:06:25.304628 1562 raft_consensus.cc:2258] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.348977 1562 ts_tablet_manager.cc:1905] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:25.350154 914 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 425a19227aba4612a06b6ba78872f6b7
I20260927 15:06:25.352854 910 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet dfe3d3012ce94175a530b593af00d7af
I20260927 15:06:25.355710 1556 tablet_bootstrap.cc:492] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:25.356249 1556 ts_tablet_manager.cc:1397] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.000s
I20260927 15:06:25.357060 1556 raft_consensus.cc:348] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.357317 1556 raft_consensus.cc:374] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.357404 1556 raft_consensus.cc:729] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.357666 1556 consensus_queue.cc:260] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.362805 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_76972cc723b84c24856db8afb0f9c6f0" } modify_external_catalogs: true
I20260927 15:06:25.363106 1552 tablet_bootstrap.cc:492] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.363281 1552 ts_tablet_manager.cc:1397] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.001s
I20260927 15:06:25.363153 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_76972cc723b84c24856db8afb0f9c6f0" } modify_external_catalogs: true
I20260927 15:06:25.363991 1552 raft_consensus.cc:348] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.364295 1552 raft_consensus.cc:374] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.364394 1552 raft_consensus.cc:729] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.364622 1552 consensus_queue.cc:260] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.369602 3235 raft_consensus.cc:482] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.369738 3235 raft_consensus.cc:504] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.370329 3235 leader_election.cc:288] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:25.370424 3167 ts_tablet_manager.cc:1918] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:25.370537 3167 log.cc:1196] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/12f6403cde734c1394aabfc92c093290
I20260927 15:06:25.370925 3167 ts_tablet_manager.cc:1939] T 12f6403cde734c1394aabfc92c093290 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:25.371107 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089b6b5ac39d49fea744240261a8010e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:25.371608 1102 leader_election.cc:341] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.373492 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_646b99944cd449bca4e0cc9ffb91ae64" } modify_external_catalogs: true
I20260927 15:06:25.373684 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_646b99944cd449bca4e0cc9ffb91ae64" } modify_external_catalogs: true
W20260927 15:06:25.373796 1099 leader_election.cc:341] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 089b6b5ac39d49fea744240261a8010e
I20260927 15:06:25.373893 1099 leader_election.cc:302] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.374205 3235 raft_consensus.cc:2726] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.374315 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1292) took 1506 ms. Trace:
I20260927 15:06:25.374403 3167 rpcz_store.cc:276] 0927 15:06:23.867999 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.871314 (+ 3315us) service_pool.cc:227] Handling call
0927 15:06:25.331665 (+1460351us) ts_tablet_manager.cc:1145] Deleting tablet 12f6403cde734c1394aabfc92c093290
0927 15:06:25.331677 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.341606 (+ 9929us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.365652 (+ 24046us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.374296 (+ 8644us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1453572}
I20260927 15:06:25.374783 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 12f6403cde734c1394aabfc92c093290 (table default.Table_2c48b816d5304111b8219dab75d9045e [id=0edcbb91cd0c40a786b015c417ed12f6]) successfully deleted
I20260927 15:06:25.375206 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b4beb4112734b9c91e32b300fd266d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.376786 910 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:25.377233 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1312) took 1308 ms. Trace:
I20260927 15:06:25.377393 1552 ts_tablet_manager.cc:1428] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260927 15:06:25.377315 3167 rpcz_store.cc:276] 0927 15:06:24.069164 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.167115 (+ 97951us) service_pool.cc:227] Handling call
0927 15:06:25.377123 (+1210008us) ts_tablet_manager.cc:1145] Deleting tablet 8034812bd8b44d97bc63b7d65b8f83d1
0927 15:06:25.377132 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.377216 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209848}
W20260927 15:06:25.377717 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8034812bd8b44d97bc63b7d65b8f83d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8034812bd8b44d97bc63b7d65b8f83d1 already in progress: creating tablet
I20260927 15:06:25.379967 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_42a3d94c0b8941159390c7b63237c540" } new_table_name: "default.Table_cb6e33f1eea9475b95a75d69bf52e008" modify_external_catalogs: true
I20260927 15:06:25.381388 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ad7e667a8ad34ec0982da6f0d22e165d" } new_table_name: "default.Table_c0e0bbf4ead54026bb2cf033a738e57c" modify_external_catalogs: true
I20260927 15:06:25.378798 1556 ts_tablet_manager.cc:1428] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20260927 15:06:25.384593 1552 tablet_bootstrap.cc:492] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:25.385969 1552 tablet_bootstrap.cc:654] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:25.388039 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0de058913cf340e59a7c10822ae6055f has no consensus state
I20260927 15:06:25.388315 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
W20260927 15:06:25.391806 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4c230b306aa24570ba1b6c8a6d90b24f consensus state has no leader
I20260927 15:06:25.400943 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8c4bf3aaab144abaacd7d4299e48ac7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:25.401216 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 5eac490b2b4b4c1daf236667e3bf8446 (DEFAULT_TABLE table=default.Table_66e6745812d34935870c1ccdcfe5a816 [id=f250ccdf30fa4436aafef55bfbafd4e5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:25.401458 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c4bf3aaab144abaacd7d4299e48ac7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.401612 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eac490b2b4b4c1daf236667e3bf8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.401652 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 5eac490b2b4b4c1daf236667e3bf8446 (DEFAULT_TABLE table=default.Table_66e6745812d34935870c1ccdcfe5a816 [id=f250ccdf30fa4436aafef55bfbafd4e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.402034 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eac490b2b4b4c1daf236667e3bf8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.405531 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_364502146dc94d29ad5dfeee8614488e" } modify_external_catalogs: true
I20260927 15:06:25.405754 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_364502146dc94d29ad5dfeee8614488e" } modify_external_catalogs: true
I20260927 15:06:25.405826 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ca5a9b80300b42728744d2e195db648b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.406319 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca5a9b80300b42728744d2e195db648b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.407255 913 master_service.cc:946] ReplaceTablet: received request to replace tablet 180c347e066f4d9a897825bad8a32d69 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:25.410276 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c90e10a8cad34967be2fab613de9c78f
I20260927 15:06:25.410362 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0e313b183d4549ca975d8077b22fc3f6
I20260927 15:06:25.411417 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet c90e10a8cad34967be2fab613de9c78f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.411638 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet c90e10a8cad34967be2fab613de9c78f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.411850 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e313b183d4549ca975d8077b22fc3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.412096 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e313b183d4549ca975d8077b22fc3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.413144 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e313b183d4549ca975d8077b22fc3f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.415607 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 5eac490b2b4b4c1daf236667e3bf8446 (DEFAULT_TABLE table=default.Table_66e6745812d34935870c1ccdcfe5a816 [id=f250ccdf30fa4436aafef55bfbafd4e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.416563 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet c90e10a8cad34967be2fab613de9c78f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.417951 1418 tablet_service.cc:1467] Processing CreateTablet for tablet cf11130f994648769767df94b9e5228b (DEFAULT_TABLE table=default.Table_de0f24579fff4970bcb165b09f879d44 [id=08f996d979f14d0c9066dce033bd7ebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.418684 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf11130f994648769767df94b9e5228b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.419018 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 180c347e066f4d9a897825bad8a32d69
I20260927 15:06:25.419127 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a1cf541492d1404dbddff27f0415de8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:25.419354 913 catalog_manager.cc:6565] ReplaceTablet: tablet 180c347e066f4d9a897825bad8a32d69 deleted and replaced by tablet d8be343d34234d518f2d5f6cbd983f4b
W20260927 15:06:25.419636 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1cf541492d1404dbddff27f0415de8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.420401 1144 tablet_service.cc:1514] Processing DeleteTablet for tablet 180c347e066f4d9a897825bad8a32d69 with delete_type TABLET_DATA_DELETED (replaced by tablet d8be343d34234d518f2d5f6cbd983f4b) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.420746 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 180c347e066f4d9a897825bad8a32d69 with delete_type TABLET_DATA_DELETED (replaced by tablet d8be343d34234d518f2d5f6cbd983f4b) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.421073 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e8627fa93635406394c82a90066c8df4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:25.421394 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_43bc54a224174626b9698e42dfc19583"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:25.421725 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_509996d8a440495796331c77fab835ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.421875 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43bc54a224174626b9698e42dfc19583 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:25.422187 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_509996d8a440495796331c77fab835ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.422217 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c2bf22bb725d4f42b715ca3be60f0cfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.422601 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2bf22bb725d4f42b715ca3be60f0cfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:25.421557 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8627fa93635406394c82a90066c8df4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.423100 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f5a8babbf25c4a88865463b6d4178ac0" } new_table_name: "default.Table_6b5fe893548f4774ae229030339f885f" modify_external_catalogs: true
I20260927 15:06:25.423796 1270 tablet_service.cc:1467] Processing CreateTablet for tablet cf11130f994648769767df94b9e5228b (DEFAULT_TABLE table=default.Table_de0f24579fff4970bcb165b09f879d44 [id=08f996d979f14d0c9066dce033bd7ebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.424116 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8f3f5117c7a949e59bf75560bbec6325" } new_table_name: "default.Table_772f89b27e494146a12fe1f53b3a61cc" modify_external_catalogs: true
I20260927 15:06:25.424193 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf11130f994648769767df94b9e5228b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.425127 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d730ac6787fb440dbad00713e38fc65e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.425503 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d730ac6787fb440dbad00713e38fc65e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.427469 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet 180c347e066f4d9a897825bad8a32d69 with delete_type TABLET_DATA_DELETED (replaced by tablet d8be343d34234d518f2d5f6cbd983f4b) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.430562 1552 tablet_bootstrap.cc:492] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.430657 1561 tablet_bootstrap.cc:654] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.430684 1552 ts_tablet_manager.cc:1397] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.001s
I20260927 15:06:25.431361 1552 raft_consensus.cc:348] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.431564 1552 raft_consensus.cc:374] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.431631 1552 raft_consensus.cc:729] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.431833 1552 consensus_queue.cc:260] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:25.439949 1102 consensus_peers.cc:487] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:25.440277 1556 tablet_bootstrap.cc:492] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:25.443675 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_551093c99d6f4eb88aa8ecd6fe4feb5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.444233 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_551093c99d6f4eb88aa8ecd6fe4feb5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.446002 1556 tablet_bootstrap.cc:654] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.445993 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_408d5290765e4ad48e15300c6ff5f72a" } new_table_name: "default.Table_5cac038f0dac43d792267233cb64de25" modify_external_catalogs: true
I20260927 15:06:25.447191 1552 ts_tablet_manager.cc:1428] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 15:06:25.447096 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5c89a4c26c1349df9e405dfabc6aeb31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.447474 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c89a4c26c1349df9e405dfabc6aeb31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.449247 1552 tablet_bootstrap.cc:492] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:25.450557 1552 tablet_bootstrap.cc:654] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:25.450843 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91d3f636671b4aa5825397cb97f6e909 consensus state has no leader
I20260927 15:06:25.452049 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eac490b2b4b4c1daf236667e3bf8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.452114 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:25.379130 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1313) took 1309 ms. Trace:
I20260927 15:06:25.455001 3167 rpcz_store.cc:276] 0927 15:06:24.069242 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.167286 (+ 98044us) service_pool.cc:227] Handling call
0927 15:06:25.379035 (+1211749us) ts_tablet_manager.cc:1145] Deleting tablet decee14b5d7a4aef9989051dcaeb5a7b
0927 15:06:25.379044 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.379115 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1211639}
W20260927 15:06:25.455610 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet decee14b5d7a4aef9989051dcaeb5a7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet decee14b5d7a4aef9989051dcaeb5a7b already in progress: creating tablet
I20260927 15:06:25.456058 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1315) took 1312 ms. Trace:
I20260927 15:06:25.456195 3167 rpcz_store.cc:276] 0927 15:06:24.143692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.167694 (+ 24002us) service_pool.cc:227] Handling call
0927 15:06:25.455931 (+1288237us) ts_tablet_manager.cc:1145] Deleting tablet 1d9562d917b74db9aa4a9678b9d32841
0927 15:06:25.455943 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.456038 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288107}
W20260927 15:06:25.456621 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1d9562d917b74db9aa4a9678b9d32841 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d9562d917b74db9aa4a9678b9d32841 already in progress: creating tablet
I20260927 15:06:25.456986 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1316) took 1313 ms. Trace:
I20260927 15:06:25.457116 3167 rpcz_store.cc:276] 0927 15:06:24.143814 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.167829 (+ 24015us) service_pool.cc:227] Handling call
0927 15:06:25.456890 (+1289061us) ts_tablet_manager.cc:1145] Deleting tablet 8c2b6f278ef64476b1f4a1f1c69e45d1
0927 15:06:25.456900 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.456971 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288964}
W20260927 15:06:25.457577 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 already in progress: creating tablet
I20260927 15:06:25.459638 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1317) took 1308 ms. Trace:
I20260927 15:06:25.459762 3167 rpcz_store.cc:276] 0927 15:06:24.151495 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.167930 (+ 16435us) service_pool.cc:227] Handling call
0927 15:06:25.459536 (+1291606us) ts_tablet_manager.cc:1145] Deleting tablet 0617b596022e48e7a2913762ae39251e
0927 15:06:25.459548 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.459622 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1291506}
W20260927 15:06:25.460173 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0617b596022e48e7a2913762ae39251e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0617b596022e48e7a2913762ae39251e already in progress: creating tablet
W20260927 15:06:25.460755 1099 consensus_peers.cc:487] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2ba3bdf50b14aec85a99742426e9298. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:25.461632 1416 tablet_service.cc:1467] Processing CreateTablet for tablet cf6fdc99e2264106b3e492c5cfd0f302 (DEFAULT_TABLE table=default.Table_5aa7437a03474a359e81a00987b02ccf [id=374363d73ac04cac918654973e2cf80d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.461790 1144 tablet_service.cc:1467] Processing CreateTablet for tablet cf11130f994648769767df94b9e5228b (DEFAULT_TABLE table=default.Table_de0f24579fff4970bcb165b09f879d44 [id=08f996d979f14d0c9066dce033bd7ebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.461977 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf6fdc99e2264106b3e492c5cfd0f302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.467033 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1318) took 1315 ms. Trace:
I20260927 15:06:25.467170 3167 rpcz_store.cc:276] 0927 15:06:24.151636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.168027 (+ 16391us) service_pool.cc:227] Handling call
0927 15:06:25.466917 (+1298890us) ts_tablet_manager.cc:1145] Deleting tablet 04fe5b9e0d7747a185c1666664cb4378
0927 15:06:25.466927 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.467017 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1298798}
I20260927 15:06:25.467211 1285 tablet_service.cc:1467] Processing CreateTablet for tablet cf6fdc99e2264106b3e492c5cfd0f302 (DEFAULT_TABLE table=default.Table_5aa7437a03474a359e81a00987b02ccf [id=374363d73ac04cac918654973e2cf80d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.467574 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf11130f994648769767df94b9e5228b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.467576 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf6fdc99e2264106b3e492c5cfd0f302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.475517 3223 consensus_queue.cc:1035] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:06:25.484515 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54cf2f6a6a5042a1be0d53d9ea66bd29 consensus state has no leader
W20260927 15:06:25.486286 1102 consensus_peers.cc:487] T bd5b041a4274477895e88d4822b91cca P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:25.488137 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cd3eb83597ef4aae9bf00fcfc2517ea6
I20260927 15:06:25.489975 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet cd3eb83597ef4aae9bf00fcfc2517ea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.491308 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet cd3eb83597ef4aae9bf00fcfc2517ea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.491520 1211 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
W20260927 15:06:25.492117 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 62fb9c535738497389ac5711e2f03888 consensus state has no leader
I20260927 15:06:25.493568 1137 tablet_service.cc:1467] Processing CreateTablet for tablet cf6fdc99e2264106b3e492c5cfd0f302 (DEFAULT_TABLE table=default.Table_5aa7437a03474a359e81a00987b02ccf [id=374363d73ac04cac918654973e2cf80d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.493942 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf6fdc99e2264106b3e492c5cfd0f302. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.495237 1102 consensus_peers.cc:487] T e2ba3bdf50b14aec85a99742426e9298 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:25.496047 1285 tablet_service.cc:1467] Processing CreateTablet for tablet e07d9c71bf8b44338d07b4dac500a052 (DEFAULT_TABLE table=default.Table_0f659a8971134327870326b1abbd02ef [id=f2503cfebe054c51a07250e5a22c3a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.496444 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e07d9c71bf8b44338d07b4dac500a052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.496541 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 4ef57f9016fa4c88bd45cf7c211a3197 (DEFAULT_TABLE table=default.Table_98a757a95a984780a58b5621784bf721 [id=f370b49e24714d3caf3ee87a913ae57f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.496840 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ef57f9016fa4c88bd45cf7c211a3197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.503896 1144 tablet_service.cc:1467] Processing CreateTablet for tablet e07d9c71bf8b44338d07b4dac500a052 (DEFAULT_TABLE table=default.Table_0f659a8971134327870326b1abbd02ef [id=f2503cfebe054c51a07250e5a22c3a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.504405 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e07d9c71bf8b44338d07b4dac500a052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.507413 2119 ts_tablet_manager.cc:1918] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:25.510596 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 04fe5b9e0d7747a185c1666664cb4378 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04fe5b9e0d7747a185c1666664cb4378 already in progress: creating tablet
I20260927 15:06:25.490207 1416 tablet_service.cc:1514] Processing DeleteTablet for tablet cd3eb83597ef4aae9bf00fcfc2517ea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.495908 1402 tablet_service.cc:1467] Processing CreateTablet for tablet e07d9c71bf8b44338d07b4dac500a052 (DEFAULT_TABLE table=default.Table_0f659a8971134327870326b1abbd02ef [id=f2503cfebe054c51a07250e5a22c3a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.511075 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e07d9c71bf8b44338d07b4dac500a052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.515697 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 4ef57f9016fa4c88bd45cf7c211a3197 (DEFAULT_TABLE table=default.Table_98a757a95a984780a58b5621784bf721 [id=f370b49e24714d3caf3ee87a913ae57f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.515901 1556 tablet_bootstrap.cc:492] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:25.516985 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 4ef57f9016fa4c88bd45cf7c211a3197 (DEFAULT_TABLE table=default.Table_98a757a95a984780a58b5621784bf721 [id=f370b49e24714d3caf3ee87a913ae57f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.517350 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ef57f9016fa4c88bd45cf7c211a3197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.518307 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 30529cb465f24677a9a3614d24c03af5 (DEFAULT_TABLE table=default.Table_794e803c168b4dc5a020c370b62ddc2e [id=603a5de4c9894c4996615083d2eda727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.518592 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30529cb465f24677a9a3614d24c03af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.519150 1556 ts_tablet_manager.cc:1397] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.079s user 0.001s sys 0.003s
I20260927 15:06:25.519891 1556 raft_consensus.cc:348] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.516068 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ef57f9016fa4c88bd45cf7c211a3197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.511059 3167 tablet_replica.cc:330] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:25.524967 3167 raft_consensus.cc:2229] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:25.526518 1561 tablet_bootstrap.cc:492] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:25.526659 1561 ts_tablet_manager.cc:1397] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.291s user 0.009s sys 0.001s
I20260927 15:06:25.527530 1561 raft_consensus.cc:348] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.527732 1561 raft_consensus.cc:374] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.527786 1561 raft_consensus.cc:729] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.527978 1561 consensus_queue.cc:260] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.528671 1561 ts_tablet_manager.cc:1428] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:25.528937 1561 tablet_bootstrap.cc:492] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:25.531087 1561 tablet_bootstrap.cc:654] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.532501 1143 tablet_service.cc:1467] Processing CreateTablet for tablet f18da3fd00cc4eeb974669e385e90dd6 (DEFAULT_TABLE table=default.Table_036c6a31c1554c64b2d42d657c5a8dea [id=61df74ae9d994d29bc6501d71a581462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.532729 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 2ec229806b71408ca6a5f86703fbf705 (DEFAULT_TABLE table=default.Table_3876e0af15fc4aa9bc1ea98a63734e89 [id=7fc721c2814b4493a94d37d69fd88da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.532842 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f18da3fd00cc4eeb974669e385e90dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.533056 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ec229806b71408ca6a5f86703fbf705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.540505 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 1b34c8654ecf4613a96e44ffe694798c (DEFAULT_TABLE table=default.Table_a18d94cec70e4ebd817697122070733b [id=07cef97e18a04ea18c220664172e8736]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.540859 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b34c8654ecf4613a96e44ffe694798c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.541546 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 9f96655527c94392b745de1848587f80 (DEFAULT_TABLE table=default.Table_429d443b5fb143fe98b4859408b4ee8c [id=2eefc3c4f64b40208b5e377b4326e228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.542238 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f96655527c94392b745de1848587f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.546288 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 0ff0d766443b4a8fa55f07d3b2123503 (DEFAULT_TABLE table=default.Table_919553c2f3764db79a9723eef628899d [id=1b44d1f4ac9d436394950dbcff395d3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.546603 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ff0d766443b4a8fa55f07d3b2123503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.547148 2119 log.cc:1196] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/568ba79ea795403cba76fb6632efd7e2
I20260927 15:06:25.547554 2119 ts_tablet_manager.cc:1939] T 568ba79ea795403cba76fb6632efd7e2 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:25.548116 1139 tablet_service.cc:1467] Processing CreateTablet for tablet e94a69f56a6541f18426be2355a5bae2 (DEFAULT_TABLE table=default.Table_c66d128c837e453d9ed283938dcc7449 [id=fa699dffe8214c59a37200e579c59e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.548429 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e94a69f56a6541f18426be2355a5bae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.550694 1140 tablet_service.cc:1467] Processing CreateTablet for tablet e37e32d17f984d7db7ff9570175c18ed (DEFAULT_TABLE table=default.Table_a1576e767b1042379532c20177c72f68 [id=7ba31ad0717042c99dfd43836eb2bbfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.551021 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37e32d17f984d7db7ff9570175c18ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.551581 913 master_service.cc:946] ReplaceTablet: received request to replace tablet db62070ea78b43e69ddd249a71e9ceea from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:25.551702 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c272da8a59fe42d5a5a4bf88b8f3f3ce" } modify_external_catalogs: true
I20260927 15:06:25.551884 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c272da8a59fe42d5a5a4bf88b8f3f3ce" } modify_external_catalogs: true
I20260927 15:06:25.554420 1269 tablet_service.cc:1467] Processing CreateTablet for tablet e37e32d17f984d7db7ff9570175c18ed (DEFAULT_TABLE table=default.Table_a1576e767b1042379532c20177c72f68 [id=7ba31ad0717042c99dfd43836eb2bbfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.554778 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37e32d17f984d7db7ff9570175c18ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.523589 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 30529cb465f24677a9a3614d24c03af5 (DEFAULT_TABLE table=default.Table_794e803c168b4dc5a020c370b62ddc2e [id=603a5de4c9894c4996615083d2eda727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.530112 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 9f96655527c94392b745de1848587f80 (DEFAULT_TABLE table=default.Table_429d443b5fb143fe98b4859408b4ee8c [id=2eefc3c4f64b40208b5e377b4326e228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.555145 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 4714d536373a4bf2a4be9ebeaebe77c1 with delete_type TABLET_DATA_DELETED (replaced by tablet f0e0d5f68e5b4bccb59ca2c31efdc60f) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.555634 1562 ts_tablet_manager.cc:1918] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:25.555699 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f96655527c94392b745de1848587f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.555722 1562 log.cc:1196] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/3042c17580d54082971b761433a7dca9
I20260927 15:06:25.556027 1562 ts_tablet_manager.cc:1939] T 3042c17580d54082971b761433a7dca9 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:25.556290 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1049) took 6385 ms. Trace:
I20260927 15:06:25.556355 1562 rpcz_store.cc:276] 0927 15:06:19.170705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.171782 (+ 1077us) service_pool.cc:227] Handling call
0927 15:06:25.304003 (+6132221us) ts_tablet_manager.cc:1145] Deleting tablet 3042c17580d54082971b761433a7dca9
0927 15:06:25.304015 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.487737 (+183722us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.555524 (+ 67787us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.556278 (+ 754us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6132097}
I20260927 15:06:25.556859 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 3042c17580d54082971b761433a7dca9 (table default.Table_30f44c4820b9415daf4edfe7ea689da3 [id=d80cbbb5881e42f0b5651563d6f60bb5]) successfully deleted
I20260927 15:06:25.559352 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 315f73fa35af4ca9ae64a13a06316f66 (DEFAULT_TABLE table=default.Table_8a91020bbdf74fca974b5a6d451ea784 [id=1780b9a4b83d4a708e43edc5b5a828ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.530200 1271 tablet_service.cc:1467] Processing CreateTablet for tablet f18da3fd00cc4eeb974669e385e90dd6 (DEFAULT_TABLE table=default.Table_036c6a31c1554c64b2d42d657c5a8dea [id=61df74ae9d994d29bc6501d71a581462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.561599 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f18da3fd00cc4eeb974669e385e90dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.531504 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 2ec229806b71408ca6a5f86703fbf705 (DEFAULT_TABLE table=default.Table_3876e0af15fc4aa9bc1ea98a63734e89 [id=7fc721c2814b4493a94d37d69fd88da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.563120 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ec229806b71408ca6a5f86703fbf705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.564930 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 0de058913cf340e59a7c10822ae6055f (DEFAULT_TABLE table=default.Table_cb6e33f1eea9475b95a75d69bf52e008 [id=8c91d9c9aa644edb8318143ef4ef0093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.565279 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7142c97a22e74bc8b93c7e9acb949073
I20260927 15:06:25.531960 1552 tablet_bootstrap.cc:492] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.536239 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 1b34c8654ecf4613a96e44ffe694798c (DEFAULT_TABLE table=default.Table_a18d94cec70e4ebd817697122070733b [id=07cef97e18a04ea18c220664172e8736]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.567001 1552 ts_tablet_manager.cc:1397] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.118s user 0.003s sys 0.000s
I20260927 15:06:25.567055 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b34c8654ecf4613a96e44ffe694798c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.567068 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet db62070ea78b43e69ddd249a71e9ceea
I20260927 15:06:25.567405 913 catalog_manager.cc:6565] ReplaceTablet: tablet db62070ea78b43e69ddd249a71e9ceea deleted and replaced by tablet d87f66df496942cbbdf680dd4de1a310
I20260927 15:06:25.554775 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1165) took 2349 ms. Trace:
I20260927 15:06:25.567651 2119 rpcz_store.cc:276] 0927 15:06:23.204977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.205335 (+ 358us) service_pool.cc:227] Handling call
0927 15:06:24.932892 (+1727557us) ts_tablet_manager.cc:1145] Deleting tablet 568ba79ea795403cba76fb6632efd7e2
0927 15:06:24.932902 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.442444 (+509542us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.507331 (+ 64887us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.554759 (+ 47428us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1727322}
I20260927 15:06:25.567750 1552 raft_consensus.cc:348] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.567976 1552 raft_consensus.cc:374] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.568039 1552 raft_consensus.cc:729] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.568301 1552 consensus_queue.cc:260] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.568854 1552 ts_tablet_manager.cc:1428] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:25.569100 1552 tablet_bootstrap.cc:492] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:25.570295 1552 tablet_bootstrap.cc:654] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.571028 1139 tablet_service.cc:1514] Processing DeleteTablet for tablet db62070ea78b43e69ddd249a71e9ceea with delete_type TABLET_DATA_DELETED (replaced by tablet d87f66df496942cbbdf680dd4de1a310) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.571130 1146 tablet_service.cc:1467] Processing CreateTablet for tablet ca1f9ad8f64c4201a98c931a40d29e54 (DEFAULT_TABLE table=default.Table_41b0eed35d19455ba973069a70acbc64 [id=c567d08f322647c3b72d29ae94d1d8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.572353 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 23caf1cba6c1487dafd8aee74b2c58b2 (DEFAULT_TABLE table=default.Table_7a3f92ab32c24543a706b0bd262a2dc3 [id=ca3b6b5e46c94f54a6487f84a1489532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.541859 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 0de058913cf340e59a7c10822ae6055f (DEFAULT_TABLE table=default.Table_cb6e33f1eea9475b95a75d69bf52e008 [id=8c91d9c9aa644edb8318143ef4ef0093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.544325 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 0ff0d766443b4a8fa55f07d3b2123503 (DEFAULT_TABLE table=default.Table_919553c2f3764db79a9723eef628899d [id=1b44d1f4ac9d436394950dbcff395d3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.546108 1280 tablet_service.cc:1467] Processing CreateTablet for tablet e94a69f56a6541f18426be2355a5bae2 (DEFAULT_TABLE table=default.Table_c66d128c837e453d9ed283938dcc7449 [id=fa699dffe8214c59a37200e579c59e1a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:25.573220 1102 consensus_peers.cc:487] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:25.573698 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ff0d766443b4a8fa55f07d3b2123503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.575238 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 7a0b0e1c11b047e9935d9bae942e95bd (DEFAULT_TABLE table=default.Table_54073bf7dec94c5e8db9a20eff4fb711 [id=662dbfeffcbc4dd9bdd772bd4ab7083e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.575781 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1059) took 6340 ms. Trace:
I20260927 15:06:25.575857 1562 rpcz_store.cc:276] 0927 15:06:19.234902 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.234946 (+ 44us) service_pool.cc:227] Handling call
0927 15:06:25.556614 (+6321668us) ts_tablet_manager.cc:1145] Deleting tablet 9d8fd588fe344e819f13aadb33e26153
0927 15:06:25.556622 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.575765 (+ 19143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6321458}
I20260927 15:06:25.576220 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet db62070ea78b43e69ddd249a71e9ceea with delete_type TABLET_DATA_DELETED (replaced by tablet d87f66df496942cbbdf680dd4de1a310) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:25.576489 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 9d8fd588fe344e819f13aadb33e26153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d8fd588fe344e819f13aadb33e26153 already in progress: creating tablet
I20260927 15:06:25.576570 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ae003f1ca76472cbaa8b577b66fe84c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.576892 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 568ba79ea795403cba76fb6632efd7e2 (table default.Table_c28d498257e24a9da0bd0a67c9e5a953 [id=f66d759455bb472e9ec7816c859d2811]) successfully deleted
I20260927 15:06:25.576862 1267 tablet_service.cc:1467] Processing CreateTablet for tablet ca1f9ad8f64c4201a98c931a40d29e54 (DEFAULT_TABLE table=default.Table_41b0eed35d19455ba973069a70acbc64 [id=c567d08f322647c3b72d29ae94d1d8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.577167 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1f9ad8f64c4201a98c931a40d29e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.578868 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 2e542e408abd46ff8ec472f14f0dba5c (DEFAULT_TABLE table=default.Table_e7201c95f3774e8d9f1d97fafd16cb63 [id=66ed7f950e644d4b80f86413953d3c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.580772 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 23caf1cba6c1487dafd8aee74b2c58b2 (DEFAULT_TABLE table=default.Table_7a3f92ab32c24543a706b0bd262a2dc3 [id=ca3b6b5e46c94f54a6487f84a1489532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.580931 1142 tablet_service.cc:1467] Processing CreateTablet for tablet 1b8a8b6d74cf4a98bca8f3c0a2bef0f3 (DEFAULT_TABLE table=default.Table_72023c794c384d78b2f120771a8d6e94 [id=7e62b91977314e03b5e61a352d02523f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.581063 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23caf1cba6c1487dafd8aee74b2c58b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.582984 1284 tablet_service.cc:1467] Processing CreateTablet for tablet 2e542e408abd46ff8ec472f14f0dba5c (DEFAULT_TABLE table=default.Table_e7201c95f3774e8d9f1d97fafd16cb63 [id=66ed7f950e644d4b80f86413953d3c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.583294 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e542e408abd46ff8ec472f14f0dba5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.583473 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_570d1e19c0ad439298f5a54fac20ff7e" } modify_external_catalogs: true
I20260927 15:06:25.583657 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_570d1e19c0ad439298f5a54fac20ff7e" } modify_external_catalogs: true
I20260927 15:06:25.585916 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e94a69f56a6541f18426be2355a5bae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.587605 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 315f73fa35af4ca9ae64a13a06316f66 (DEFAULT_TABLE table=default.Table_8a91020bbdf74fca974b5a6d451ea784 [id=1780b9a4b83d4a708e43edc5b5a828ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.588020 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 315f73fa35af4ca9ae64a13a06316f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.591032 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30529cb465f24677a9a3614d24c03af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.593161 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 7142c97a22e74bc8b93c7e9acb949073 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.593508 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 1b8a8b6d74cf4a98bca8f3c0a2bef0f3 (DEFAULT_TABLE table=default.Table_72023c794c384d78b2f120771a8d6e94 [id=7e62b91977314e03b5e61a352d02523f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.593860 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b8a8b6d74cf4a98bca8f3c0a2bef0f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.595395 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_04806c4d169c477aa076124ac18c17f1" } new_table_name: "default.Table_716ceae421a34f01b220259826938914" modify_external_catalogs: true
I20260927 15:06:25.599614 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 315f73fa35af4ca9ae64a13a06316f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.599715 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9421c4a3c84e449ea9e86594f7342489" } new_table_name: "default.Table_11d82a666e204a059c3afbf4a7d46c2d" modify_external_catalogs: true
I20260927 15:06:25.603041 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a0b0e1c11b047e9935d9bae942e95bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.604782 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1af8b4fa71d54bb2b83a0a81ef43d269 consensus state has no leader
I20260927 15:06:25.607306 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23caf1cba6c1487dafd8aee74b2c58b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.607487 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e542e408abd46ff8ec472f14f0dba5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.610289 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet dbeebc4fdf444b24ab901e4bb80b49d1
I20260927 15:06:25.611037 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b8a8b6d74cf4a98bca8f3c0a2bef0f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.612176 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_523e2ef14fe8419c80231f7d636c8d6b" } modify_external_catalogs: true
I20260927 15:06:25.612387 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_523e2ef14fe8419c80231f7d636c8d6b" } modify_external_catalogs: true
I20260927 15:06:25.614611 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_90b9ccd25c694abe98e24e0b37bb75af" } modify_external_catalogs: true
I20260927 15:06:25.614835 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_90b9ccd25c694abe98e24e0b37bb75af" } modify_external_catalogs: true
I20260927 15:06:25.614962 1128 tablet_service.cc:1514] Processing DeleteTablet for tablet dbeebc4fdf444b24ab901e4bb80b49d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.615342 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de058913cf340e59a7c10822ae6055f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.619258 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_104aa6a284064e49bdcc3395e61dd253"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.619791 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_104aa6a284064e49bdcc3395e61dd253 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.607319 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1055) took 6372 ms. Trace:
I20260927 15:06:25.622373 1562 rpcz_store.cc:276] 0927 15:06:19.234469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.235455 (+ 986us) service_pool.cc:227] Handling call
0927 15:06:25.576127 (+6340672us) ts_tablet_manager.cc:1145] Deleting tablet 72862763900249b8a7079fde891d8021
0927 15:06:25.607184 (+ 31057us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.607303 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6340554}
I20260927 15:06:25.622844 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1056) took 6388 ms. Trace:
I20260927 15:06:25.622916 1562 rpcz_store.cc:276] 0927 15:06:19.234543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.235612 (+ 1069us) service_pool.cc:227] Handling call
0927 15:06:25.622718 (+6387106us) ts_tablet_manager.cc:1145] Deleting tablet 85e8909687fb40fdbccad15cd99b6eaf
0927 15:06:25.622728 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.622812 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6386984}
W20260927 15:06:25.623245 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 72862763900249b8a7079fde891d8021 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72862763900249b8a7079fde891d8021 already in progress: creating tablet
W20260927 15:06:25.623442 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 85e8909687fb40fdbccad15cd99b6eaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85e8909687fb40fdbccad15cd99b6eaf already in progress: creating tablet
I20260927 15:06:25.623718 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1058) took 6389 ms. Trace:
I20260927 15:06:25.623785 1562 rpcz_store.cc:276] 0927 15:06:19.234756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.238870 (+ 4114us) service_pool.cc:227] Handling call
0927 15:06:25.623625 (+6384755us) ts_tablet_manager.cc:1145] Deleting tablet 1dfbe94faecb4c6a9bea043a4b0f6361
0927 15:06:25.623634 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.623704 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6384606}
W20260927 15:06:25.624217 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 1dfbe94faecb4c6a9bea043a4b0f6361 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dfbe94faecb4c6a9bea043a4b0f6361 already in progress: creating tablet
I20260927 15:06:25.624476 1562 tablet_replica.cc:330] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:25.624683 1562 raft_consensus.cc:2229] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:25.624979 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1f9ad8f64c4201a98c931a40d29e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.625458 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2a31738c476c459280e837ff109fd84f
I20260927 15:06:25.626719 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9737e70f2ddb45029c042ffbd83af157
I20260927 15:06:25.627648 1413 tablet_service.cc:1514] Processing DeleteTablet for tablet 9737e70f2ddb45029c042ffbd83af157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.517274 1416 tablet_service.cc:1467] Processing CreateTablet for tablet 30529cb465f24677a9a3614d24c03af5 (DEFAULT_TABLE table=default.Table_794e803c168b4dc5a020c370b62ddc2e [id=603a5de4c9894c4996615083d2eda727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.627811 3167 pending_rounds.cc:62] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:25.627853 3167 pending_rounds.cc:68] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976410768228352 op_type: NO_OP noop_request { }
I20260927 15:06:25.627967 3167 raft_consensus.cc:2866] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:25.628039 1416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30529cb465f24677a9a3614d24c03af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.531060 1410 tablet_service.cc:1467] Processing CreateTablet for tablet 2ec229806b71408ca6a5f86703fbf705 (DEFAULT_TABLE table=default.Table_3876e0af15fc4aa9bc1ea98a63734e89 [id=7fc721c2814b4493a94d37d69fd88da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.628049 3167 raft_consensus.cc:2258] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.631117 1410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ec229806b71408ca6a5f86703fbf705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.531211 1415 tablet_service.cc:1467] Processing CreateTablet for tablet f18da3fd00cc4eeb974669e385e90dd6 (DEFAULT_TABLE table=default.Table_036c6a31c1554c64b2d42d657c5a8dea [id=61df74ae9d994d29bc6501d71a581462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.632035 1415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f18da3fd00cc4eeb974669e385e90dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.632653 1142 tablet_service.cc:1514] Processing DeleteTablet for tablet 9737e70f2ddb45029c042ffbd83af157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.632884 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de058913cf340e59a7c10822ae6055f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.632929 1562 raft_consensus.cc:2258] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.633463 1562 ts_tablet_manager.cc:1905] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:25.637079 3167 ts_tablet_manager.cc:1905] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:25.638883 3223 raft_consensus.cc:482] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.638677 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_7092bbe836634d1fb388491e9ecc2957"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:25.639000 3223 raft_consensus.cc:504] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:25.639318 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7092bbe836634d1fb388491e9ecc2957 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.639576 3223 leader_election.cc:288] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:25.640194 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4714d536373a4bf2a4be9ebeaebe77c1" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:25.640672 1238 leader_election.cc:341] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 4714d536373a4bf2a4be9ebeaebe77c1
I20260927 15:06:25.640970 1239 leader_election.cc:302] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.641227 3223 raft_consensus.cc:2726] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.642531 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a31738c476c459280e837ff109fd84f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.642807 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 7142c97a22e74bc8b93c7e9acb949073 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.576584 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 7a0b0e1c11b047e9935d9bae942e95bd (DEFAULT_TABLE table=default.Table_54073bf7dec94c5e8db9a20eff4fb711 [id=662dbfeffcbc4dd9bdd772bd4ab7083e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.643697 1561 tablet_bootstrap.cc:492] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:25.643831 1561 ts_tablet_manager.cc:1397] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.000s
I20260927 15:06:25.643888 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a0b0e1c11b047e9935d9bae942e95bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.644554 1561 raft_consensus.cc:348] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.644763 1561 raft_consensus.cc:374] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.644824 1561 raft_consensus.cc:729] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.645013 1561 consensus_queue.cc:260] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.645538 1561 ts_tablet_manager.cc:1428] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:25.645798 1561 tablet_bootstrap.cc:492] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:25.568039 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1171) took 2362 ms. Trace:
I20260927 15:06:25.646507 2119 rpcz_store.cc:276] 0927 15:06:23.205475 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.205653 (+ 178us) service_pool.cc:227] Handling call
0927 15:06:25.567936 (+2362283us) ts_tablet_manager.cc:1145] Deleting tablet d35282079d4f4ab3a6093385244236eb
0927 15:06:25.567946 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.568026 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2362069}
I20260927 15:06:25.646905 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1163) took 2442 ms. Trace:
I20260927 15:06:25.646977 2119 rpcz_store.cc:276] 0927 15:06:23.204759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.212386 (+ 7627us) service_pool.cc:227] Handling call
0927 15:06:25.646765 (+2434379us) ts_tablet_manager.cc:1145] Deleting tablet 4470df4cd407401ab03b6f62452c0dc7
0927 15:06:25.646776 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.646888 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2434114}
I20260927 15:06:25.647214 2119 tablet_replica.cc:330] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:25.647373 2119 raft_consensus.cc:2229] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:25.647516 2119 raft_consensus.cc:2258] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.647634 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet dbeebc4fdf444b24ab901e4bb80b49d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.648028 2119 ts_tablet_manager.cc:1905] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:25.649672 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f30db604c44a42eb9b59a1816cad7f44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:25.650070 1552 tablet_bootstrap.cc:492] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.650169 1552 ts_tablet_manager.cc:1397] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.000s
W20260927 15:06:25.650308 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f30db604c44a42eb9b59a1816cad7f44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.650880 1552 raft_consensus.cc:348] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.651113 1552 raft_consensus.cc:374] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.651166 1552 raft_consensus.cc:729] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.651338 1552 consensus_queue.cc:260] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.651623 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5474bb8f04f44464a989b7b4601ae781"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:25.651870 1552 ts_tablet_manager.cc:1428] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260927 15:06:25.651983 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet d35282079d4f4ab3a6093385244236eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d35282079d4f4ab3a6093385244236eb already in progress: creating tablet
I20260927 15:06:25.652127 1552 tablet_bootstrap.cc:492] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:25.652207 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 4470df4cd407401ab03b6f62452c0dc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4470df4cd407401ab03b6f62452c0dc7 already in progress: creating tablet
W20260927 15:06:25.652184 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5474bb8f04f44464a989b7b4601ae781 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.653714 1561 tablet_bootstrap.cc:654] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.655548 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ba8679c56bbb4c98b5ef7e30f76f5b1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.655963 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba8679c56bbb4c98b5ef7e30f76f5b1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.655999 1552 tablet_bootstrap.cc:654] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.657285 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3897e840376a41e09ba83d5f96f1dd34" } new_table_name: "default.Table_84670a65a64546309f984cd1bc204eac" modify_external_catalogs: true
I20260927 15:06:25.658118 2119 ts_tablet_manager.cc:1918] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:25.658219 2119 log.cc:1196] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/df6d7670381b49bb927943b2ee920c84
I20260927 15:06:25.658572 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_682b5cbc1e4f445eba8c243a26a9df25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.659044 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_682b5cbc1e4f445eba8c243a26a9df25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.659453 2119 ts_tablet_manager.cc:1939] T df6d7670381b49bb927943b2ee920c84 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:25.660257 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1166) took 2455 ms. Trace:
I20260927 15:06:25.660338 1291 raft_consensus.cc:3037] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.662374 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d533883e3344eca939cd67644895148 with delete_type TABLET_DATA_DELETED (replaced by tablet 534a74d9f8e648168b87e26fb73c8b3a) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.663638 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 9737e70f2ddb45029c042ffbd83af157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.664842 1552 tablet_bootstrap.cc:492] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.664950 1552 ts_tablet_manager.cc:1397] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260927 15:06:25.665531 1552 raft_consensus.cc:348] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.665709 1552 raft_consensus.cc:374] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.665766 1552 raft_consensus.cc:729] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.665997 1562 ts_tablet_manager.cc:1918] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:25.665961 1552 consensus_queue.cc:260] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.666103 1562 log.cc:1196] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/769e9b5c08cd44cc8a0d681500d64f54
I20260927 15:06:25.666405 1562 ts_tablet_manager.cc:1939] T 769e9b5c08cd44cc8a0d681500d64f54 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:25.666736 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1060) took 6431 ms. Trace:
I20260927 15:06:25.666852 1552 ts_tablet_manager.cc:1428] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:25.667325 1552 tablet_bootstrap.cc:492] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:25.664183 1285 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a31738c476c459280e837ff109fd84f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.539624 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 9f96655527c94392b745de1848587f80 (DEFAULT_TABLE table=default.Table_429d443b5fb143fe98b4859408b4ee8c [id=2eefc3c4f64b40208b5e377b4326e228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.541483 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 0de058913cf340e59a7c10822ae6055f (DEFAULT_TABLE table=default.Table_cb6e33f1eea9475b95a75d69bf52e008 [id=8c91d9c9aa644edb8318143ef4ef0093]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.670518 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0de058913cf340e59a7c10822ae6055f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.671195 1552 tablet_bootstrap.cc:654] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.544480 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 0ff0d766443b4a8fa55f07d3b2123503 (DEFAULT_TABLE table=default.Table_919553c2f3764db79a9723eef628899d [id=1b44d1f4ac9d436394950dbcff395d3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.674396 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ff0d766443b4a8fa55f07d3b2123503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.546222 1411 tablet_service.cc:1467] Processing CreateTablet for tablet e94a69f56a6541f18426be2355a5bae2 (DEFAULT_TABLE table=default.Table_c66d128c837e453d9ed283938dcc7449 [id=fa699dffe8214c59a37200e579c59e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.546986 1556 raft_consensus.cc:374] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.678951 1556 raft_consensus.cc:729] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.679123 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e94a69f56a6541f18426be2355a5bae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.679219 1556 consensus_queue.cc:260] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.679890 1556 ts_tablet_manager.cc:1428] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.161s user 0.001s sys 0.001s
I20260927 15:06:25.549045 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 1b34c8654ecf4613a96e44ffe694798c (DEFAULT_TABLE table=default.Table_a18d94cec70e4ebd817697122070733b [id=07cef97e18a04ea18c220664172e8736]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.549719 1403 tablet_service.cc:1467] Processing CreateTablet for tablet e37e32d17f984d7db7ff9570175c18ed (DEFAULT_TABLE table=default.Table_a1576e767b1042379532c20177c72f68 [id=7ba31ad0717042c99dfd43836eb2bbfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.557942 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 315f73fa35af4ca9ae64a13a06316f66 (DEFAULT_TABLE table=default.Table_8a91020bbdf74fca974b5a6d451ea784 [id=1780b9a4b83d4a708e43edc5b5a828ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.566068 1419 tablet_service.cc:1514] Processing DeleteTablet for tablet 7142c97a22e74bc8b93c7e9acb949073 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.568411 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet db62070ea78b43e69ddd249a71e9ceea with delete_type TABLET_DATA_DELETED (replaced by tablet d87f66df496942cbbdf680dd4de1a310) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.570251 1404 tablet_service.cc:1467] Processing CreateTablet for tablet ca1f9ad8f64c4201a98c931a40d29e54 (DEFAULT_TABLE table=default.Table_41b0eed35d19455ba973069a70acbc64 [id=c567d08f322647c3b72d29ae94d1d8fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.571569 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 23caf1cba6c1487dafd8aee74b2c58b2 (DEFAULT_TABLE table=default.Table_7a3f92ab32c24543a706b0bd262a2dc3 [id=ca3b6b5e46c94f54a6487f84a1489532]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.574425 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 7a0b0e1c11b047e9935d9bae942e95bd (DEFAULT_TABLE table=default.Table_54073bf7dec94c5e8db9a20eff4fb711 [id=662dbfeffcbc4dd9bdd772bd4ab7083e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.576128 1406 tablet_service.cc:1467] Processing CreateTablet for tablet 2e542e408abd46ff8ec472f14f0dba5c (DEFAULT_TABLE table=default.Table_e7201c95f3774e8d9f1d97fafd16cb63 [id=66ed7f950e644d4b80f86413953d3c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.580463 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 1b8a8b6d74cf4a98bca8f3c0a2bef0f3 (DEFAULT_TABLE table=default.Table_72023c794c384d78b2f120771a8d6e94 [id=7e62b91977314e03b5e61a352d02523f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.611038 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet dbeebc4fdf444b24ab901e4bb80b49d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.626291 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a31738c476c459280e837ff109fd84f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.681680 1556 tablet_bootstrap.cc:492] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:25.687433 1552 tablet_bootstrap.cc:492] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.687899 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 315f73fa35af4ca9ae64a13a06316f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.687999 1552 ts_tablet_manager.cc:1397] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.003s
I20260927 15:06:25.691397 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b8a8b6d74cf4a98bca8f3c0a2bef0f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.692041 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f96655527c94392b745de1848587f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.690934 1552 raft_consensus.cc:348] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.692359 1552 raft_consensus.cc:374] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.692632 1552 raft_consensus.cc:729] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.693277 1556 tablet_bootstrap.cc:654] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.695024 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23caf1cba6c1487dafd8aee74b2c58b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.694149 1552 consensus_queue.cc:260] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.696641 1552 ts_tablet_manager.cc:1428] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260927 15:06:25.697572 1552 tablet_bootstrap.cc:492] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:25.698735 1291 raft_consensus.cc:3037] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.699093 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e542e408abd46ff8ec472f14f0dba5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.699657 3223 raft_consensus.cc:482] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.699776 3223 raft_consensus.cc:504] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.700312 3223 leader_election.cc:288] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:25.700474 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_550687aecc8d4614bde9460879d9d576"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.701000 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_550687aecc8d4614bde9460879d9d576 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.702409 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_776494daeb7b4503a513e14e4da8dd2c" } new_table_name: "default.Table_9805998342e7470786c3bffe0ec0a889" modify_external_catalogs: true
I20260927 15:06:25.703006 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a0b0e1c11b047e9935d9bae942e95bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.703087 1238 leader_election.cc:341] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b9a97e3e6a5749feb4dd5f835d9c01ac
I20260927 15:06:25.706782 1552 tablet_bootstrap.cc:654] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.709899 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b34c8654ecf4613a96e44ffe694798c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.718981 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 190002us
I20260927 15:06:25.719146 3210 raft_consensus.cc:482] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.719702 3210 raft_consensus.cc:504] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.720310 3210 leader_election.cc:288] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:25.723186 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4612913071c2423fa050e81aa5cb9219"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.723913 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4612913071c2423fa050e81aa5cb9219 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.724308 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea3220df595848258d0f53fa941b2beb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:25.727319 1376 leader_election.cc:341] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.728221 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1f9ad8f64c4201a98c931a40d29e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.728653 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet ea3220df595848258d0f53fa941b2beb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.729274 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b23a43b448d3437cbd8ce7083dff3d36" } modify_external_catalogs: true
I20260927 15:06:25.729417 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b23a43b448d3437cbd8ce7083dff3d36" } modify_external_catalogs: true
I20260927 15:06:25.730065 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f4af77c955e24ad38b78c0afba81a10d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.730525 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4af77c955e24ad38b78c0afba81a10d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.731257 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37e32d17f984d7db7ff9570175c18ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.735579 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_682599a715844488b4cc55dcd6f0d70d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.736114 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_682599a715844488b4cc55dcd6f0d70d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.750321 1556 tablet_bootstrap.cc:492] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:25.750536 1556 ts_tablet_manager.cc:1397] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.069s user 0.004s sys 0.004s
W20260927 15:06:25.751296 907 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52555162ccaa455ca6c43b6c79f513ae consensus state has no leader
I20260927 15:06:25.751600 1556 raft_consensus.cc:348] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.751791 1556 raft_consensus.cc:374] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.751835 1556 raft_consensus.cc:729] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.752031 1556 consensus_queue.cc:260] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.753604 1556 ts_tablet_manager.cc:1428] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:25.758247 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b518b0bdc28d4894b2a09ef80c2e8d27" } new_table_name: "default.Table_0210cfc76feb4b09b5db961df8e0edb2" modify_external_catalogs: true
W20260927 15:06:25.759629 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d15b7dfb83494d329ca75dd96a189c60 consensus state has no leader
I20260927 15:06:25.760212 907 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:25.760607 1556 tablet_bootstrap.cc:492] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:25.703374 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9a97e3e6a5749feb4dd5f835d9c01ac" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:25.766883 1562 rpcz_store.cc:276] 0927 15:06:19.234993 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.239045 (+ 4052us) service_pool.cc:227] Handling call
0927 15:06:25.624437 (+6385392us) ts_tablet_manager.cc:1145] Deleting tablet 769e9b5c08cd44cc8a0d681500d64f54
0927 15:06:25.624446 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.642696 (+ 18250us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.665905 (+ 23209us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.666719 (+ 814us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6385275}
W20260927 15:06:25.723201 1099 consensus_peers.cc:487] T 52e7439320dd48aba25b5f7dc627964c P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52e7439320dd48aba25b5f7dc627964c. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:25.721093 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea3220df595848258d0f53fa941b2beb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:25.767196 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 44034.5us
I20260927 15:06:25.767323 1162 raft_consensus.cc:2454] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:25.767560 911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_437d2682e5f7473fa0056683c1d8babc" } modify_external_catalogs: true
I20260927 15:06:25.767741 911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_437d2682e5f7473fa0056683c1d8babc" } modify_external_catalogs: true
I20260927 15:06:25.768507 1374 leader_election.cc:302] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:25.768931 1239 leader_election.cc:302] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.779150 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 769e9b5c08cd44cc8a0d681500d64f54 (table default.Table_144247c8f6c749539a8c431dd3e74d17 [id=e8ef09e7d3114b19a5e62a4ff883166e]) successfully deleted
I20260927 15:06:25.779170 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1061) took 6544 ms. Trace:
I20260927 15:06:25.779289 1562 rpcz_store.cc:276] 0927 15:06:19.235073 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.239192 (+ 4119us) service_pool.cc:227] Handling call
0927 15:06:25.779005 (+6539813us) ts_tablet_manager.cc:1145] Deleting tablet 0163a49d9a894953905e20941878400b
0927 15:06:25.779020 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.779146 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6539672}
W20260927 15:06:25.779846 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 0163a49d9a894953905e20941878400b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0163a49d9a894953905e20941878400b already in progress: creating tablet
I20260927 15:06:25.790627 3235 raft_consensus.cc:482] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.790777 3235 raft_consensus.cc:504] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.791386 3235 leader_election.cc:288] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:25.792586 1099 leader_election.cc:341] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b44e2611d2bf40ae90c4fd857225e39e
I20260927 15:06:25.792634 3210 raft_consensus.cc:2781] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:25.792755 3210 raft_consensus.cc:482] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:25.792838 3210 raft_consensus.cc:3037] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.795154 3289 raft_consensus.cc:482] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.795286 3289 raft_consensus.cc:504] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.796039 3289 leader_election.cc:288] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:25.796248 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fd8311955974e1cbcdda1961c318588" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:25.796285 3210 raft_consensus.cc:504] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.796432 1162 raft_consensus.cc:2454] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:25.796777 3210 leader_election.cc:288] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:25.797017 1374 leader_election.cc:302] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:25.796840 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet b9a97e3e6a5749feb4dd5f835d9c01ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.797561 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea3220df595848258d0f53fa941b2beb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:25.797727 1162 raft_consensus.cc:3037] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.798341 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fd8311955974e1cbcdda1961c318588" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:25.798732 1561 tablet_bootstrap.cc:492] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:25.798890 1561 ts_tablet_manager.cc:1397] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.005s
I20260927 15:06:25.660349 2119 rpcz_store.cc:276] 0927 15:06:23.205074 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.216031 (+ 10957us) service_pool.cc:227] Handling call
0927 15:06:25.647179 (+2431148us) ts_tablet_manager.cc:1145] Deleting tablet df6d7670381b49bb927943b2ee920c84
0927 15:06:25.647187 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.655040 (+ 7853us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.658021 (+ 2981us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.660236 (+ 2215us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2430901}
I20260927 15:06:25.799086 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea3220df595848258d0f53fa941b2beb" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:25.799331 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet df6d7670381b49bb927943b2ee920c84 (table default.Table_c10827cf92b44050bf8d4dc379b26be3 [id=2125b2fb567a43128346e08a4370ace2]) successfully deleted
W20260927 15:06:25.799512 1376 leader_election.cc:341] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.799664 1561 raft_consensus.cc:348] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:25.799772 1376 leader_election.cc:341] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.799834 1561 raft_consensus.cc:374] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.799875 1561 raft_consensus.cc:729] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.800448 1162 raft_consensus.cc:2454] T ea3220df595848258d0f53fa941b2beb P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:25.800901 1374 leader_election.cc:302] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:25.801393 3210 raft_consensus.cc:2781] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:25.801532 3210 raft_consensus.cc:482] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:25.801790 3210 raft_consensus.cc:3037] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.804616 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1054) took 6570 ms. Trace:
I20260927 15:06:25.804751 1562 rpcz_store.cc:276] 0927 15:06:19.234378 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.235384 (+ 1006us) service_pool.cc:227] Handling call
0927 15:06:25.804488 (+6569104us) ts_tablet_manager.cc:1145] Deleting tablet eed526a0500c4f098719c74dd74975c6
0927 15:06:25.804499 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.804598 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6554265}
W20260927 15:06:25.805202 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet eed526a0500c4f098719c74dd74975c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eed526a0500c4f098719c74dd74975c6 already in progress: creating tablet
I20260927 15:06:25.806006 3210 raft_consensus.cc:504] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.807163 2119 tablet_replica.cc:330] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:25.807360 2119 raft_consensus.cc:2229] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260927 15:06:25.807408 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6cac7646e1e4497daa184b2662736053 consensus state has no leader
I20260927 15:06:25.807516 2119 raft_consensus.cc:2258] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.807583 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fd8311955974e1cbcdda1961c318588" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:25.807772 1162 raft_consensus.cc:3037] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.810562 905 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:25.811865 1162 raft_consensus.cc:2454] T 7fd8311955974e1cbcdda1961c318588 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:25.812333 1374 leader_election.cc:302] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:25.813928 2119 ts_tablet_manager.cc:1905] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:25.813967 1099 consensus_peers.cc:487] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9fecfb2325046f98e69797ff8342892. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:25.815513 1556 tablet_bootstrap.cc:654] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.817538 3210 leader_election.cc:288] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:25.818341 3210 raft_consensus.cc:2781] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:25.819264 3289 raft_consensus.cc:2781] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:25.819092 3210 raft_consensus.cc:686] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:25.819864 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df
I20260927 15:06:25.820775 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.821139 3210 consensus_queue.cc:237] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.823454 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.828281 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fd8311955974e1cbcdda1961c318588" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:25.829140 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0f659a8971134327870326b1abbd02ef" } new_table_name: "default.Table_63f2cae360b0432c9e102045fc919811" modify_external_catalogs: true
I20260927 15:06:25.829547 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_779ab963c30743b88c0399bf522b1ef3" } new_table_name: "default.Table_2424cf27f56a4ece8e079a08041b6f36" modify_external_catalogs: true
I20260927 15:06:25.830921 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d6c9d61c79934636a425c02a9d7ba5ba" } modify_external_catalogs: true
I20260927 15:06:25.831068 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d6c9d61c79934636a425c02a9d7ba5ba" } modify_external_catalogs: true
I20260927 15:06:25.834206 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a74f885820c0411d9d4f5276fadeeaa6" } modify_external_catalogs: true
I20260927 15:06:25.834408 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a74f885820c0411d9d4f5276fadeeaa6" } modify_external_catalogs: true
I20260927 15:06:25.834614 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.834232 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_83fad230fc02478d978d4c302780347b" } modify_external_catalogs: true
I20260927 15:06:25.835435 3303 raft_consensus.cc:2726] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.835433 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_83fad230fc02478d978d4c302780347b" } modify_external_catalogs: true
W20260927 15:06:25.837534 1376 leader_election.cc:341] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.837196 3289 raft_consensus.cc:686] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
W20260927 15:06:25.838562 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 69658.8us
I20260927 15:06:25.838567 3289 consensus_queue.cc:237] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:25.838979 1102 consensus_peers.cc:487] T 1a89ce4434ad4171bf613d4bbb3337a8 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:25.840927 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44e2611d2bf40ae90c4fd857225e39e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:25.841418 1102 leader_election.cc:341] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.841538 1102 leader_election.cc:302] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:25.847079 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 25628ba242e34341b9c10fb68bbd8635 consensus state has no leader
I20260927 15:06:25.847469 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet cf0cc2ae2792420a91f2c42edcf47fd7
I20260927 15:06:25.848229 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0cc2ae2792420a91f2c42edcf47fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.850594 3167 ts_tablet_manager.cc:1918] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:25.850729 3167 log.cc:1196] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/a97f72ddef5346c297d73589e926260c
W20260927 15:06:25.851012 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e07d9c71bf8b44338d07b4dac500a052 consensus state has no leader
I20260927 15:06:25.851686 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0cc2ae2792420a91f2c42edcf47fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.852183 3167 ts_tablet_manager.cc:1939] T a97f72ddef5346c297d73589e926260c P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:25.857705 2119 ts_tablet_manager.cc:1918] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:25.864251 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0cc2ae2792420a91f2c42edcf47fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:25.868382 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 25628ba242e34341b9c10fb68bbd8635 (table default.Table_2424cf27f56a4ece8e079a08041b6f36 [id=61c5bdcfabd2455cab364eb831b6673f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 25628ba242e34341b9c10fb68bbd8635 consensus state has no leader
I20260927 15:06:25.874866 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1067) took 6519 ms. Trace:
I20260927 15:06:25.877902 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1319) took 1670 ms. Trace:
I20260927 15:06:25.878039 3167 rpcz_store.cc:276] 0927 15:06:24.207542 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.207604 (+ 62us) service_pool.cc:227] Handling call
0927 15:06:25.511016 (+1303412us) ts_tablet_manager.cc:1145] Deleting tablet a97f72ddef5346c297d73589e926260c
0927 15:06:25.511026 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.673699 (+162673us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.850481 (+176782us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.877871 (+ 27390us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246668}
I20260927 15:06:25.878629 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet a97f72ddef5346c297d73589e926260c (table default.Table_8d8d19b1fbfc4a4a8ec451b4af3cf646 [id=5d0dd65f7df0425d8164dc60f19fdb3a]) successfully deleted
I20260927 15:06:25.882352 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 9cd4941f342d41f6a0b4d9c1c42a983d
I20260927 15:06:25.882370 1562 rpcz_store.cc:276] 0927 15:06:19.355225 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.360567 (+ 5342us) service_pool.cc:227] Handling call
0927 15:06:25.874713 (+6514146us) ts_tablet_manager.cc:1145] Deleting tablet 512a2f4e3c3f479daba37eb1ca0d463b
0927 15:06:25.874723 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.874841 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6513982}
I20260927 15:06:25.882958 1562 tablet_replica.cc:330] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:25.883543 1556 tablet_bootstrap.cc:492] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:25.883671 1556 ts_tablet_manager.cc:1397] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.123s user 0.001s sys 0.003s
W20260927 15:06:25.884099 899 catalog_manager.cc:4821] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): delete failed for tablet 512a2f4e3c3f479daba37eb1ca0d463b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 512a2f4e3c3f479daba37eb1ca0d463b already in progress: creating tablet
I20260927 15:06:25.884465 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cd4941f342d41f6a0b4d9c1c42a983d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.884541 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cd4941f342d41f6a0b4d9c1c42a983d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.884898 1556 raft_consensus.cc:348] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.880343 1561 consensus_queue.cc:260] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.885447 1556 raft_consensus.cc:374] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.885587 1556 raft_consensus.cc:729] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.885891 1561 ts_tablet_manager.cc:1428] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.087s user 0.002s sys 0.000s
I20260927 15:06:25.885831 1556 consensus_queue.cc:260] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.886487 1556 ts_tablet_manager.cc:1428] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:25.892788 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2843bf6dbf4117b3f44cd39c328b99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.893529 880 master_runner.cc:186] Error getting master registration for 127.0.201.60:46799: OK, instance_id { permanent_uuid: "2a122de3662f485f8f44b0a5e4b29862" instance_seqno: 1790521579018896 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260927 15:06:25.893786 880 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260927 15:06:25.893055 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1330) took 1543 ms. Trace:
I20260927 15:06:25.894866 3167 rpcz_store.cc:276] 0927 15:06:24.349933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.367094 (+ 17161us) service_pool.cc:227] Handling call
0927 15:06:25.892944 (+1525850us) ts_tablet_manager.cc:1145] Deleting tablet ec3d823781234015aa8a48421a23bbd2
0927 15:06:25.892954 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.893040 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1525677}
W20260927 15:06:25.896011 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ec3d823781234015aa8a48421a23bbd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec3d823781234015aa8a48421a23bbd2 already in progress: creating tablet
I20260927 15:06:25.897544 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1331) took 1541 ms. Trace:
I20260927 15:06:25.898885 3167 rpcz_store.cc:276] 0927 15:06:24.355630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.367279 (+ 11649us) service_pool.cc:227] Handling call
0927 15:06:25.897422 (+1530143us) ts_tablet_manager.cc:1145] Deleting tablet fb8e95f350f249ac85c5df42afe4a90d
0927 15:06:25.897437 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.897527 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1528885}
W20260927 15:06:25.899405 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fb8e95f350f249ac85c5df42afe4a90d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb8e95f350f249ac85c5df42afe4a90d already in progress: creating tablet
I20260927 15:06:25.899833 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1326) took 1609 ms. Trace:
I20260927 15:06:25.899958 3167 rpcz_store.cc:276] 0927 15:06:24.290031 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.290297 (+ 266us) service_pool.cc:227] Handling call
0927 15:06:25.899710 (+1609413us) ts_tablet_manager.cc:1145] Deleting tablet ba42f1c2016249e995e8968ee3a91c1a
0927 15:06:25.899722 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.899813 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1484781}
W20260927 15:06:25.900511 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ba42f1c2016249e995e8968ee3a91c1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba42f1c2016249e995e8968ee3a91c1a already in progress: creating tablet
I20260927 15:06:25.900826 3167 tablet_replica.cc:330] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:25.901078 3167 raft_consensus.cc:2229] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:25.901314 3167 raft_consensus.cc:2258] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:25.901943 3167 ts_tablet_manager.cc:1905] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:25.898305 1556 tablet_bootstrap.cc:492] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:25.902981 1561 tablet_bootstrap.cc:492] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:25.903970 1556 tablet_bootstrap.cc:654] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.904428 1561 tablet_bootstrap.cc:654] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.911561 3235 raft_consensus.cc:482] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.911727 3235 raft_consensus.cc:504] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.912395 3235 leader_election.cc:288] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:25.913390 1099 leader_election.cc:341] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c6a248ec4ee64d0a8d986fdc683d69ba
I20260927 15:06:25.881093 1552 tablet_bootstrap.cc:492] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.883842 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 9cd4941f342d41f6a0b4d9c1c42a983d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.901551 3302 raft_consensus.cc:482] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.917531 1552 ts_tablet_manager.cc:1397] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.220s user 0.028s sys 0.052s
I20260927 15:06:25.917567 3302 raft_consensus.cc:504] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.918215 3302 leader_election.cc:288] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:25.918320 1552 raft_consensus.cc:348] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.918546 1552 raft_consensus.cc:374] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.918614 1552 raft_consensus.cc:729] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.918813 1552 consensus_queue.cc:260] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:25.919235 1238 leader_election.cc:341] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 1ba163e0f6164d65b09da684ee4872e0
I20260927 15:06:25.919428 1552 ts_tablet_manager.cc:1428] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:25.928633 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_fce46ca41de8464fa059789abda64740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.929248 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fce46ca41de8464fa059789abda64740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.932963 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_59b1ed2d8319426e850d87b7343adff1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.933478 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59b1ed2d8319426e850d87b7343adff1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.935120 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ac636789d81649e5a114ac2bdca92d6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:25.935529 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac636789d81649e5a114ac2bdca92d6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:25.937752 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba163e0f6164d65b09da684ee4872e0" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:25.938019 1162 raft_consensus.cc:2379] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in this term.
I20260927 15:06:25.938951 3235 raft_consensus.cc:482] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.939072 3235 raft_consensus.cc:504] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.939136 3315 tablet.cc:1722] T fb5f4a30bac94d72b5265c8a7a0d4d59 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:25.939605 3235 leader_election.cc:288] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:25.939769 3316 tablet.cc:1722] T fb5f4a30bac94d72b5265c8a7a0d4d59 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:25.940645 1556 tablet_bootstrap.cc:492] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:25.940954 1556 ts_tablet_manager.cc:1397] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.004s
I20260927 15:06:25.942324 1556 raft_consensus.cc:348] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.919445 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ba163e0f6164d65b09da684ee4872e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.950764 1562 raft_consensus.cc:2229] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:25.951033 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 01a81e786b6b47599d4cee122de2c29a
I20260927 15:06:25.951725 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 024f439ab5774474ad197bf7fa557ac7
I20260927 15:06:25.952615 1271 tablet_service.cc:1514] Processing DeleteTablet for tablet 024f439ab5774474ad197bf7fa557ac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.952653 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 024f439ab5774474ad197bf7fa557ac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:25.953662 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 5b3d0b51543c4af69252e63c3fced051 (DEFAULT_TABLE table=default.Table_5c89a4c26c1349df9e405dfabc6aeb31 [id=b8d74e95ffa64a5fa4ca919c95ee303b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.954068 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b3d0b51543c4af69252e63c3fced051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.919976 2119 log.cc:1196] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/a8de6246f7904f6c80df624f3631db17
I20260927 15:06:25.920562 1552 tablet_bootstrap.cc:492] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:25.956863 1552 tablet_bootstrap.cc:654] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.928011 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 541147938d864cd9ad7208d96533b0f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:25.938545 1239 leader_election.cc:302] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.957502 3302 raft_consensus.cc:3037] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.957527 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 5b3d0b51543c4af69252e63c3fced051 (DEFAULT_TABLE table=default.Table_5c89a4c26c1349df9e405dfabc6aeb31 [id=b8d74e95ffa64a5fa4ca919c95ee303b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.957890 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b3d0b51543c4af69252e63c3fced051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.959082 2119 ts_tablet_manager.cc:1939] T a8de6246f7904f6c80df624f3631db17 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:25.959309 1278 tablet_service.cc:1467] Processing CreateTablet for tablet de8a79ff4abb4610a9bb6833457ad64a (DEFAULT_TABLE table=default.Table_551093c99d6f4eb88aa8ecd6fe4feb5f [id=4335d9f2875c4c8d94fcb47b3593c595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.962278 3302 raft_consensus.cc:2726] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.963408 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 0be94317be5f43a68215717f6c844f89 (DEFAULT_TABLE table=default.Table_d730ac6787fb440dbad00713e38fc65e [id=3132132709a04e178e75380dd393c06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.963860 1269 tablet_service.cc:1467] Processing CreateTablet for tablet e90fa9b068e34c5d975710f6d0f8ca42 (DEFAULT_TABLE table=default.Table_509996d8a440495796331c77fab835ac [id=d088d9ee8ea94c399ed09b5e06f0805d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.964303 1137 tablet_service.cc:1467] Processing CreateTablet for tablet de8a79ff4abb4610a9bb6833457ad64a (DEFAULT_TABLE table=default.Table_551093c99d6f4eb88aa8ecd6fe4feb5f [id=4335d9f2875c4c8d94fcb47b3593c595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.964687 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de8a79ff4abb4610a9bb6833457ad64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.964951 1267 tablet_service.cc:1467] Processing CreateTablet for tablet 36490579859e41e4873b6521924f2597 (DEFAULT_TABLE table=default.Table_ca5a9b80300b42728744d2e195db648b [id=1ee697fbd75b43d3a1c9fac59e450a64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.965766 1556 raft_consensus.cc:374] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.965842 1556 raft_consensus.cc:729] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.966045 1556 consensus_queue.cc:260] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.949045 1428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa58fa9a1384013ac1674bc7d53c3b1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:25.966445 1428 raft_consensus.cc:2454] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:25.952785 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 01a81e786b6b47599d4cee122de2c29a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.956825 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 024f439ab5774474ad197bf7fa557ac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:25.959208 1406 tablet_service.cc:1467] Processing CreateTablet for tablet de8a79ff4abb4610a9bb6833457ad64a (DEFAULT_TABLE table=default.Table_551093c99d6f4eb88aa8ecd6fe4feb5f [id=4335d9f2875c4c8d94fcb47b3593c595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.967712 1406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de8a79ff4abb4610a9bb6833457ad64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.967765 3302 raft_consensus.cc:482] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.967921 3302 raft_consensus.cc:504] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.968168 1552 tablet_bootstrap.cc:492] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:25.968429 1552 ts_tablet_manager.cc:1397] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.003s
I20260927 15:06:25.969033 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2268d824f5324cd1b81879e2fe4fd027" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:25.969270 1162 raft_consensus.cc:2379] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in this term.
I20260927 15:06:25.969548 1552 raft_consensus.cc:348] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.969878 1552 raft_consensus.cc:374] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:25.970041 1552 raft_consensus.cc:729] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:25.970310 1552 consensus_queue.cc:260] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:25.970681 1238 leader_election.cc:341] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 2268d824f5324cd1b81879e2fe4fd027
I20260927 15:06:25.970770 1238 leader_election.cc:302] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:25.971064 3303 raft_consensus.cc:3037] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.971544 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 0be94317be5f43a68215717f6c844f89 (DEFAULT_TABLE table=default.Table_d730ac6787fb440dbad00713e38fc65e [id=3132132709a04e178e75380dd393c06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.971764 1140 tablet_service.cc:1467] Processing CreateTablet for tablet de6bf781cd26415e88775f33a6f3ea8a (DEFAULT_TABLE table=default.Table_e8627fa93635406394c82a90066c8df4 [id=85dc354c3c4a4d1ebc3fbf4e49a6c3de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.971906 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0be94317be5f43a68215717f6c844f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.972026 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de6bf781cd26415e88775f33a6f3ea8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.972043 1556 ts_tablet_manager.cc:1428] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260927 15:06:25.972299 1556 tablet_bootstrap.cc:492] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:25.973685 3303 raft_consensus.cc:2726] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:25.963172 1409 tablet_service.cc:1467] Processing CreateTablet for tablet 5b3d0b51543c4af69252e63c3fced051 (DEFAULT_TABLE table=default.Table_5c89a4c26c1349df9e405dfabc6aeb31 [id=b8d74e95ffa64a5fa4ca919c95ee303b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.975050 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b3d0b51543c4af69252e63c3fced051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.963523 1408 tablet_service.cc:1467] Processing CreateTablet for tablet e90fa9b068e34c5d975710f6d0f8ca42 (DEFAULT_TABLE table=default.Table_509996d8a440495796331c77fab835ac [id=d088d9ee8ea94c399ed09b5e06f0805d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.977819 1552 ts_tablet_manager.cc:1428] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260927 15:06:25.977890 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e90fa9b068e34c5d975710f6d0f8ca42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.978309 1552 tablet_bootstrap.cc:492] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:25.981701 1420 tablet_service.cc:1467] Processing CreateTablet for tablet f06b68e3832f4be59957292a40708165 (DEFAULT_TABLE table=default.Table_8c4bf3aaab144abaacd7d4299e48ac7f [id=e5caf95c14c54bb79c6e46d57bc78f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.981920 3289 raft_consensus.cc:482] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:25.965049 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 36490579859e41e4873b6521924f2597 (DEFAULT_TABLE table=default.Table_ca5a9b80300b42728744d2e195db648b [id=1ee697fbd75b43d3a1c9fac59e450a64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.982041 3289 raft_consensus.cc:504] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.982656 3289 leader_election.cc:288] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:25.983600 3167 ts_tablet_manager.cc:1918] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260927 15:06:25.983566 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5c8e8865a34f01addbb505cf777a0d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:25.983711 3167 log.cc:1196] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/db09498a395b4570a34d32fbfc71e8ed
I20260927 15:06:25.983812 1162 raft_consensus.cc:2454] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:25.984053 3167 ts_tablet_manager.cc:1939] T db09498a395b4570a34d32fbfc71e8ed P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:25.984283 1374 leader_election.cc:302] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:25.984347 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1333) took 1544 ms. Trace:
I20260927 15:06:25.984423 3167 rpcz_store.cc:276] 0927 15:06:24.439760 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.440131 (+ 371us) service_pool.cc:227] Handling call
0927 15:06:25.900789 (+1460658us) ts_tablet_manager.cc:1145] Deleting tablet db09498a395b4570a34d32fbfc71e8ed
0927 15:06:25.900798 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.924555 (+ 23757us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.983506 (+ 58951us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.984335 (+ 829us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1460455}
I20260927 15:06:25.984748 1402 tablet_service.cc:1467] Processing CreateTablet for tablet d1ea2432b41e46d3a12cdd98d52c561c (DEFAULT_TABLE table=default.Table_ee20f668fb634c218b0c8869c513a936 [id=00f6800732224e7e98a01afec9cbb268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.984815 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet db09498a395b4570a34d32fbfc71e8ed (table default.Table_5b7e58750e9a481cab2abf34e5753a5e [id=ed34d1e88ae54c6086ae3a7cbfdf7861]) successfully deleted
I20260927 15:06:25.985081 3289 raft_consensus.cc:2781] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:25.985172 3289 raft_consensus.cc:482] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:25.985190 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1334) took 1545 ms. Trace:
I20260927 15:06:25.985249 3289 raft_consensus.cc:3037] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.985267 3167 rpcz_store.cc:276] 0927 15:06:24.439878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.442563 (+ 2685us) service_pool.cc:227] Handling call
0927 15:06:25.985067 (+1542504us) ts_tablet_manager.cc:1145] Deleting tablet 45fbe474949344348cd2db98b75d4916
0927 15:06:25.985079 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.985175 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1542336}
W20260927 15:06:25.985664 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 45fbe474949344348cd2db98b75d4916 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fbe474949344348cd2db98b75d4916 already in progress: creating tablet
I20260927 15:06:25.982043 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f06b68e3832f4be59957292a40708165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.986259 1552 tablet_bootstrap.cc:654] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.986558 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ea2432b41e46d3a12cdd98d52c561c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.986740 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36490579859e41e4873b6521924f2597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.986905 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1335) took 1511 ms. Trace:
I20260927 15:06:25.986979 3167 rpcz_store.cc:276] 0927 15:06:24.475544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.478088 (+ 2544us) service_pool.cc:227] Handling call
0927 15:06:25.986782 (+1508694us) ts_tablet_manager.cc:1145] Deleting tablet 723df898361144aeb16065868885d120
0927 15:06:25.986792 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.986890 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1508483}
W20260927 15:06:25.987346 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 723df898361144aeb16065868885d120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 723df898361144aeb16065868885d120 already in progress: creating tablet
I20260927 15:06:25.987533 3289 raft_consensus.cc:504] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:25.988579 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5c8e8865a34f01addbb505cf777a0d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:25.989059 1376 leader_election.cc:341] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:25.989663 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 0be94317be5f43a68215717f6c844f89 (DEFAULT_TABLE table=default.Table_d730ac6787fb440dbad00713e38fc65e [id=3132132709a04e178e75380dd393c06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.989665 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5c8e8865a34f01addbb505cf777a0d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:25.989856 1162 raft_consensus.cc:3037] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:25.989964 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0be94317be5f43a68215717f6c844f89. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:25.990355 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda already in progress: creating tablet
W20260927 15:06:25.990876 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 33bbd34a3c6148b5a49aa92d54aad36d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33bbd34a3c6148b5a49aa92d54aad36d already in progress: creating tablet
I20260927 15:06:25.991205 3289 leader_election.cc:288] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:25.991345 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 50d786631fc849789164e83efaca333d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50d786631fc849789164e83efaca333d already in progress: creating tablet
I20260927 15:06:25.991797 3223 raft_consensus.cc:482] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:25.991852 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7fc551eab48542029c50a300b33dab5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fc551eab48542029c50a300b33dab5f already in progress: creating tablet
I20260927 15:06:25.991843 1268 tablet_service.cc:1467] Processing CreateTablet for tablet f06b68e3832f4be59957292a40708165 (DEFAULT_TABLE table=default.Table_8c4bf3aaab144abaacd7d4299e48ac7f [id=e5caf95c14c54bb79c6e46d57bc78f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.991918 3223 raft_consensus.cc:504] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:25.992295 1284 tablet_service.cc:1467] Processing CreateTablet for tablet d1ea2432b41e46d3a12cdd98d52c561c (DEFAULT_TABLE table=default.Table_ee20f668fb634c218b0c8869c513a936 [id=00f6800732224e7e98a01afec9cbb268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.992445 3223 leader_election.cc:288] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:25.992977 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae003f1ca76472cbaa8b577b66fe84c" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:25.993186 1160 raft_consensus.cc:2379] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in this term.
W20260927 15:06:25.993841 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet d9c032a06c0b497fa21a3553375978ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9c032a06c0b497fa21a3553375978ca already in progress: creating tablet
I20260927 15:06:25.996730 1556 tablet_bootstrap.cc:654] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:25.996857 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9b78a9eb194b4eb5ad63c4ae966b6b (DEFAULT_TABLE table=default.Table_051d42f317f34540a90b5fc0ed638420 [id=96501b58b8654ea38489ef2a276b1d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.997444 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f9b78a9eb194b4eb5ad63c4ae966b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:25.997809 3167 tablet_replica.cc:330] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:25.997808 1162 raft_consensus.cc:2454] T 9f5c8e8865a34f01addbb505cf777a0d P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:25.998044 3167 raft_consensus.cc:2229] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:25.998286 3167 pending_rounds.cc:62] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:25.998250 1374 leader_election.cc:302] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:25.998898 3210 raft_consensus.cc:2781] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:25.999011 3210 raft_consensus.cc:686] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:25.999230 1282 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9b78a9eb194b4eb5ad63c4ae966b6b (DEFAULT_TABLE table=default.Table_051d42f317f34540a90b5fc0ed638420 [id=96501b58b8654ea38489ef2a276b1d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.999202 3210 consensus_queue.cc:237] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:26.000365 1238 leader_election.cc:341] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 9ae003f1ca76472cbaa8b577b66fe84c
I20260927 15:06:26.000478 1238 leader_election.cc:302] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.000815 3223 raft_consensus.cc:3037] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.005366 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 60391f28f93c4332a8cd9bc13b12caad (DEFAULT_TABLE table=default.Table_43bc54a224174626b9698e42dfc19583 [id=47326ee677ac45e692890b7e4d4e20c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.005740 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60391f28f93c4332a8cd9bc13b12caad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.006729 3223 raft_consensus.cc:2726] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.007789 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 60391f28f93c4332a8cd9bc13b12caad (DEFAULT_TABLE table=default.Table_43bc54a224174626b9698e42dfc19583 [id=47326ee677ac45e692890b7e4d4e20c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.007899 1266 tablet_service.cc:1467] Processing CreateTablet for tablet b226f1e323fd4d189825013a2ded66d2 (DEFAULT_TABLE table=default.Table_b1f46b4fd15b41debe963417e6c9fbd2 [id=44adf42ef1de47668896f14f933c4eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.008488 3307 raft_consensus.cc:482] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.008627 3307 raft_consensus.cc:504] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.008821 3167 pending_rounds.cc:68] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976415608590336 op_type: NO_OP noop_request { }
I20260927 15:06:26.008929 3167 raft_consensus.cc:2866] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:26.009003 3167 raft_consensus.cc:2258] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.009351 3307 leader_election.cc:288] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.009931 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9f171fd62d644f38262a2257d47fafe" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.010514 3167 ts_tablet_manager.cc:1905] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:26.010489 1376 leader_election.cc:341] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.010959 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 1bbfa83e764146fdbea89da8c7134a46 (DEFAULT_TABLE table=default.Table_d11b170221294649b651d1a165da5341 [id=74947a57ddf34fac8c44178d19b2b04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.011302 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bbfa83e764146fdbea89da8c7134a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.012154 1281 tablet_service.cc:1467] Processing CreateTablet for tablet de6bf781cd26415e88775f33a6f3ea8a (DEFAULT_TABLE table=default.Table_e8627fa93635406394c82a90066c8df4 [id=85dc354c3c4a4d1ebc3fbf4e49a6c3de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.012692 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f06b68e3832f4be59957292a40708165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.012732 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1167) took 2807 ms. Trace:
I20260927 15:06:26.012722 1404 tablet_service.cc:1467] Processing CreateTablet for tablet b226f1e323fd4d189825013a2ded66d2 (DEFAULT_TABLE table=default.Table_b1f46b4fd15b41debe963417e6c9fbd2 [id=44adf42ef1de47668896f14f933c4eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.012811 2119 rpcz_store.cc:276] 0927 15:06:23.205161 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.216421 (+ 11260us) service_pool.cc:227] Handling call
0927 15:06:25.800520 (+2584099us) ts_tablet_manager.cc:1145] Deleting tablet a8de6246f7904f6c80df624f3631db17
0927 15:06:25.807118 (+ 6598us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.853910 (+ 46792us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:25.857590 (+ 3680us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.012717 (+155127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2583898}
I20260927 15:06:26.013002 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b226f1e323fd4d189825013a2ded66d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.013155 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ea2432b41e46d3a12cdd98d52c561c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.013199 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1170) took 2807 ms. Trace:
I20260927 15:06:26.013295 2119 rpcz_store.cc:276] 0927 15:06:23.205398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.217392 (+ 11994us) service_pool.cc:227] Handling call
0927 15:06:26.013068 (+2795676us) ts_tablet_manager.cc:1145] Deleting tablet 99e672c109e144b09193f916f8c5d516
0927 15:06:26.013078 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.013182 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2795490}
I20260927 15:06:26.013551 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60391f28f93c4332a8cd9bc13b12caad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.013597 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1169) took 2808 ms. Trace:
I20260927 15:06:26.013664 2119 rpcz_store.cc:276] 0927 15:06:23.205321 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.218087 (+ 12766us) service_pool.cc:227] Handling call
0927 15:06:26.013491 (+2795404us) ts_tablet_manager.cc:1145] Deleting tablet 997c93bdf78b49709130d97a8d96a5a5
0927 15:06:26.013500 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.013572 (+ 72us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2795202}
I20260927 15:06:26.013931 2119 tablet_replica.cc:330] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.014195 2119 raft_consensus.cc:2229] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.014425 2119 raft_consensus.cc:2258] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.014962 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36490579859e41e4873b6521924f2597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.015352 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e90fa9b068e34c5d975710f6d0f8ca42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.015718 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0be94317be5f43a68215717f6c844f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.016099 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f9b78a9eb194b4eb5ad63c4ae966b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.016458 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de8a79ff4abb4610a9bb6833457ad64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.016763 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b226f1e323fd4d189825013a2ded66d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.021428 2119 ts_tablet_manager.cc:1905] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.022432 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet a8de6246f7904f6c80df624f3631db17 (table default.Table_e18064a8c28446469b9ea854acda2a65 [id=f4b1254299c64997962c71b810f7cc67]) successfully deleted
I20260927 15:06:26.025373 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 1bbfa83e764146fdbea89da8c7134a46 (DEFAULT_TABLE table=default.Table_d11b170221294649b651d1a165da5341 [id=74947a57ddf34fac8c44178d19b2b04b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:26.025928 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 99e672c109e144b09193f916f8c5d516 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99e672c109e144b09193f916f8c5d516 already in progress: creating tablet
W20260927 15:06:26.026151 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 997c93bdf78b49709130d97a8d96a5a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 997c93bdf78b49709130d97a8d96a5a5 already in progress: creating tablet
I20260927 15:06:26.026225 1418 tablet_service.cc:1467] Processing CreateTablet for tablet de6bf781cd26415e88775f33a6f3ea8a (DEFAULT_TABLE table=default.Table_e8627fa93635406394c82a90066c8df4 [id=85dc354c3c4a4d1ebc3fbf4e49a6c3de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:25.969883 3302 leader_election.cc:288] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.026582 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de6bf781cd26415e88775f33a6f3ea8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.026958 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de6bf781cd26415e88775f33a6f3ea8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.031571 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9f171fd62d644f38262a2257d47fafe" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:26.032239 1374 leader_election.cc:341] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.032383 1374 leader_election.cc:302] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:26.032944 3289 raft_consensus.cc:2726] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.035571 1556 tablet_bootstrap.cc:492] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:26.035550 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5c8e8865a34f01addbb505cf777a0d" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.035838 1556 ts_tablet_manager.cc:1397] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.064s user 0.001s sys 0.006s
W20260927 15:06:26.036124 1376 leader_election.cc:341] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.036721 1556 raft_consensus.cc:348] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.036993 1556 raft_consensus.cc:374] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.037097 1556 raft_consensus.cc:729] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.037055 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9b78a9eb194b4eb5ad63c4ae966b6b (DEFAULT_TABLE table=default.Table_051d42f317f34540a90b5fc0ed638420 [id=96501b58b8654ea38489ef2a276b1d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.037200 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 60391f28f93c4332a8cd9bc13b12caad (DEFAULT_TABLE table=default.Table_43bc54a224174626b9698e42dfc19583 [id=47326ee677ac45e692890b7e4d4e20c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.037504 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f9b78a9eb194b4eb5ad63c4ae966b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.037458 1556 consensus_queue.cc:260] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.037688 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60391f28f93c4332a8cd9bc13b12caad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.038229 1556 ts_tablet_manager.cc:1428] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 15:06:26.038519 1556 tablet_bootstrap.cc:492] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:26.044346 1556 tablet_bootstrap.cc:654] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.044162 1140 tablet_service.cc:1467] Processing CreateTablet for tablet f06b68e3832f4be59957292a40708165 (DEFAULT_TABLE table=default.Table_8c4bf3aaab144abaacd7d4299e48ac7f [id=e5caf95c14c54bb79c6e46d57bc78f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.044909 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f06b68e3832f4be59957292a40708165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.046725 1135 tablet_service.cc:1467] Processing CreateTablet for tablet d1ea2432b41e46d3a12cdd98d52c561c (DEFAULT_TABLE table=default.Table_ee20f668fb634c218b0c8869c513a936 [id=00f6800732224e7e98a01afec9cbb268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.047057 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1ea2432b41e46d3a12cdd98d52c561c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.046972 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 01a81e786b6b47599d4cee122de2c29a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.047636 1138 tablet_service.cc:1467] Processing CreateTablet for tablet e90fa9b068e34c5d975710f6d0f8ca42 (DEFAULT_TABLE table=default.Table_509996d8a440495796331c77fab835ac [id=d088d9ee8ea94c399ed09b5e06f0805d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.048099 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e90fa9b068e34c5d975710f6d0f8ca42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.055887 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 36490579859e41e4873b6521924f2597 (DEFAULT_TABLE table=default.Table_ca5a9b80300b42728744d2e195db648b [id=1ee697fbd75b43d3a1c9fac59e450a64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.056016 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5f5c99114765454986c40955601ebb30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:26.056332 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36490579859e41e4873b6521924f2597. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:26.056632 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f5c99114765454986c40955601ebb30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.057796 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bbfa83e764146fdbea89da8c7134a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.057860 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f9c63ae6bd6a449e82b7b67428a51e48" } new_table_name: "default.Table_7f75eda53f1a4ebb9bcc79f31ce89129" modify_external_catalogs: true
I20260927 15:06:26.059110 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_62005f9ebacc4cf5a1f7e502ba4aee7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.059587 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62005f9ebacc4cf5a1f7e502ba4aee7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.060652 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6a6021df9f98438cb02b4bd851812236"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.061106 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a6021df9f98438cb02b4bd851812236 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.062196 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4f7df3628e4e4614a155c21f02221cb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.062639 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f7df3628e4e4614a155c21f02221cb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.063786 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_439cbba98d3f41249b9d11d607af5dad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.064224 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_439cbba98d3f41249b9d11d607af5dad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.065533 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_684d82aaea5948cfb615ad0372fdadc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.065899 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_684d82aaea5948cfb615ad0372fdadc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.073925 3223 raft_consensus.cc:482] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.074136 3223 raft_consensus.cc:504] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:26.075106 3223 leader_election.cc:288] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:26.078552 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2424cf27f56a4ece8e079a08041b6f36" } new_table_name: "default.Table_a871a11f43444fa2b367b83118d053b1" modify_external_catalogs: true
I20260927 15:06:26.078481 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a7eb534e289543168d49435edd522753" } new_table_name: "default.Table_d1231a5040be43938a3a26bc25ff741b" modify_external_catalogs: true
I20260927 15:06:26.085594 1561 tablet_bootstrap.cc:492] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:26.086603 1561 ts_tablet_manager.cc:1397] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.184s user 0.003s sys 0.000s
I20260927 15:06:26.088138 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 7c52b32ffd95403b8cac4465177141c9 (DEFAULT_TABLE table=default.Table_953bcb72d20a4a17b4928ada000259fd [id=d6d8ec80100e4f60aad74ab3bbbd829b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.088611 2119 ts_tablet_manager.cc:1918] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:26.088647 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c52b32ffd95403b8cac4465177141c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.089458 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 2d6521bb3bbb4773b856ce3343fbaf04 (DEFAULT_TABLE table=default.Table_309f95d9eb8a4aa4ad1c9c5d1604ac78 [id=65f53d772c0240cd8f0f26896286179c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.090267 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d6521bb3bbb4773b856ce3343fbaf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.091102 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 2d6521bb3bbb4773b856ce3343fbaf04 (DEFAULT_TABLE table=default.Table_309f95d9eb8a4aa4ad1c9c5d1604ac78 [id=65f53d772c0240cd8f0f26896286179c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.091466 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d6521bb3bbb4773b856ce3343fbaf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.093918 1402 tablet_service.cc:1467] Processing CreateTablet for tablet abd0c2b79d5149f083ef234a53c53c75 (DEFAULT_TABLE table=default.Table_66e72649acdf4638aade652ed153d286 [id=7be2af5987374898b370f9772f4e1ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.089818 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 7c52b32ffd95403b8cac4465177141c9 (DEFAULT_TABLE table=default.Table_953bcb72d20a4a17b4928ada000259fd [id=d6d8ec80100e4f60aad74ab3bbbd829b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.094612 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c52b32ffd95403b8cac4465177141c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.095141 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abd0c2b79d5149f083ef234a53c53c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.096544 3289 raft_consensus.cc:482] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.096673 3289 raft_consensus.cc:504] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.097266 3289 leader_election.cc:288] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.036715 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 01a81e786b6b47599d4cee122de2c29a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:25 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.098177 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2843bf6dbf4117b3f44cd39c328b99" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.098584 1282 tablet_service.cc:1467] Processing CreateTablet for tablet abd0c2b79d5149f083ef234a53c53c75 (DEFAULT_TABLE table=default.Table_66e72649acdf4638aade652ed153d286 [id=7be2af5987374898b370f9772f4e1ced]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:26.098858 1376 leader_election.cc:341] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.099020 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abd0c2b79d5149f083ef234a53c53c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.102310 1556 tablet_bootstrap.cc:492] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:26.102506 1556 ts_tablet_manager.cc:1397] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.000s
I20260927 15:06:26.103312 1556 raft_consensus.cc:348] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.103595 1556 raft_consensus.cc:374] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.104192 1556 raft_consensus.cc:729] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.105144 1556 consensus_queue.cc:260] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.105829 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 614cd53bf98541e996734be007b3bf27 (DEFAULT_TABLE table=default.Table_b7180c38c8244e5590c1af88dee592c3 [id=735b9a2275b44ef98805eae95167830d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.106185 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 97c9b99c752f4bdc81e8b238d80455e1 (DEFAULT_TABLE table=default.Table_a1cf541492d1404dbddff27f0415de8c [id=9c422284ef8e4c548f6d1ac146316117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.105897 1556 ts_tablet_manager.cc:1428] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:26.106734 1420 tablet_service.cc:1467] Processing CreateTablet for tablet d8be343d34234d518f2d5f6cbd983f4b (DEFAULT_TABLE table=default.Table_c86e5471fe7b4b768f8d44582dd240f0 [id=9f66a66cb744485da60e11e4b4d3edd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.107806 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 614cd53bf98541e996734be007b3bf27 (DEFAULT_TABLE table=default.Table_b7180c38c8244e5590c1af88dee592c3 [id=735b9a2275b44ef98805eae95167830d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.107964 1273 tablet_service.cc:1467] Processing CreateTablet for tablet 97c9b99c752f4bdc81e8b238d80455e1 (DEFAULT_TABLE table=default.Table_a1cf541492d1404dbddff27f0415de8c [id=9c422284ef8e4c548f6d1ac146316117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.108167 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 614cd53bf98541e996734be007b3bf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.108322 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97c9b99c752f4bdc81e8b238d80455e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:26.108613 2985 log.cc:924] Time spent T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: Append to log took a long time: real 0.058s user 0.002s sys 0.002s
I20260927 15:06:26.111068 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8be343d34234d518f2d5f6cbd983f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.111828 1270 tablet_service.cc:1467] Processing CreateTablet for tablet d8be343d34234d518f2d5f6cbd983f4b (DEFAULT_TABLE table=default.Table_c86e5471fe7b4b768f8d44582dd240f0 [id=9f66a66cb744485da60e11e4b4d3edd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.111786 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 614cd53bf98541e996734be007b3bf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.112283 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8be343d34234d518f2d5f6cbd983f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.115113 1556 tablet_bootstrap.cc:492] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:26.117125 1556 tablet_bootstrap.cc:654] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:26.119762 910 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 25628ba242e34341b9c10fb68bbd8635 consensus state has no leader
I20260927 15:06:26.120138 3235 raft_consensus.cc:2726] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.120054 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2d8a930a9263401db2c395efc4959a7a" } modify_external_catalogs: true
I20260927 15:06:26.120247 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2d8a930a9263401db2c395efc4959a7a" } modify_external_catalogs: true
I20260927 15:06:26.120162 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_88e139425569406aa1c212c05593e9af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.120688 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88e139425569406aa1c212c05593e9af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.120671 1099 leader_election.cc:302] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:26.121515 3250 raft_consensus.cc:2781] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260927 15:06:26.121539 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4cc28b977ad4ed3bfe1672fbe44ec03 consensus state has no leader
I20260927 15:06:26.121590 3250 raft_consensus.cc:482] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:26.121663 3250 raft_consensus.cc:3037] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.121841 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3683b1582f6747a99a46e5f72b7067d3" } new_table_name: "default.Table_030ece7afe0047bfa4b52f147ffdb43f" modify_external_catalogs: true
I20260927 15:06:26.123369 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4249e024508544838076d00f351bbaed" } modify_external_catalogs: true
I20260927 15:06:26.123524 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_4249e024508544838076d00f351bbaed" } modify_external_catalogs: true
I20260927 15:06:26.123641 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f2e2c330bf5f4e459ae856c9f8b35dd8" } new_table_name: "default.Table_8a931b02e84048c29413d853c7310b83" modify_external_catalogs: true
I20260927 15:06:26.124894 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_19cff94cd880489087101b1fb339fc27" } modify_external_catalogs: true
I20260927 15:06:26.125026 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_19cff94cd880489087101b1fb339fc27" } modify_external_catalogs: true
I20260927 15:06:26.125593 1418 tablet_service.cc:1467] Processing CreateTablet for tablet d87f66df496942cbbdf680dd4de1a310 (DEFAULT_TABLE table=default.Table_f112f4d6034843c095757c716356f20d [id=bd33a6834c0643959c1aa982cd603abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.126060 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d87f66df496942cbbdf680dd4de1a310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.126358 908 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_11d82a666e204a059c3afbf4a7d46c2d [id=239ff5a7776c4a469e14137b23b6544a] alter complete (version 2)
I20260927 15:06:26.127493 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2843bf6dbf4117b3f44cd39c328b99" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.127799 1162 raft_consensus.cc:2454] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:26.128168 2119 log.cc:1196] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/3042c17580d54082971b761433a7dca9
I20260927 15:06:26.128470 1374 leader_election.cc:302] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:26.128835 3289 raft_consensus.cc:2781] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:26.128906 3289 raft_consensus.cc:482] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:26.128975 3289 raft_consensus.cc:3037] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.131655 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97c9b99c752f4bdc81e8b238d80455e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.135711 3289 raft_consensus.cc:504] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.136441 3289 leader_election.cc:288] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.136767 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2843bf6dbf4117b3f44cd39c328b99" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:26.137362 1376 leader_election.cc:341] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.137465 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.137856 2119 ts_tablet_manager.cc:1939] T 3042c17580d54082971b761433a7dca9 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.138489 1562 pending_rounds.cc:62] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:26.138999 1562 pending_rounds.cc:68] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976386024943616 op_type: NO_OP noop_request { }
I20260927 15:06:26.139294 1562 raft_consensus.cc:2866] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:26.139560 1562 raft_consensus.cc:2258] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.140293 1562 ts_tablet_manager.cc:1905] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:26.140926 1238 leader_election.cc:341] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: db09498a395b4570a34d32fbfc71e8ed
I20260927 15:06:26.138787 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f2843bf6dbf4117b3f44cd39c328b99" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:26.142601 1162 raft_consensus.cc:3037] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.144973 1281 tablet_service.cc:1467] Processing CreateTablet for tablet d87f66df496942cbbdf680dd4de1a310 (DEFAULT_TABLE table=default.Table_f112f4d6034843c095757c716356f20d [id=bd33a6834c0643959c1aa982cd603abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.145454 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d87f66df496942cbbdf680dd4de1a310. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:26.148233 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 306808us
I20260927 15:06:26.147846 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet f0a71cf0ee554b3eafca3f054cc16b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.149590 3289 raft_consensus.cc:482] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.149724 3289 raft_consensus.cc:504] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.150398 3289 leader_election.cc:288] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.150695 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bdb6d04e5a94d7fbe3b27ccc0042f85" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:26.151594 1376 leader_election.cc:341] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.152307 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1168) took 2947 ms. Trace:
I20260927 15:06:26.152436 2119 rpcz_store.cc:276] 0927 15:06:23.205254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.215973 (+ 10719us) service_pool.cc:227] Handling call
0927 15:06:26.013862 (+2797889us) ts_tablet_manager.cc:1145] Deleting tablet 3042c17580d54082971b761433a7dca9
0927 15:06:26.013874 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.084910 (+ 71036us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.088507 (+ 3597us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.152288 (+ 63781us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2787950}
I20260927 15:06:26.152974 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1178) took 2919 ms. Trace:
I20260927 15:06:26.153095 914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dcd9af74989a47d68e624f28fa3b265e" } modify_external_catalogs: true
I20260927 15:06:26.153328 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 3042c17580d54082971b761433a7dca9 (table default.Table_30f44c4820b9415daf4edfe7ea689da3 [id=d80cbbb5881e42f0b5651563d6f60bb5]) successfully deleted
I20260927 15:06:26.153304 914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_dcd9af74989a47d68e624f28fa3b265e" } modify_external_catalogs: true
I20260927 15:06:26.153481 2119 rpcz_store.cc:276] 0927 15:06:23.233847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.233893 (+ 46us) service_pool.cc:227] Handling call
0927 15:06:26.152860 (+2918967us) ts_tablet_manager.cc:1145] Deleting tablet 048a1713b6054024959a9bdc245f71a4
0927 15:06:26.152871 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.152958 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2918803}
W20260927 15:06:26.153916 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 048a1713b6054024959a9bdc245f71a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 048a1713b6054024959a9bdc245f71a4 already in progress: creating tablet
I20260927 15:06:26.154204 2119 tablet_replica.cc:330] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.154399 2119 raft_consensus.cc:2229] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.154708 2119 raft_consensus.cc:2258] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.155313 2119 ts_tablet_manager.cc:1905] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.156203 3223 raft_consensus.cc:482] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.156277 1556 tablet_bootstrap.cc:492] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:26.156388 1556 ts_tablet_manager.cc:1397] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.004s
I20260927 15:06:26.156325 3223 raft_consensus.cc:504] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.157070 3223 leader_election.cc:288] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.157119 1556 raft_consensus.cc:348] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.157305 1556 raft_consensus.cc:374] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.157356 1556 raft_consensus.cc:729] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.157560 1556 consensus_queue.cc:260] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.158524 1556 ts_tablet_manager.cc:1428] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:26.158468 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2aadf6203773433ebe185e3b8127d619" } modify_external_catalogs: true
I20260927 15:06:26.158651 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_2aadf6203773433ebe185e3b8127d619" } modify_external_catalogs: true
I20260927 15:06:26.161196 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_92172755649f4820b81248dd4ea0d76b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.161839 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92172755649f4820b81248dd4ea0d76b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:26.161934 1238 leader_election.cc:341] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 63fbd388210d4a1aabfcf27c7533efbf
I20260927 15:06:26.164152 1556 tablet_bootstrap.cc:492] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:26.165750 1556 tablet_bootstrap.cc:654] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.179343 3289 raft_consensus.cc:482] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.179477 3289 raft_consensus.cc:504] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.180576 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "219639c0184f4888984fa04a1f84bd83" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.180656 3167 ts_tablet_manager.cc:1918] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:26.181350 1376 leader_election.cc:341] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.180963 3167 log.cc:1196] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/7fd8311955974e1cbcdda1961c318588
I20260927 15:06:26.182391 3289 leader_election.cc:288] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.186676 3167 ts_tablet_manager.cc:1939] T 7fd8311955974e1cbcdda1961c318588 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.194777 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 7fd8311955974e1cbcdda1961c318588 (table default.Table_0393b69c63dc4c42b67201f634d5c6fa [id=3d369788b9e44a0b9befbbb44303d24e]) successfully deleted
I20260927 15:06:26.195427 3167 tablet_replica.cc:330] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.196313 3167 raft_consensus.cc:2229] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:26.197224 3167 pending_rounds.cc:62] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:26.197479 3167 pending_rounds.cc:68] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976416254996480 op_type: NO_OP noop_request { }
I20260927 15:06:26.124881 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db09498a395b4570a34d32fbfc71e8ed" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.151089 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bdb6d04e5a94d7fbe3b27ccc0042f85" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:26.151980 3315 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.209s user 0.000s sys 0.000s
I20260927 15:06:26.164705 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63fbd388210d4a1aabfcf27c7533efbf" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.198055 3167 raft_consensus.cc:2866] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:26.198386 1160 raft_consensus.cc:2379] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate c4264874db964ff2830b7894c2b3d61c in this term.
W20260927 15:06:26.198421 1374 leader_election.cc:341] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.172465 3250 raft_consensus.cc:504] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.198539 1374 leader_election.cc:302] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:26.198581 3167 raft_consensus.cc:2258] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.198884 3289 raft_consensus.cc:2726] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.199010 3250 leader_election.cc:288] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:26.177597 1135 tablet_service.cc:1467] Processing CreateTablet for tablet b226f1e323fd4d189825013a2ded66d2 (DEFAULT_TABLE table=default.Table_b1f46b4fd15b41debe963417e6c9fbd2 [id=44adf42ef1de47668896f14f933c4eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.199155 1239 leader_election.cc:302] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.199501 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b226f1e323fd4d189825013a2ded66d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.200968 3167 ts_tablet_manager.cc:1905] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.201925 3223 raft_consensus.cc:2726] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.202332 1239 leader_election.cc:302] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.178288 1144 tablet_service.cc:1467] Processing CreateTablet for tablet abd0c2b79d5149f083ef234a53c53c75 (DEFAULT_TABLE table=default.Table_66e72649acdf4638aade652ed153d286 [id=7be2af5987374898b370f9772f4e1ced]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.203151 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abd0c2b79d5149f083ef234a53c53c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.203972 3223 raft_consensus.cc:3037] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.205353 2119 ts_tablet_manager.cc:1918] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.205446 2119 log.cc:1196] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/fd5f2ab9677c4598b0b8d9a93a6a23c7
I20260927 15:06:26.205711 2119 ts_tablet_manager.cc:1939] T fd5f2ab9677c4598b0b8d9a93a6a23c7 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.206403 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1179) took 2901 ms. Trace:
I20260927 15:06:26.178795 1127 tablet_service.cc:1467] Processing CreateTablet for tablet d87f66df496942cbbdf680dd4de1a310 (DEFAULT_TABLE table=default.Table_f112f4d6034843c095757c716356f20d [id=bd33a6834c0643959c1aa982cd603abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.206561 3223 raft_consensus.cc:2726] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.206547 2119 rpcz_store.cc:276] 0927 15:06:23.305083 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.305135 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:26.154163 (+2849028us) ts_tablet_manager.cc:1145] Deleting tablet fd5f2ab9677c4598b0b8d9a93a6a23c7
0927 15:06:26.154172 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.176523 (+ 22351us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.205263 (+ 28740us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.206385 (+ 1122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2848831}
I20260927 15:06:26.206763 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d87f66df496942cbbdf680dd4de1a310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.207139 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet fd5f2ab9677c4598b0b8d9a93a6a23c7 (table default.Table_305a912a4d114bd5a0d5e527d05ca887 [id=4b7c7c2c153344028b80e1a72287b117]) successfully deleted
I20260927 15:06:26.207594 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1180) took 2871 ms. Trace:
I20260927 15:06:26.207697 2119 rpcz_store.cc:276] 0927 15:06:23.336012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.336066 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:26.207469 (+2871403us) ts_tablet_manager.cc:1145] Deleting tablet 9f5c8e8865a34f01addbb505cf777a0d
0927 15:06:26.207479 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.207578 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2871190}
I20260927 15:06:26.179230 1142 tablet_service.cc:1467] Processing CreateTablet for tablet d8be343d34234d518f2d5f6cbd983f4b (DEFAULT_TABLE table=default.Table_c86e5471fe7b4b768f8d44582dd240f0 [id=9f66a66cb744485da60e11e4b4d3edd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.210392 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8be343d34234d518f2d5f6cbd983f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.181588 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 7c52b32ffd95403b8cac4465177141c9 (DEFAULT_TABLE table=default.Table_953bcb72d20a4a17b4928ada000259fd [id=d6d8ec80100e4f60aad74ab3bbbd829b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.213982 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c52b32ffd95403b8cac4465177141c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.181918 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 97c9b99c752f4bdc81e8b238d80455e1 (DEFAULT_TABLE table=default.Table_a1cf541492d1404dbddff27f0415de8c [id=9c422284ef8e4c548f6d1ac146316117]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.182974 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "219639c0184f4888984fa04a1f84bd83" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.217522 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97c9b99c752f4bdc81e8b238d80455e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:26.217854 1374 leader_election.cc:341] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.217978 1374 leader_election.cc:302] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:26.218327 3289 raft_consensus.cc:2726] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:26.183553 1099 consensus_peers.cc:487] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3939bfd903d42e9bfaaf6ecdf50b8d4. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:26.224025 1428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa58fa9a1384013ac1674bc7d53c3b1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:26.224368 1428 raft_consensus.cc:3037] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:26.225790 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9f5c8e8865a34f01addbb505cf777a0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f5c8e8865a34f01addbb505cf777a0d already in progress: creating tablet
I20260927 15:06:26.226539 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1188) took 2741 ms. Trace:
I20260927 15:06:26.226688 2119 rpcz_store.cc:276] 0927 15:06:23.484752 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.490878 (+ 6126us) service_pool.cc:227] Handling call
0927 15:06:26.226404 (+2735526us) ts_tablet_manager.cc:1145] Deleting tablet 12403ee769904d389f180ccb13d86270
0927 15:06:26.226418 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.226518 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2735348}
I20260927 15:06:26.226799 3167 ts_tablet_manager.cc:1918] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:26.227273 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 12403ee769904d389f180ccb13d86270 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12403ee769904d389f180ccb13d86270 already in progress: creating tablet
I20260927 15:06:26.227301 3167 log.cc:1196] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/9f5c8e8865a34f01addbb505cf777a0d
I20260927 15:06:26.227700 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1187) took 2743 ms. Trace:
I20260927 15:06:26.227818 2119 rpcz_store.cc:276] 0927 15:06:23.484563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.491078 (+ 6515us) service_pool.cc:227] Handling call
0927 15:06:26.227596 (+2736518us) ts_tablet_manager.cc:1145] Deleting tablet 34e40bea0cd04d3f8ff17b518f50b859
0927 15:06:26.227608 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.227686 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2736325}
W20260927 15:06:26.228220 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 34e40bea0cd04d3f8ff17b518f50b859 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34e40bea0cd04d3f8ff17b518f50b859 already in progress: creating tablet
I20260927 15:06:26.228235 3315 tablet.cc:1722] T 99d4707e599840b3bdc2ab13c348ea80 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:26.228609 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1191) took 2722 ms. Trace:
I20260927 15:06:26.228799 3167 ts_tablet_manager.cc:1939] T 9f5c8e8865a34f01addbb505cf777a0d P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.229715 3316 tablet.cc:1722] T 99d4707e599840b3bdc2ab13c348ea80 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:26.228678 2119 rpcz_store.cc:276] 0927 15:06:23.506571 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.509273 (+ 2702us) service_pool.cc:227] Handling call
0927 15:06:26.228459 (+2719186us) ts_tablet_manager.cc:1145] Deleting tablet 52e7439320dd48aba25b5f7dc627964c
0927 15:06:26.228468 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.228594 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2718904}
I20260927 15:06:26.232401 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 9f5c8e8865a34f01addbb505cf777a0d (table default.Table_9d80b52d671c4ba582ca662849267880 [id=aabccd10145946b78e5ddb0ce9aebae4]) successfully deleted
W20260927 15:06:26.232578 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 52e7439320dd48aba25b5f7dc627964c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e7439320dd48aba25b5f7dc627964c already in progress: creating tablet
I20260927 15:06:26.232887 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1194) took 2722 ms. Trace:
I20260927 15:06:26.233000 2119 rpcz_store.cc:276] 0927 15:06:23.510344 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.510389 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:26.232795 (+2722406us) ts_tablet_manager.cc:1145] Deleting tablet ca9bb98aab8c4ec087412248cd28a86f
0927 15:06:26.232804 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.232872 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2722247}
I20260927 15:06:26.233126 3167 tablet_replica.cc:330] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
W20260927 15:06:26.233410 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ca9bb98aab8c4ec087412248cd28a86f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca9bb98aab8c4ec087412248cd28a86f already in progress: creating tablet
I20260927 15:06:26.233695 2119 tablet_replica.cc:330] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.233901 2119 raft_consensus.cc:2229] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.234233 2119 raft_consensus.cc:2258] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.234761 2119 ts_tablet_manager.cc:1905] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.236814 1428 raft_consensus.cc:2454] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:26.236958 3167 raft_consensus.cc:2229] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.237284 1099 leader_election.cc:302] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:26.237514 3250 raft_consensus.cc:2781] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:26.237627 3250 raft_consensus.cc:686] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:26.237550 3167 raft_consensus.cc:2258] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.237849 3250 consensus_queue.cc:237] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.238723 3167 ts_tablet_manager.cc:1905] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.240687 2119 ts_tablet_manager.cc:1918] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260927 15:06:26.240842 2119 log.cc:1196] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/c3939bfd903d42e9bfaaf6ecdf50b8d4
I20260927 15:06:26.241226 2119 ts_tablet_manager.cc:1939] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.242036 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1193) took 2731 ms. Trace:
I20260927 15:06:26.242182 2119 rpcz_store.cc:276] 0927 15:06:23.510224 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.510274 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:26.233654 (+2723380us) ts_tablet_manager.cc:1145] Deleting tablet c3939bfd903d42e9bfaaf6ecdf50b8d4
0927 15:06:26.233664 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.237975 (+ 4311us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.240610 (+ 2635us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.242016 (+ 1406us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2722752}
I20260927 15:06:26.242702 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet c3939bfd903d42e9bfaaf6ecdf50b8d4 (table default.Table_77aaa5739f804cd985c9096b2b908d21 [id=7e847271183947df9443097f992a88b8]) successfully deleted
I20260927 15:06:26.243134 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1192) took 2736 ms. Trace:
I20260927 15:06:26.243257 2119 rpcz_store.cc:276] 0927 15:06:23.506713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.508001 (+ 1288us) service_pool.cc:227] Handling call
0927 15:06:26.243011 (+2735010us) ts_tablet_manager.cc:1145] Deleting tablet 2e85b83758e44de4894d3101465bb47e
0927 15:06:26.243021 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.243116 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2731767}
W20260927 15:06:26.243686 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2e85b83758e44de4894d3101465bb47e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e85b83758e44de4894d3101465bb47e already in progress: creating tablet
I20260927 15:06:26.244118 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1199) took 2687 ms. Trace:
I20260927 15:06:26.244230 2119 rpcz_store.cc:276] 0927 15:06:23.556975 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.557341 (+ 366us) service_pool.cc:227] Handling call
0927 15:06:26.244011 (+2686670us) ts_tablet_manager.cc:1145] Deleting tablet 6c195d8161e24a2bb02b98c89aaa8d24
0927 15:06:26.244021 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.244102 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2686442}
W20260927 15:06:26.244632 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 6c195d8161e24a2bb02b98c89aaa8d24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c195d8161e24a2bb02b98c89aaa8d24 already in progress: creating tablet
I20260927 15:06:26.245038 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1210) took 2489 ms. Trace:
I20260927 15:06:26.245167 2119 rpcz_store.cc:276] 0927 15:06:23.755259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.755583 (+ 324us) service_pool.cc:227] Handling call
0927 15:06:26.244888 (+2489305us) ts_tablet_manager.cc:1145] Deleting tablet 57580db090ad4e4e94a3d22063e57ad4
0927 15:06:26.244898 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.245021 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2489066}
W20260927 15:06:26.245576 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 57580db090ad4e4e94a3d22063e57ad4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57580db090ad4e4e94a3d22063e57ad4 already in progress: creating tablet
I20260927 15:06:26.245922 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1212) took 2444 ms. Trace:
I20260927 15:06:26.246034 2119 rpcz_store.cc:276] 0927 15:06:23.801854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.801975 (+ 121us) service_pool.cc:227] Handling call
0927 15:06:26.245833 (+2443858us) ts_tablet_manager.cc:1145] Deleting tablet 1d83cf0b359b45299f5cdebdc7dee7d4
0927 15:06:26.245842 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.245907 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2443692}
W20260927 15:06:26.246440 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1d83cf0b359b45299f5cdebdc7dee7d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d83cf0b359b45299f5cdebdc7dee7d4 already in progress: creating tablet
I20260927 15:06:26.246788 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1213) took 2373 ms. Trace:
I20260927 15:06:26.246927 2119 rpcz_store.cc:276] 0927 15:06:23.873372 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.874151 (+ 779us) service_pool.cc:227] Handling call
0927 15:06:26.246693 (+2372542us) ts_tablet_manager.cc:1145] Deleting tablet bd0e035cec844fe789fdc815644fc025
0927 15:06:26.246702 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.246771 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2372359}
W20260927 15:06:26.247368 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet bd0e035cec844fe789fdc815644fc025 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd0e035cec844fe789fdc815644fc025 already in progress: creating tablet
I20260927 15:06:26.247700 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1214) took 2373 ms. Trace:
I20260927 15:06:26.247807 2119 rpcz_store.cc:276] 0927 15:06:23.873894 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.874370 (+ 476us) service_pool.cc:227] Handling call
0927 15:06:26.247614 (+2373244us) ts_tablet_manager.cc:1145] Deleting tablet b5ffe51b1b834bf4af262dc70b9206f8
0927 15:06:26.247623 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.247687 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2373116}
W20260927 15:06:26.248184 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet b5ffe51b1b834bf4af262dc70b9206f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ffe51b1b834bf4af262dc70b9206f8 already in progress: creating tablet
I20260927 15:06:26.248512 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1211) took 2446 ms. Trace:
I20260927 15:06:26.248620 2119 rpcz_store.cc:276] 0927 15:06:23.801736 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:23.801905 (+ 169us) service_pool.cc:227] Handling call
0927 15:06:26.248421 (+2446516us) ts_tablet_manager.cc:1145] Deleting tablet 4891a90ecd36456ab875732b3f2770c4
0927 15:06:26.248432 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.248497 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2323943}
W20260927 15:06:26.248984 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 4891a90ecd36456ab875732b3f2770c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4891a90ecd36456ab875732b3f2770c4 already in progress: creating tablet
I20260927 15:06:26.249333 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1237) took 2066 ms. Trace:
I20260927 15:06:26.249435 2119 rpcz_store.cc:276] 0927 15:06:24.182498 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.199199 (+ 16701us) service_pool.cc:227] Handling call
0927 15:06:26.249247 (+2050048us) ts_tablet_manager.cc:1145] Deleting tablet 8034812bd8b44d97bc63b7d65b8f83d1
0927 15:06:26.249256 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.249320 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2048653}
W20260927 15:06:26.249799 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8034812bd8b44d97bc63b7d65b8f83d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8034812bd8b44d97bc63b7d65b8f83d1 already in progress: creating tablet
I20260927 15:06:26.250152 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1238) took 2067 ms. Trace:
I20260927 15:06:26.250290 2119 rpcz_store.cc:276] 0927 15:06:24.182576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.200628 (+ 18052us) service_pool.cc:227] Handling call
0927 15:06:26.250050 (+2049422us) ts_tablet_manager.cc:1145] Deleting tablet decee14b5d7a4aef9989051dcaeb5a7b
0927 15:06:26.250059 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.250137 (+ 78us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2049171}
W20260927 15:06:26.250691 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet decee14b5d7a4aef9989051dcaeb5a7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet decee14b5d7a4aef9989051dcaeb5a7b already in progress: creating tablet
I20260927 15:06:26.251056 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1239) took 2068 ms. Trace:
I20260927 15:06:26.251178 2119 rpcz_store.cc:276] 0927 15:06:24.182645 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.200905 (+ 18260us) service_pool.cc:227] Handling call
0927 15:06:26.250968 (+2050063us) ts_tablet_manager.cc:1145] Deleting tablet 1d9562d917b74db9aa4a9678b9d32841
0927 15:06:26.250977 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.251042 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2049893}
W20260927 15:06:26.251552 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 1d9562d917b74db9aa4a9678b9d32841 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d9562d917b74db9aa4a9678b9d32841 already in progress: creating tablet
I20260927 15:06:26.251873 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1240) took 2069 ms. Trace:
I20260927 15:06:26.251994 2119 rpcz_store.cc:276] 0927 15:06:24.182714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.201091 (+ 18377us) service_pool.cc:227] Handling call
0927 15:06:26.251786 (+2050695us) ts_tablet_manager.cc:1145] Deleting tablet 8c2b6f278ef64476b1f4a1f1c69e45d1
0927 15:06:26.251795 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.251859 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2050178}
W20260927 15:06:26.252379 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c2b6f278ef64476b1f4a1f1c69e45d1 already in progress: creating tablet
I20260927 15:06:26.252704 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1242) took 1984 ms. Trace:
I20260927 15:06:26.252822 2119 rpcz_store.cc:276] 0927 15:06:24.267904 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.274991 (+ 7087us) service_pool.cc:227] Handling call
0927 15:06:26.252617 (+1977626us) ts_tablet_manager.cc:1145] Deleting tablet 04fe5b9e0d7747a185c1666664cb4378
0927 15:06:26.252626 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.252690 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1977380}
W20260927 15:06:26.253196 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 04fe5b9e0d7747a185c1666664cb4378 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04fe5b9e0d7747a185c1666664cb4378 already in progress: creating tablet
I20260927 15:06:26.253530 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1241) took 1985 ms. Trace:
I20260927 15:06:26.253633 2119 rpcz_store.cc:276] 0927 15:06:24.267781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.291603 (+ 23822us) service_pool.cc:227] Handling call
0927 15:06:26.253445 (+1961842us) ts_tablet_manager.cc:1145] Deleting tablet 0617b596022e48e7a2913762ae39251e
0927 15:06:26.253454 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.253516 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1961668}
W20260927 15:06:26.254004 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0617b596022e48e7a2913762ae39251e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0617b596022e48e7a2913762ae39251e already in progress: creating tablet
I20260927 15:06:26.254348 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1249) took 1922 ms. Trace:
I20260927 15:06:26.254458 2119 rpcz_store.cc:276] 0927 15:06:24.332009 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.336416 (+ 4407us) service_pool.cc:227] Handling call
0927 15:06:26.254262 (+1917846us) ts_tablet_manager.cc:1145] Deleting tablet ba42f1c2016249e995e8968ee3a91c1a
0927 15:06:26.254272 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.254335 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1917670}
W20260927 15:06:26.254846 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ba42f1c2016249e995e8968ee3a91c1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba42f1c2016249e995e8968ee3a91c1a already in progress: creating tablet
I20260927 15:06:26.255201 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1253) took 1885 ms. Trace:
I20260927 15:06:26.255317 2119 rpcz_store.cc:276] 0927 15:06:24.369926 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.370254 (+ 328us) service_pool.cc:227] Handling call
0927 15:06:26.255108 (+1884854us) ts_tablet_manager.cc:1145] Deleting tablet ec3d823781234015aa8a48421a23bbd2
0927 15:06:26.255119 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.255186 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1884679}
W20260927 15:06:26.255735 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet ec3d823781234015aa8a48421a23bbd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec3d823781234015aa8a48421a23bbd2 already in progress: creating tablet
I20260927 15:06:26.256112 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1257) took 1873 ms. Trace:
I20260927 15:06:26.256230 2119 rpcz_store.cc:276] 0927 15:06:24.382281 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.382338 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:26.256002 (+1873664us) ts_tablet_manager.cc:1145] Deleting tablet 45fbe474949344348cd2db98b75d4916
0927 15:06:26.256012 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.256086 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1873482}
W20260927 15:06:26.256618 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 45fbe474949344348cd2db98b75d4916 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fbe474949344348cd2db98b75d4916 already in progress: creating tablet
I20260927 15:06:26.256916 2119 tablet_replica.cc:330] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.257153 2119 raft_consensus.cc:2229] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.257364 2119 raft_consensus.cc:2258] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.258466 2119 ts_tablet_manager.cc:1905] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.186172 1162 raft_consensus.cc:2454] T 8f2843bf6dbf4117b3f44cd39c328b99 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:26.187034 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 2d6521bb3bbb4773b856ce3343fbaf04 (DEFAULT_TABLE table=default.Table_309f95d9eb8a4aa4ad1c9c5d1604ac78 [id=65f53d772c0240cd8f0f26896286179c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.268373 3289 raft_consensus.cc:482] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.268026 3167 ts_tablet_manager.cc:1918] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.268606 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d6521bb3bbb4773b856ce3343fbaf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.268621 3289 raft_consensus.cc:504] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.268941 3167 log.cc:1196] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/5aa58fa9a1384013ac1674bc7d53c3b1
I20260927 15:06:26.269176 3289 leader_election.cc:288] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.269796 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4beb4112734b9c91e32b300fd266d7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:26.270417 1376 leader_election.cc:341] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.268071 1374 leader_election.cc:302] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:26.187333 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 1bbfa83e764146fdbea89da8c7134a46 (DEFAULT_TABLE table=default.Table_d11b170221294649b651d1a165da5341 [id=74947a57ddf34fac8c44178d19b2b04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.270604 3167 ts_tablet_manager.cc:1939] T 5aa58fa9a1384013ac1674bc7d53c3b1 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.271116 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bbfa83e764146fdbea89da8c7134a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.271235 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4beb4112734b9c91e32b300fd266d7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.271284 3289 raft_consensus.cc:2781] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:26.271404 3289 raft_consensus.cc:686] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:26.271610 3289 consensus_queue.cc:237] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.189952 1561 raft_consensus.cc:348] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.274976 1561 raft_consensus.cc:374] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.275098 1561 raft_consensus.cc:729] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.275671 1561 consensus_queue.cc:260] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.275921 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1362) took 1030 ms. Trace:
I20260927 15:06:26.276644 1166 raft_consensus.cc:2454] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:26.277426 1374 leader_election.cc:302] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:26.277767 3210 raft_consensus.cc:2781] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:26.278056 3210 raft_consensus.cc:482] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:26.278122 3210 raft_consensus.cc:3037] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.276472 3167 rpcz_store.cc:276] 0927 15:06:25.245576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.260642 (+ 15066us) service_pool.cc:227] Handling call
0927 15:06:26.232992 (+972350us) ts_tablet_manager.cc:1145] Deleting tablet 5aa58fa9a1384013ac1674bc7d53c3b1
0927 15:06:26.233005 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.237335 (+ 4330us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x6150004801a4. stack: 00007f26d729d66e 00007f26d729d430 00007f26d63245ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f26e27d904d 00007f26e3a7d5ec 00007f26e640c2e6 00007f26e643e404 00007f26e641f870 00007f26e641f5fd 00000000009edb7c 00007f26d72e3344 00007f26d72e691b 00007f26d72e6798
0927 15:06:26.249995 (+ 12660us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.267487 (+ 17492us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.275666 (+ 8179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7070592,"tablet-delete.queue_time_us":972097}
I20260927 15:06:26.279014 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 5aa58fa9a1384013ac1674bc7d53c3b1 (table default.Table_cb47d8e094f84808bbcf64674dd9f797 [id=959be14ff5134cd286ca43fa57db2078]) successfully deleted
I20260927 15:06:26.279824 3167 tablet_replica.cc:330] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.280714 3210 raft_consensus.cc:504] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.280992 3167 raft_consensus.cc:2229] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.281342 3210 leader_election.cc:288] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.281718 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4beb4112734b9c91e32b300fd266d7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:26.282229 1376 leader_election.cc:341] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.282234 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4beb4112734b9c91e32b300fd266d7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:26.282431 1166 raft_consensus.cc:3037] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.283373 1561 ts_tablet_manager.cc:1428] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.190s user 0.002s sys 0.000s
I20260927 15:06:26.281787 3167 raft_consensus.cc:2258] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.287988 1561 tablet_bootstrap.cc:492] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:26.284885 1166 raft_consensus.cc:2454] T 6b4beb4112734b9c91e32b300fd266d7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:26.288465 1374 leader_election.cc:302] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:26.288690 3289 raft_consensus.cc:2781] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:26.288841 3289 raft_consensus.cc:686] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:26.289136 3289 consensus_queue.cc:237] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.289294 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6a248ec4ee64d0a8d986fdc683d69ba" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.290782 1552 tablet_bootstrap.cc:492] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.291007 1552 ts_tablet_manager.cc:1397] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.313s user 0.005s sys 0.001s
I20260927 15:06:26.290800 3167 ts_tablet_manager.cc:1905] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.292037 1552 raft_consensus.cc:348] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.292315 1552 raft_consensus.cc:374] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.292495 1552 raft_consensus.cc:729] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.292788 1552 consensus_queue.cc:260] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.293483 1552 ts_tablet_manager.cc:1428] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:26.294281 2119 ts_tablet_manager.cc:1918] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.295122 1552 tablet_bootstrap.cc:492] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.295117 2119 log.cc:1196] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/db09498a395b4570a34d32fbfc71e8ed
I20260927 15:06:26.296888 1552 tablet_bootstrap.cc:654] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.298663 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet e9f171fd62d644f38262a2257d47fafe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.311327 1137 tablet_service.cc:1467] Processing CreateTablet for tablet 614cd53bf98541e996734be007b3bf27 (DEFAULT_TABLE table=default.Table_b7180c38c8244e5590c1af88dee592c3 [id=735b9a2275b44ef98805eae95167830d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.312913 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 614cd53bf98541e996734be007b3bf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.297200 2119 ts_tablet_manager.cc:1939] T db09498a395b4570a34d32fbfc71e8ed P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.315294 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1256) took 1933 ms. Trace:
I20260927 15:06:26.301985 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa58fa9a1384013ac1674bc7d53c3b1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.315713 2119 rpcz_store.cc:276] 0927 15:06:24.382180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.382467 (+ 287us) service_pool.cc:227] Handling call
0927 15:06:26.256879 (+1874412us) ts_tablet_manager.cc:1145] Deleting tablet db09498a395b4570a34d32fbfc71e8ed
0927 15:06:26.256887 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.267431 (+ 10544us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.293785 (+ 26354us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.315270 (+ 21485us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1874223}
I20260927 15:06:26.316277 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1255) took 1934 ms. Trace:
I20260927 15:06:26.316282 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet db09498a395b4570a34d32fbfc71e8ed (table default.Table_5b7e58750e9a481cab2abf34e5753a5e [id=ed34d1e88ae54c6086ae3a7cbfdf7861]) successfully deleted
I20260927 15:06:26.316445 2119 rpcz_store.cc:276] 0927 15:06:24.382028 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.384787 (+ 2759us) service_pool.cc:227] Handling call
0927 15:06:26.316138 (+1931351us) ts_tablet_manager.cc:1145] Deleting tablet fb8e95f350f249ac85c5df42afe4a90d
0927 15:06:26.316152 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.316261 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1917630}
I20260927 15:06:26.316892 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1258) took 1842 ms. Trace:
I20260927 15:06:26.316895 3167 ts_tablet_manager.cc:1918] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260927 15:06:26.317004 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet fb8e95f350f249ac85c5df42afe4a90d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb8e95f350f249ac85c5df42afe4a90d already in progress: creating tablet
I20260927 15:06:26.317030 2119 rpcz_store.cc:276] 0927 15:06:24.474535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.475753 (+ 1218us) service_pool.cc:227] Handling call
0927 15:06:26.316786 (+1841033us) ts_tablet_manager.cc:1145] Deleting tablet 723df898361144aeb16065868885d120
0927 15:06:26.316794 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.316877 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1840836}
I20260927 15:06:26.317332 2119 tablet_replica.cc:330] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
W20260927 15:06:26.317423 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 723df898361144aeb16065868885d120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 723df898361144aeb16065868885d120 already in progress: creating tablet
I20260927 15:06:26.317544 2119 raft_consensus.cc:2229] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:26.317468 3167 log.cc:1196] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/8f95d664f1134ac9bbb62c1a3d4b5617
I20260927 15:06:26.317862 2119 raft_consensus.cc:2258] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.319083 3167 ts_tablet_manager.cc:1939] T 8f95d664f1134ac9bbb62c1a3d4b5617 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.319828 2119 ts_tablet_manager.cc:1905] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.322104 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1365) took 1038 ms. Trace:
I20260927 15:06:26.322533 3167 rpcz_store.cc:276] 0927 15:06:25.283479 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.288990 (+ 5511us) service_pool.cc:227] Handling call
0927 15:06:26.279576 (+990586us) ts_tablet_manager.cc:1145] Deleting tablet 8f95d664f1134ac9bbb62c1a3d4b5617
0927 15:06:26.279683 (+ 107us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.305272 (+ 25589us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.316516 (+ 11244us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.322053 (+ 5537us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":985797}
I20260927 15:06:26.324256 3167 tablet_replica.cc:330] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.325033 3167 raft_consensus.cc:2229] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
W20260927 15:06:26.325017 1099 consensus_peers.cc:487] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f95d664f1134ac9bbb62c1a3d4b5617. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:26.325927 3167 pending_rounds.cc:62] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:26.326277 3167 pending_rounds.cc:68] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976417442983936 op_type: NO_OP noop_request { }
I20260927 15:06:26.327405 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 61bd404f62004de6941ba6fbddea1ddb (DEFAULT_TABLE table=default.Table_c2bf22bb725d4f42b715ca3be60f0cfd [id=e1e9607578054ec1a99d5f50e73d4486]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.327795 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61bd404f62004de6941ba6fbddea1ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.327836 1135 tablet_service.cc:1467] Processing CreateTablet for tablet 61bd404f62004de6941ba6fbddea1ddb (DEFAULT_TABLE table=default.Table_c2bf22bb725d4f42b715ca3be60f0cfd [id=e1e9607578054ec1a99d5f50e73d4486]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.328203 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61bd404f62004de6941ba6fbddea1ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.329208 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 61bd404f62004de6941ba6fbddea1ddb (DEFAULT_TABLE table=default.Table_c2bf22bb725d4f42b715ca3be60f0cfd [id=e1e9607578054ec1a99d5f50e73d4486]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.329818 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61bd404f62004de6941ba6fbddea1ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.325137 3325 raft_consensus.cc:482] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.329432 3167 raft_consensus.cc:2866] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:26.331630 3325 raft_consensus.cc:504] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:26.332747 1099 consensus_peers.cc:487] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db09498a395b4570a34d32fbfc71e8ed. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:26.332440 3167 raft_consensus.cc:2258] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.334082 3325 leader_election.cc:288] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:26.334911 1099 leader_election.cc:341] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 727652500d9a47b68b7a0d0dcf583822
I20260927 15:06:26.335314 1304 raft_consensus.cc:3037] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.337198 3167 ts_tablet_manager.cc:1905] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.344110 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa58fa9a1384013ac1674bc7d53c3b1" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:26.345238 1485 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:26.359146 1561 tablet_bootstrap.cc:654] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.359422 1552 tablet_bootstrap.cc:492] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.359704 1552 ts_tablet_manager.cc:1397] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.001s
I20260927 15:06:26.360380 1552 raft_consensus.cc:348] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.360639 1552 raft_consensus.cc:374] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.360726 1552 raft_consensus.cc:729] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.360961 1552 consensus_queue.cc:260] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.361477 1552 ts_tablet_manager.cc:1428] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:26.361766 1552 tablet_bootstrap.cc:492] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.363157 1552 tablet_bootstrap.cc:654] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.363350 1294 raft_consensus.cc:3037] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.367769 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 8fd389719a9948788c34b99e4953af57 (DEFAULT_TABLE table=default.Table_3c0029ef42144b28bbae10e7f7c78b34 [id=b9597056e3f249a88558fc0af9a18bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.368130 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:26.368544 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fd389719a9948788c34b99e4953af57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.371506 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 8fd389719a9948788c34b99e4953af57 (DEFAULT_TABLE table=default.Table_3c0029ef42144b28bbae10e7f7c78b34 [id=b9597056e3f249a88558fc0af9a18bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.371923 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fd389719a9948788c34b99e4953af57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.373631 3167 ts_tablet_manager.cc:1918] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:26.374306 3167 log.cc:1196] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/6b4beb4112734b9c91e32b300fd266d7
I20260927 15:06:26.377130 3167 ts_tablet_manager.cc:1939] T 6b4beb4112734b9c91e32b300fd266d7 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.379774 1552 tablet_bootstrap.cc:492] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.379912 1552 ts_tablet_manager.cc:1397] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260927 15:06:26.380743 1552 raft_consensus.cc:348] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.381057 1552 raft_consensus.cc:374] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.381126 1552 raft_consensus.cc:729] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.381415 1552 consensus_queue.cc:260] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.382108 1552 ts_tablet_manager.cc:1428] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:26.382014 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1366) took 1018 ms. Trace:
I20260927 15:06:26.382391 1552 tablet_bootstrap.cc:492] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.382535 3167 rpcz_store.cc:276] 0927 15:06:25.363694 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.375133 (+ 11439us) service_pool.cc:227] Handling call
0927 15:06:26.324014 (+948881us) ts_tablet_manager.cc:1145] Deleting tablet 6b4beb4112734b9c91e32b300fd266d7
0927 15:06:26.324125 (+ 111us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.356046 (+ 31921us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.373087 (+ 17041us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.381888 (+ 8801us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":948635}
I20260927 15:06:26.383981 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 6b4beb4112734b9c91e32b300fd266d7 (table default.Table_56a3935c2e7e42f3a601932943f67459 [id=8c8bd97266a2496babd70e882c94152b]) successfully deleted
I20260927 15:06:26.384086 1552 tablet_bootstrap.cc:654] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:26.385843 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c90e10a8cad34967be2fab613de9c78f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c90e10a8cad34967be2fab613de9c78f already in progress: creating tablet
W20260927 15:06:26.387318 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0e313b183d4549ca975d8077b22fc3f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e313b183d4549ca975d8077b22fc3f6 already in progress: creating tablet
I20260927 15:06:26.367751 1127 tablet_service.cc:1467] Processing CreateTablet for tablet 8fd389719a9948788c34b99e4953af57 (DEFAULT_TABLE table=default.Table_3c0029ef42144b28bbae10e7f7c78b34 [id=b9597056e3f249a88558fc0af9a18bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:26.369091 3250 raft_consensus.cc:482] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:26.388784 1556 tablet_bootstrap.cc:492] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:26.388990 1556 ts_tablet_manager.cc:1397] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.229s user 0.024s sys 0.033s
I20260927 15:06:26.388996 3250 raft_consensus.cc:504] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.389976 3250 leader_election.cc:288] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:26.390555 1099 leader_election.cc:341] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 2268d824f5324cd1b81879e2fe4fd027
I20260927 15:06:26.390363 1556 raft_consensus.cc:348] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.391007 1556 raft_consensus.cc:374] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.391163 1556 raft_consensus.cc:729] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.391477 1556 consensus_queue.cc:260] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:26.396067 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 180c347e066f4d9a897825bad8a32d69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 180c347e066f4d9a897825bad8a32d69 already in progress: creating tablet
I20260927 15:06:26.395643 1556 ts_tablet_manager.cc:1428] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
W20260927 15:06:26.397496 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet cd3eb83597ef4aae9bf00fcfc2517ea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd3eb83597ef4aae9bf00fcfc2517ea6 already in progress: creating tablet
I20260927 15:06:26.397241 1556 tablet_bootstrap.cc:492] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:26.398778 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9737e70f2ddb45029c042ffbd83af157 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9737e70f2ddb45029c042ffbd83af157 already in progress: creating tablet
W20260927 15:06:26.400372 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7142c97a22e74bc8b93c7e9acb949073 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7142c97a22e74bc8b93c7e9acb949073 already in progress: creating tablet
W20260927 15:06:26.401571 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet db62070ea78b43e69ddd249a71e9ceea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db62070ea78b43e69ddd249a71e9ceea already in progress: creating tablet
W20260927 15:06:26.402933 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet dbeebc4fdf444b24ab901e4bb80b49d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbeebc4fdf444b24ab901e4bb80b49d1 already in progress: creating tablet
W20260927 15:06:26.404253 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2a31738c476c459280e837ff109fd84f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a31738c476c459280e837ff109fd84f already in progress: creating tablet
I20260927 15:06:26.405020 3167 tablet_replica.cc:330] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.405982 3167 raft_consensus.cc:2229] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:26.407348 3167 pending_rounds.cc:62] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:26.407696 3167 pending_rounds.cc:68] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976415555436544 op_type: NO_OP noop_request { }
I20260927 15:06:26.409751 3167 raft_consensus.cc:2866] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:26.410234 3167 raft_consensus.cc:2258] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.410688 1556 tablet_bootstrap.cc:654] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:26.387991 1102 leader_election.cc:341] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.411104 1102 leader_election.cc:302] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.411911 3325 raft_consensus.cc:2726] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:26.412701 1102 leader_election.cc:341] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:26.414027 1102 leader_election.cc:341] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.413898 3167 ts_tablet_manager.cc:1905] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:26.414355 1102 consensus_peers.cc:487] T c3939bfd903d42e9bfaaf6ecdf50b8d4 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3939bfd903d42e9bfaaf6ecdf50b8d4. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:26.415077 1552 tablet_bootstrap.cc:492] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.415201 1552 ts_tablet_manager.cc:1397] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.005s
I20260927 15:06:26.415877 1552 raft_consensus.cc:348] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.416074 1552 raft_consensus.cc:374] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.416123 1552 raft_consensus.cc:729] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.416285 1552 consensus_queue.cc:260] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.416783 1552 ts_tablet_manager.cc:1428] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:26.417312 1552 tablet_bootstrap.cc:492] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.418601 1552 tablet_bootstrap.cc:654] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.425624 1556 tablet_bootstrap.cc:492] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:26.425913 1556 ts_tablet_manager.cc:1397] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.000s
I20260927 15:06:26.427280 1556 raft_consensus.cc:348] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.427708 1556 raft_consensus.cc:374] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.427848 1556 raft_consensus.cc:729] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.428277 1556 consensus_queue.cc:260] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.430226 1552 tablet_bootstrap.cc:492] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.430399 1552 ts_tablet_manager.cc:1397] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.006s
I20260927 15:06:26.431180 1552 raft_consensus.cc:348] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.431439 1552 raft_consensus.cc:374] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.431548 1552 raft_consensus.cc:729] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.431810 1552 consensus_queue.cc:260] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.432351 1552 ts_tablet_manager.cc:1428] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:26.433378 1552 tablet_bootstrap.cc:492] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.434991 1552 tablet_bootstrap.cc:654] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.435132 1562 ts_tablet_manager.cc:1918] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:26.435201 1556 ts_tablet_manager.cc:1428] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260927 15:06:26.435319 1562 log.cc:1196] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/d463a481cb8c4243961e9b0d2b11822c
I20260927 15:06:26.435704 1562 ts_tablet_manager.cc:1939] T d463a481cb8c4243961e9b0d2b11822c P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:26.436064 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1071) took 7066 ms. Trace:
I20260927 15:06:26.436189 1562 rpcz_store.cc:276] 0927 15:06:19.369176 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.369221 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:25.882895 (+6513674us) ts_tablet_manager.cc:1145] Deleting tablet d463a481cb8c4243961e9b0d2b11822c
0927 15:06:25.882911 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:25.951371 (+ 68460us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x6150003a1ea4. stack: 00007f344c23b66e 00007f344c23b430 00007f344b2c25ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f345777704d 00007f3458a1b5ec 00007f345b3aa2e6 00007f345b3dc404 00007f345b3bd870 00007f345b3bd5fd 00000000009edb7c 00007f344c281344 00007f344c28491b 00007f344c284798
0927 15:06:26.153698 (+202327us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.435011 (+281313us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.436048 (+ 1037us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":72581,"spinlock_wait_cycles":55167744,"tablet-delete.queue_time_us":6509961}
I20260927 15:06:26.436803 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet d463a481cb8c4243961e9b0d2b11822c (table default.Table_04e241fd53a64c76b188ab49cd5ea266 [id=9f11325f98a4445eb6ee1d8c251866fb]) successfully deleted
I20260927 15:06:26.437184 1562 tablet_replica.cc:330] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:26.437412 1562 raft_consensus.cc:2229] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.438975 1562 raft_consensus.cc:2258] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.442939 1556 tablet_bootstrap.cc:492] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:26.444001 3289 raft_consensus.cc:482] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.444125 3289 raft_consensus.cc:504] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.444720 3289 leader_election.cc:288] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.445369 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b911b7f278ce4e5f8946fe8381fd9ba7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.445684 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b911b7f278ce4e5f8946fe8381fd9ba7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.445876 1166 raft_consensus.cc:2454] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
W20260927 15:06:26.446017 1376 leader_election.cc:341] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.446643 1374 leader_election.cc:302] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:26.447088 3289 raft_consensus.cc:2781] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:26.447166 3289 raft_consensus.cc:482] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:26.447225 3289 raft_consensus.cc:3037] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.449589 1556 tablet_bootstrap.cc:654] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.452358 3167 ts_tablet_manager.cc:1918] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:26.452512 3167 log.cc:1196] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/ea3220df595848258d0f53fa941b2beb
I20260927 15:06:26.453145 3167 ts_tablet_manager.cc:1939] T ea3220df595848258d0f53fa941b2beb P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.449648 3289 raft_consensus.cc:504] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.454293 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b911b7f278ce4e5f8946fe8381fd9ba7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:26.454797 1376 leader_election.cc:341] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.454767 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet ea3220df595848258d0f53fa941b2beb (table default.Table_995d720be4324759bc78c1c0aaae8213 [id=897414435dff415ea9c597e1ade8caab]) successfully deleted
I20260927 15:06:26.455610 3289 leader_election.cc:288] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:26.455616 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df already in progress: creating tablet
I20260927 15:06:26.455905 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b911b7f278ce4e5f8946fe8381fd9ba7" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:26.456130 1166 raft_consensus.cc:3037] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.458662 1166 raft_consensus.cc:2454] T b911b7f278ce4e5f8946fe8381fd9ba7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:26.459061 1374 leader_election.cc:302] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:26.459468 3289 raft_consensus.cc:2781] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
W20260927 15:06:26.459632 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet cf0cc2ae2792420a91f2c42edcf47fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf0cc2ae2792420a91f2c42edcf47fd7 already in progress: creating tablet
I20260927 15:06:26.459985 3289 raft_consensus.cc:686] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:26.460232 3289 consensus_queue.cc:237] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:26.460381 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 9cd4941f342d41f6a0b4d9c1c42a983d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cd4941f342d41f6a0b4d9c1c42a983d already in progress: creating tablet
I20260927 15:06:26.460810 3167 tablet_replica.cc:330] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.461220 3167 raft_consensus.cc:2229] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:26.463130 3167 pending_rounds.cc:62] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:26.463353 3167 pending_rounds.cc:68] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976417370615808 op_type: NO_OP noop_request { }
I20260927 15:06:26.463820 3167 raft_consensus.cc:2866] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:26.464164 3167 raft_consensus.cc:2258] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.466442 3167 ts_tablet_manager.cc:1905] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.468950 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fd389719a9948788c34b99e4953af57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:26.475631 3325 raft_consensus.cc:482] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.475802 3325 raft_consensus.cc:504] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:26.477341 1099 leader_election.cc:341] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ac64eacc7d924940aacc8779b5bfeae7
I20260927 15:06:26.477519 3325 leader_election.cc:288] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:26.481333 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 66761.5us
I20260927 15:06:26.481971 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727652500d9a47b68b7a0d0dcf583822" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.486083 1294 raft_consensus.cc:3037] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.494750 1561 tablet_bootstrap.cc:492] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:26.494971 1561 ts_tablet_manager.cc:1397] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.207s user 0.003s sys 0.000s
I20260927 15:06:26.495754 1561 raft_consensus.cc:348] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.496011 1561 raft_consensus.cc:374] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.496081 1561 raft_consensus.cc:729] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.496628 1561 consensus_queue.cc:260] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.497344 1561 ts_tablet_manager.cc:1428] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:26.504186 1295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac64eacc7d924940aacc8779b5bfeae7" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.502781 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2268d824f5324cd1b81879e2fe4fd027" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.504444 1305 raft_consensus.cc:2454] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:26.503418 3223 raft_consensus.cc:482] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.504854 3223 raft_consensus.cc:504] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.505483 3223 leader_election.cc:288] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:26.509604 1238 leader_election.cc:341] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 8f95d664f1134ac9bbb62c1a3d4b5617
I20260927 15:06:26.511183 1562 ts_tablet_manager.cc:1905] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.501678 3346 tablet.cc:1722] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:26.517563 3347 tablet.cc:1722] T 99d4707e599840b3bdc2ab13c348ea80 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260927 15:06:26.518859 3223 raft_consensus.cc:482] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.519289 3223 raft_consensus.cc:504] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.519960 3223 leader_election.cc:288] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.521145 1428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a89ce4434ad4171bf613d4bbb3337a8" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:26.522333 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a89ce4434ad4171bf613d4bbb3337a8" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.522356 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f95d664f1134ac9bbb62c1a3d4b5617" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.523365 1239 leader_election.cc:302] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.523744 1239 leader_election.cc:302] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.524055 3302 raft_consensus.cc:2726] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.524199 3302 raft_consensus.cc:2726] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.525135 1561 tablet_bootstrap.cc:492] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:26.527019 1561 tablet_bootstrap.cc:654] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.535375 2119 ts_tablet_manager.cc:1918] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:26.535605 2119 log.cc:1196] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/28f6bef5f000441090f73eb842450362
I20260927 15:06:26.536046 2119 ts_tablet_manager.cc:1939] T 28f6bef5f000441090f73eb842450362 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.536429 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1260) took 1686 ms. Trace:
I20260927 15:06:26.536592 2119 rpcz_store.cc:276] 0927 15:06:24.853509 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:24.863025 (+ 9516us) service_pool.cc:227] Handling call
0927 15:06:26.317287 (+1454262us) ts_tablet_manager.cc:1145] Deleting tablet 28f6bef5f000441090f73eb842450362
0927 15:06:26.317296 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.408200 (+ 90904us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.535282 (+127082us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.536408 (+ 1126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1453999}
I20260927 15:06:26.537210 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 28f6bef5f000441090f73eb842450362 (table default.Table_083e1ad3d401408dabc1266d11ab2734 [id=77045a2c0b5143e19139d270564a1a27]) successfully deleted
I20260927 15:06:26.537719 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1281) took 1398 ms. Trace:
I20260927 15:06:26.537860 2119 rpcz_store.cc:276] 0927 15:06:25.139204 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.140744 (+ 1540us) service_pool.cc:227] Handling call
0927 15:06:26.537581 (+1396837us) ts_tablet_manager.cc:1145] Deleting tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda
0927 15:06:26.537595 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.537698 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1396289}
W20260927 15:06:26.538353 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22cb8d4cf7b4448b8f8d5b8be0a5abda already in progress: creating tablet
I20260927 15:06:26.538780 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1283) took 1395 ms. Trace:
I20260927 15:06:26.538928 2119 rpcz_store.cc:276] 0927 15:06:25.143740 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.143905 (+ 165us) service_pool.cc:227] Handling call
0927 15:06:26.538668 (+1394763us) ts_tablet_manager.cc:1145] Deleting tablet 50d786631fc849789164e83efaca333d
0927 15:06:26.538678 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.538763 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1394559}
W20260927 15:06:26.539384 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 50d786631fc849789164e83efaca333d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50d786631fc849789164e83efaca333d already in progress: creating tablet
I20260927 15:06:26.539781 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1284) took 1395 ms. Trace:
W20260927 15:06:26.540215 1102 leader_election.cc:341] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.559450 1102 leader_election.cc:302] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.560140 3235 raft_consensus.cc:2726] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:26.561728 1102 leader_election.cc:341] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.561923 1102 leader_election.cc:302] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.562179 3235 raft_consensus.cc:2726] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.576396 1102 leader_election.cc:302] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.576853 3235 raft_consensus.cc:2781] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260927 15:06:26.576954 3235 raft_consensus.cc:482] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:26.577021 3235 raft_consensus.cc:3037] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Advancing to term 2
I20260927 15:06:26.580384 3235 raft_consensus.cc:504] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:26.582108 1099 leader_election.cc:341] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 2268d824f5324cd1b81879e2fe4fd027
I20260927 15:06:26.582337 3235 leader_election.cc:288] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:26.590364 3235 raft_consensus.cc:482] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.590629 3235 raft_consensus.cc:504] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:26.592207 1099 leader_election.cc:341] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: cdcc55fb32b14935922e5870819bc266
I20260927 15:06:26.592423 3235 leader_election.cc:288] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:26.596432 1561 tablet_bootstrap.cc:492] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:26.596648 1561 ts_tablet_manager.cc:1397] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.072s user 0.000s sys 0.003s
I20260927 15:06:26.597469 1561 raft_consensus.cc:348] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.597847 1561 raft_consensus.cc:374] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.597954 1561 raft_consensus.cc:729] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.598240 1561 consensus_queue.cc:260] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.617367 1556 tablet_bootstrap.cc:492] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:26.618377 1556 ts_tablet_manager.cc:1397] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.176s user 0.012s sys 0.007s
I20260927 15:06:26.604239 1294 raft_consensus.cc:3037] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.605563 1291 raft_consensus.cc:3037] T 1a89ce4434ad4171bf613d4bbb3337a8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.607161 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2268d824f5324cd1b81879e2fe4fd027" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:26.625203 1304 raft_consensus.cc:3037] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Advancing to term 2
I20260927 15:06:26.627682 1304 raft_consensus.cc:2454] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 2.
I20260927 15:06:26.607669 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdcc55fb32b14935922e5870819bc266" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.608619 3223 raft_consensus.cc:482] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.612022 1552 tablet_bootstrap.cc:492] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.628328 1552 ts_tablet_manager.cc:1397] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.195s user 0.033s sys 0.047s
I20260927 15:06:26.628258 3223 raft_consensus.cc:504] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.628858 3223 leader_election.cc:288] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.629030 1552 raft_consensus.cc:348] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.629235 1552 raft_consensus.cc:374] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.629283 1552 raft_consensus.cc:729] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.629464 1552 consensus_queue.cc:260] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.629961 1552 ts_tablet_manager.cc:1428] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 15:06:26.630189 1552 tablet_bootstrap.cc:492] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:26.630247 1239 leader_election.cc:341] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: d463a481cb8c4243961e9b0d2b11822c
I20260927 15:06:26.631713 1552 tablet_bootstrap.cc:654] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:26.632035 1238 leader_election.cc:341] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: d463a481cb8c4243961e9b0d2b11822c
I20260927 15:06:26.632138 1238 leader_election.cc:302] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.632455 3223 raft_consensus.cc:2726] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.629355 1556 raft_consensus.cc:348] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.633419 1556 raft_consensus.cc:374] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.634321 1556 raft_consensus.cc:729] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.645654 1552 tablet_bootstrap.cc:492] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.645874 1552 ts_tablet_manager.cc:1397] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.005s
I20260927 15:06:26.646682 1552 raft_consensus.cc:348] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.646979 1552 raft_consensus.cc:374] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.647085 1552 raft_consensus.cc:729] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.647344 1552 consensus_queue.cc:260] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.647950 1552 ts_tablet_manager.cc:1428] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260927 15:06:26.648259 1552 tablet_bootstrap.cc:492] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.647527 2119 rpcz_store.cc:276] 0927 15:06:25.143913 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.144144 (+ 231us) service_pool.cc:227] Handling call
0927 15:06:26.539683 (+1395539us) ts_tablet_manager.cc:1145] Deleting tablet 7fc551eab48542029c50a300b33dab5f
0927 15:06:26.539693 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.539766 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1395389}
I20260927 15:06:26.649856 1552 tablet_bootstrap.cc:654] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:26.651707 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7fc551eab48542029c50a300b33dab5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fc551eab48542029c50a300b33dab5f already in progress: creating tablet
I20260927 15:06:26.655217 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 684bf999658b4c0c9d66918921d98194
I20260927 15:06:26.656028 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 7508e8c3438649c69daabac7a2a11efc
I20260927 15:06:26.657584 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_8afeeca8129440629ac50aaf3490a531"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.658120 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8afeeca8129440629ac50aaf3490a531 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.658087 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_852b2e72f7614ed2b99a3928b9f6733b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.658614 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_852b2e72f7614ed2b99a3928b9f6733b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.655217 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 092f1616c5e24505b9ca600c599bd351
W20260927 15:06:26.659932 1488 tablet.cc:2369] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:06:26.659861 910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bed1aef81ce94335983f4b9f92dca99c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:26.660130 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a1576e767b1042379532c20177c72f68" } new_table_name: "default.Table_9f60a0e985b24214a7e17dfe61f754f5" modify_external_catalogs: true
W20260927 15:06:26.660303 910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bed1aef81ce94335983f4b9f92dca99c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.662662 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 684bf999658b4c0c9d66918921d98194 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.662899 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 7508e8c3438649c69daabac7a2a11efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:26.663087 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21da5f76a51045789261e7cfe0feacd3 consensus state has no leader
I20260927 15:06:26.663108 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet d463a481cb8c4243961e9b0d2b11822c with delete_type TABLET_DATA_DELETED (replaced by tablet 1c018f11de9842bc883409f8af35fb5f) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.663300 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 092f1616c5e24505b9ca600c599bd351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.663448 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_de2bd790e5a14661bb418a4e1f469db3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.663939 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de2bd790e5a14661bb418a4e1f469db3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.664647 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 99d4707e599840b3bdc2ab13c348ea80 (table default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25]). Expected version 3 got 0
I20260927 15:06:26.664858 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet 20d349cb04314c388e2f72b243c629ba (table default.Table_fe611237a8bb400a86751f2eed953ea9 [id=afca5fe4316b4f5f97dfaf1ce641d832]). Expected version 1 got 0
W20260927 15:06:26.665062 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc130e9f46854e738bdd68d51e8cdc00 consensus state has no leader
I20260927 15:06:26.665376 908 catalog_manager.cc:5587] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757) does not have the latest schema for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (table default.Table_11d82a666e204a059c3afbf4a7d46c2d [id=239ff5a7776c4a469e14137b23b6544a]). Expected version 2 got 0
I20260927 15:06:26.665644 914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 53e22a7e5a1d4282ab4e901542dac2de
I20260927 15:06:26.666239 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet 092f1616c5e24505b9ca600c599bd351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.666213 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7c21987b6b304665a44fbb61a3d4e790" } new_table_name: "default.Table_a2afc70532344aec84602f579669904d" modify_external_catalogs: true
I20260927 15:06:26.666513 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 684bf999658b4c0c9d66918921d98194 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.668262 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 219639c0184f4888984fa04a1f84bd83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.668500 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet 092f1616c5e24505b9ca600c599bd351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.668669 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 53e22a7e5a1d4282ab4e901542dac2de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.669061 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet a50808126865423ab0303ef1667b7f2b
I20260927 15:06:26.669184 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 684bf999658b4c0c9d66918921d98194 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.669628 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_0401b1246f65444893e96dc8d92d7ff7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.670040 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0401b1246f65444893e96dc8d92d7ff7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.671583 907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_60a7ee0cc4194155bbbda937cddc4433"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:26.671761 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1282) took 1529 ms. Trace:
I20260927 15:06:26.671844 2119 rpcz_store.cc:276] 0927 15:06:25.142796 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.150884 (+ 8088us) service_pool.cc:227] Handling call
0927 15:06:26.653425 (+1502541us) ts_tablet_manager.cc:1145] Deleting tablet 33bbd34a3c6148b5a49aa92d54aad36d
0927 15:06:26.653440 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.671738 (+ 18298us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1500999}
W20260927 15:06:26.671977 907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60a7ee0cc4194155bbbda937cddc4433 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.673534 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet a50808126865423ab0303ef1667b7f2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.673996 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 7508e8c3438649c69daabac7a2a11efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:26.674804 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 33bbd34a3c6148b5a49aa92d54aad36d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33bbd34a3c6148b5a49aa92d54aad36d already in progress: creating tablet
I20260927 15:06:26.665340 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1043ad612c1a428895b2abbe98a32e97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.677860 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1043ad612c1a428895b2abbe98a32e97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.681914 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 53e22a7e5a1d4282ab4e901542dac2de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.681946 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet a50808126865423ab0303ef1667b7f2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.682927 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_2136f669aaf340fab8d3e19283572434"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:26.685266 1138 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fd8311955974e1cbcdda1961c318588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:26.685285 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2136f669aaf340fab8d3e19283572434 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.685702 1127 tablet_service.cc:1514] Processing DeleteTablet for tablet a50808126865423ab0303ef1667b7f2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.685757 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 5aa58fa9a1384013ac1674bc7d53c3b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.685983 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet 7508e8c3438649c69daabac7a2a11efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.637953 1556 consensus_queue.cc:260] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.695618 1556 ts_tablet_manager.cc:1428] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.077s user 0.002s sys 0.001s
I20260927 15:06:26.700506 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 53e22a7e5a1d4282ab4e901542dac2de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.702773 3167 ts_tablet_manager.cc:1918] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:26.704226 3167 log.cc:1196] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/8f2843bf6dbf4117b3f44cd39c328b99
I20260927 15:06:26.705158 3167 ts_tablet_manager.cc:1939] T 8f2843bf6dbf4117b3f44cd39c328b99 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.706770 1552 tablet_bootstrap.cc:492] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.706966 1552 ts_tablet_manager.cc:1397] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.059s user 0.013s sys 0.011s
I20260927 15:06:26.707749 1552 raft_consensus.cc:348] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.708016 1552 raft_consensus.cc:374] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.708112 1552 raft_consensus.cc:729] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.708370 1552 consensus_queue.cc:260] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.709235 1552 ts_tablet_manager.cc:1428] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 15:06:26.709551 1552 tablet_bootstrap.cc:492] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.711426 1552 tablet_bootstrap.cc:654] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.711483 1556 tablet_bootstrap.cc:492] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:26.713218 1556 tablet_bootstrap.cc:654] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.715512 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 8f2843bf6dbf4117b3f44cd39c328b99 (table default.Table_9308e69b438d4173a3e71eb08336c30a [id=e535d77458dc4a71a14e0f60585c5779]) successfully deleted
W20260927 15:06:26.716257 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 01a81e786b6b47599d4cee122de2c29a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01a81e786b6b47599d4cee122de2c29a already in progress: creating tablet
W20260927 15:06:26.716856 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 024f439ab5774474ad197bf7fa557ac7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 024f439ab5774474ad197bf7fa557ac7 already in progress: creating tablet
I20260927 15:06:26.717001 1304 raft_consensus.cc:3037] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.717166 3167 tablet_replica.cc:330] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.717377 3167 raft_consensus.cc:2229] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.717525 3167 raft_consensus.cc:2258] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.717989 3167 ts_tablet_manager.cc:1905] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.720114 1552 tablet_bootstrap.cc:492] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.720296 1552 ts_tablet_manager.cc:1397] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.006s
I20260927 15:06:26.721021 1552 raft_consensus.cc:348] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.721276 1552 raft_consensus.cc:374] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.721372 1552 raft_consensus.cc:729] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.721618 1552 consensus_queue.cc:260] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.722164 1552 ts_tablet_manager.cc:1428] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:26.722491 1552 tablet_bootstrap.cc:492] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.724052 1552 tablet_bootstrap.cc:654] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.728272 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1285) took 1568 ms. Trace:
I20260927 15:06:26.728464 2119 rpcz_store.cc:276] 0927 15:06:25.159530 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.161268 (+ 1738us) service_pool.cc:227] Handling call
0927 15:06:26.728115 (+1566847us) ts_tablet_manager.cc:1145] Deleting tablet d9c032a06c0b497fa21a3553375978ca
0927 15:06:26.728130 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.728248 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1566666}
W20260927 15:06:26.729081 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet d9c032a06c0b497fa21a3553375978ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9c032a06c0b497fa21a3553375978ca already in progress: creating tablet
I20260927 15:06:26.729532 2119 tablet_replica.cc:330] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.729835 2119 raft_consensus.cc:2229] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.730048 2119 raft_consensus.cc:2258] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.730867 2119 ts_tablet_manager.cc:1905] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.733143 3167 ts_tablet_manager.cc:1918] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.733278 3167 log.cc:1196] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/5bdb6d04e5a94d7fbe3b27ccc0042f85
I20260927 15:06:26.733566 3167 ts_tablet_manager.cc:1939] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.733649 1102 leader_election.cc:302] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.734102 3325 raft_consensus.cc:2781] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 2 FOLLOWER]: Leader election won for term 2
I20260927 15:06:26.734503 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 (table default.Table_8314c67a0ac344ac978f6ec17eb62d72 [id=476ee068cefa474298baab50827b6122]) successfully deleted
I20260927 15:06:26.734583 3289 raft_consensus.cc:482] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.734696 3289 raft_consensus.cc:504] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.735252 3289 leader_election.cc:288] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.736485 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87b54364a63b48e9981463d1019dad59" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:26.737085 1376 leader_election.cc:341] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.737715 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87b54364a63b48e9981463d1019dad59" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.737962 1166 raft_consensus.cc:2454] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:26.738340 1556 tablet_bootstrap.cc:492] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:26.738369 1374 leader_election.cc:302] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:26.738304 3325 raft_consensus.cc:686] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 2 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:26.738466 1556 ts_tablet_manager.cc:1397] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.007s
I20260927 15:06:26.738821 3289 raft_consensus.cc:2781] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:26.738965 3289 raft_consensus.cc:482] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:26.739048 3289 raft_consensus.cc:3037] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.738865 3325 consensus_queue.cc:237] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.739555 1552 tablet_bootstrap.cc:492] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.739548 1556 raft_consensus.cc:348] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.739667 1552 ts_tablet_manager.cc:1397] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20260927 15:06:26.739717 1556 raft_consensus.cc:374] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.739758 1556 raft_consensus.cc:729] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.739912 1556 consensus_queue.cc:260] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.740351 1556 ts_tablet_manager.cc:1428] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 15:06:26.740319 1552 raft_consensus.cc:348] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:26.740552 1552 raft_consensus.cc:374] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.740581 1556 tablet_bootstrap.cc:492] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:26.740619 1552 raft_consensus.cc:729] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.740859 1552 consensus_queue.cc:260] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:26.741391 1552 ts_tablet_manager.cc:1428] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:26.741430 3289 raft_consensus.cc:504] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.741642 1552 tablet_bootstrap.cc:492] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.742192 1556 tablet_bootstrap.cc:654] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.743285 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87b54364a63b48e9981463d1019dad59" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:26.743278 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87b54364a63b48e9981463d1019dad59" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
I20260927 15:06:26.743484 1166 raft_consensus.cc:3037] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:26.743916 1376 leader_election.cc:341] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.744124 3289 leader_election.cc:288] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.744604 3167 tablet_replica.cc:330] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.744728 1552 tablet_bootstrap.cc:654] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.744771 3167 raft_consensus.cc:2229] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.744908 3167 raft_consensus.cc:2258] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.746062 1166 raft_consensus.cc:2454] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
I20260927 15:06:26.746564 1374 leader_election.cc:302] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:26.746784 3167 ts_tablet_manager.cc:1905] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.746784 3289 raft_consensus.cc:2781] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:26.747018 3289 raft_consensus.cc:686] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:26.747337 3289 consensus_queue.cc:237] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.747664 2119 ts_tablet_manager.cc:1918] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.747776 2119 log.cc:1196] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/8f95d664f1134ac9bbb62c1a3d4b5617
I20260927 15:06:26.748080 2119 ts_tablet_manager.cc:1939] T 8f95d664f1134ac9bbb62c1a3d4b5617 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.748374 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1286) took 1462 ms. Trace:
I20260927 15:06:26.748466 2119 rpcz_store.cc:276] 0927 15:06:25.286037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.288691 (+ 2654us) service_pool.cc:227] Handling call
0927 15:06:26.729482 (+1440791us) ts_tablet_manager.cc:1145] Deleting tablet 8f95d664f1134ac9bbb62c1a3d4b5617
0927 15:06:26.729495 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.735398 (+ 5903us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.747569 (+ 12171us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.748361 (+ 792us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1440548}
I20260927 15:06:26.752270 1556 tablet_bootstrap.cc:492] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:26.752393 1556 ts_tablet_manager.cc:1397] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.001s
I20260927 15:06:26.753010 1556 raft_consensus.cc:348] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.753192 2119 tablet_replica.cc:330] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.753207 1556 raft_consensus.cc:374] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.753284 1556 raft_consensus.cc:729] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.753419 2119 raft_consensus.cc:2229] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.753592 2119 raft_consensus.cc:2258] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.754124 2119 ts_tablet_manager.cc:1905] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.755959 1556 consensus_queue.cc:260] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.756908 1556 ts_tablet_manager.cc:1428] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:26.758039 1561 ts_tablet_manager.cc:1428] T 87b54364a63b48e9981463d1019dad59 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.161s user 0.001s sys 0.001s
I20260927 15:06:26.758368 1561 tablet_bootstrap.cc:492] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:26.759388 1556 tablet_bootstrap.cc:492] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:26.764002 1552 tablet_bootstrap.cc:492] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.764180 1552 ts_tablet_manager.cc:1397] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.004s
I20260927 15:06:26.764294 3167 ts_tablet_manager.cc:1918] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.764429 3167 log.cc:1196] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/f0a71cf0ee554b3eafca3f054cc16b28
I20260927 15:06:26.764705 3167 ts_tablet_manager.cc:1939] T f0a71cf0ee554b3eafca3f054cc16b28 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.765147 1552 raft_consensus.cc:348] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.765435 1552 raft_consensus.cc:374] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.765549 1552 raft_consensus.cc:729] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.765588 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet f0a71cf0ee554b3eafca3f054cc16b28 (table default.Table_24cb81a378f04185be135842bae6db54 [id=a377cb3f421c4976b9725fceac939926]) successfully deleted
I20260927 15:06:26.765807 1552 consensus_queue.cc:260] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.766440 1552 ts_tablet_manager.cc:1428] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:26.766678 1556 tablet_bootstrap.cc:654] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.766873 1552 tablet_bootstrap.cc:492] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.768343 1552 tablet_bootstrap.cc:654] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.771513 3167 tablet_replica.cc:330] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.771590 3210 raft_consensus.cc:482] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.771690 3210 raft_consensus.cc:504] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.772099 2119 ts_tablet_manager.cc:1918] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.772210 2119 log.cc:1196] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/2268d824f5324cd1b81879e2fe4fd027
I20260927 15:06:26.772346 3210 leader_election.cc:288] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.771693 3167 raft_consensus.cc:2229] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.772511 3167 raft_consensus.cc:2258] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.772522 2119 ts_tablet_manager.cc:1939] T 2268d824f5324cd1b81879e2fe4fd027 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.772910 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1287) took 1479 ms. Trace:
I20260927 15:06:26.773125 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f199e9507a894fdabe2ccd2cef699fd8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.773061 2119 rpcz_store.cc:276] 0927 15:06:25.293294 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.293709 (+ 415us) service_pool.cc:227] Handling call
0927 15:06:26.753142 (+1459433us) ts_tablet_manager.cc:1145] Deleting tablet 2268d824f5324cd1b81879e2fe4fd027
0927 15:06:26.753157 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.757259 (+ 4102us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.772000 (+ 14741us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.772892 (+ 892us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1459214}
I20260927 15:06:26.773674 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 2268d824f5324cd1b81879e2fe4fd027 (table default.Table_83597ebfdee14f58abf228d7cd16bbd3 [id=b36bff625e7a4da699490e2921c33802]) successfully deleted
W20260927 15:06:26.773880 1376 leader_election.cc:341] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.772964 3167 ts_tablet_manager.cc:1905] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.774466 2119 tablet_replica.cc:330] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.774701 2119 raft_consensus.cc:2229] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.774711 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f199e9507a894fdabe2ccd2cef699fd8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.774869 2119 raft_consensus.cc:2258] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:26.775367 1374 leader_election.cc:341] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.775424 2119 ts_tablet_manager.cc:1905] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.775506 1374 leader_election.cc:302] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:26.776000 3210 raft_consensus.cc:2726] T f199e9507a894fdabe2ccd2cef699fd8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:26.779824 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 46183.4us
W20260927 15:06:26.780143 1102 leader_election.cc:341] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.780331 1102 leader_election.cc:302] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.780820 3250 raft_consensus.cc:2726] T cdcc55fb32b14935922e5870819bc266 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.795357 1552 tablet_bootstrap.cc:492] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.795513 1552 ts_tablet_manager.cc:1397] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.001s
I20260927 15:06:26.795529 910 catalog_manager.cc:5495] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:26.796245 1552 raft_consensus.cc:348] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.796452 1552 raft_consensus.cc:374] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.796504 1552 raft_consensus.cc:729] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.797123 911 master_service.cc:946] ReplaceTablet: received request to replace tablet c99d932c64f748b0af0162d415fc4962 from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:26.797441 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 814c20f4af8a401a890f4a873ddcb0f3 consensus state has no leader
I20260927 15:06:26.802457 2119 ts_tablet_manager.cc:1918] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.802592 2119 log.cc:1196] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/63fbd388210d4a1aabfcf27c7533efbf
W20260927 15:06:26.798851 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e37e32d17f984d7db7ff9570175c18ed consensus state has no leader
I20260927 15:06:26.802975 1552 consensus_queue.cc:260] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.803579 1552 ts_tablet_manager.cc:1428] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260927 15:06:26.803859 1552 tablet_bootstrap.cc:492] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.803772 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 08f28c023473434ba73b1142a041be97 (table default.Table_d1231a5040be43938a3a26bc25ff741b [id=67762455acad44448ba24d18c2863816]). Expected version 5 got 4
I20260927 15:06:26.807647 1561 tablet_bootstrap.cc:654] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.814356 2119 ts_tablet_manager.cc:1939] T 63fbd388210d4a1aabfcf27c7533efbf P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.814711 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1288) took 1493 ms. Trace:
I20260927 15:06:26.814813 2119 rpcz_store.cc:276] 0927 15:06:25.321683 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.327679 (+ 5996us) service_pool.cc:227] Handling call
0927 15:06:26.774415 (+1446736us) ts_tablet_manager.cc:1145] Deleting tablet 63fbd388210d4a1aabfcf27c7533efbf
0927 15:06:26.774430 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.778801 (+ 4371us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.802361 (+ 23560us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.814695 (+ 12334us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1446470}
I20260927 15:06:26.815374 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 63fbd388210d4a1aabfcf27c7533efbf (table default.Table_5d29cefe8c174dd89895f67e0784bf77 [id=35b9ecf64d084b66b80115a19fd1055a]) successfully deleted
I20260927 15:06:26.816094 1552 tablet_bootstrap.cc:654] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.818032 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1291) took 1405 ms. Trace:
I20260927 15:06:26.818145 2119 rpcz_store.cc:276] 0927 15:06:25.412332 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.413090 (+ 758us) service_pool.cc:227] Handling call
0927 15:06:26.817875 (+1404785us) ts_tablet_manager.cc:1145] Deleting tablet 0e313b183d4549ca975d8077b22fc3f6
0927 15:06:26.817889 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.818012 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1404564}
W20260927 15:06:26.818643 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 0e313b183d4549ca975d8077b22fc3f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e313b183d4549ca975d8077b22fc3f6 already in progress: creating tablet
I20260927 15:06:26.822521 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1290) took 1410 ms. Trace:
I20260927 15:06:26.822644 2119 rpcz_store.cc:276] 0927 15:06:25.412212 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.416508 (+ 4296us) service_pool.cc:227] Handling call
0927 15:06:26.822327 (+1405819us) ts_tablet_manager.cc:1145] Deleting tablet c90e10a8cad34967be2fab613de9c78f
0927 15:06:26.822343 (+ 16us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.822501 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1405605}
W20260927 15:06:26.823148 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c90e10a8cad34967be2fab613de9c78f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c90e10a8cad34967be2fab613de9c78f already in progress: creating tablet
I20260927 15:06:26.823781 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1293) took 1403 ms. Trace:
I20260927 15:06:26.823873 2119 rpcz_store.cc:276] 0927 15:06:25.419897 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.420695 (+ 798us) service_pool.cc:227] Handling call
0927 15:06:26.822902 (+1402207us) ts_tablet_manager.cc:1145] Deleting tablet 180c347e066f4d9a897825bad8a32d69
0927 15:06:26.823656 (+ 754us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.823761 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1402031}
I20260927 15:06:26.824685 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1296) took 1335 ms. Trace:
I20260927 15:06:26.824783 2119 rpcz_store.cc:276] 0927 15:06:25.488776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.489923 (+ 1147us) service_pool.cc:227] Handling call
0927 15:06:26.824082 (+1334159us) ts_tablet_manager.cc:1145] Deleting tablet cd3eb83597ef4aae9bf00fcfc2517ea6
0927 15:06:26.824553 (+ 471us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.824668 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1333972}
I20260927 15:06:26.825057 2119 tablet_replica.cc:330] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.825261 2119 raft_consensus.cc:2229] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.825425 2119 raft_consensus.cc:2258] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:26.825950 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 180c347e066f4d9a897825bad8a32d69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 180c347e066f4d9a897825bad8a32d69 already in progress: creating tablet
W20260927 15:06:26.826220 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet cd3eb83597ef4aae9bf00fcfc2517ea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd3eb83597ef4aae9bf00fcfc2517ea6 already in progress: creating tablet
I20260927 15:06:26.828135 1552 tablet_bootstrap.cc:492] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.828354 1552 ts_tablet_manager.cc:1397] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.003s
I20260927 15:06:26.828601 911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet c99d932c64f748b0af0162d415fc4962
I20260927 15:06:26.828977 911 catalog_manager.cc:6565] ReplaceTablet: tablet c99d932c64f748b0af0162d415fc4962 deleted and replaced by tablet d639e4b65c0d4b2da00efc8973d2603f
I20260927 15:06:26.830943 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet c99d932c64f748b0af0162d415fc4962 with delete_type TABLET_DATA_DELETED (replaced by tablet d639e4b65c0d4b2da00efc8973d2603f) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.831033 906 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet bd5b041a4274477895e88d4822b91cca (table default.Table_215f907352cd4345ae56604d6322ded9 [id=1f51698c91d64bb38f760d13529935b6]). Expected version 1 got 0
I20260927 15:06:26.831440 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:26.831633 1552 raft_consensus.cc:348] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.832798 1552 raft_consensus.cc:374] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.833066 1552 raft_consensus.cc:729] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.833869 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet c99d932c64f748b0af0162d415fc4962 with delete_type TABLET_DATA_DELETED (replaced by tablet d639e4b65c0d4b2da00efc8973d2603f) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.834592 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet c99d932c64f748b0af0162d415fc4962 with delete_type TABLET_DATA_DELETED (replaced by tablet d639e4b65c0d4b2da00efc8973d2603f) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.831647 2119 ts_tablet_manager.cc:1905] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.834087 1552 consensus_queue.cc:260] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.837574 1552 ts_tablet_manager.cc:1428] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260927 15:06:26.839496 3167 ts_tablet_manager.cc:1918] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.839623 3167 log.cc:1196] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/e9f171fd62d644f38262a2257d47fafe
I20260927 15:06:26.839934 3167 ts_tablet_manager.cc:1939] T e9f171fd62d644f38262a2257d47fafe P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.840473 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet e9f171fd62d644f38262a2257d47fafe (table default.Table_5c817097aae54fadb81259c5729c0b56 [id=20f8b048eb614535a4f2602745f2edf0]) successfully deleted
I20260927 15:06:26.840914 910 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_ca8c876717e746a68e817e519f5790d1 [id=8dc10ed6a11843b09a8a9937c145ba25] alter complete (version 3)
I20260927 15:06:26.843927 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 87b54364a63b48e9981463d1019dad59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:21 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.844206 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f2843bf6dbf4117b3f44cd39c328b99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.847949 2119 ts_tablet_manager.cc:1918] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:26.849354 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet a8659865bf644458b3b5a78eae36a524 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.849757 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet e19cd7febe054432899739e21605406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.849792 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 with delete_type TABLET_DATA_DELETED (replaced by tablet 425a19227aba4612a06b6ba78872f6b7) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.853993 2119 log.cc:1196] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/4714d536373a4bf2a4be9ebeaebe77c1
I20260927 15:06:26.854346 1552 tablet_bootstrap.cc:492] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.854925 2119 ts_tablet_manager.cc:1939] T 4714d536373a4bf2a4be9ebeaebe77c1 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.858090 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet f199e9507a894fdabe2ccd2cef699fd8 (table default.Table_3f87c14f83fd403a9ab71722e7e3bff9 [id=05e0628c4a1943d3b157b2687b7d0df7]). Expected version 1 got 0
I20260927 15:06:26.860173 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3b979fe89b604e5bb269f000a48f04f5" } modify_external_catalogs: true
I20260927 15:06:26.860401 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3b979fe89b604e5bb269f000a48f04f5" } modify_external_catalogs: true
I20260927 15:06:26.860507 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1294) took 1402 ms. Trace:
I20260927 15:06:26.860616 2119 rpcz_store.cc:276] 0927 15:06:25.458147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.555094 (+ 96947us) service_pool.cc:227] Handling call
0927 15:06:26.825021 (+1269927us) ts_tablet_manager.cc:1145] Deleting tablet 4714d536373a4bf2a4be9ebeaebe77c1
0927 15:06:26.825029 (+ 8us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.831354 (+ 6325us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x60d000013ec8. stack: 00007fcdad80a66e 00007fcdad80a430 00007fcdac8915ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fcdad59698a 00007fcdad591f16 00007fcdad6876cf 00007fcdad687b9d 00007fcdad68c731 00007fcdad68c670 00007fcdad686ce2 00000000008e30e6 00000000008e2fc1 00000000009f2111
0927 15:06:26.844220 (+ 12866us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.847858 (+ 3638us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.860479 (+ 12621us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8795392,"tablet-delete.queue_time_us":1269761}
I20260927 15:06:26.861094 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 4714d536373a4bf2a4be9ebeaebe77c1 (table default.Table_b94ff6d2011948078b03af17b4d95fae [id=8af79e2564b34d66be63893f6a90bd04]) successfully deleted
I20260927 15:06:26.861936 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1310) took 1285 ms. Trace:
W20260927 15:06:26.862010 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 79161.9us
I20260927 15:06:26.862028 2119 rpcz_store.cc:276] 0927 15:06:25.576051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.576171 (+ 120us) service_pool.cc:227] Handling call
0927 15:06:26.861791 (+1285620us) ts_tablet_manager.cc:1145] Deleting tablet db62070ea78b43e69ddd249a71e9ceea
0927 15:06:26.861802 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.861912 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1285448}
W20260927 15:06:26.862432 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet db62070ea78b43e69ddd249a71e9ceea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db62070ea78b43e69ddd249a71e9ceea already in progress: creating tablet
I20260927 15:06:26.863243 2119 tablet_replica.cc:330] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.863719 2119 raft_consensus.cc:2229] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.864105 2119 raft_consensus.cc:2258] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.864499 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_73cee218630c48adb25b948ee481b5ea" } new_table_name: "default.Table_afbd287f0d6844b3ae9f88ddb1437f09" modify_external_catalogs: true
I20260927 15:06:26.864677 1562 ts_tablet_manager.cc:1918] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:26.864820 1562 log.cc:1196] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/28f6bef5f000441090f73eb842450362
I20260927 15:06:26.864974 2119 ts_tablet_manager.cc:1905] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.865221 1562 ts_tablet_manager.cc:1939] T 28f6bef5f000441090f73eb842450362 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:26.865541 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1069) took 7496 ms. Trace:
I20260927 15:06:26.865512 1552 tablet_bootstrap.cc:654] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.865676 1562 rpcz_store.cc:276] 0927 15:06:19.368959 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.370468 (+ 1509us) service_pool.cc:227] Handling call
0927 15:06:26.437140 (+7066672us) ts_tablet_manager.cc:1145] Deleting tablet 28f6bef5f000441090f73eb842450362
0927 15:06:26.437152 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.515207 (+ 78055us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.864526 (+349319us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.865505 (+ 979us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7064199}
I20260927 15:06:26.865939 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_ec952799f4af4fe18f14b5837e7c1965"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.866515 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec952799f4af4fe18f14b5837e7c1965 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:26.868345 3223 raft_consensus.cc:482] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.868467 3223 raft_consensus.cc:504] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.869122 3223 leader_election.cc:288] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.869383 907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9a00bed1fa194766ad89ee518de9875c" } modify_external_catalogs: true
I20260927 15:06:26.869549 907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9a00bed1fa194766ad89ee518de9875c" } modify_external_catalogs: true
I20260927 15:06:26.870024 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_368c9daf6cb94ec39b284e00b73ab9c9" } new_table_name: "default.Table_46ee1ebc17de406bb8927c6aa5ff575e" modify_external_catalogs: true
I20260927 15:06:26.870990 912 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_7d6318c8cf304d57953dfa5f8cd683fb" } new_table_name: "default.Table_6851c681d14f463fb51405a361c06564" modify_external_catalogs: true
I20260927 15:06:26.872045 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_625bbfb2286a4154a290204b53c7fe24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:26.872473 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_625bbfb2286a4154a290204b53c7fe24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:26.874145 1238 leader_election.cc:341] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ac64eacc7d924940aacc8779b5bfeae7
I20260927 15:06:26.878461 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d221f14ad57462e95017b9068eb8714 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:08 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.878774 906 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet 078ba40ca56745b2a2b86402a1519011 (table default.Table_4e61792c99664faca894de841edc089d [id=f8a991083fb74bfc9d9969214ac7108f]). Expected version 2 got 0
I20260927 15:06:26.880007 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 921db5dbe31a4d0381bdd823cb497424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.882148 905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ee124d45bf99401ea1d62efd5d0bb634" } modify_external_catalogs: true
I20260927 15:06:26.882320 905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_ee124d45bf99401ea1d62efd5d0bb634" } modify_external_catalogs: true
W20260927 15:06:26.883158 899 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet dc130e9f46854e738bdd68d51e8cdc00 (table default.Table_030ece7afe0047bfa4b52f147ffdb43f [id=84bd671ffe0b4cbd96c87541d967ff6d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet dc130e9f46854e738bdd68d51e8cdc00 consensus state has no leader
I20260927 15:06:26.883484 910 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_616b395e89e04a72b5950685fde37543" } modify_external_catalogs: true
I20260927 15:06:26.883983 2119 ts_tablet_manager.cc:1918] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.884305 910 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_616b395e89e04a72b5950685fde37543" } modify_external_catalogs: true
I20260927 15:06:26.884461 2119 log.cc:1196] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/9ae003f1ca76472cbaa8b577b66fe84c
I20260927 15:06:26.884554 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 089b6b5ac39d49fea744240261a8010e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.885075 2119 ts_tablet_manager.cc:1939] T 9ae003f1ca76472cbaa8b577b66fe84c P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.885411 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet efa42545da374ca989199433ce1284c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.885818 3346 tablet.cc:1722] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 15:06:26.885541 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 79a3125723034cb48bc1a05fc4abbb82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.886790 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet ac64eacc7d924940aacc8779b5bfeae7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.888417 1552 tablet_bootstrap.cc:492] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.888682 1552 ts_tablet_manager.cc:1397] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.001s
I20260927 15:06:26.890026 1552 raft_consensus.cc:348] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.890503 1552 raft_consensus.cc:374] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.890672 1552 raft_consensus.cc:729] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.891295 1552 consensus_queue.cc:260] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.893347 1552 ts_tablet_manager.cc:1428] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:26.894232 1552 tablet_bootstrap.cc:492] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.894338 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1314) took 1317 ms. Trace:
I20260927 15:06:26.894565 2119 rpcz_store.cc:276] 0927 15:06:25.576498 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.576538 (+ 40us) service_pool.cc:227] Handling call
0927 15:06:26.863199 (+1286661us) ts_tablet_manager.cc:1145] Deleting tablet 9ae003f1ca76472cbaa8b577b66fe84c
0927 15:06:26.863214 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.868191 (+ 4977us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.883880 (+ 15689us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.894281 (+ 10401us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":104,"spinlock_wait_cycles":768,"tablet-delete.queue_time_us":1286502}
I20260927 15:06:26.895187 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 9ae003f1ca76472cbaa8b577b66fe84c (table default.Table_9cb03ce349ee4cefa2a1b109f59c75ee [id=8e5ae781d15d48f7924076fea8d3d292]) successfully deleted
I20260927 15:06:26.895707 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1309) took 1319 ms. Trace:
I20260927 15:06:26.895890 2119 rpcz_store.cc:276] 0927 15:06:25.575960 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.642741 (+ 66781us) service_pool.cc:227] Handling call
0927 15:06:26.895104 (+1252363us) ts_tablet_manager.cc:1145] Deleting tablet 7142c97a22e74bc8b93c7e9acb949073
0927 15:06:26.895557 (+ 453us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.895691 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1280,"tablet-delete.queue_time_us":1252148}
I20260927 15:06:26.896616 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1317) took 1265 ms. Trace:
W20260927 15:06:26.896672 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7142c97a22e74bc8b93c7e9acb949073 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7142c97a22e74bc8b93c7e9acb949073 already in progress: creating tablet
I20260927 15:06:26.898839 2119 rpcz_store.cc:276] 0927 15:06:25.631654 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.647525 (+ 15871us) service_pool.cc:227] Handling call
0927 15:06:26.896505 (+1248980us) ts_tablet_manager.cc:1145] Deleting tablet dbeebc4fdf444b24ab901e4bb80b49d1
0927 15:06:26.896515 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.896603 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1248722}
I20260927 15:06:26.899375 2119 tablet_replica.cc:330] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.899775 2119 raft_consensus.cc:2229] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.900177 2119 raft_consensus.cc:2258] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.900936 2119 ts_tablet_manager.cc:1905] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.870661 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac64eacc7d924940aacc8779b5bfeae7" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:26.902704 1162 raft_consensus.cc:2454] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
W20260927 15:06:26.902999 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet dbeebc4fdf444b24ab901e4bb80b49d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbeebc4fdf444b24ab901e4bb80b49d1 already in progress: creating tablet
I20260927 15:06:26.903262 1239 leader_election.cc:302] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.903590 3223 raft_consensus.cc:2781] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:26.903656 3223 raft_consensus.cc:482] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:26.903720 3223 raft_consensus.cc:3037] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.906152 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 727652500d9a47b68b7a0d0dcf583822 with delete_type TABLET_DATA_DELETED (replaced by tablet decee14b5d7a4aef9989051dcaeb5a7b) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.906082 3223 raft_consensus.cc:504] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.907260 3375 tablet.cc:1722] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 15:06:26.907904 1552 tablet_bootstrap.cc:654] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.909147 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac64eacc7d924940aacc8779b5bfeae7" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:26.909344 1162 raft_consensus.cc:3037] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.909977 2119 ts_tablet_manager.cc:1918] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:26.910071 2119 log.cc:1196] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/8d533883e3344eca939cd67644895148
I20260927 15:06:26.911093 906 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3c03069c2c6548b4846c99945f2c244f" } modify_external_catalogs: true
I20260927 15:06:26.912078 1162 raft_consensus.cc:2454] T ac64eacc7d924940aacc8779b5bfeae7 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:26.912569 1239 leader_election.cc:302] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:26.912711 3302 raft_consensus.cc:482] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.911643 906 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3c03069c2c6548b4846c99945f2c244f" } modify_external_catalogs: true
I20260927 15:06:26.908617 3223 leader_election.cc:288] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.915045 3223 raft_consensus.cc:2781] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:26.915110 3167 tablet_replica.cc:330] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.915241 3223 raft_consensus.cc:686] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:26.915318 3167 raft_consensus.cc:2229] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.915467 3167 raft_consensus.cc:2258] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.916088 3167 ts_tablet_manager.cc:1905] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:26.916339 1238 leader_election.cc:341] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: ac64eacc7d924940aacc8779b5bfeae7
I20260927 15:06:26.917631 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 28f6bef5f000441090f73eb842450362 (table default.Table_083e1ad3d401408dabc1266d11ab2734 [id=77045a2c0b5143e19139d270564a1a27]) successfully deleted
W20260927 15:06:26.922086 912 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7770c4e004ff47ecbd38f86cf7f6fe74 consensus state has no leader
W20260927 15:06:26.922547 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e29abccdacc4a18910470fe104b6801 consensus state has no leader
I20260927 15:06:26.923380 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 581416f6c2cc434d8ee3ae1428d94f1c
I20260927 15:06:26.924283 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 581416f6c2cc434d8ee3ae1428d94f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:26.925395 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73fbb8371d0f4f5083cd93a673e8df0c consensus state has no leader
I20260927 15:06:26.927106 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 581416f6c2cc434d8ee3ae1428d94f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.927766 910 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet afbfe01feee7463e8c5b795f9fda70cd
I20260927 15:06:26.928586 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet afbfe01feee7463e8c5b795f9fda70cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.928860 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet afbfe01feee7463e8c5b795f9fda70cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.930076 3379 tablet.cc:1722] T 08f28c023473434ba73b1142a041be97 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260927 15:06:26.931581 1562 tablet_replica.cc:330] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:26.931874 1562 raft_consensus.cc:2229] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.932107 1562 raft_consensus.cc:2258] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.932256 1561 tablet_bootstrap.cc:492] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:26.932448 1561 ts_tablet_manager.cc:1397] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.174s user 0.004s sys 0.000s
I20260927 15:06:26.932775 1562 ts_tablet_manager.cc:1905] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.933367 3250 raft_consensus.cc:482] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:26.933257 1561 raft_consensus.cc:348] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.933491 3250 raft_consensus.cc:504] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.933491 1561 raft_consensus.cc:374] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.933902 1561 raft_consensus.cc:729] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.934101 3250 leader_election.cc:288] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:26.934312 1561 consensus_queue.cc:260] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:26.935263 1099 leader_election.cc:341] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: fd1f51cb124d4d20a9d6024e6eb6810f
I20260927 15:06:26.935276 1561 ts_tablet_manager.cc:1428] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:26.935725 1561 tablet_bootstrap.cc:492] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:26.938143 1561 tablet_bootstrap.cc:654] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.912815 3302 raft_consensus.cc:504] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.939493 3302 leader_election.cc:288] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:26.940368 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 581416f6c2cc434d8ee3ae1428d94f1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.940374 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet afbfe01feee7463e8c5b795f9fda70cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.915539 3223 consensus_queue.cc:237] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:26.941983 1353 tablet.cc:2369] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:06:26.942690 1552 tablet_bootstrap.cc:492] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.942878 1552 ts_tablet_manager.cc:1397] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.004s
I20260927 15:06:26.943837 1552 raft_consensus.cc:348] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.944082 1552 raft_consensus.cc:374] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.944154 1552 raft_consensus.cc:729] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:26.942715 1238 leader_election.cc:341] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: a8659865bf644458b3b5a78eae36a524
I20260927 15:06:26.945153 1552 consensus_queue.cc:260] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.946450 1552 ts_tablet_manager.cc:1428] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260927 15:06:26.947563 906 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 3ee9b3d162764abf9d2754ba5c1382fe
I20260927 15:06:26.948220 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ee9b3d162764abf9d2754ba5c1382fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.949204 1552 tablet_bootstrap.cc:492] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.949636 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ee9b3d162764abf9d2754ba5c1382fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:26.950037 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ee9b3d162764abf9d2754ba5c1382fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:26.952802 1556 tablet_bootstrap.cc:492] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:26.952963 1552 tablet_bootstrap.cc:654] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.954035 1556 ts_tablet_manager.cc:1397] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.195s user 0.005s sys 0.009s
I20260927 15:06:26.954924 1556 raft_consensus.cc:348] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.955140 1556 raft_consensus.cc:374] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.955193 1556 raft_consensus.cc:729] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.955367 1556 consensus_queue.cc:260] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.957067 1556 ts_tablet_manager.cc:1428] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260927 15:06:26.962189 1561 tablet_bootstrap.cc:492] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:26.962268 3167 ts_tablet_manager.cc:1918] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:26.962606 1556 tablet_bootstrap.cc:492] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:26.962605 1561 ts_tablet_manager.cc:1397] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20260927 15:06:26.964494 1556 tablet_bootstrap.cc:654] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:26.965409 3167 log.cc:1196] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/219639c0184f4888984fa04a1f84bd83
I20260927 15:06:26.965701 3167 ts_tablet_manager.cc:1939] T 219639c0184f4888984fa04a1f84bd83 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:26.966143 2119 ts_tablet_manager.cc:1939] T 8d533883e3344eca939cd67644895148 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:26.966884 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1320) took 1304 ms. Trace:
I20260927 15:06:26.966914 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 219639c0184f4888984fa04a1f84bd83 (table default.Table_f460864092f142578f5dc17d264586a0 [id=80690e27ef044148b9638249e2d7d5ac]) successfully deleted
W20260927 15:06:26.967741 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 092f1616c5e24505b9ca600c599bd351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 092f1616c5e24505b9ca600c599bd351 already in progress: creating tablet
W20260927 15:06:26.968469 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 53e22a7e5a1d4282ab4e901542dac2de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53e22a7e5a1d4282ab4e901542dac2de already in progress: creating tablet
W20260927 15:06:26.969221 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 684bf999658b4c0c9d66918921d98194 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 684bf999658b4c0c9d66918921d98194 already in progress: creating tablet
W20260927 15:06:26.969905 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet a50808126865423ab0303ef1667b7f2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a50808126865423ab0303ef1667b7f2b already in progress: creating tablet
W20260927 15:06:26.971443 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 7508e8c3438649c69daabac7a2a11efc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7508e8c3438649c69daabac7a2a11efc already in progress: creating tablet
W20260927 15:06:26.972288 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet c99d932c64f748b0af0162d415fc4962 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c99d932c64f748b0af0162d415fc4962 already in progress: creating tablet
I20260927 15:06:26.972831 3167 tablet_replica.cc:330] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:26.973417 3167 raft_consensus.cc:2229] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:26.974879 2119 rpcz_store.cc:276] 0927 15:06:25.662250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.662309 (+ 59us) service_pool.cc:227] Handling call
0927 15:06:26.899337 (+1237028us) ts_tablet_manager.cc:1145] Deleting tablet 8d533883e3344eca939cd67644895148
0927 15:06:26.899347 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.907051 (+ 7704us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.909901 (+ 2850us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:26.966863 (+ 56962us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1236838}
W20260927 15:06:26.967499 1239 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.1:46757, user_credentials={real_user=slave}} blocked reactor thread for 54949.7us
I20260927 15:06:26.975351 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 8d533883e3344eca939cd67644895148 (table default.Table_d072149ddba94cff935fb906dcf0524c [id=ba95aca9e7c449bd8fe939e896ab1ba5]) successfully deleted
I20260927 15:06:26.975698 910 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_d1231a5040be43938a3a26bc25ff741b [id=67762455acad44448ba24d18c2863816] alter complete (version 5)
I20260927 15:06:26.976678 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd1f51cb124d4d20a9d6024e6eb6810f" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:26.977149 1304 raft_consensus.cc:3037] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.977363 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1319) took 1325 ms. Trace:
I20260927 15:06:26.977515 2119 rpcz_store.cc:276] 0927 15:06:25.651825 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.663591 (+ 11766us) service_pool.cc:227] Handling call
0927 15:06:26.976813 (+1313222us) ts_tablet_manager.cc:1145] Deleting tablet 9737e70f2ddb45029c042ffbd83af157
0927 15:06:26.977016 (+ 203us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.977348 (+ 332us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1313054}
W20260927 15:06:26.978001 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9737e70f2ddb45029c042ffbd83af157 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9737e70f2ddb45029c042ffbd83af157 already in progress: creating tablet
I20260927 15:06:26.978710 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1318) took 1327 ms. Trace:
I20260927 15:06:26.978931 2119 rpcz_store.cc:276] 0927 15:06:25.651729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.664055 (+ 12326us) service_pool.cc:227] Handling call
0927 15:06:26.978576 (+1314521us) ts_tablet_manager.cc:1145] Deleting tablet 2a31738c476c459280e837ff109fd84f
0927 15:06:26.978586 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:26.978695 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1310113}
W20260927 15:06:26.979342 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2a31738c476c459280e837ff109fd84f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a31738c476c459280e837ff109fd84f already in progress: creating tablet
I20260927 15:06:26.979648 2119 tablet_replica.cc:330] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:26.979877 2119 raft_consensus.cc:2229] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:26.980067 2119 pending_rounds.cc:62] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:26.980159 2119 pending_rounds.cc:68] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976388808134656 op_type: NO_OP noop_request { }
I20260927 15:06:26.980312 2119 raft_consensus.cc:2866] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:26.980448 2119 raft_consensus.cc:2258] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.980746 1294 raft_consensus.cc:3037] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:26.981444 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet c6a248ec4ee64d0a8d986fdc683d69ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:26.986406 3167 pending_rounds.cc:62] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Trying to abort 1 pending ops.
I20260927 15:06:26.986500 3167 pending_rounds.cc:68] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976419320115200 op_type: NO_OP noop_request { }
I20260927 15:06:26.986660 3167 raft_consensus.cc:2866] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:26.987310 3167 raft_consensus.cc:2258] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:26.987773 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8659865bf644458b3b5a78eae36a524" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:26.988050 1102 consensus_peers.cc:487] T 8f95d664f1134ac9bbb62c1a3d4b5617 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f95d664f1134ac9bbb62c1a3d4b5617. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:26.988381 3167 ts_tablet_manager.cc:1905] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.988476 1239 leader_election.cc:302] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.990512 2119 ts_tablet_manager.cc:1905] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:26.991129 1552 tablet_bootstrap.cc:492] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:26.991365 1552 ts_tablet_manager.cc:1397] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.044s user 0.007s sys 0.000s
I20260927 15:06:26.991478 3378 raft_consensus.cc:2726] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.993312 1552 raft_consensus.cc:348] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.993808 1552 raft_consensus.cc:374] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.993772 3346 tablet.cc:1722] T 078ba40ca56745b2a2b86402a1519011 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260927 15:06:26.994300 1102 leader_election.cc:341] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:26.994051 1552 raft_consensus.cc:729] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.995797 1102 leader_election.cc:302] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:26.995419 1552 consensus_queue.cc:260] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.997593 1552 ts_tablet_manager.cc:1428] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260927 15:06:26.998150 1552 tablet_bootstrap.cc:492] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:26.998178 3250 raft_consensus.cc:2726] T fd1f51cb124d4d20a9d6024e6eb6810f P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:26.999003 1561 raft_consensus.cc:348] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:26.999298 1561 raft_consensus.cc:374] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:26.999430 1561 raft_consensus.cc:729] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:26.999707 1561 consensus_queue.cc:260] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.000506 1561 ts_tablet_manager.cc:1428] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20260927 15:06:27.000586 3347 tablet.cc:1722] T bd5b041a4274477895e88d4822b91cca P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260927 15:06:27.000862 1561 tablet_bootstrap.cc:492] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:27.002310 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4f931542df8d4d26b76c67c6918900e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:27.002560 1552 tablet_bootstrap.cc:654] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.003451 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1fc4416732994e56a9c9ca407d0c71b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.004016 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fc4416732994e56a9c9ca407d0c71b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.005693 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_265e084ba09544bfa1308fd1694eda1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.006178 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_265e084ba09544bfa1308fd1694eda1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.007496 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1038827838794fdc95b4b56ca3d2e73a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.007938 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1038827838794fdc95b4b56ca3d2e73a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.009043 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6e75daf1363d4b7b8717cd44feca6f05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.009450 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e75daf1363d4b7b8717cd44feca6f05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.010262 2119 ts_tablet_manager.cc:1918] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:27.010426 2119 log.cc:1196] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/b9a97e3e6a5749feb4dd5f835d9c01ac
I20260927 15:06:27.014863 912 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet bd5b041a4274477895e88d4822b91cca (table default.Table_215f907352cd4345ae56604d6322ded9 [id=1f51698c91d64bb38f760d13529935b6]). Expected version 1 got 0
W20260927 15:06:27.019830 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f931542df8d4d26b76c67c6918900e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.032397 1556 tablet_bootstrap.cc:492] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.032646 1556 ts_tablet_manager.cc:1397] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.005s
I20260927 15:06:27.033974 1556 raft_consensus.cc:348] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.034426 1556 raft_consensus.cc:374] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.034514 1556 raft_consensus.cc:729] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.035620 1556 consensus_queue.cc:260] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.037585 1556 ts_tablet_manager.cc:1428] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:27.041886 1556 tablet_bootstrap.cc:492] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.043778 2119 ts_tablet_manager.cc:1939] T b9a97e3e6a5749feb4dd5f835d9c01ac P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:27.044953 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1322) took 1282 ms. Trace:
I20260927 15:06:27.046203 2119 rpcz_store.cc:276] 0927 15:06:25.762325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.796691 (+ 34366us) service_pool.cc:227] Handling call
0927 15:06:26.979611 (+1182920us) ts_tablet_manager.cc:1145] Deleting tablet b9a97e3e6a5749feb4dd5f835d9c01ac
0927 15:06:26.979621 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.006433 (+ 26812us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.010162 (+ 3729us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.044926 (+ 34764us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8312,"tablet-delete.queue_time_us":1182393}
I20260927 15:06:27.046669 3378 raft_consensus.cc:482] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.047140 3378 raft_consensus.cc:504] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.047928 3378 leader_election.cc:288] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.048089 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_46666c2ad208426f9661f04984957063"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.048806 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46666c2ad208426f9661f04984957063 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.048903 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1323) took 1228 ms. Trace:
I20260927 15:06:27.049000 2119 rpcz_store.cc:276] 0927 15:06:25.820617 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.823378 (+ 2761us) service_pool.cc:227] Handling call
0927 15:06:27.048717 (+1225339us) ts_tablet_manager.cc:1145] Deleting tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df
0927 15:06:27.048732 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.048884 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1221748}
I20260927 15:06:27.049376 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1324) took 1201 ms. Trace:
I20260927 15:06:27.049454 2119 rpcz_store.cc:276] 0927 15:06:25.848123 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.848173 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:27.049256 (+1201083us) ts_tablet_manager.cc:1145] Deleting tablet cf0cc2ae2792420a91f2c42edcf47fd7
0927 15:06:27.049267 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.049357 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1200825}
W20260927 15:06:27.050091 1238 leader_election.cc:341] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 089b6b5ac39d49fea744240261a8010e
I20260927 15:06:27.052357 909 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e7da400da0844237be49eb47322f6f64" } new_table_name: "default.Table_1658d7021ff74264b9a971f776de3033" modify_external_catalogs: true
I20260927 15:06:27.052616 3250 raft_consensus.cc:482] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.052825 1556 tablet_bootstrap.cc:654] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.052798 3250 raft_consensus.cc:504] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.053695 3250 leader_election.cc:288] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:27.054287 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089b6b5ac39d49fea744240261a8010e" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.054538 1166 raft_consensus.cc:2454] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:27.054580 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet b9a97e3e6a5749feb4dd5f835d9c01ac (table default.Table_81fc47a80ea6475cacc27b37367105f4 [id=14db419325464ded9b465782c513f3d7]) successfully deleted
W20260927 15:06:27.054816 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d3fefebe2eb4cb9a1c7ab9351bf05df already in progress: creating tablet
W20260927 15:06:27.055040 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet cf0cc2ae2792420a91f2c42edcf47fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf0cc2ae2792420a91f2c42edcf47fd7 already in progress: creating tablet
I20260927 15:06:27.055261 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c160b8f77fd948d783d82f95625ff38c" } new_table_name: "default.Table_6946235c88db4a18bce37242afbd0af9" modify_external_catalogs: true
W20260927 15:06:27.055687 1099 leader_election.cc:341] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3fff31ceb379400bbfa4586c749e6d6e
I20260927 15:06:27.055977 1239 leader_election.cc:302] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.056085 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_bfa71ab3f2d9470b91fde8794d25c0af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:27.056277 3378 raft_consensus.cc:2781] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:27.056366 3378 raft_consensus.cc:482] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:27.056465 3378 raft_consensus.cc:3037] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:27.056617 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfa71ab3f2d9470b91fde8794d25c0af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.059691 3378 raft_consensus.cc:504] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.061015 3378 leader_election.cc:288] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.061249 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f0d667472ee4f1481c213e03403461e with delete_type TABLET_DATA_DELETED (replaced by tablet 0a64059ef2234ad6adbdfd8d3576f2a6) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:27.061859 1238 leader_election.cc:341] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 089b6b5ac39d49fea744240261a8010e
I20260927 15:06:27.062656 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_80a8d7672c88408a9085ac01a6616ff6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.063474 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80a8d7672c88408a9085ac01a6616ff6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.064881 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "089b6b5ac39d49fea744240261a8010e" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:27.065174 1166 raft_consensus.cc:3037] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.067242 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1325) took 1184 ms. Trace:
I20260927 15:06:27.067343 2119 rpcz_store.cc:276] 0927 15:06:25.883254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.883776 (+ 522us) service_pool.cc:227] Handling call
0927 15:06:27.067078 (+1183302us) ts_tablet_manager.cc:1145] Deleting tablet 9cd4941f342d41f6a0b4d9c1c42a983d
0927 15:06:27.067090 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.067218 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1149589}
W20260927 15:06:27.067824 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 9cd4941f342d41f6a0b4d9c1c42a983d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cd4941f342d41f6a0b4d9c1c42a983d already in progress: creating tablet
I20260927 15:06:27.068823 1166 raft_consensus.cc:2454] T 089b6b5ac39d49fea744240261a8010e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:27.069276 1239 leader_election.cc:302] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.069700 3378 raft_consensus.cc:2781] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:27.070281 3378 raft_consensus.cc:686] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:27.070613 3378 consensus_queue.cc:237] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.070746 3210 raft_consensus.cc:482] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.070906 3210 raft_consensus.cc:504] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.071728 3210 leader_election.cc:288] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:27.072274 1102 consensus_peers.cc:487] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:27.072436 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 75923.1us
I20260927 15:06:27.072660 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "921db5dbe31a4d0381bdd823cb497424" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.073216 1376 leader_election.cc:341] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.073586 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "921db5dbe31a4d0381bdd823cb497424" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.074369 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fff31ceb379400bbfa4586c749e6d6e" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.074759 1374 leader_election.cc:341] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.074903 1374 leader_election.cc:302] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.073648 3390 raft_consensus.cc:482] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.075268 3289 raft_consensus.cc:2726] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.075368 3390 raft_consensus.cc:504] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.077520 1556 tablet_bootstrap.cc:492] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.080189 2119 tablet_replica.cc:330] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:27.080433 2119 raft_consensus.cc:2229] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.080627 2119 raft_consensus.cc:2258] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.085572 2119 ts_tablet_manager.cc:1905] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:27.088630 1102 leader_election.cc:341] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.088928 1102 leader_election.cc:302] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.089915 3235 raft_consensus.cc:2726] T 3fff31ceb379400bbfa4586c749e6d6e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.084528 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d221f14ad57462e95017b9068eb8714" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.092260 1376 leader_election.cc:341] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.098066 1556 ts_tablet_manager.cc:1397] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.057s user 0.004s sys 0.005s
I20260927 15:06:27.103994 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d221f14ad57462e95017b9068eb8714" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.103874 3390 leader_election.cc:288] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:27.104650 1374 leader_election.cc:341] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.104763 1374 leader_election.cc:302] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.108500 1561 tablet_bootstrap.cc:654] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.106566 1556 raft_consensus.cc:348] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.111075 1556 raft_consensus.cc:374] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.111485 1556 raft_consensus.cc:729] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.112547 1562 ts_tablet_manager.cc:1918] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:27.112751 1562 log.cc:1196] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/81e0be77dff645f795237ffe779ed684
I20260927 15:06:27.113215 1562 ts_tablet_manager.cc:1939] T 81e0be77dff645f795237ffe779ed684 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:27.113651 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1070) took 7744 ms. Trace:
I20260927 15:06:27.115258 1556 consensus_queue.cc:260] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.116775 3374 raft_consensus.cc:2726] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.118268 1556 ts_tablet_manager.cc:1428] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20260927 15:06:27.119331 1556 tablet_bootstrap.cc:492] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.126919 2119 ts_tablet_manager.cc:1918] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:27.127853 2119 log.cc:1196] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/1ba163e0f6164d65b09da684ee4872e0
I20260927 15:06:27.128285 2119 ts_tablet_manager.cc:1939] T 1ba163e0f6164d65b09da684ee4872e0 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:27.127657 1556 tablet_bootstrap.cc:654] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.129453 3378 raft_consensus.cc:482] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.134964 3378 raft_consensus.cc:504] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.135706 3378 leader_election.cc:288] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:27.138293 1238 leader_election.cc:341] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 7f0d667472ee4f1481c213e03403461e
I20260927 15:06:27.140384 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1321) took 1417 ms. Trace:
I20260927 15:06:27.141187 2119 rpcz_store.cc:276] 0927 15:06:25.722865 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.919170 (+196305us) service_pool.cc:227] Handling call
0927 15:06:27.080140 (+1160970us) ts_tablet_manager.cc:1145] Deleting tablet 1ba163e0f6164d65b09da684ee4872e0
0927 15:06:27.080151 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.108760 (+ 28609us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.126755 (+ 17995us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.140358 (+ 13603us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1130572}
I20260927 15:06:27.144060 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 1ba163e0f6164d65b09da684ee4872e0 (table default.Table_df75a53e443d434aaa888fab1ad38e36 [id=935f8397667e4d338a12c98850a26789]) successfully deleted
I20260927 15:06:27.144563 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1328) took 1192 ms. Trace:
I20260927 15:06:27.144742 2119 rpcz_store.cc:276] 0927 15:06:25.952508 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.952558 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:27.144384 (+1191826us) ts_tablet_manager.cc:1145] Deleting tablet 024f439ab5774474ad197bf7fa557ac7
0927 15:06:27.144399 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.144508 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1191614}
W20260927 15:06:27.146071 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 024f439ab5774474ad197bf7fa557ac7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 024f439ab5774474ad197bf7fa557ac7 already in progress: creating tablet
I20260927 15:06:27.146416 2119 tablet_replica.cc:330] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:27.147104 2119 raft_consensus.cc:2229] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.147554 1556 tablet_bootstrap.cc:492] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.148267 2119 raft_consensus.cc:2258] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.148494 1556 ts_tablet_manager.cc:1397] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.000s
I20260927 15:06:27.151467 2119 ts_tablet_manager.cc:1905] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.152408 1556 raft_consensus.cc:348] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.153510 1556 raft_consensus.cc:374] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.153893 1556 raft_consensus.cc:729] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.154692 1556 consensus_queue.cc:260] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.157051 1556 ts_tablet_manager.cc:1428] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
W20260927 15:06:27.116355 1102 consensus_peers.cc:487] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:27.137053 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0d667472ee4f1481c213e03403461e" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.158239 1556 tablet_bootstrap.cc:492] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.159430 1291 raft_consensus.cc:3037] T 59d852b4adbc47c58db352535923ff49 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.165948 1556 tablet_bootstrap.cc:654] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.168728 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_e981892a4ed34c849cdde0cead54dadb" } new_table_name: "default.Table_ddb7f252a5154ccb9b5fe6a700cbd1d1" modify_external_catalogs: true
I20260927 15:06:27.169426 2119 ts_tablet_manager.cc:1918] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:27.169548 2119 log.cc:1196] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/541147938d864cd9ad7208d96533b0f4
I20260927 15:06:27.169917 2119 ts_tablet_manager.cc:1939] T 541147938d864cd9ad7208d96533b0f4 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:27.170236 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1326) took 1242 ms. Trace:
I20260927 15:06:27.170323 2119 rpcz_store.cc:276] 0927 15:06:25.927621 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:25.927952 (+ 331us) service_pool.cc:227] Handling call
0927 15:06:27.146359 (+1218407us) ts_tablet_manager.cc:1145] Deleting tablet 541147938d864cd9ad7208d96533b0f4
0927 15:06:27.146373 (+ 14us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.165585 (+ 19212us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.169316 (+ 3731us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.170218 (+ 902us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189036}
I20260927 15:06:27.170758 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 541147938d864cd9ad7208d96533b0f4 (table default.Table_2c585ef1be384bbf993054ce07ec28d2 [id=ad01215da9fd4367aff8c096e377eb4e]) successfully deleted
I20260927 15:06:27.171236 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3c0029ef42144b28bbae10e7f7c78b34" } modify_external_catalogs: true
I20260927 15:06:27.171411 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3c0029ef42144b28bbae10e7f7c78b34" } modify_external_catalogs: true
W20260927 15:06:27.171938 909 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da8d5ee1ed414a94b9c2f5c7edfcaffa consensus state has no leader
I20260927 15:06:27.172359 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_859de3f4fedb49bfb077334ad79af160"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.172873 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_859de3f4fedb49bfb077334ad79af160 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:27.174078 913 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet abbe0b6179d44ae58da14741c2db3ae9 consensus state has no leader
I20260927 15:06:27.196358 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1327) took 1244 ms. Trace:
I20260927 15:06:27.196611 2119 rpcz_store.cc:276] 0927 15:06:25.952373 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.036657 (+ 84284us) service_pool.cc:227] Handling call
0927 15:06:27.196172 (+1159515us) ts_tablet_manager.cc:1145] Deleting tablet 01a81e786b6b47599d4cee122de2c29a
0927 15:06:27.196189 (+ 17us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.196330 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1097884}
W20260927 15:06:27.197228 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 01a81e786b6b47599d4cee122de2c29a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01a81e786b6b47599d4cee122de2c29a already in progress: creating tablet
W20260927 15:06:27.197536 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 684bf999658b4c0c9d66918921d98194 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 684bf999658b4c0c9d66918921d98194 already in progress: creating tablet
I20260927 15:06:27.197832 2119 tablet_replica.cc:330] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
W20260927 15:06:27.197927 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 7508e8c3438649c69daabac7a2a11efc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7508e8c3438649c69daabac7a2a11efc already in progress: creating tablet
I20260927 15:06:27.198014 2119 raft_consensus.cc:2229] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.198163 2119 raft_consensus.cc:2258] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.198799 2119 ts_tablet_manager.cc:1905] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.201066 1556 tablet_bootstrap.cc:492] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.201648 1556 ts_tablet_manager.cc:1397] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.044s user 0.007s sys 0.006s
I20260927 15:06:27.204197 3167 ts_tablet_manager.cc:1918] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:27.204327 3167 log.cc:1196] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/87b54364a63b48e9981463d1019dad59
I20260927 15:06:27.204790 3167 ts_tablet_manager.cc:1939] T 87b54364a63b48e9981463d1019dad59 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:27.205463 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_f5211813b597484b8e1213862cc672ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.206236 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5211813b597484b8e1213862cc672ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.208585 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6d2594aac47f4cdd9a608744f1fc2575" } modify_external_catalogs: true
I20260927 15:06:27.208773 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6d2594aac47f4cdd9a608744f1fc2575" } modify_external_catalogs: true
I20260927 15:06:27.228994 2119 ts_tablet_manager.cc:1918] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:27.229206 2119 log.cc:1196] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/d463a481cb8c4243961e9b0d2b11822c
I20260927 15:06:27.229640 2119 ts_tablet_manager.cc:1939] T d463a481cb8c4243961e9b0d2b11822c P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:27.230284 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet d463a481cb8c4243961e9b0d2b11822c (table default.Table_04e241fd53a64c76b188ab49cd5ea266 [id=9f11325f98a4445eb6ee1d8c251866fb]) successfully deleted
I20260927 15:06:27.231087 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 8fd389719a9948788c34b99e4953af57
W20260927 15:06:27.231493 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49f6f839939042838a24e234a21eacb6 consensus state has no leader
I20260927 15:06:27.231850 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_f032422e891740819ffdfaeade5c0c1b" } new_table_name: "default.Table_b7d70294517c4062befc9dbf7dfbb693" modify_external_catalogs: true
I20260927 15:06:27.209856 3374 raft_consensus.cc:482] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.211841 1556 raft_consensus.cc:348] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.233103 3374 raft_consensus.cc:504] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.233122 1556 raft_consensus.cc:374] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.233376 1556 raft_consensus.cc:729] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.233574 1556 consensus_queue.cc:260] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.233755 3374 leader_election.cc:288] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.234131 1556 ts_tablet_manager.cc:1428] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260927 15:06:27.234385 1556 tablet_bootstrap.cc:492] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.235177 3378 raft_consensus.cc:482] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.235329 3378 raft_consensus.cc:504] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.235904 1556 tablet_bootstrap.cc:654] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.235904 3378 leader_election.cc:288] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:27.236680 1238 leader_election.cc:341] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 727652500d9a47b68b7a0d0dcf583822
I20260927 15:06:27.237358 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 87b54364a63b48e9981463d1019dad59 (table default.Table_6107c32d572944a0aafc76ab7111a7aa [id=530ccac0880047cfb6d45de2528cf595]) successfully deleted
I20260927 15:06:27.237788 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047fe4ed761642ccbfecdf543900d064" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.239934 1376 leader_election.cc:341] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.241534 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_6851c681d14f463fb51405a361c06564" } new_table_name: "default.Table_077080ec7f9a4765ae686c671cc2001a" modify_external_catalogs: true
W20260927 15:06:27.242358 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 092f1616c5e24505b9ca600c599bd351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 092f1616c5e24505b9ca600c599bd351 already in progress: creating tablet
W20260927 15:06:27.244155 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 53e22a7e5a1d4282ab4e901542dac2de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53e22a7e5a1d4282ab4e901542dac2de already in progress: creating tablet
W20260927 15:06:27.244971 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet a50808126865423ab0303ef1667b7f2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a50808126865423ab0303ef1667b7f2b already in progress: creating tablet
I20260927 15:06:27.248039 908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d1231a5040be43938a3a26bc25ff741b" } modify_external_catalogs: true
I20260927 15:06:27.248243 908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d1231a5040be43938a3a26bc25ff741b" } modify_external_catalogs: true
I20260927 15:06:27.249508 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fd389719a9948788c34b99e4953af57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:27.250916 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fd389719a9948788c34b99e4953af57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:27.254200 1556 tablet_bootstrap.cc:492] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.254475 1556 ts_tablet_manager.cc:1397] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.005s
I20260927 15:06:27.256361 1556 raft_consensus.cc:348] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.256750 1556 raft_consensus.cc:374] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.257485 1556 raft_consensus.cc:729] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.258281 2119 tablet_replica.cc:330] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
W20260927 15:06:27.258469 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet c99d932c64f748b0af0162d415fc4962 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c99d932c64f748b0af0162d415fc4962 already in progress: creating tablet
I20260927 15:06:27.258486 2119 raft_consensus.cc:2229] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.258670 2119 raft_consensus.cc:2258] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.257910 1556 consensus_queue.cc:260] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.259230 2119 ts_tablet_manager.cc:1905] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.259826 1556 ts_tablet_manager.cc:1428] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:27.262266 909 master_service.cc:946] ReplaceTablet: received request to replace tablet 2bbb2131b0f54a7eb74c5d3cba962860 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:27.262952 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a99c7000fc104e00abe119b46015e3a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.263494 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a99c7000fc104e00abe119b46015e3a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.264909 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_988eb09c5a3349eea5cec654a0687360"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.265374 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_988eb09c5a3349eea5cec654a0687360 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.266431 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet fb99a5570603497fbcc029a31f7f947f
I20260927 15:06:27.267279 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet fb99a5570603497fbcc029a31f7f947f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:27.271720 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_52f9528507c7443e8079d07eeff65aae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:27.272586 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet fb99a5570603497fbcc029a31f7f947f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:27.272939 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52f9528507c7443e8079d07eeff65aae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.285351 1556 tablet_bootstrap.cc:492] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.287281 1556 tablet_bootstrap.cc:654] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.291245 3390 raft_consensus.cc:482] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.291420 3390 raft_consensus.cc:504] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.292120 3390 leader_election.cc:288] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.293267 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f86725bd5d5247faa0dff164857629d3" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.293980 1376 leader_election.cc:341] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.307197 1556 tablet_bootstrap.cc:492] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.307487 1556 ts_tablet_manager.cc:1397] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.004s
I20260927 15:06:27.309206 1556 raft_consensus.cc:348] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.309535 1556 raft_consensus.cc:374] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.309665 1556 raft_consensus.cc:729] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.310040 1556 consensus_queue.cc:260] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.311064 1556 ts_tablet_manager.cc:1428] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:27.311597 1556 tablet_bootstrap.cc:492] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.314750 1556 tablet_bootstrap.cc:654] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.328508 1556 tablet_bootstrap.cc:492] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.329380 1556 ts_tablet_manager.cc:1397] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.004s
I20260927 15:06:27.312883 2119 ts_tablet_manager.cc:1918] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:27.329882 2119 log.cc:1196] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/a8659865bf644458b3b5a78eae36a524
I20260927 15:06:27.330343 2119 ts_tablet_manager.cc:1939] T a8659865bf644458b3b5a78eae36a524 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:27.331151 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet a8659865bf644458b3b5a78eae36a524 (table default.Table_cf1a116400854111ad696b9bbc4fc97d [id=d6bb694a914342d8b8ae58cf744932fd]) successfully deleted
W20260927 15:06:27.331696 898 catalog_manager.cc:4808] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8f2843bf6dbf4117b3f44cd39c328b99 because the tablet was not found. No further retry: Not found: Tablet not found: 8f2843bf6dbf4117b3f44cd39c328b99
I20260927 15:06:27.332055 3167 tablet_replica.cc:330] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:27.332192 1552 tablet_bootstrap.cc:492] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:27.332301 3167 raft_consensus.cc:2229] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.332458 3167 raft_consensus.cc:2258] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.332613 1552 ts_tablet_manager.cc:1397] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.335s user 0.027s sys 0.073s
I20260927 15:06:27.332870 3390 raft_consensus.cc:482] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.332943 3167 ts_tablet_manager.cc:1905] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.332984 2119 tablet_replica.cc:330] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:27.333009 3390 raft_consensus.cc:504] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.333160 2119 raft_consensus.cc:2229] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.333335 2119 raft_consensus.cc:2258] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.333608 3390 leader_election.cc:288] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.334324 1552 raft_consensus.cc:348] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.334671 2119 ts_tablet_manager.cc:1905] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.334709 1552 raft_consensus.cc:374] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.334789 1552 raft_consensus.cc:729] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.335173 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a4360599644da0921de9ff0e4111c6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.334741 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a4360599644da0921de9ff0e4111c6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.335126 1552 consensus_queue.cc:260] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:27.336302 1376 leader_election.cc:341] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.336663 1552 ts_tablet_manager.cc:1428] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:27.337678 1552 tablet_bootstrap.cc:492] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:27.337498 1556 raft_consensus.cc:348] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:27.338420 1556 raft_consensus.cc:374] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.338752 1556 raft_consensus.cc:729] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.339524 1556 consensus_queue.cc:260] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:27.340384 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:27.342561 1556 ts_tablet_manager.cc:1428] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260927 15:06:27.343583 1556 tablet_bootstrap.cc:492] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.344671 1552 tablet_bootstrap.cc:654] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.348966 1556 tablet_bootstrap.cc:654] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.356750 2119 ts_tablet_manager.cc:1918] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:27.361111 1556 tablet_bootstrap.cc:492] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.361338 1556 ts_tablet_manager.cc:1397] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.004s
W20260927 15:06:27.361833 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd1cbe255dea4bd184a504df6da284d8 consensus state has no leader
I20260927 15:06:27.362948 1556 raft_consensus.cc:348] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.364506 1556 raft_consensus.cc:374] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.364589 1556 raft_consensus.cc:729] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.364910 1556 consensus_queue.cc:260] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.365902 1556 ts_tablet_manager.cc:1428] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260927 15:06:27.367060 1556 tablet_bootstrap.cc:492] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.364108 1552 tablet_bootstrap.cc:492] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:27.368476 1552 ts_tablet_manager.cc:1397] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.002s
I20260927 15:06:27.369815 1552 raft_consensus.cc:348] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.370208 1552 raft_consensus.cc:374] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.370354 1552 raft_consensus.cc:729] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.368281 2119 log.cc:1196] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/e19cd7febe054432899739e21605406d
I20260927 15:06:27.370754 1552 consensus_queue.cc:260] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.371433 2119 ts_tablet_manager.cc:1939] T e19cd7febe054432899739e21605406d P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:27.371912 1552 ts_tablet_manager.cc:1428] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:27.374226 1556 tablet_bootstrap.cc:654] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.375198 3378 raft_consensus.cc:482] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.375319 3378 raft_consensus.cc:504] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:27.375856 3378 leader_election.cc:288] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:27.377547 1238 leader_election.cc:341] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 79a3125723034cb48bc1a05fc4abbb82
I20260927 15:06:27.381011 1552 tablet_bootstrap.cc:492] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:27.381111 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet e19cd7febe054432899739e21605406d (table default.Table_1a919c358b5340f7a616321c89f236a4 [id=9a56fa8ed14a4bff867d4648b4491c31]) successfully deleted
I20260927 15:06:27.382597 1552 tablet_bootstrap.cc:654] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.384308 1552 tablet_bootstrap.cc:492] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:27.384541 1552 ts_tablet_manager.cc:1397] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260927 15:06:27.385816 1552 raft_consensus.cc:348] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.386209 1552 raft_consensus.cc:374] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.386355 1552 raft_consensus.cc:729] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:27.387249 901 catalog_manager.cc:4808] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8f95d664f1134ac9bbb62c1a3d4b5617 because the tablet was not found. No further retry: Not found: Tablet not found: 8f95d664f1134ac9bbb62c1a3d4b5617
I20260927 15:06:27.386725 1552 consensus_queue.cc:260] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.388370 1552 ts_tablet_manager.cc:1428] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:27.392445 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_547904b5ac5542bea36791210505ede7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.392962 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_547904b5ac5542bea36791210505ede7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.391896 1556 tablet_bootstrap.cc:492] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.393213 1556 ts_tablet_manager.cc:1397] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.002s
I20260927 15:06:27.394536 1556 raft_consensus.cc:348] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.394877 1556 raft_consensus.cc:374] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.394994 1556 raft_consensus.cc:729] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.395359 1556 consensus_queue.cc:260] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.396284 1556 ts_tablet_manager.cc:1428] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:27.396468 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f8744e2349e49d3a821eca42c7f89a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:17 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:27.396746 1556 tablet_bootstrap.cc:492] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.399467 1556 tablet_bootstrap.cc:654] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:27.407541 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7770c4e004ff47ecbd38f86cf7f6fe74 consensus state has no leader
I20260927 15:06:27.237140 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727652500d9a47b68b7a0d0dcf583822" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.411243 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79a3125723034cb48bc1a05fc4abbb82" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.414601 1166 raft_consensus.cc:2454] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:27.416847 1561 tablet_bootstrap.cc:492] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:27.417002 1562 rpcz_store.cc:276] 0927 15:06:19.369064 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.369129 (+ 65us) service_pool.cc:227] Handling call
0927 15:06:26.931413 (+7562284us) ts_tablet_manager.cc:1145] Deleting tablet 81e0be77dff645f795237ffe779ed684
0927 15:06:26.931424 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.081876 (+150452us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.112415 (+ 30539us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.113604 (+ 1189us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7558173}
W20260927 15:06:27.417493 1219 tablet.cc:2369] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260927 15:06:27.418998 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 81e0be77dff645f795237ffe779ed684 (table default.Table_806abc9f7da043179a751515c37b1170 [id=2602f6dfc6ac49a8ac3f4af47b38f21b]) successfully deleted
I20260927 15:06:27.419431 1140 tablet_service.cc:1514] Processing DeleteTablet for tablet fb99a5570603497fbcc029a31f7f947f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:27.419586 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f86725bd5d5247faa0dff164857629d3" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.419829 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fd389719a9948788c34b99e4953af57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:27.419932 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047fe4ed761642ccbfecdf543900d064" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.420133 3150 raft_consensus.cc:482] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:27.420243 1102 consensus_peers.cc:487] T 4714d536373a4bf2a4be9ebeaebe77c1 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4714d536373a4bf2a4be9ebeaebe77c1. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:27.420321 1099 consensus_peers.cc:487] T 5aa58fa9a1384013ac1674bc7d53c3b1 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5aa58fa9a1384013ac1674bc7d53c3b1. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:27.420389 3325 raft_consensus.cc:482] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:27.421012 1160 raft_consensus.cc:2454] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:27.421696 1239 leader_election.cc:302] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.422132 1239 leader_election.cc:302] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:27.422474 1374 leader_election.cc:341] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.422582 1374 leader_election.cc:302] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.423298 3378 raft_consensus.cc:2781] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:27.423373 3378 raft_consensus.cc:482] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:27.423424 3378 raft_consensus.cc:3037] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.426046 3378 raft_consensus.cc:504] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.426725 3223 raft_consensus.cc:2781] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:27.426793 3223 raft_consensus.cc:482] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:27.426914 3223 raft_consensus.cc:3037] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.429201 3223 raft_consensus.cc:504] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.429652 3223 leader_election.cc:288] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.429821 3390 raft_consensus.cc:2726] T f86725bd5d5247faa0dff164857629d3 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.432885 3378 leader_election.cc:288] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.433802 1161 raft_consensus.cc:2454] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
W20260927 15:06:27.434725 1374 leader_election.cc:341] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.434846 1374 leader_election.cc:302] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.435022 1561 ts_tablet_manager.cc:1397] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.416s user 0.004s sys 0.000s
I20260927 15:06:27.435168 3390 raft_consensus.cc:2726] T 047fe4ed761642ccbfecdf543900d064 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.435396 1562 tablet_replica.cc:330] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
W20260927 15:06:27.436046 1102 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 58359.3us
I20260927 15:06:27.436527 3325 raft_consensus.cc:504] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.436887 1239 leader_election.cc:302] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.437145 3150 raft_consensus.cc:504] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.438025 3302 raft_consensus.cc:482] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.438143 3302 raft_consensus.cc:504] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.438617 3302 leader_election.cc:288] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.438762 3302 raft_consensus.cc:2781] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:27.438824 3302 raft_consensus.cc:482] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:27.438899 3302 raft_consensus.cc:3037] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.439889 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a4360599644da0921de9ff0e4111c6" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.441340 3302 raft_consensus.cc:504] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:27.441766 3302 leader_election.cc:288] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:27.444280 1556 tablet_bootstrap.cc:492] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.444476 1556 ts_tablet_manager.cc:1397] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.048s user 0.015s sys 0.019s
I20260927 15:06:27.445154 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5ba85b040404405b8988d1bc47ba9a59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.445650 1099 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 125909us
W20260927 15:06:27.445709 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ba85b040404405b8988d1bc47ba9a59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.445802 1556 raft_consensus.cc:348] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.446193 1556 raft_consensus.cc:374] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.446312 1556 raft_consensus.cc:729] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.446645 1556 consensus_queue.cc:260] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.447402 3236 raft_consensus.cc:482] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.447543 1556 ts_tablet_manager.cc:1428] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260927 15:06:27.450297 1165 raft_consensus.cc:2454] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 0.
I20260927 15:06:27.454236 908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 08f28c023473434ba73b1142a041be97
I20260927 15:06:27.433552 3223 raft_consensus.cc:482] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.454514 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d021fa8153384daa8ac61aeaa1587850"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:27.454604 3223 raft_consensus.cc:504] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.454872 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_79a73a988c8143c9b9b339591b234581" } new_table_name: "default.Table_7a06a9a51e064811b56f4fe365131c6d" modify_external_catalogs: true
W20260927 15:06:27.455029 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d021fa8153384daa8ac61aeaa1587850 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.455112 3223 leader_election.cc:288] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:27.434513 1238 leader_election.cc:341] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 7f0d667472ee4f1481c213e03403461e
W20260927 15:06:27.455833 1238 leader_election.cc:341] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 727652500d9a47b68b7a0d0dcf583822
I20260927 15:06:27.455967 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 955461f27b6444d4b4c3f9a9f629d5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:27.456001 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 769e9b5c08cd44cc8a0d681500d64f54 with delete_type TABLET_DATA_DELETED (replaced by tablet 01b31e13faed44088c5ad5e3e9fa6b3f) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:27.456682 1440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a4360599644da0921de9ff0e4111c6" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:27.456908 1440 raft_consensus.cc:2454] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:27.460645 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f28c023473434ba73b1142a041be97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:49234
W20260927 15:06:27.460774 1239 leader_election.cc:341] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 769e9b5c08cd44cc8a0d681500d64f54
I20260927 15:06:27.461357 1556 tablet_bootstrap.cc:492] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
W20260927 15:06:27.461863 1238 leader_election.cc:341] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 769e9b5c08cd44cc8a0d681500d64f54
I20260927 15:06:27.462001 1238 leader_election.cc:302] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:27.462405 1238 leader_election.cc:341] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 79a3125723034cb48bc1a05fc4abbb82
W20260927 15:06:27.462623 1238 leader_election.cc:341] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: efa42545da374ca989199433ce1284c3
I20260927 15:06:27.463056 1556 tablet_bootstrap.cc:654] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.463464 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f28c023473434ba73b1142a041be97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:27.465628 913 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_9d78b6648ac548e586c621d86d1938ba" } new_table_name: "default.Table_fc106e6d0e9640a49d258e21fb7d2331" modify_external_catalogs: true
I20260927 15:06:27.465945 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a3e46166877f48ad8e19f919ab365546"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:27.466027 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d374678e5ff1432aa1554842e39e119e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.466362 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3e46166877f48ad8e19f919ab365546 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:27.466475 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d374678e5ff1432aa1554842e39e119e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.470336 3223 raft_consensus.cc:2726] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.471426 3325 leader_election.cc:288] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:27.471988 1102 leader_election.cc:341] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Not found: Tablet not found: 1ba163e0f6164d65b09da684ee4872e0
I20260927 15:06:27.472280 3150 leader_election.cc:288] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:27.474059 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "727652500d9a47b68b7a0d0dcf583822" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:27.474287 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f0d667472ee4f1481c213e03403461e" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:27.474198 3236 raft_consensus.cc:504] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.475841 1374 leader_election.cc:302] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:27.476184 3374 consensus_queue.cc:1035] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:27.476562 3374 raft_consensus.cc:2781] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:27.476647 3374 raft_consensus.cc:482] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:27.476711 3374 raft_consensus.cc:3037] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.480059 3374 raft_consensus.cc:504] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.481200 3374 leader_election.cc:288] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.483155 1552 tablet_bootstrap.cc:492] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:27.483142 3235 raft_consensus.cc:482] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.483330 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 08f28c023473434ba73b1142a041be97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:27.483485 1562 raft_consensus.cc:2229] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.484578 1552 tablet_bootstrap.cc:654] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.485558 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a4360599644da0921de9ff0e4111c6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:27.486326 1376 leader_election.cc:341] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.486871 1165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa42545da374ca989199433ce1284c3" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.487140 1165 raft_consensus.cc:2379] T efa42545da374ca989199433ce1284c3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4769a710b72a4b49b816725a5921e86e in current term 1: Already voted for candidate c4264874db964ff2830b7894c2b3d61c in this term.
I20260927 15:06:27.487293 1160 raft_consensus.cc:3037] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.487614 1561 raft_consensus.cc:348] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.487910 1561 raft_consensus.cc:374] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.488001 1561 raft_consensus.cc:729] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.488238 1561 consensus_queue.cc:260] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.489043 1561 ts_tablet_manager.cc:1428] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.054s user 0.000s sys 0.002s
I20260927 15:06:27.489348 1561 tablet_bootstrap.cc:492] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
W20260927 15:06:27.490414 1102 leader_election.cc:341] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.490757 1164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79a3125723034cb48bc1a05fc4abbb82" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:27.491719 1239 leader_election.cc:302] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.491900 1556 tablet_bootstrap.cc:492] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.492007 1556 ts_tablet_manager.cc:1397] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.001s
I20260927 15:06:27.492681 1556 raft_consensus.cc:348] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.492919 1556 raft_consensus.cc:374] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.492919 3378 raft_consensus.cc:3037] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.492985 1556 raft_consensus.cc:729] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.493281 1556 consensus_queue.cc:260] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.494907 1556 ts_tablet_manager.cc:1428] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260927 15:06:27.495702 1556 tablet_bootstrap.cc:492] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.496786 2119 tablet_replica.cc:330] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:27.496971 2119 raft_consensus.cc:2229] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:27.497170 2119 pending_rounds.cc:62] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:27.497207 2119 pending_rounds.cc:68] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976420644425728 op_type: NO_OP noop_request { }
I20260927 15:06:27.497306 2119 raft_consensus.cc:2866] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:27.497375 2119 raft_consensus.cc:2258] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.498289 2119 ts_tablet_manager.cc:1905] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.498481 1160 raft_consensus.cc:2454] T 7f0d667472ee4f1481c213e03403461e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:27.502907 3235 raft_consensus.cc:504] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.503621 3235 leader_election.cc:288] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:27.503759 1166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52a4360599644da0921de9ff0e4111c6" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:27.503945 1166 raft_consensus.cc:3037] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.504065 1556 tablet_bootstrap.cc:654] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.507539 1161 raft_consensus.cc:3037] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.507829 3378 raft_consensus.cc:2726] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.507967 3236 leader_election.cc:288] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:27.508809 1239 leader_election.cc:302] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.509256 3223 raft_consensus.cc:2781] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:27.509397 3223 raft_consensus.cc:686] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:27.509644 3223 consensus_queue.cc:237] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:27.512876 1102 consensus_peers.cc:487] T a8659865bf644458b3b5a78eae36a524 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8659865bf644458b3b5a78eae36a524. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:27.514360 1164 raft_consensus.cc:3037] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.514851 3374 raft_consensus.cc:482] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.514973 3374 raft_consensus.cc:504] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.515813 1561 tablet_bootstrap.cc:654] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.515888 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54f5c4b7c7a045bea1a79bc67a913f65" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.516005 1552 tablet_bootstrap.cc:492] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:27.516269 1552 ts_tablet_manager.cc:1397] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.000s
W20260927 15:06:27.516449 1376 leader_election.cc:341] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.516741 3374 leader_election.cc:288] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.517488 1552 raft_consensus.cc:348] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.517904 1552 raft_consensus.cc:374] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.518069 1552 raft_consensus.cc:729] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.518537 1552 consensus_queue.cc:260] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.519150 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3540982dd7544e60af6c153fc41a412c" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.519726 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289bea546c8a41bf97edfdc9a453a024" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.521333 1552 ts_tablet_manager.cc:1428] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260927 15:06:27.522401 1562 raft_consensus.cc:2258] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:27.523406 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4430aa799314fc2a2b4acc3fdd1df7a consensus state has no leader
I20260927 15:06:27.523415 1552 tablet_bootstrap.cc:492] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:27.524724 1556 tablet_bootstrap.cc:492] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.525192 1164 raft_consensus.cc:2454] T 79a3125723034cb48bc1a05fc4abbb82 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:27.525358 1556 ts_tablet_manager.cc:1397] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.001s
I20260927 15:06:27.527441 1239 leader_election.cc:302] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.527941 3378 raft_consensus.cc:2781] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:27.528120 3378 raft_consensus.cc:686] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:27.528477 3378 consensus_queue.cc:237] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:27.532732 1552 tablet_bootstrap.cc:654] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.535781 1562 ts_tablet_manager.cc:1905] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.532579 1556 raft_consensus.cc:348] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.536077 1556 raft_consensus.cc:374] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.536893 1556 raft_consensus.cc:729] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.540056 1485 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:27.538949 1556 consensus_queue.cc:260] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:27.542867 1102 leader_election.cc:341] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:27.543188 1102 leader_election.cc:341] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.543291 1166 raft_consensus.cc:2454] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fabb59e74b7d48fa9be047d7f4c4cc38 in term 1.
W20260927 15:06:27.543522 1102 consensus_peers.cc:487] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 541147938d864cd9ad7208d96533b0f4. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:27.544315 1374 leader_election.cc:302] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:27.544822 1556 ts_tablet_manager.cc:1428] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.019s user 0.002s sys 0.002s
I20260927 15:06:27.546169 3374 raft_consensus.cc:2781] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:27.546490 3374 raft_consensus.cc:686] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Becoming Leader. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Running, Role: LEADER
I20260927 15:06:27.547040 3374 consensus_queue.cc:237] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.549254 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54f5c4b7c7a045bea1a79bc67a913f65" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:27.550979 1374 leader_election.cc:341] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.551105 1374 leader_election.cc:302] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.551318 3289 raft_consensus.cc:2726] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.555400 1161 raft_consensus.cc:2454] T 727652500d9a47b68b7a0d0dcf583822 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:27.556205 1239 leader_election.cc:302] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.556681 3223 raft_consensus.cc:2781] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:27.556816 3223 raft_consensus.cc:686] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:27.557036 3223 consensus_queue.cc:237] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.569634 1562 ts_tablet_manager.cc:1918] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:27.569890 1562 log.cc:1196] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/63fbd388210d4a1aabfcf27c7533efbf
I20260927 15:06:27.570251 1562 ts_tablet_manager.cc:1939] T 63fbd388210d4a1aabfcf27c7533efbf P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:27.571362 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1080) took 8154 ms. Trace:
I20260927 15:06:27.571575 1562 rpcz_store.cc:276] 0927 15:06:19.416432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.416498 (+ 66us) service_pool.cc:227] Handling call
0927 15:06:27.417299 (+8000801us) ts_tablet_manager.cc:1145] Deleting tablet 63fbd388210d4a1aabfcf27c7533efbf
0927 15:06:27.417314 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.545551 (+128237us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.569470 (+ 23919us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.571313 (+ 1843us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":25321,"tablet-delete.queue_time_us":8000612}
I20260927 15:06:27.572227 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 63fbd388210d4a1aabfcf27c7533efbf (table default.Table_5d29cefe8c174dd89895f67e0784bf77 [id=35b9ecf64d084b66b80115a19fd1055a]) successfully deleted
I20260927 15:06:27.572683 1562 tablet_replica.cc:330] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:27.572974 1562 raft_consensus.cc:2229] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:27.573362 1562 raft_consensus.cc:2258] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.578049 1562 ts_tablet_manager.cc:1905] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.594805 1556 tablet_bootstrap.cc:492] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.597146 1556 tablet_bootstrap.cc:654] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:27.613904 1102 consensus_peers.cc:487] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2268d824f5324cd1b81879e2fe4fd027. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:27.619599 3405 raft_consensus.cc:482] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.619877 3405 raft_consensus.cc:504] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.620965 3405 leader_election.cc:288] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:27.621707 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bdb6d04e5a94d7fbe3b27ccc0042f85" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.622262 1102 leader_election.cc:341] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.624509 1556 tablet_bootstrap.cc:492] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.624759 1556 ts_tablet_manager.cc:1397] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.005s
I20260927 15:06:27.625190 1099 leader_election.cc:302] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
W20260927 15:06:27.625757 1099 leader_election.cc:341] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 1ba163e0f6164d65b09da684ee4872e0
I20260927 15:06:27.625959 3405 raft_consensus.cc:2741] T 52a4360599644da0921de9ff0e4111c6 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260927 15:06:27.626098 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8099ae6bb34144a4b6ee60602eb8c0c2" } modify_external_catalogs: true
I20260927 15:06:27.626300 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8099ae6bb34144a4b6ee60602eb8c0c2" } modify_external_catalogs: true
I20260927 15:06:27.626873 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9f47b1bb7dc94cc2910bb1dc8a81d85a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:27.626309 1556 raft_consensus.cc:348] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.627337 1556 raft_consensus.cc:374] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260927 15:06:27.627663 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f47b1bb7dc94cc2910bb1dc8a81d85a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.627610 1556 raft_consensus.cc:729] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.628409 1556 consensus_queue.cc:260] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.629611 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_16f70ab1fb7b4329a608676f83d8d1aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.630071 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16f70ab1fb7b4329a608676f83d8d1aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.631148 1556 ts_tablet_manager.cc:1428] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260927 15:06:27.631420 913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b74ce51718e7413bb6e6657e638c8d49" } modify_external_catalogs: true
I20260927 15:06:27.631587 913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b74ce51718e7413bb6e6657e638c8d49" } modify_external_catalogs: true
I20260927 15:06:27.632216 1556 tablet_bootstrap.cc:492] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.632498 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_d910172cef91481584bcb74ff261aa94" } new_table_name: "default.Table_95b587dd46384904945b80c13e07869a" modify_external_catalogs: true
W20260927 15:06:27.634814 1376 consensus_peers.cc:487] T b911b7f278ce4e5f8946fe8381fd9ba7 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:27.636989 1556 tablet_bootstrap.cc:654] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.641537 1099 leader_election.cc:302] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.642158 3405 raft_consensus.cc:2726] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:27.649704 1561 tablet_bootstrap.cc:492] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:27.649941 1561 ts_tablet_manager.cc:1397] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.161s user 0.001s sys 0.010s
I20260927 15:06:27.650931 1561 raft_consensus.cc:348] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.651254 1561 raft_consensus.cc:374] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.651386 1561 raft_consensus.cc:729] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.651752 1561 consensus_queue.cc:260] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.652845 1561 ts_tablet_manager.cc:1428] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:27.656051 1552 tablet_bootstrap.cc:492] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:27.656334 1552 ts_tablet_manager.cc:1397] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.134s user 0.002s sys 0.025s
I20260927 15:06:27.657478 1552 raft_consensus.cc:348] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.657902 1552 raft_consensus.cc:374] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.658041 1552 raft_consensus.cc:729] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.658411 1552 consensus_queue.cc:260] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.659574 1552 ts_tablet_manager.cc:1428] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260927 15:06:27.660430 1552 tablet_bootstrap.cc:492] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:27.654191 1099 leader_election.cc:341] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 3540982dd7544e60af6c153fc41a412c
I20260927 15:06:27.663005 1099 leader_election.cc:302] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:27.663468 1099 leader_election.cc:341] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 289bea546c8a41bf97edfdc9a453a024
I20260927 15:06:27.663654 1099 leader_election.cc:302] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.663926 3406 raft_consensus.cc:2726] T 3540982dd7544e60af6c153fc41a412c P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.664086 3406 raft_consensus.cc:2726] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.667129 1552 tablet_bootstrap.cc:654] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.668955 1561 tablet_bootstrap.cc:492] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:27.671128 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c93be0971e984cc0a524ef3e04a5b01c" } new_table_name: "default.Table_a1fd299321ad4800b2aa4be3307028e8" modify_external_catalogs: true
I20260927 15:06:27.682060 1552 tablet_bootstrap.cc:492] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
W20260927 15:06:27.682986 1102 consensus_peers.cc:487] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d533883e3344eca939cd67644895148. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:27.683076 1552 ts_tablet_manager.cc:1397] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.006s
I20260927 15:06:27.658495 1562 ts_tablet_manager.cc:1918] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:27.683871 1562 log.cc:1196] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/e19cd7febe054432899739e21605406d
I20260927 15:06:27.687492 1562 ts_tablet_manager.cc:1939] T e19cd7febe054432899739e21605406d P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:27.687920 3223 raft_consensus.cc:482] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.688107 3223 raft_consensus.cc:504] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.687677 1552 raft_consensus.cc:348] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.689004 1552 raft_consensus.cc:374] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.689554 3223 leader_election.cc:288] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.689565 1552 raft_consensus.cc:729] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:27.690555 1238 leader_election.cc:341] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 7f8744e2349e49d3a821eca42c7f89a2
W20260927 15:06:27.686980 1099 leader_election.cc:341] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 5bdb6d04e5a94d7fbe3b27ccc0042f85
I20260927 15:06:27.690892 1099 leader_election.cc:302] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.691214 3406 raft_consensus.cc:2726] T 5bdb6d04e5a94d7fbe3b27ccc0042f85 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.690933 1552 consensus_queue.cc:260] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:27.692502 1239 leader_election.cc:341] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Not found: Tablet not found: 7f8744e2349e49d3a821eca42c7f89a2
I20260927 15:06:27.692629 1239 leader_election.cc:302] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.693295 3378 raft_consensus.cc:2726] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.693611 3289 raft_consensus.cc:482] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:27.693817 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b3b4aa4811a4e0f8e245812da8f731a consensus state has no leader
I20260927 15:06:27.693972 3289 raft_consensus.cc:504] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.695091 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3bdfede5744513aeadb22da73b6f8a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.694962 1552 ts_tablet_manager.cc:1428] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
W20260927 15:06:27.695658 1376 leader_election.cc:341] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.695997 3289 leader_election.cc:288] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.696485 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3bdfede5744513aeadb22da73b6f8a" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.696713 1552 tablet_bootstrap.cc:492] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
W20260927 15:06:27.697381 1374 leader_election.cc:341] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.697486 1374 leader_election.cc:302] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.696302 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1081) took 8279 ms. Trace:
I20260927 15:06:27.698361 1562 rpcz_store.cc:276] 0927 15:06:19.416528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.416718 (+ 190us) service_pool.cc:227] Handling call
0927 15:06:27.572603 (+8155885us) ts_tablet_manager.cc:1145] Deleting tablet e19cd7febe054432899739e21605406d
0927 15:06:27.572618 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.637831 (+ 65213us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.658375 (+ 20544us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.696245 (+ 37870us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8155725}
I20260927 15:06:27.698541 3374 raft_consensus.cc:2726] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.699381 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet e19cd7febe054432899739e21605406d (table default.Table_1a919c358b5340f7a616321c89f236a4 [id=9a56fa8ed14a4bff867d4648b4491c31]) successfully deleted
I20260927 15:06:27.699975 1562 tablet_replica.cc:330] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:27.700210 1562 raft_consensus.cc:2229] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:27.701849 3223 raft_consensus.cc:482] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.702039 3223 raft_consensus.cc:504] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.704311 3223 leader_election.cc:288] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:27.705258 1238 leader_election.cc:341] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 289bea546c8a41bf97edfdc9a453a024
I20260927 15:06:27.706668 1561 tablet_bootstrap.cc:654] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:27.709122 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9850f919fb14421eb6bc76ab4ac88c0d consensus state has no leader
I20260927 15:06:27.709157 1552 tablet_bootstrap.cc:654] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.710956 3223 raft_consensus.cc:482] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.711290 3223 raft_consensus.cc:504] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:27.713636 1238 leader_election.cc:341] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c6a248ec4ee64d0a8d986fdc683d69ba
I20260927 15:06:27.714236 3223 leader_election.cc:288] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.723392 912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0e9c3d26fe564af7b61f6cdf7317d97a" } modify_external_catalogs: true
I20260927 15:06:27.723624 912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_0e9c3d26fe564af7b61f6cdf7317d97a" } modify_external_catalogs: true
I20260927 15:06:27.725528 914 catalog_manager.cc:5587] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515) does not have the latest schema for tablet fb5f4a30bac94d72b5265c8a7a0d4d59 (table default.Table_11d82a666e204a059c3afbf4a7d46c2d [id=239ff5a7776c4a469e14137b23b6544a]). Expected version 2 got 0
I20260927 15:06:27.728811 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_22a033f3a29943128d8a45d37b2958ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.729431 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22a033f3a29943128d8a45d37b2958ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.733131 1278 tablet_service.cc:1514] Processing DeleteTablet for tablet b44e2611d2bf40ae90c4fd857225e39e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:27.733590 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6e4f6e6549ab47109c8e42add99a2c75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.734627 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e4f6e6549ab47109c8e42add99a2c75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.709860 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289bea546c8a41bf97edfdc9a453a024" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.712682 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6a248ec4ee64d0a8d986fdc683d69ba" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.735939 1161 raft_consensus.cc:2454] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:27.736191 1162 raft_consensus.cc:2454] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:27.736486 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_8e46dc9150ec457b971ac1048d393976" } new_table_name: "default.Table_5892c30586414df7b6e081f43b2147d6" modify_external_catalogs: true
I20260927 15:06:27.731225 1562 raft_consensus.cc:2258] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.738148 1562 ts_tablet_manager.cc:1905] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.738901 1239 leader_election.cc:302] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.739329 1239 leader_election.cc:302] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.739818 3378 raft_consensus.cc:2781] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:27.739900 3378 raft_consensus.cc:482] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:27.739961 3378 raft_consensus.cc:3037] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.742468 3378 raft_consensus.cc:504] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.747540 3378 leader_election.cc:288] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.747831 3378 raft_consensus.cc:2781] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:27.747975 3378 raft_consensus.cc:482] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:27.748106 3378 raft_consensus.cc:3037] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:27.751657 1238 leader_election.cc:341] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: c6a248ec4ee64d0a8d986fdc683d69ba
I20260927 15:06:27.752038 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6a248ec4ee64d0a8d986fdc683d69ba" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:27.752313 1162 raft_consensus.cc:3037] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.755398 1162 raft_consensus.cc:2454] T c6a248ec4ee64d0a8d986fdc683d69ba P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:27.755857 1239 leader_election.cc:302] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.756335 3223 raft_consensus.cc:2781] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:27.756626 3223 raft_consensus.cc:686] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:27.756904 3223 consensus_queue.cc:237] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.758782 3378 raft_consensus.cc:504] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:27.760138 1238 leader_election.cc:341] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 289bea546c8a41bf97edfdc9a453a024
I20260927 15:06:27.761134 3250 raft_consensus.cc:482] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.761314 3250 raft_consensus.cc:504] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.762303 3250 leader_election.cc:288] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:27.762851 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "219639c0184f4888984fa04a1f84bd83" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.763209 3167 ts_tablet_manager.cc:1918] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:27.763343 3167 log.cc:1196] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/1d221f14ad57462e95017b9068eb8714
I20260927 15:06:27.763636 3167 ts_tablet_manager.cc:1939] T 1d221f14ad57462e95017b9068eb8714 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:27.763584 1102 leader_election.cc:341] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.764462 3167 tablet_replica.cc:330] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:27.764663 3167 raft_consensus.cc:2229] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.764623 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 1d221f14ad57462e95017b9068eb8714 (table default.Table_f75fed3fee5b474c89a743876719cbfb [id=36c8b90a707644c6bccc421821b00404]) successfully deleted
I20260927 15:06:27.764950 3289 raft_consensus.cc:482] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.765141 3289 raft_consensus.cc:504] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.765985 2119 ts_tablet_manager.cc:1918] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:27.766116 2119 log.cc:1196] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/089b6b5ac39d49fea744240261a8010e
I20260927 15:06:27.766323 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15609a2240ff42bfb30c3a318ce7ef91" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.766907 1376 leader_election.cc:341] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.767520 3289 leader_election.cc:288] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.767693 3289 raft_consensus.cc:482] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.767828 3289 raft_consensus.cc:504] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:27.768694 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20278f979638419db92105e55310f605" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.769063 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20278f979638419db92105e55310f605" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.769541 1376 leader_election.cc:341] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:27.769985 1374 leader_election.cc:341] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.770095 1374 leader_election.cc:302] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.770094 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d1768be101a44222bad24905d4a5c1dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:27.770488 3374 raft_consensus.cc:2726] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:27.770642 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1768be101a44222bad24905d4a5c1dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.770723 3289 leader_election.cc:288] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:27.771386 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_13e6ac5950024cb3adc05f8460026993"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.772027 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13e6ac5950024cb3adc05f8460026993 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.774780 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "289bea546c8a41bf97edfdc9a453a024" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:27.775038 1161 raft_consensus.cc:3037] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.777871 1161 raft_consensus.cc:2454] T 289bea546c8a41bf97edfdc9a453a024 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
W20260927 15:06:27.777937 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 467cda952ec4492f9206ee4847abc3bc consensus state has no leader
I20260927 15:06:27.778419 1239 leader_election.cc:302] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.778698 3302 raft_consensus.cc:2781] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:27.778788 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a3e940f09e1e408d8aea961e05268b44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.779584 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3e940f09e1e408d8aea961e05268b44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.787588 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_855da981cdf548feb28bf8de80f02306"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.788133 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_855da981cdf548feb28bf8de80f02306 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.788708 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15609a2240ff42bfb30c3a318ce7ef91" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:27.789693 1374 leader_election.cc:341] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.789824 1374 leader_election.cc:302] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.790266 3378 leader_election.cc:288] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:27.791115 1099 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.201.62:41167, user_credentials={real_user=slave}} blocked reactor thread for 56263.6us
I20260927 15:06:27.791538 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_204b853f46d742a6a6903e95d452c5b2" } new_table_name: "default.Table_7a5d249ac21b4cd4b49cdebf3b6f1768" modify_external_catalogs: true
I20260927 15:06:27.790773 3423 raft_consensus.cc:2726] T 15609a2240ff42bfb30c3a318ce7ef91 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.766435 2119 ts_tablet_manager.cc:1939] T 089b6b5ac39d49fea744240261a8010e P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:27.806263 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 089b6b5ac39d49fea744240261a8010e (table default.Table_ade3cb71f3dd4d55ac7e8839474d785a [id=fd1367da84814f54b92d304168674f0c]) successfully deleted
W20260927 15:06:27.810761 906 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0c54768b4f18467787d5e9894cb083d0 consensus state has no leader
I20260927 15:06:27.812399 1556 tablet_bootstrap.cc:492] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.812543 1556 ts_tablet_manager.cc:1397] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.181s user 0.015s sys 0.014s
I20260927 15:06:27.813256 1556 raft_consensus.cc:348] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.813473 1556 raft_consensus.cc:374] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.813535 1556 raft_consensus.cc:729] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.813733 1556 consensus_queue.cc:260] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.814255 1556 ts_tablet_manager.cc:1428] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260927 15:06:27.814525 1556 tablet_bootstrap.cc:492] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.814903 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_1409c4adee7d404dabbb49569c1ef638" } new_table_name: "default.Table_54550ea1e0c74204a18398137abc3c4c" modify_external_catalogs: true
I20260927 15:06:27.816992 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_5a7e16e3e7614729a0cebb135eae0538"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.817543 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a7e16e3e7614729a0cebb135eae0538 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.818666 2119 tablet_replica.cc:330] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:27.820734 2119 raft_consensus.cc:2229] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.820940 2119 raft_consensus.cc:2258] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.821460 2119 ts_tablet_manager.cc:1905] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.822219 1270 tablet_service.cc:1514] Processing DeleteTablet for tablet 289bea546c8a41bf97edfdc9a453a024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:27.826246 3167 raft_consensus.cc:2258] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.828418 3167 ts_tablet_manager.cc:1905] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:27.833688 1099 leader_election.cc:341] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 219639c0184f4888984fa04a1f84bd83
I20260927 15:06:27.833915 1099 leader_election.cc:302] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.834244 3250 raft_consensus.cc:2726] T 219639c0184f4888984fa04a1f84bd83 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.838240 1561 tablet_bootstrap.cc:492] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:27.838943 1561 ts_tablet_manager.cc:1397] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.170s user 0.001s sys 0.013s
I20260927 15:06:27.839007 1562 ts_tablet_manager.cc:1918] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:27.839872 1562 log.cc:1196] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/541147938d864cd9ad7208d96533b0f4
W20260927 15:06:27.842300 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec758b674b674456940ff90b2b7770a3 consensus state has no leader
I20260927 15:06:27.843418 1562 ts_tablet_manager.cc:1939] T 541147938d864cd9ad7208d96533b0f4 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:27.843211 1556 tablet_bootstrap.cc:654] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.845598 3302 raft_consensus.cc:686] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:27.845942 3302 consensus_queue.cc:237] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.846239 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1082) took 8429 ms. Trace:
I20260927 15:06:27.845371 1561 raft_consensus.cc:348] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.847023 1562 rpcz_store.cc:276] 0927 15:06:19.416649 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.416910 (+ 261us) service_pool.cc:227] Handling call
0927 15:06:27.699899 (+8282989us) ts_tablet_manager.cc:1145] Deleting tablet 541147938d864cd9ad7208d96533b0f4
0927 15:06:27.699910 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.782385 (+ 82475us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.838446 (+ 56061us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.845978 (+ 7532us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8282812}
I20260927 15:06:27.847993 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 541147938d864cd9ad7208d96533b0f4 (table default.Table_2c585ef1be384bbf993054ce07ec28d2 [id=ad01215da9fd4367aff8c096e377eb4e]) successfully deleted
I20260927 15:06:27.848505 1562 tablet_replica.cc:330] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:27.848887 1562 raft_consensus.cc:2229] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:27.849223 1562 raft_consensus.cc:2258] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.847175 1561 raft_consensus.cc:374] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.850936 1561 raft_consensus.cc:729] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.851249 1561 consensus_queue.cc:260] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.855926 3223 raft_consensus.cc:482] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.856232 3223 raft_consensus.cc:504] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:27.857856 1238 leader_election.cc:341] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 955461f27b6444d4b4c3f9a9f629d5e3
I20260927 15:06:27.860195 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955461f27b6444d4b4c3f9a9f629d5e3" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:27.860558 1162 raft_consensus.cc:2454] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:27.861050 1239 leader_election.cc:302] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.861493 3435 raft_consensus.cc:2781] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:27.861660 3435 raft_consensus.cc:482] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:27.861810 3435 raft_consensus.cc:3037] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.867025 3223 leader_election.cc:288] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.869674 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_261f0518b7d3413eb8ffe8741ccc7c4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.870288 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_261f0518b7d3413eb8ffe8741ccc7c4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.870716 1556 tablet_bootstrap.cc:492] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.870873 1556 ts_tablet_manager.cc:1397] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.056s user 0.005s sys 0.000s
I20260927 15:06:27.871469 1556 raft_consensus.cc:348] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:27.871670 1556 raft_consensus.cc:374] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.871726 1556 raft_consensus.cc:729] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.871892 1556 consensus_queue.cc:260] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:27.872372 1556 ts_tablet_manager.cc:1428] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260927 15:06:27.872611 1556 tablet_bootstrap.cc:492] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.875639 1562 ts_tablet_manager.cc:1905] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.880617 1561 ts_tablet_manager.cc:1428] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260927 15:06:27.884727 3435 raft_consensus.cc:504] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:27.885473 1099 consensus_peers.cc:487] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2268d824f5324cd1b81879e2fe4fd027. This is attempt 1: this message will repeat every 5th retry.
W20260927 15:06:27.885910 900 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0c54768b4f18467787d5e9894cb083d0 (table default.Table_7a5d249ac21b4cd4b49cdebf3b6f1768 [id=d4b50c4eac27403fb94efa8aa7ef901c], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0c54768b4f18467787d5e9894cb083d0 consensus state has no leader
I20260927 15:06:27.888638 3441 tablet.cc:1722] T adf68ba5020446bf8b522ac6db0e21e7 P fabb59e74b7d48fa9be047d7f4c4cc38: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:27.889190 3438 tablet.cc:1722] T adf68ba5020446bf8b522ac6db0e21e7 P c4264874db964ff2830b7894c2b3d61c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:27.889683 3440 tablet.cc:1722] T adf68ba5020446bf8b522ac6db0e21e7 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:27.891438 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_45c55cf1d22b4fdb93644e1dfe4e7c08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.892176 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45c55cf1d22b4fdb93644e1dfe4e7c08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.891467 1552 tablet_bootstrap.cc:492] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:27.896818 1552 ts_tablet_manager.cc:1397] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.200s user 0.007s sys 0.015s
I20260927 15:06:27.897588 3167 ts_tablet_manager.cc:1918] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:27.897706 3167 log.cc:1196] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/921db5dbe31a4d0381bdd823cb497424
I20260927 15:06:27.897989 3167 ts_tablet_manager.cc:1939] T 921db5dbe31a4d0381bdd823cb497424 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:27.898272 3167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49234 (request call id 1438) took 1018 ms. Trace:
I20260927 15:06:27.898365 3167 rpcz_store.cc:276] 0927 15:06:26.879921 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.879967 (+ 46us) service_pool.cc:227] Handling call
0927 15:06:27.764415 (+884448us) ts_tablet_manager.cc:1145] Deleting tablet 921db5dbe31a4d0381bdd823cb497424
0927 15:06:27.764425 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.882187 (+117762us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.897485 (+ 15298us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.898254 (+ 769us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":61412,"tablet-delete.queue_time_us":884286}
I20260927 15:06:27.899354 3167 tablet_replica.cc:330] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:27.899581 3167 raft_consensus.cc:2229] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:27.899870 3167 raft_consensus.cc:2258] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.898694 1552 raft_consensus.cc:348] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.900847 1556 tablet_bootstrap.cc:654] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.900985 1552 raft_consensus.cc:374] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.901319 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 921db5dbe31a4d0381bdd823cb497424 (table default.Table_fb1ec2ad14a54339a8ded2628758b6ce [id=b11f83d1010940d5bbd03efa06497202]) successfully deleted
W20260927 15:06:27.901602 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 581416f6c2cc434d8ee3ae1428d94f1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 581416f6c2cc434d8ee3ae1428d94f1c already in progress: creating tablet
W20260927 15:06:27.901782 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet afbfe01feee7463e8c5b795f9fda70cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afbfe01feee7463e8c5b795f9fda70cd already in progress: creating tablet
W20260927 15:06:27.901932 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 3ee9b3d162764abf9d2754ba5c1382fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ee9b3d162764abf9d2754ba5c1382fe already in progress: creating tablet
W20260927 15:06:27.902086 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 8fd389719a9948788c34b99e4953af57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fd389719a9948788c34b99e4953af57 already in progress: creating tablet
I20260927 15:06:27.901643 1552 raft_consensus.cc:729] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
W20260927 15:06:27.902295 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet fb99a5570603497fbcc029a31f7f947f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb99a5570603497fbcc029a31f7f947f already in progress: creating tablet
I20260927 15:06:27.902367 2119 ts_tablet_manager.cc:1918] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:27.902459 2119 log.cc:1196] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/efa42545da374ca989199433ce1284c3
I20260927 15:06:27.902745 2119 ts_tablet_manager.cc:1939] T efa42545da374ca989199433ce1284c3 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:27.903422 1552 consensus_queue.cc:260] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.910993 1552 ts_tablet_manager.cc:1428] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260927 15:06:27.913281 1552 tablet_bootstrap.cc:492] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:27.917399 1562 ts_tablet_manager.cc:1918] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:27.919765 908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_b6f5a16e230c47b0bf30927e7d65089f" } new_table_name: "default.Table_11cf11cfcee449e88afcf744f86ebe8e" modify_external_catalogs: true
I20260927 15:06:27.921023 914 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a75c1bff99d44d8aa0a19f7efd59f579" } new_table_name: "default.Table_ce35bed08dc743148ba9640dd69d0d46" modify_external_catalogs: true
I20260927 15:06:27.924468 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1361) took 1039 ms. Trace:
I20260927 15:06:27.924543 3167 ts_tablet_manager.cc:1905] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.927644 2119 rpcz_store.cc:276] 0927 15:06:26.885278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.885351 (+ 73us) service_pool.cc:227] Handling call
0927 15:06:27.818615 (+933264us) ts_tablet_manager.cc:1145] Deleting tablet efa42545da374ca989199433ce1284c3
0927 15:06:27.818628 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.899550 (+ 80922us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.902292 (+ 2742us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.924452 (+ 22160us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":932682}
I20260927 15:06:27.928102 2119 tablet_replica.cc:330] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:27.928190 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet efa42545da374ca989199433ce1284c3 (table default.Table_68376a56de55491a97cd372ac2473b62 [id=6d1dd8371c594833aab5bf7dfc193107]) successfully deleted
I20260927 15:06:27.928337 2119 raft_consensus.cc:2229] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:27.928575 2119 pending_rounds.cc:62] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:27.928663 2119 pending_rounds.cc:68] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976422519750656 op_type: NO_OP noop_request { }
I20260927 15:06:27.929247 2119 raft_consensus.cc:2866] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:27.929385 2119 raft_consensus.cc:2258] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.931309 3423 raft_consensus.cc:482] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.931497 3423 raft_consensus.cc:504] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.932803 3423 leader_election.cc:288] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.933218 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_44ea84260efb4f4cbd21d2dcf6121c3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:27.933612 3423 raft_consensus.cc:482] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:27.933756 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44ea84260efb4f4cbd21d2dcf6121c3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.933763 3423 raft_consensus.cc:504] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.934077 1562 log.cc:1196] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/9ae003f1ca76472cbaa8b577b66fe84c
I20260927 15:06:27.935230 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "611e63080dcb474c8dde370c54a0e777" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:27.935912 1374 leader_election.cc:341] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.936102 3423 leader_election.cc:288] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.936558 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90619b7804324c9589b53342e2f6d0e8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:27.937211 1374 leader_election.cc:341] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.938458 3236 raft_consensus.cc:482] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.938592 3236 raft_consensus.cc:504] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.938876 1562 ts_tablet_manager.cc:1939] T 9ae003f1ca76472cbaa8b577b66fe84c P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:27.939464 3236 leader_election.cc:288] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:27.940442 3423 raft_consensus.cc:482] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.940606 3423 raft_consensus.cc:504] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.942220 3423 leader_election.cc:288] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.942464 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "396cafb9a2ff4f8c9922745ad85b307c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:27.942961 1374 leader_election.cc:341] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.944252 3167 ts_tablet_manager.cc:1918] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 15:06:27.944356 3167 log.cc:1196] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/08f28c023473434ba73b1142a041be97
I20260927 15:06:27.944689 3167 ts_tablet_manager.cc:1939] T 08f28c023473434ba73b1142a041be97 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:27.945942 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1083) took 8528 ms. Trace:
I20260927 15:06:27.947001 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 08f28c023473434ba73b1142a041be97 (table default.Table_d1231a5040be43938a3a26bc25ff741b [id=67762455acad44448ba24d18c2863816]) successfully deleted
W20260927 15:06:27.948108 1099 leader_election.cc:341] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: f0a71cf0ee554b3eafca3f054cc16b28
I20260927 15:06:27.946590 1562 rpcz_store.cc:276] 0927 15:06:19.417678 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.417723 (+ 45us) service_pool.cc:227] Handling call
0927 15:06:27.848386 (+8430663us) ts_tablet_manager.cc:1145] Deleting tablet 9ae003f1ca76472cbaa8b577b66fe84c
0927 15:06:27.848399 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.902217 (+ 53818us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.917286 (+ 15069us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.945765 (+ 28479us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8430452}
I20260927 15:06:27.948354 3423 raft_consensus.cc:482] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:27.948534 3423 raft_consensus.cc:504] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.949311 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 9ae003f1ca76472cbaa8b577b66fe84c (table default.Table_9cb03ce349ee4cefa2a1b109f59c75ee [id=8e5ae781d15d48f7924076fea8d3d292]) successfully deleted
I20260927 15:06:27.949776 3423 leader_election.cc:288] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.950054 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c032a06c0b497fa21a3553375978ca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:27.931125 1238 leader_election.cc:341] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 955461f27b6444d4b4c3f9a9f629d5e3
I20260927 15:06:27.933279 1552 tablet_bootstrap.cc:654] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:27.950495 1374 leader_election.cc:341] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.933426 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90619b7804324c9589b53342e2f6d0e8" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.939411 1305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0a71cf0ee554b3eafca3f054cc16b28" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.941447 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "396cafb9a2ff4f8c9922745ad85b307c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.943245 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "611e63080dcb474c8dde370c54a0e777" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.951150 1376 leader_election.cc:341] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.951256 1376 leader_election.cc:302] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:27.951287 1102 leader_election.cc:341] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.951381 1102 leader_election.cc:302] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:27.952107 1376 leader_election.cc:341] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.949430 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c032a06c0b497fa21a3553375978ca" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:27.952221 1376 leader_election.cc:302] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.952485 3289 raft_consensus.cc:2726] T 90619b7804324c9589b53342e2f6d0e8 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:27.952622 1376 leader_election.cc:341] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.952729 1376 leader_election.cc:302] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:27.952874 908 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4443d7dc02f34891a8fe6d5be986252e consensus state has no leader
I20260927 15:06:27.953050 3374 raft_consensus.cc:2726] T 611e63080dcb474c8dde370c54a0e777 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.952638 3289 raft_consensus.cc:2726] T 396cafb9a2ff4f8c9922745ad85b307c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.955592 1552 tablet_bootstrap.cc:492] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
W20260927 15:06:27.956085 1376 leader_election.cc:341] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.956189 1376 leader_election.cc:302] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:27.956389 3423 raft_consensus.cc:2726] T d9c032a06c0b497fa21a3553375978ca P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.956245 1562 tablet_replica.cc:330] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:27.959157 1552 ts_tablet_manager.cc:1397] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.000s
I20260927 15:06:27.956519 3236 raft_consensus.cc:2726] T f0a71cf0ee554b3eafca3f054cc16b28 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:27.957216 3435 leader_election.cc:288] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:27.957000 2119 ts_tablet_manager.cc:1905] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.957609 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955461f27b6444d4b4c3f9a9f629d5e3" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:27.961900 1162 raft_consensus.cc:3037] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:27.964587 1162 raft_consensus.cc:2454] T 955461f27b6444d4b4c3f9a9f629d5e3 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
I20260927 15:06:27.965691 1239 leader_election.cc:302] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.966876 1562 raft_consensus.cc:2229] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:27.967231 1562 raft_consensus.cc:2258] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:27.967455 3435 raft_consensus.cc:2781] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:27.967623 3435 raft_consensus.cc:686] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:27.967886 3435 consensus_queue.cc:237] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.969069 1552 raft_consensus.cc:348] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.970328 1562 ts_tablet_manager.cc:1905] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:27.970484 1552 raft_consensus.cc:374] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.971109 1552 raft_consensus.cc:729] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.972581 1552 consensus_queue.cc:260] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:27.975611 914 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d639e4b65c0d4b2da00efc8973d2603f has no consensus state
I20260927 15:06:27.975714 1556 tablet_bootstrap.cc:492] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.975826 1556 ts_tablet_manager.cc:1397] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.005s
I20260927 15:06:27.975981 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_810bad6fad2240e494d69633aa9e262f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.976450 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_810bad6fad2240e494d69633aa9e262f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:27.976423 1556 raft_consensus.cc:348] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.976613 1556 raft_consensus.cc:374] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.976833 3236 raft_consensus.cc:482] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fabb59e74b7d48fa9be047d7f4c4cc38)
I20260927 15:06:27.976665 1556 raft_consensus.cc:729] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:27.976943 3236 raft_consensus.cc:504] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.977178 1556 consensus_queue.cc:260] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.977466 3236 leader_election.cc:288] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:27.977703 1556 ts_tablet_manager.cc:1428] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:27.977954 1556 tablet_bootstrap.cc:492] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:27.978171 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "796eef27ca8341b1a1ccc95770892e04" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:27.978641 1102 leader_election.cc:341] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:27.979254 1556 tablet_bootstrap.cc:654] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.980140 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_c1e4db8585bc4387a0026bbdef736301"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:27.980625 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1e4db8585bc4387a0026bbdef736301 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260927 15:06:27.983186 1099 leader_election.cc:341] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 796eef27ca8341b1a1ccc95770892e04
I20260927 15:06:27.983296 1099 leader_election.cc:302] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:27.985404 3236 raft_consensus.cc:2726] T 796eef27ca8341b1a1ccc95770892e04 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:27.985801 1552 ts_tablet_manager.cc:1428] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260927 15:06:27.986609 1552 tablet_bootstrap.cc:492] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:27.988266 1552 tablet_bootstrap.cc:654] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:27.991917 2985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a122de3662f485f8f44b0a5e4b29862: Bootstrap replaying log segment 1/1 (250.1K/281.2K this segment, stats: ops{read=701 overwritten=0 applied=700 ignored=0} inserts{seen=630 ignored=0} mutations{seen=798 ignored=0} orphaned_commits=0)
I20260927 15:06:27.992496 2119 ts_tablet_manager.cc:1918] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:27.992928 2119 log.cc:1196] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/79a3125723034cb48bc1a05fc4abbb82
I20260927 15:06:27.993264 1556 tablet_bootstrap.cc:492] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:27.993414 1556 ts_tablet_manager.cc:1397] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260927 15:06:27.994197 1556 raft_consensus.cc:348] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:27.994443 1556 raft_consensus.cc:374] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:27.994534 2119 ts_tablet_manager.cc:1939] T 79a3125723034cb48bc1a05fc4abbb82 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:27.999070 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 047fe4ed761642ccbfecdf543900d064 (table default.Table_e1ff12b28a334d19ad9258294a011d92 [id=5b0182bd937d41d2bb0f615cc82b7e39]). Expected version 3 got 0
W20260927 15:06:27.999591 910 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.201.3:60991 (request call id 193) took 1014 ms (client timeout 1000 ms). Trace:
W20260927 15:06:27.999681 910 rpcz_store.cc:269] 0927 15:06:26.984877 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.984931 (+ 54us) service_pool.cc:227] Handling call
0927 15:06:27.999570 (+1014639us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20260927 15:06:28.003818 3435 raft_consensus.cc:482] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.003976 3435 raft_consensus.cc:504] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.005465 3435 leader_election.cc:288] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.008394 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 541147938d864cd9ad7208d96533b0f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:05 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.009377 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b4beb4112734b9c91e32b300fd266d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:11 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.010093 1137 tablet_service.cc:1514] Processing DeleteTablet for tablet e19cd7febe054432899739e21605406d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:28.010530 911 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.201.1:54519 (request call id 176) took 914 ms (client timeout 1000 ms). Trace:
W20260927 15:06:28.011047 911 rpcz_store.cc:269] 0927 15:06:27.096395 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:27.096486 (+ 91us) service_pool.cc:227] Handling call
0927 15:06:28.010507 (+914021us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":19}
I20260927 15:06:28.012976 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1362) took 1127 ms. Trace:
I20260927 15:06:28.005115 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5f4a30bac94d72b5265c8a7a0d4d59" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:28.013149 1556 raft_consensus.cc:729] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.013625 1556 consensus_queue.cc:260] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.013903 2119 rpcz_store.cc:276] 0927 15:06:26.885459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.885517 (+ 58us) service_pool.cc:227] Handling call
0927 15:06:27.928049 (+1042532us) ts_tablet_manager.cc:1145] Deleting tablet 79a3125723034cb48bc1a05fc4abbb82
0927 15:06:27.928070 (+ 21us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.965231 (+ 37161us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:27.992113 (+ 26882us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.012953 (+ 20840us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1042022}
I20260927 15:06:28.016510 1562 ts_tablet_manager.cc:1918] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:28.016927 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 79a3125723034cb48bc1a05fc4abbb82 (table default.Table_9a6330b2000f4bb5a7817b924f99ad53 [id=09a85e91664d444eab58b705a3be138d]) successfully deleted
I20260927 15:06:28.017319 2119 tablet_replica.cc:330] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:28.017577 2119 raft_consensus.cc:2229] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:28.017825 2119 pending_rounds.cc:62] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:28.019097 2119 pending_rounds.cc:68] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976420115378176 op_type: NO_OP noop_request { }
I20260927 15:06:28.019263 2119 raft_consensus.cc:2866] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:28.019378 2119 raft_consensus.cc:2258] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.020043 1556 ts_tablet_manager.cc:1428] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.027s user 0.001s sys 0.000s
I20260927 15:06:28.020615 2119 ts_tablet_manager.cc:1905] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.020925 1556 tablet_bootstrap.cc:492] T 81f65ad693894e7c8b575cd8e1942c14 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:28.021862 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 047fe4ed761642ccbfecdf543900d064 (table default.Table_e1ff12b28a334d19ad9258294a011d92 [id=5b0182bd937d41d2bb0f615cc82b7e39]). Expected version 3 got 0
I20260927 15:06:28.022266 910 catalog_manager.cc:5495] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3). New cstate: current_term: 1 leader_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } health_report { overall_health: UNKNOWN } } }
I20260927 15:06:28.022974 3289 raft_consensus.cc:482] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.023114 3289 raft_consensus.cc:504] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.023687 3289 leader_election.cc:288] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.024108 1270 tablet_service.cc:1467] Processing CreateTablet for tablet f19ce5333b464979b23be19fb0dd5e7e (DEFAULT_TABLE table=default.Table_684d82aaea5948cfb615ad0372fdadc7 [id=20de92dfb3d54ff4ab64c9e55f1281e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.024179 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2e4f338ecf74608b6261d74cbd6db9b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.024466 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f19ce5333b464979b23be19fb0dd5e7e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:28.024725 1376 leader_election.cc:341] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.027829 1273 tablet_service.cc:1467] Processing CreateTablet for tablet df67e96919874518a9715c2bf8bef74a (DEFAULT_TABLE table=default.Table_59b1ed2d8319426e850d87b7343adff1 [id=1fbe66ff8e1e469db1c140c46ff2494c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.028173 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df67e96919874518a9715c2bf8bef74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.028092 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 0595d56b703047f1b032f28bd74771c7 (DEFAULT_TABLE table=default.Table_439cbba98d3f41249b9d11d607af5dad [id=da5f82cb6be6429290c2a58a92aaf7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.028237 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 0595d56b703047f1b032f28bd74771c7 (DEFAULT_TABLE table=default.Table_439cbba98d3f41249b9d11d607af5dad [id=da5f82cb6be6429290c2a58a92aaf7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.028460 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0595d56b703047f1b032f28bd74771c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.028591 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0595d56b703047f1b032f28bd74771c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.030546 1402 tablet_service.cc:1467] Processing CreateTablet for tablet f19ce5333b464979b23be19fb0dd5e7e (DEFAULT_TABLE table=default.Table_684d82aaea5948cfb615ad0372fdadc7 [id=20de92dfb3d54ff4ab64c9e55f1281e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.030885 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f19ce5333b464979b23be19fb0dd5e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.031057 1281 tablet_service.cc:1467] Processing CreateTablet for tablet e75d7b80594d4e9084e40dd63b9c325e (DEFAULT_TABLE table=default.Table_fce46ca41de8464fa059789abda64740 [id=3530346e19414714aef088a2a60baefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.031107 1414 tablet_service.cc:1467] Processing CreateTablet for tablet df67e96919874518a9715c2bf8bef74a (DEFAULT_TABLE table=default.Table_59b1ed2d8319426e850d87b7343adff1 [id=1fbe66ff8e1e469db1c140c46ff2494c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.031370 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75d7b80594d4e9084e40dd63b9c325e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.031445 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df67e96919874518a9715c2bf8bef74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.035277 1420 tablet_service.cc:1467] Processing CreateTablet for tablet e75d7b80594d4e9084e40dd63b9c325e (DEFAULT_TABLE table=default.Table_fce46ca41de8464fa059789abda64740 [id=3530346e19414714aef088a2a60baefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.035637 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75d7b80594d4e9084e40dd63b9c325e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.041942 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 56a18cf5e2c94bfe9af9fab67f3cca70 (DEFAULT_TABLE table=default.Table_4612913071c2423fa050e81aa5cb9219 [id=eab9f17601624a4691824775b2316aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.042666 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56a18cf5e2c94bfe9af9fab67f3cca70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.047698 1270 tablet_service.cc:1467] Processing CreateTablet for tablet 56a18cf5e2c94bfe9af9fab67f3cca70 (DEFAULT_TABLE table=default.Table_4612913071c2423fa050e81aa5cb9219 [id=eab9f17601624a4691824775b2316aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.049836 1556 tablet_bootstrap.cc:654] T 81f65ad693894e7c8b575cd8e1942c14 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.051036 911 master_service.cc:946] ReplaceTablet: received request to replace tablet 024f439ab5774474ad197bf7fa557ac7 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:28.051666 911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5c89a4c26c1349df9e405dfabc6aeb31" } new_table_name: "default.Table_136c248f235b4d539096662b810e5313" modify_external_catalogs: true
I20260927 15:06:28.056689 910 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet d2e4f338ecf74608b6261d74cbd6db9b (table default.Table_ddd7c8d753fb4bbb936c56ec9fe101a3 [id=7f2d5f98ab62449da015bd58173ce825]). Expected version 1 got 0
I20260927 15:06:28.058780 1552 tablet_bootstrap.cc:492] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:28.060307 1552 ts_tablet_manager.cc:1397] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.000s
I20260927 15:06:28.060957 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 97747261b3d54ac9a3c71eb1ed93d5d1 (DEFAULT_TABLE table=default.Table_f30db604c44a42eb9b59a1816cad7f44 [id=19050db51db14827b689bff65eaf1268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.061385 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97747261b3d54ac9a3c71eb1ed93d5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.060549 1278 tablet_service.cc:1467] Processing CreateTablet for tablet 97747261b3d54ac9a3c71eb1ed93d5d1 (DEFAULT_TABLE table=default.Table_f30db604c44a42eb9b59a1816cad7f44 [id=19050db51db14827b689bff65eaf1268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.061195 1270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56a18cf5e2c94bfe9af9fab67f3cca70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.061825 1278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97747261b3d54ac9a3c71eb1ed93d5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.068641 1273 tablet_service.cc:1467] Processing CreateTablet for tablet eb5148ed1a71493c85a8ebbd84cacb74 (DEFAULT_TABLE table=default.Table_682b5cbc1e4f445eba8c243a26a9df25 [id=3c588608b4a444ac9dbd433ddf2e0eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.069087 1273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb5148ed1a71493c85a8ebbd84cacb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.071558 1411 tablet_service.cc:1467] Processing CreateTablet for tablet f34f275657a04a57ad3d4f2609c1a3c1 (DEFAULT_TABLE table=default.Table_550687aecc8d4614bde9460879d9d576 [id=e89fe5a60d0146959121b987a9741793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.072016 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f34f275657a04a57ad3d4f2609c1a3c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.073266 1408 tablet_service.cc:1467] Processing CreateTablet for tablet 4d935fe5f4d14a12bc7bea07562087e8 (DEFAULT_TABLE table=default.Table_4f7df3628e4e4614a155c21f02221cb3 [id=25b66f8d582e4423856d6834c83fb0ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.073619 1408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d935fe5f4d14a12bc7bea07562087e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.074268 1402 tablet_service.cc:1467] Processing CreateTablet for tablet eb5148ed1a71493c85a8ebbd84cacb74 (DEFAULT_TABLE table=default.Table_682b5cbc1e4f445eba8c243a26a9df25 [id=3c588608b4a444ac9dbd433ddf2e0eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.074565 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb5148ed1a71493c85a8ebbd84cacb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.078082 1282 tablet_service.cc:1467] Processing CreateTablet for tablet f34f275657a04a57ad3d4f2609c1a3c1 (DEFAULT_TABLE table=default.Table_550687aecc8d4614bde9460879d9d576 [id=e89fe5a60d0146959121b987a9741793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.078508 1282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f34f275657a04a57ad3d4f2609c1a3c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.083165 1281 tablet_service.cc:1467] Processing CreateTablet for tablet 6cda785228624dcfb7fea6ac3d65713b (DEFAULT_TABLE table=default.Table_5474bb8f04f44464a989b7b4601ae781 [id=b8780ae73d1a466ebfdfbc7fbb6c52b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.083595 1281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cda785228624dcfb7fea6ac3d65713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.087308 908 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: default.Table_fc106e6d0e9640a49d258e21fb7d2331 [id=3fc04b4c774144dd85bbb92d05883018] alter complete (version 2)
I20260927 15:06:28.089035 1266 tablet_service.cc:1467] Processing CreateTablet for tablet 4d935fe5f4d14a12bc7bea07562087e8 (DEFAULT_TABLE table=default.Table_4f7df3628e4e4614a155c21f02221cb3 [id=25b66f8d582e4423856d6834c83fb0ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.089416 1266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d935fe5f4d14a12bc7bea07562087e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.096320 1291 raft_consensus.cc:3037] T af25950fd08043f18a6eaaf46ded4378 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:28.096346 1285 tablet_service.cc:1467] Processing CreateTablet for tablet 5d77f09ca22447e5a06a92a473ad1d1e (DEFAULT_TABLE table=default.Table_ba8679c56bbb4c98b5ef7e30f76f5b1e [id=1fe5015e654845c6955ae0de037cb7c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.099080 1271 tablet_service.cc:1467] Processing CreateTablet for tablet 1df048ff83d149d4ab5a357118968ef5 (DEFAULT_TABLE table=default.Table_62005f9ebacc4cf5a1f7e502ba4aee7d [id=405c83c7e2ee4c7e9b6c935b668fdbe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.103278 1269 tablet_service.cc:1467] Processing CreateTablet for tablet 1f72f9a43f664ef3b5c4e6c9e8d3f4ed (DEFAULT_TABLE table=default.Table_f4af77c955e24ad38b78c0afba81a10d [id=6e64124b05a141e5b1c2538f0e2e33ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.104681 1267 tablet_service.cc:1467] Processing CreateTablet for tablet c074c67676b841b391cc3160ea6ea89a (DEFAULT_TABLE table=default.Table_6a6021df9f98438cb02b4bd851812236 [id=32eb07009d9e43889044e746fe9d839b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.105592 1284 tablet_service.cc:1467] Processing CreateTablet for tablet bac65e0662b44f579e6ec4de23062a0d (DEFAULT_TABLE table=default.Table_5f5c99114765454986c40955601ebb30 [id=608a081be2124b0b992def7085cdf4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.105964 1268 tablet_service.cc:1467] Processing CreateTablet for tablet 7110b625a40148c4a4c340e78ef9a357 (DEFAULT_TABLE table=default.Table_682599a715844488b4cc55dcd6f0d70d [id=34081c88d2ec43c19c76bb854347c28a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.106277 1280 tablet_service.cc:1467] Processing CreateTablet for tablet 991325ffb7e545598af2364130a578e6 (DEFAULT_TABLE table=default.Table_7092bbe836634d1fb388491e9ecc2957 [id=b7c80c15ffb842d192363d1e00234815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.112500 907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 1d6afacbd3e04806862929e82e4bdeac
I20260927 15:06:28.112967 907 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49800 (request call id 1728) took 1244 ms. Trace:
I20260927 15:06:28.113178 1283 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d6afacbd3e04806862929e82e4bdeac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:28.113054 907 rpcz_store.cc:276] 0927 15:06:26.868936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.869277 (+ 341us) service_pool.cc:227] Handling call
0927 15:06:26.869652 (+ 375us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0927 15:06:26.869795 (+ 143us) catalog_manager.cc:2752] Modifying in-memory table state
0927 15:06:26.869846 (+ 51us) catalog_manager.cc:2761] Locking tablets
0927 15:06:27.996292 (+1126446us) catalog_manager.cc:2775] Removing table and tablets from system table
0927 15:06:28.112360 (+116068us) catalog_manager.cc:2793] Removing table from by-name map
0927 15:06:28.112432 (+ 72us) catalog_manager.cc:2809] Committing in-memory state
0927 15:06:28.112468 (+ 36us) catalog_manager.cc:2813] Aborting table tasks
0927 15:06:28.112948 (+ 480us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:28.081462 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:28.081548 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:28.081552 (+ 4us) write_op.cc:435] Acquired schema lock
0927 15:06:28.081555 (+ 3us) tablet.cc:660] Decoding operations
0927 15:06:28.081649 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:28.081657 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:28.081662 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:28.081757 (+ 95us) tablet.cc:699] Row locks acquired
0927 15:06:28.081759 (+ 2us) write_op.cc:260] PREPARE: finished
0927 15:06:28.081784 (+ 25us) write_op.cc:270] Start()
0927 15:06:28.081811 (+ 27us) write_op.cc:276] Timestamp: P: 1790521588081767 usec, L: 0
0927 15:06:28.081815 (+ 4us) op_driver.cc:331] REPLICATION: starting
0927 15:06:28.081945 (+ 130us) log.cc:842] Serialized 725 byte log entry
0927 15:06:28.109655 (+ 27710us) op_driver.cc:444] REPLICATION: finished
0927 15:06:28.110946 (+ 1291us) write_op.cc:301] APPLY: starting
0927 15:06:28.110956 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:28.110984 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:28.111003 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:28.111075 (+ 72us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:28.111100 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 15:06:28.111105 (+ 5us) write_op.cc:312] APPLY: finished
0927 15:06:28.111173 (+ 68us) log.cc:842] Serialized 29 byte log entry
0927 15:06:28.111210 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:28.111223 (+ 13us) write_op.cc:454] Released schema lock
0927 15:06:28.111228 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:28.111275 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:28.111279 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1261,"apply.run_cpu_time_us":375,"apply.run_wall_time_us":375,"num_ops":2,"prepare.queue_time_us":84445,"prepare.run_cpu_time_us":550,"prepare.run_wall_time_us":834,"replication_time_us":27827,"threads_started":1}]]}
I20260927 15:06:28.121882 1283 tablet_service.cc:1467] Processing CreateTablet for tablet 2fb2b0917451411c895d72483c9b11a5 (DEFAULT_TABLE table=default.Table_104aa6a284064e49bdcc3395e61dd253 [id=cc1b3195c76244fbaf7f9cb5c071358f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.122740 1277 tablet_service.cc:1467] Processing CreateTablet for tablet 02d1ac2a13544f3ab196621b24979558 (DEFAULT_TABLE table=default.Table_ac636789d81649e5a114ac2bdca92d6a [id=9bf9df53d62b4d4fbb18a381fe12acf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.127974 1277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d1ac2a13544f3ab196621b24979558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.129731 1285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d77f09ca22447e5a06a92a473ad1d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.131057 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f72f9a43f664ef3b5c4e6c9e8d3f4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.131958 1267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c074c67676b841b391cc3160ea6ea89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.132731 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac65e0662b44f579e6ec4de23062a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.133803 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7110b625a40148c4a4c340e78ef9a357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.134430 1280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 991325ffb7e545598af2364130a578e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.134680 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fb2b0917451411c895d72483c9b11a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.121112 1552 raft_consensus.cc:348] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.136556 1552 raft_consensus.cc:374] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.136651 1552 raft_consensus.cc:729] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.136914 1552 consensus_queue.cc:260] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.025467 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2e4f338ecf74608b6261d74cbd6db9b" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.141634 1562 log.cc:1196] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/8d533883e3344eca939cd67644895148
I20260927 15:06:28.026248 1140 tablet_service.cc:1467] Processing CreateTablet for tablet 0595d56b703047f1b032f28bd74771c7 (DEFAULT_TABLE table=default.Table_439cbba98d3f41249b9d11d607af5dad [id=da5f82cb6be6429290c2a58a92aaf7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.142061 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0595d56b703047f1b032f28bd74771c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.142174 1562 ts_tablet_manager.cc:1939] T 8d533883e3344eca939cd67644895148 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:28.143020 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1084) took 8725 ms. Trace:
I20260927 15:06:28.143146 1562 rpcz_store.cc:276] 0927 15:06:19.417835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.417928 (+ 93us) service_pool.cc:227] Handling call
0927 15:06:27.950158 (+8532230us) ts_tablet_manager.cc:1145] Deleting tablet 8d533883e3344eca939cd67644895148
0927 15:06:27.950377 (+ 219us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:27.984560 (+ 34183us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.016402 (+ 31842us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.143001 (+126599us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1880,"tablet-delete.queue_time_us":8532042}
I20260927 15:06:28.143673 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 8d533883e3344eca939cd67644895148 (table default.Table_d072149ddba94cff935fb906dcf0524c [id=ba95aca9e7c449bd8fe939e896ab1ba5]) successfully deleted
I20260927 15:06:28.144021 1562 tablet_replica.cc:330] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:28.144253 1562 raft_consensus.cc:2229] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:28.144444 1562 pending_rounds.cc:62] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:28.144520 1562 pending_rounds.cc:68] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976388389588992 op_type: NO_OP noop_request { }
I20260927 15:06:28.144649 1562 raft_consensus.cc:2866] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:28.144754 1562 raft_consensus.cc:2258] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.027066 1137 tablet_service.cc:1467] Processing CreateTablet for tablet f19ce5333b464979b23be19fb0dd5e7e (DEFAULT_TABLE table=default.Table_684d82aaea5948cfb615ad0372fdadc7 [id=20de92dfb3d54ff4ab64c9e55f1281e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.145147 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f19ce5333b464979b23be19fb0dd5e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.145460 1562 ts_tablet_manager.cc:1905] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:28.146059 1374 leader_election.cc:341] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.146186 1374 leader_election.cc:302] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:28.146515 3374 raft_consensus.cc:2726] T d2e4f338ecf74608b6261d74cbd6db9b P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.040750 1127 tablet_service.cc:1467] Processing CreateTablet for tablet e75d7b80594d4e9084e40dd63b9c325e (DEFAULT_TABLE table=default.Table_fce46ca41de8464fa059789abda64740 [id=3530346e19414714aef088a2a60baefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.147687 1127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75d7b80594d4e9084e40dd63b9c325e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.042487 1138 tablet_service.cc:1467] Processing CreateTablet for tablet 56a18cf5e2c94bfe9af9fab67f3cca70 (DEFAULT_TABLE table=default.Table_4612913071c2423fa050e81aa5cb9219 [id=eab9f17601624a4691824775b2316aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.153340 1138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56a18cf5e2c94bfe9af9fab67f3cca70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.057789 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb5f4a30bac94d72b5265c8a7a0d4d59" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.060138 1144 tablet_service.cc:1467] Processing CreateTablet for tablet 97747261b3d54ac9a3c71eb1ed93d5d1 (DEFAULT_TABLE table=default.Table_f30db604c44a42eb9b59a1816cad7f44 [id=19050db51db14827b689bff65eaf1268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.158329 1144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97747261b3d54ac9a3c71eb1ed93d5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.068437 1142 tablet_service.cc:1467] Processing CreateTablet for tablet eb5148ed1a71493c85a8ebbd84cacb74 (DEFAULT_TABLE table=default.Table_682b5cbc1e4f445eba8c243a26a9df25 [id=3c588608b4a444ac9dbd433ddf2e0eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.162282 1142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb5148ed1a71493c85a8ebbd84cacb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.070454 1146 tablet_service.cc:1467] Processing CreateTablet for tablet 6cda785228624dcfb7fea6ac3d65713b (DEFAULT_TABLE table=default.Table_5474bb8f04f44464a989b7b4601ae781 [id=b8780ae73d1a466ebfdfbc7fbb6c52b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.167111 1146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cda785228624dcfb7fea6ac3d65713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.072289 1145 tablet_service.cc:1467] Processing CreateTablet for tablet f34f275657a04a57ad3d4f2609c1a3c1 (DEFAULT_TABLE table=default.Table_550687aecc8d4614bde9460879d9d576 [id=e89fe5a60d0146959121b987a9741793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.171409 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f34f275657a04a57ad3d4f2609c1a3c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.088372 1132 tablet_service.cc:1467] Processing CreateTablet for tablet 4d935fe5f4d14a12bc7bea07562087e8 (DEFAULT_TABLE table=default.Table_4f7df3628e4e4614a155c21f02221cb3 [id=25b66f8d582e4423856d6834c83fb0ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.092343 3236 raft_consensus.cc:482] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.175284 3236 raft_consensus.cc:504] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.175487 1132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d935fe5f4d14a12bc7bea07562087e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.175907 3236 leader_election.cc:288] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:28.097148 1143 tablet_service.cc:1467] Processing CreateTablet for tablet 5d77f09ca22447e5a06a92a473ad1d1e (DEFAULT_TABLE table=default.Table_ba8679c56bbb4c98b5ef7e30f76f5b1e [id=1fe5015e654845c6955ae0de037cb7c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.176232 1143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d77f09ca22447e5a06a92a473ad1d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.097988 1128 tablet_service.cc:1467] Processing CreateTablet for tablet 1df048ff83d149d4ab5a357118968ef5 (DEFAULT_TABLE table=default.Table_62005f9ebacc4cf5a1f7e502ba4aee7d [id=405c83c7e2ee4c7e9b6c935b668fdbe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.179338 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9f171fd62d644f38262a2257d47fafe" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.099218 1139 tablet_service.cc:1467] Processing CreateTablet for tablet 1f72f9a43f664ef3b5c4e6c9e8d3f4ed (DEFAULT_TABLE table=default.Table_f4af77c955e24ad38b78c0afba81a10d [id=6e64124b05a141e5b1c2538f0e2e33ab]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:28.179888 1102 leader_election.cc:341] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.100112 1130 tablet_service.cc:1467] Processing CreateTablet for tablet bac65e0662b44f579e6ec4de23062a0d (DEFAULT_TABLE table=default.Table_5f5c99114765454986c40955601ebb30 [id=608a081be2124b0b992def7085cdf4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.101362 1134 tablet_service.cc:1467] Processing CreateTablet for tablet 7110b625a40148c4a4c340e78ef9a357 (DEFAULT_TABLE table=default.Table_682599a715844488b4cc55dcd6f0d70d [id=34081c88d2ec43c19c76bb854347c28a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.102661 1133 tablet_service.cc:1467] Processing CreateTablet for tablet 991325ffb7e545598af2364130a578e6 (DEFAULT_TABLE table=default.Table_7092bbe836634d1fb388491e9ecc2957 [id=b7c80c15ffb842d192363d1e00234815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.103866 1131 tablet_service.cc:1467] Processing CreateTablet for tablet c074c67676b841b391cc3160ea6ea89a (DEFAULT_TABLE table=default.Table_6a6021df9f98438cb02b4bd851812236 [id=32eb07009d9e43889044e746fe9d839b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.114219 1211 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:28.115366 1136 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d6afacbd3e04806862929e82e4bdeac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.123432 1129 tablet_service.cc:1467] Processing CreateTablet for tablet 02d1ac2a13544f3ab196621b24979558 (DEFAULT_TABLE table=default.Table_ac636789d81649e5a114ac2bdca92d6a [id=9bf9df53d62b4d4fbb18a381fe12acf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.123700 1141 tablet_service.cc:1467] Processing CreateTablet for tablet 2fb2b0917451411c895d72483c9b11a5 (DEFAULT_TABLE table=default.Table_104aa6a284064e49bdcc3395e61dd253 [id=cc1b3195c76244fbaf7f9cb5c071358f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.130816 1561 tablet_bootstrap.cc:492] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:28.026621 1135 tablet_service.cc:1467] Processing CreateTablet for tablet df67e96919874518a9715c2bf8bef74a (DEFAULT_TABLE table=default.Table_59b1ed2d8319426e850d87b7343adff1 [id=1fbe66ff8e1e469db1c140c46ff2494c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:28.181772 1099 leader_election.cc:341] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: e9f171fd62d644f38262a2257d47fafe
I20260927 15:06:28.181867 1099 leader_election.cc:302] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:28.182214 3250 raft_consensus.cc:2726] T e9f171fd62d644f38262a2257d47fafe P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.182760 1561 tablet_bootstrap.cc:654] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.183760 1128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1df048ff83d149d4ab5a357118968ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.185288 1239 leader_election.cc:302] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:28.185734 3435 raft_consensus.cc:2726] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.185894 1134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7110b625a40148c4a4c340e78ef9a357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.186313 1133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 991325ffb7e545598af2364130a578e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.186672 1130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac65e0662b44f579e6ec4de23062a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.186956 1131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c074c67676b841b391cc3160ea6ea89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.187327 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df67e96919874518a9715c2bf8bef74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.187706 1141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fb2b0917451411c895d72483c9b11a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.188093 1129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d1ac2a13544f3ab196621b24979558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.188424 1139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f72f9a43f664ef3b5c4e6c9e8d3f4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.205124 1552 ts_tablet_manager.cc:1428] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.144s user 0.002s sys 0.000s
I20260927 15:06:28.205403 1552 tablet_bootstrap.cc:492] T 3540982dd7544e60af6c153fc41a412c P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:28.210059 1552 tablet_bootstrap.cc:654] T 3540982dd7544e60af6c153fc41a412c P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.211488 3435 raft_consensus.cc:482] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.211608 3435 raft_consensus.cc:504] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.212148 3435 leader_election.cc:288] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.214650 1404 tablet_service.cc:1467] Processing CreateTablet for tablet bac65e0662b44f579e6ec4de23062a0d (DEFAULT_TABLE table=default.Table_5f5c99114765454986c40955601ebb30 [id=608a081be2124b0b992def7085cdf4bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260927 15:06:28.215171 1238 leader_election.cc:341] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b44e2611d2bf40ae90c4fd857225e39e
I20260927 15:06:28.215219 1414 tablet_service.cc:1467] Processing CreateTablet for tablet 5d77f09ca22447e5a06a92a473ad1d1e (DEFAULT_TABLE table=default.Table_ba8679c56bbb4c98b5ef7e30f76f5b1e [id=1fe5015e654845c6955ae0de037cb7c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.216149 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44e2611d2bf40ae90c4fd857225e39e" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.216289 1561 tablet_bootstrap.cc:492] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:28.216338 1162 raft_consensus.cc:2454] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 0.
I20260927 15:06:28.216434 1561 ts_tablet_manager.cc:1397] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.086s user 0.002s sys 0.002s
I20260927 15:06:28.216616 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1df048ff83d149d4ab5a357118968ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.217020 1239 leader_election.cc:302] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters: fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:28.217063 1561 raft_consensus.cc:348] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.217235 1561 raft_consensus.cc:374] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.217284 1561 raft_consensus.cc:729] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.217435 3435 raft_consensus.cc:2781] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:28.217501 3435 raft_consensus.cc:482] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:28.217566 3435 raft_consensus.cc:3037] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:28.217612 1561 consensus_queue.cc:260] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.218111 1561 ts_tablet_manager.cc:1428] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:28.220100 3435 raft_consensus.cc:504] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.220659 3435 leader_election.cc:288] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Requested vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.222168 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b44e2611d2bf40ae90c4fd857225e39e" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c"
I20260927 15:06:28.222327 1162 raft_consensus.cc:3037] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:28.222368 2119 ts_tablet_manager.cc:1918] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:28.222464 2119 log.cc:1196] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/ac64eacc7d924940aacc8779b5bfeae7
I20260927 15:06:28.225131 1162 raft_consensus.cc:2454] T b44e2611d2bf40ae90c4fd857225e39e P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4769a710b72a4b49b816725a5921e86e in term 1.
W20260927 15:06:28.225752 1102 consensus_peers.cc:487] T db09498a395b4570a34d32fbfc71e8ed P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db09498a395b4570a34d32fbfc71e8ed. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:28.227310 1561 tablet_bootstrap.cc:492] T ec3d823781234015aa8a48421a23bbd2 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:28.228552 1561 tablet_bootstrap.cc:654] T ec3d823781234015aa8a48421a23bbd2 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.225581 1239 leader_election.cc:302] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c; no voters:
I20260927 15:06:28.233475 1294 raft_consensus.cc:3037] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:28.236688 3302 raft_consensus.cc:2781] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:28.236792 3302 raft_consensus.cc:686] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Becoming Leader. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Running, Role: LEADER
I20260927 15:06:28.236987 3302 consensus_queue.cc:237] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:28.245554 1238 leader_election.cc:341] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b44e2611d2bf40ae90c4fd857225e39e
I20260927 15:06:28.245612 1403 tablet_service.cc:1467] Processing CreateTablet for tablet 991325ffb7e545598af2364130a578e6 (DEFAULT_TABLE table=default.Table_7092bbe836634d1fb388491e9ecc2957 [id=b7c80c15ffb842d192363d1e00234815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.246057 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d6afacbd3e04806862929e82e4bdeac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.246198 1412 tablet_service.cc:1467] Processing CreateTablet for tablet 02d1ac2a13544f3ab196621b24979558 (DEFAULT_TABLE table=default.Table_ac636789d81649e5a114ac2bdca92d6a [id=9bf9df53d62b4d4fbb18a381fe12acf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.247153 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 7110b625a40148c4a4c340e78ef9a357 (DEFAULT_TABLE table=default.Table_682599a715844488b4cc55dcd6f0d70d [id=34081c88d2ec43c19c76bb854347c28a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.247429 1409 tablet_service.cc:1467] Processing CreateTablet for tablet c074c67676b841b391cc3160ea6ea89a (DEFAULT_TABLE table=default.Table_6a6021df9f98438cb02b4bd851812236 [id=32eb07009d9e43889044e746fe9d839b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.250957 1402 tablet_service.cc:1467] Processing CreateTablet for tablet 1df048ff83d149d4ab5a357118968ef5 (DEFAULT_TABLE table=default.Table_62005f9ebacc4cf5a1f7e502ba4aee7d [id=405c83c7e2ee4c7e9b6c935b668fdbe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.250916 1401 tablet_service.cc:1467] Processing CreateTablet for tablet 2fb2b0917451411c895d72483c9b11a5 (DEFAULT_TABLE table=default.Table_104aa6a284064e49bdcc3395e61dd253 [id=cc1b3195c76244fbaf7f9cb5c071358f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.250944 1404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac65e0662b44f579e6ec4de23062a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.251624 3423 raft_consensus.cc:482] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.251889 1418 tablet_service.cc:1467] Processing CreateTablet for tablet 1f72f9a43f664ef3b5c4e6c9e8d3f4ed (DEFAULT_TABLE table=default.Table_f4af77c955e24ad38b78c0afba81a10d [id=6e64124b05a141e5b1c2538f0e2e33ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.252180 3374 raft_consensus.cc:482] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.252351 1420 tablet_service.cc:1467] Processing CreateTablet for tablet 6cda785228624dcfb7fea6ac3d65713b (DEFAULT_TABLE table=default.Table_5474bb8f04f44464a989b7b4601ae781 [id=b8780ae73d1a466ebfdfbc7fbb6c52b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260927 15:06:28.252714 1414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d77f09ca22447e5a06a92a473ad1d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.253032 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7110b625a40148c4a4c340e78ef9a357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.255024 1401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fb2b0917451411c895d72483c9b11a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.260775 3423 raft_consensus.cc:504] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.261580 3423 leader_election.cc:288] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.262359 1420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cda785228624dcfb7fea6ac3d65713b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.222810 2119 ts_tablet_manager.cc:1939] T ac64eacc7d924940aacc8779b5bfeae7 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:28.267462 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1363) took 1380 ms. Trace:
I20260927 15:06:28.267558 2119 rpcz_store.cc:276] 0927 15:06:26.886668 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.886736 (+ 68us) service_pool.cc:227] Handling call
0927 15:06:28.017272 (+1130536us) ts_tablet_manager.cc:1145] Deleting tablet ac64eacc7d924940aacc8779b5bfeae7
0927 15:06:28.017283 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.152920 (+135637us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.222293 (+ 69373us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.267443 (+ 45150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1130335}
I20260927 15:06:28.267751 3374 raft_consensus.cc:504] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.267985 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet ac64eacc7d924940aacc8779b5bfeae7 (table default.Table_a26bdbe66d9a438ab4a3a6cf93fbe430 [id=10a0f9e80795470996770db15c99a546]) successfully deleted
I20260927 15:06:28.268397 2119 tablet_replica.cc:330] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:28.268604 2119 raft_consensus.cc:2229] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:28.268874 2119 pending_rounds.cc:62] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:28.268920 2119 pending_rounds.cc:68] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976422636544000 op_type: NO_OP noop_request { }
I20260927 15:06:28.269037 2119 raft_consensus.cc:2866] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:28.269140 2119 raft_consensus.cc:2258] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.269515 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d167c390ed546e09f31f1e08988500c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.270020 2119 ts_tablet_manager.cc:1905] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.270006 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05d525c1128e4042aa97ff786ffa7ba9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.271258 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05d525c1128e4042aa97ff786ffa7ba9" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.271260 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d167c390ed546e09f31f1e08988500c" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:28.271912 1376 leader_election.cc:341] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.274315 3440 tablet.cc:1722] T fb5f4a30bac94d72b5265c8a7a0d4d59 P 4769a710b72a4b49b816725a5921e86e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260927 15:06:28.275556 3423 raft_consensus.cc:482] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.275753 3423 raft_consensus.cc:504] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.276415 3423 leader_election.cc:288] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:28.284881 809 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 61787.2us
I20260927 15:06:28.286613 1402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1df048ff83d149d4ab5a357118968ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.287551 1562 ts_tablet_manager.cc:1918] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:28.287673 1562 log.cc:1196] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/1ba163e0f6164d65b09da684ee4872e0
I20260927 15:06:28.287791 3289 raft_consensus.cc:482] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260927 15:06:28.291105 1374 leader_election.cc:341] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.291826 3374 leader_election.cc:288] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.292148 1562 ts_tablet_manager.cc:1939] T 1ba163e0f6164d65b09da684ee4872e0 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:28.298159 3302 raft_consensus.cc:482] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.298318 3302 raft_consensus.cc:504] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.299317 3302 leader_election.cc:288] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.299743 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52e7439320dd48aba25b5f7dc627964c" candidate_uuid: "4769a710b72a4b49b816725a5921e86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.301415 3236 raft_consensus.cc:482] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.301569 3236 raft_consensus.cc:504] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.302109 3236 leader_election.cc:288] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
W20260927 15:06:28.303390 1374 leader_election.cc:341] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.303537 1374 leader_election.cc:302] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:28.304052 3289 raft_consensus.cc:504] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.304594 3289 leader_election.cc:288] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.304733 3289 raft_consensus.cc:2726] T 05d525c1128e4042aa97ff786ffa7ba9 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.304908 1409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c074c67676b841b391cc3160ea6ea89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.307536 1556 tablet_bootstrap.cc:492] T 81f65ad693894e7c8b575cd8e1942c14 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:28.307686 1556 ts_tablet_manager.cc:1397] T 81f65ad693894e7c8b575cd8e1942c14 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.287s user 0.005s sys 0.005s
I20260927 15:06:28.308382 1556 raft_consensus.cc:348] T 81f65ad693894e7c8b575cd8e1942c14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.308657 1556 raft_consensus.cc:374] T 81f65ad693894e7c8b575cd8e1942c14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.308730 1556 raft_consensus.cc:729] T 81f65ad693894e7c8b575cd8e1942c14 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.308945 1556 consensus_queue.cc:260] T 81f65ad693894e7c8b575cd8e1942c14 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.309494 1556 ts_tablet_manager.cc:1428] T 81f65ad693894e7c8b575cd8e1942c14 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260927 15:06:28.309612 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e8909687fb40fdbccad15cd99b6eaf" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.309775 1556 tablet_bootstrap.cc:492] T 5b1fe1a561d04185a3703b8ec2e9ccf6 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:28.313473 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b88cb2c53be4463eb17e748d2c17f0e2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.322362 1418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f72f9a43f664ef3b5c4e6c9e8d3f4ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260927 15:06:28.324481 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 1d6afacbd3e04806862929e82e4bdeac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d6afacbd3e04806862929e82e4bdeac already in progress: creating tablet
I20260927 15:06:28.326676 3435 consensus_queue.cc:1035] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260927 15:06:28.327596 1376 leader_election.cc:341] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:28.332362 1238 leader_election.cc:341] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 52e7439320dd48aba25b5f7dc627964c
I20260927 15:06:28.332491 1238 leader_election.cc:302] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4769a710b72a4b49b816725a5921e86e; no voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38
W20260927 15:06:28.332904 1374 leader_election.cc:341] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:28.334335 1099 leader_election.cc:341] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 12f6403cde734c1394aabfc92c093290
I20260927 15:06:28.334612 1403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 991325ffb7e545598af2364130a578e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.342973 3302 raft_consensus.cc:2726] T 52e7439320dd48aba25b5f7dc627964c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:28.343582 1374 leader_election.cc:341] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.344378 1412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02d1ac2a13544f3ab196621b24979558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260927 15:06:28.344394 1376 leader_election.cc:302] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:28.344827 1376 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.201.2:39515, user_credentials={real_user=slave}} blocked reactor thread for 72605.5us
I20260927 15:06:28.345220 3405 raft_consensus.cc:482] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.345355 3405 raft_consensus.cc:504] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.345757 1300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85e8909687fb40fdbccad15cd99b6eaf" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.345959 3405 leader_election.cc:288] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:28.346138 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b88cb2c53be4463eb17e748d2c17f0e2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.346594 3374 raft_consensus.cc:2726] T 6d167c390ed546e09f31f1e08988500c P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:28.346894 1376 leader_election.cc:341] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.347007 1376 leader_election.cc:302] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
W20260927 15:06:28.347354 1376 leader_election.cc:341] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.347471 1376 leader_election.cc:302] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:28.347784 3374 raft_consensus.cc:2726] T 85e8909687fb40fdbccad15cd99b6eaf P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.347934 3374 raft_consensus.cc:2726] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.348416 2119 ts_tablet_manager.cc:1918] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:28.348528 2119 log.cc:1196] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/727652500d9a47b68b7a0d0dcf583822
I20260927 15:06:28.348920 2119 ts_tablet_manager.cc:1939] T 727652500d9a47b68b7a0d0dcf583822 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:28.350338 1099 leader_election.cc:341] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: 171ba98418b34aa283b7a7b243678fa9
I20260927 15:06:28.351317 1556 tablet_bootstrap.cc:654] T 5b1fe1a561d04185a3703b8ec2e9ccf6 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.349164 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "171ba98418b34aa283b7a7b243678fa9" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.352005 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1364) took 1446 ms. Trace:
W20260927 15:06:28.352183 1102 leader_election.cc:341] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.352314 1102 leader_election.cc:302] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:28.352761 3405 raft_consensus.cc:2726] T 171ba98418b34aa283b7a7b243678fa9 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.352908 2119 rpcz_store.cc:276] 0927 15:06:26.905995 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.906084 (+ 89us) service_pool.cc:227] Handling call
0927 15:06:28.268343 (+1362259us) ts_tablet_manager.cc:1145] Deleting tablet 727652500d9a47b68b7a0d0dcf583822
0927 15:06:28.268356 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.312649 (+ 44293us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.343923 (+ 31274us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.351989 (+ 8066us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1362066}
I20260927 15:06:28.355492 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 727652500d9a47b68b7a0d0dcf583822 (table default.Table_c4dd12d29bc04a84822989fcb7fd5c27 [id=645add1330bd41618f53f3c008b48200]) successfully deleted
I20260927 15:06:28.356081 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1365) took 1416 ms. Trace:
I20260927 15:06:28.356798 2119 rpcz_store.cc:276] 0927 15:06:26.939969 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.940319 (+ 350us) service_pool.cc:227] Handling call
0927 15:06:28.355955 (+1415636us) ts_tablet_manager.cc:1145] Deleting tablet 581416f6c2cc434d8ee3ae1428d94f1c
0927 15:06:28.355966 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.356063 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1415435}
W20260927 15:06:28.357576 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 581416f6c2cc434d8ee3ae1428d94f1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 581416f6c2cc434d8ee3ae1428d94f1c already in progress: creating tablet
I20260927 15:06:28.358191 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1366) took 1417 ms. Trace:
I20260927 15:06:28.358982 2119 rpcz_store.cc:276] 0927 15:06:26.940250 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.940315 (+ 65us) service_pool.cc:227] Handling call
0927 15:06:28.358058 (+1417743us) ts_tablet_manager.cc:1145] Deleting tablet afbfe01feee7463e8c5b795f9fda70cd
0927 15:06:28.358068 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.358174 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1417350}
I20260927 15:06:28.363597 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1079) took 8947 ms. Trace:
I20260927 15:06:28.363756 1562 rpcz_store.cc:276] 0927 15:06:19.416328 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.416696 (+ 368us) service_pool.cc:227] Handling call
0927 15:06:28.143979 (+8727283us) ts_tablet_manager.cc:1145] Deleting tablet 1ba163e0f6164d65b09da684ee4872e0
0927 15:06:28.143989 (+ 10us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.148370 (+ 4381us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.287445 (+139075us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.363575 (+ 76130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8725792}
I20260927 15:06:28.364283 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 1ba163e0f6164d65b09da684ee4872e0 (table default.Table_df75a53e443d434aaa888fab1ad38e36 [id=935f8397667e4d338a12c98850a26789]) successfully deleted
W20260927 15:06:28.364662 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet afbfe01feee7463e8c5b795f9fda70cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afbfe01feee7463e8c5b795f9fda70cd already in progress: creating tablet
I20260927 15:06:28.364758 1562 tablet_replica.cc:330] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:28.364989 1562 raft_consensus.cc:2229] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 2 LEADER]: Raft consensus shutting down.
I20260927 15:06:28.365185 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1367) took 1417 ms. Trace:
I20260927 15:06:28.365375 1562 pending_rounds.cc:62] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: Trying to abort 1 pending ops.
I20260927 15:06:28.365468 1562 pending_rounds.cc:68] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7333976419286958080 op_type: NO_OP noop_request { }
I20260927 15:06:28.365794 1562 raft_consensus.cc:2866] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:28.365936 1562 raft_consensus.cc:2258] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.366067 2119 rpcz_store.cc:276] 0927 15:06:26.948106 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.948158 (+ 52us) service_pool.cc:227] Handling call
0927 15:06:28.365060 (+1416902us) ts_tablet_manager.cc:1145] Deleting tablet 3ee9b3d162764abf9d2754ba5c1382fe
0927 15:06:28.365075 (+ 15us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.365166 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1416707}
I20260927 15:06:28.366667 1562 ts_tablet_manager.cc:1905] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260927 15:06:28.366869 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 3ee9b3d162764abf9d2754ba5c1382fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ee9b3d162764abf9d2754ba5c1382fe already in progress: creating tablet
I20260927 15:06:28.367302 2119 tablet_replica.cc:330] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:28.367889 2119 raft_consensus.cc:2229] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:28.368896 2119 pending_rounds.cc:62] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:28.369091 2119 pending_rounds.cc:68] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976423455666176 op_type: NO_OP noop_request { }
I20260927 15:06:28.369475 2119 raft_consensus.cc:2866] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:28.369829 2119 raft_consensus.cc:2258] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.370996 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12f6403cde734c1394aabfc92c093290" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:28.371644 1102 leader_election.cc:341] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.371749 1102 leader_election.cc:302] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:28.372113 3405 raft_consensus.cc:2726] T 12f6403cde734c1394aabfc92c093290 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260927 15:06:28.370972 2119 ts_tablet_manager.cc:1905] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.379415 1556 tablet_bootstrap.cc:492] T 5b1fe1a561d04185a3703b8ec2e9ccf6 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:28.379590 1556 ts_tablet_manager.cc:1397] T 5b1fe1a561d04185a3703b8ec2e9ccf6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.001s
W20260927 15:06:28.380497 898 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.201.3:41269, user_credentials={real_user=slave}} blocked reactor thread for 55439.9us
I20260927 15:06:28.387379 1556 raft_consensus.cc:348] T 5b1fe1a561d04185a3703b8ec2e9ccf6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.391031 1556 raft_consensus.cc:374] T 5b1fe1a561d04185a3703b8ec2e9ccf6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.391314 1556 raft_consensus.cc:729] T 5b1fe1a561d04185a3703b8ec2e9ccf6 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.391611 1556 consensus_queue.cc:260] T 5b1fe1a561d04185a3703b8ec2e9ccf6 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.392262 1556 ts_tablet_manager.cc:1428] T 5b1fe1a561d04185a3703b8ec2e9ccf6 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260927 15:06:28.401546 2119 ts_tablet_manager.cc:1918] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:28.410881 1556 tablet_bootstrap.cc:492] T 6d05f7db323e40b780b050b560e1c846 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:28.412788 1556 tablet_bootstrap.cc:654] T 6d05f7db323e40b780b050b560e1c846 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.415038 3289 raft_consensus.cc:482] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.415432 3289 raft_consensus.cc:504] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.416262 3289 leader_election.cc:288] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.417429 1161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723df898361144aeb16065868885d120" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:28.418063 1374 leader_election.cc:341] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.418546 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_6930473bfdbe4854bd756baad7663c9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:28.419179 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6930473bfdbe4854bd756baad7663c9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:28.413424 1552 tablet_bootstrap.cc:492] T 3540982dd7544e60af6c153fc41a412c P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:28.424437 1552 ts_tablet_manager.cc:1397] T 3540982dd7544e60af6c153fc41a412c P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.219s user 0.012s sys 0.008s
I20260927 15:06:28.425163 1552 raft_consensus.cc:348] T 3540982dd7544e60af6c153fc41a412c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.425347 1552 raft_consensus.cc:374] T 3540982dd7544e60af6c153fc41a412c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.425390 1552 raft_consensus.cc:729] T 3540982dd7544e60af6c153fc41a412c P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.425614 1552 consensus_queue.cc:260] T 3540982dd7544e60af6c153fc41a412c P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.426100 1552 ts_tablet_manager.cc:1428] T 3540982dd7544e60af6c153fc41a412c P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:28.426330 1552 tablet_bootstrap.cc:492] T fd1f51cb124d4d20a9d6024e6eb6810f P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:28.428050 1552 tablet_bootstrap.cc:654] T fd1f51cb124d4d20a9d6024e6eb6810f P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.428157 906 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_9e637fd4bd624b0fab00b03d158b3392"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:28.428727 906 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e637fd4bd624b0fab00b03d158b3392 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:28.429039 2119 log.cc:1196] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/c6a248ec4ee64d0a8d986fdc683d69ba
I20260927 15:06:28.429464 2119 ts_tablet_manager.cc:1939] T c6a248ec4ee64d0a8d986fdc683d69ba P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:28.429778 1556 tablet_bootstrap.cc:492] T 6d05f7db323e40b780b050b560e1c846 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:28.429713 907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_c33713f5f5d841b1a1f9e687db26c2e6" } new_table_name: "default.Table_95aebcf062b54dc9a70da17ad9182eec" modify_external_catalogs: true
I20260927 15:06:28.429957 1556 ts_tablet_manager.cc:1397] T 6d05f7db323e40b780b050b560e1c846 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.004s
I20260927 15:06:28.430704 1556 raft_consensus.cc:348] T 6d05f7db323e40b780b050b560e1c846 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.430981 1556 raft_consensus.cc:374] T 6d05f7db323e40b780b050b560e1c846 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.424166 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723df898361144aeb16065868885d120" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.431069 1556 raft_consensus.cc:729] T 6d05f7db323e40b780b050b560e1c846 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.431308 1556 consensus_queue.cc:260] T 6d05f7db323e40b780b050b560e1c846 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:28.431586 1376 leader_election.cc:341] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.431725 1376 leader_election.cc:302] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:28.431962 1556 ts_tablet_manager.cc:1428] T 6d05f7db323e40b780b050b560e1c846 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:28.432137 3374 raft_consensus.cc:2726] T 723df898361144aeb16065868885d120 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.432761 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1368) took 1451 ms. Trace:
I20260927 15:06:28.432897 2119 rpcz_store.cc:276] 0927 15:06:26.981310 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.981367 (+ 57us) service_pool.cc:227] Handling call
0927 15:06:28.367253 (+1385886us) ts_tablet_manager.cc:1145] Deleting tablet c6a248ec4ee64d0a8d986fdc683d69ba
0927 15:06:28.367266 (+ 13us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.398627 (+ 31361us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.401444 (+ 2817us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.432743 (+ 31299us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1385676}
I20260927 15:06:28.433437 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet c6a248ec4ee64d0a8d986fdc683d69ba (table default.Table_b33719cf7165405caf26b84396bd5f7b [id=fa89a4b72c5f49589d9ee43f118da869]) successfully deleted
I20260927 15:06:28.433796 2119 tablet_replica.cc:330] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:28.439057 2119 raft_consensus.cc:2229] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:28.439638 2119 pending_rounds.cc:62] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:28.441238 2119 pending_rounds.cc:68] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976422441967616 op_type: NO_OP noop_request { }
I20260927 15:06:28.441601 2119 raft_consensus.cc:2866] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:28.441854 2119 raft_consensus.cc:2258] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.443147 2119 ts_tablet_manager.cc:1905] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.449098 905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 0a1e7d78c7154345b33ac78f497d26a4
I20260927 15:06:28.449492 905 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:49800 (request call id 1732) took 1567 ms. Trace:
I20260927 15:06:28.449568 905 rpcz_store.cc:276] 0927 15:06:26.881813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:26.882009 (+ 196us) service_pool.cc:227] Handling call
0927 15:06:26.882428 (+ 419us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0927 15:06:26.882558 (+ 130us) catalog_manager.cc:2752] Modifying in-memory table state
0927 15:06:26.882616 (+ 58us) catalog_manager.cc:2761] Locking tablets
0927 15:06:28.001483 (+1118867us) catalog_manager.cc:2775] Removing table and tablets from system table
0927 15:06:28.448881 (+447398us) catalog_manager.cc:2793] Removing table from by-name map
0927 15:06:28.448990 (+ 109us) catalog_manager.cc:2809] Committing in-memory state
0927 15:06:28.449067 (+ 77us) catalog_manager.cc:2813] Aborting table tasks
0927 15:06:28.449478 (+ 411us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0927 15:06:28.082331 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0927 15:06:28.082413 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0927 15:06:28.082418 (+ 5us) write_op.cc:435] Acquired schema lock
0927 15:06:28.082420 (+ 2us) tablet.cc:660] Decoding operations
0927 15:06:28.082515 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
0927 15:06:28.082525 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0927 15:06:28.082530 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0927 15:06:28.082616 (+ 86us) tablet.cc:699] Row locks acquired
0927 15:06:28.082618 (+ 2us) write_op.cc:260] PREPARE: finished
0927 15:06:28.082644 (+ 26us) write_op.cc:270] Start()
0927 15:06:28.082670 (+ 26us) write_op.cc:276] Timestamp: P: 1790521588082626 usec, L: 0
0927 15:06:28.082674 (+ 4us) op_driver.cc:331] REPLICATION: starting
0927 15:06:28.082806 (+ 132us) log.cc:842] Serialized 725 byte log entry
0927 15:06:28.417553 (+334747us) op_driver.cc:444] REPLICATION: finished
0927 15:06:28.447329 (+ 29776us) write_op.cc:301] APPLY: starting
0927 15:06:28.447354 (+ 25us) tablet.cc:1365] starting BulkCheckPresence
0927 15:06:28.447419 (+ 65us) tablet.cc:1368] finished BulkCheckPresence
0927 15:06:28.447471 (+ 52us) tablet.cc:1370] starting ApplyRowOperation cycle
0927 15:06:28.447577 (+ 106us) tablet.cc:1381] finished ApplyRowOperation cycle
0927 15:06:28.447666 (+ 89us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0927 15:06:28.447673 (+ 7us) write_op.cc:312] APPLY: finished
0927 15:06:28.447779 (+ 106us) log.cc:842] Serialized 29 byte log entry
0927 15:06:28.447838 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:28.447856 (+ 18us) write_op.cc:454] Released schema lock
0927 15:06:28.447863 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0927 15:06:28.447914 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0927 15:06:28.447918 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":29665,"apply.run_cpu_time_us":644,"apply.run_wall_time_us":644,"num_ops":2,"prepare.queue_time_us":80283,"prepare.run_cpu_time_us":556,"prepare.run_wall_time_us":844,"replication_time_us":334851}]]}
I20260927 15:06:28.450786 909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet 23306cd9652e4d32b188f7e9e29d8452
I20260927 15:06:28.451581 913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet ac384537014a4a48952d12a447e56266
I20260927 15:06:28.453262 1271 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a1e7d78c7154345b33ac78f497d26a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:28.453539 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 23306cd9652e4d32b188f7e9e29d8452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:28.453796 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet ac384537014a4a48952d12a447e56266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:28.455418 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a1e7d78c7154345b33ac78f497d26a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.455665 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 23306cd9652e4d32b188f7e9e29d8452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.455849 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet ac384537014a4a48952d12a447e56266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.456998 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 23306cd9652e4d32b188f7e9e29d8452 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.457558 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a1e7d78c7154345b33ac78f497d26a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:26 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.459242 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet ac384537014a4a48952d12a447e56266 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.465271 913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_e22b0ec72d614446b20af2301c7109fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:28.465852 913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e22b0ec72d614446b20af2301c7109fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:28.469630 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet af25950fd08043f18a6eaaf46ded4378 with delete_type TABLET_DATA_DELETED (replaced by tablet 571072536098420d8b5bdddc9aaa4161) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:28.471665 909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_1b2a646db04d4726ade6dccd451f39de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:28.472204 909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b2a646db04d4726ade6dccd451f39de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:28.471328 905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_3e56420774eb4ec19f7396adcfe35b0e" } new_table_name: "default.Table_05e6274de5264fc0a0a39eb6a5da914c" modify_external_catalogs: true
I20260927 15:06:28.475555 2119 ts_tablet_manager.cc:1918] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:28.475975 2119 log.cc:1196] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/7f0d667472ee4f1481c213e03403461e
I20260927 15:06:28.476584 2119 ts_tablet_manager.cc:1939] T 7f0d667472ee4f1481c213e03403461e P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:28.477429 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1369) took 1416 ms. Trace:
I20260927 15:06:28.481143 3236 raft_consensus.cc:482] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.481472 3236 raft_consensus.cc:504] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.482810 3236 leader_election.cc:288] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:28.485370 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54f5c4b7c7a045bea1a79bc67a913f65" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:28.485646 1439 raft_consensus.cc:2454] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:28.486021 1099 leader_election.cc:302] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:28.483676 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54f5c4b7c7a045bea1a79bc67a913f65" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.486557 2119 rpcz_store.cc:276] 0927 15:06:27.061115 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:27.061180 (+ 65us) service_pool.cc:227] Handling call
0927 15:06:28.433741 (+1372561us) ts_tablet_manager.cc:1145] Deleting tablet 7f0d667472ee4f1481c213e03403461e
0927 15:06:28.433753 (+ 12us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.458040 (+ 24287us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.475434 (+ 17394us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.477411 (+ 1977us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1372327}
I20260927 15:06:28.486954 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1370) took 1239 ms. Trace:
I20260927 15:06:28.487083 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 7f0d667472ee4f1481c213e03403461e (table default.Table_47142ae009c646398d187fa84231faa2 [id=4a2d7f51ed0d461dab1ea8add3ba8619]) successfully deleted
I20260927 15:06:28.487047 2119 rpcz_store.cc:276] 0927 15:06:27.247924 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:27.249440 (+ 1516us) service_pool.cc:227] Handling call
0927 15:06:28.486820 (+1237380us) ts_tablet_manager.cc:1145] Deleting tablet 8fd389719a9948788c34b99e4953af57
0927 15:06:28.486850 (+ 30us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.486938 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1237166}
W20260927 15:06:28.487680 901 catalog_manager.cc:4821] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): delete failed for tablet 8fd389719a9948788c34b99e4953af57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fd389719a9948788c34b99e4953af57 already in progress: creating tablet
I20260927 15:06:28.488083 3405 raft_consensus.cc:482] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.488197 3405 raft_consensus.cc:504] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.488683 3405 leader_election.cc:288] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:28.489172 3236 raft_consensus.cc:2781] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:28.489140 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20278f979638419db92105e55310f605" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" is_pre_election: true
I20260927 15:06:28.489358 1439 raft_consensus.cc:2454] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 0.
I20260927 15:06:28.489405 3236 raft_consensus.cc:482] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:28.489717 1099 leader_election.cc:302] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters:
I20260927 15:06:28.490052 3405 raft_consensus.cc:2781] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260927 15:06:28.490114 3405 raft_consensus.cc:482] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260927 15:06:28.490170 3405 raft_consensus.cc:3037] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:28.492712 3405 raft_consensus.cc:504] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.493393 2119 tablet_replica.cc:330] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:28.494077 3405 leader_election.cc:288] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:28.494383 2119 raft_consensus.cc:2229] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:28.495488 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20278f979638419db92105e55310f605" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.495215 2119 raft_consensus.cc:2258] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
W20260927 15:06:28.494997 1102 leader_election.cc:341] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260927 15:06:28.496630 1102 leader_election.cc:341] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.489704 3236 raft_consensus.cc:3037] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:28.499357 2119 ts_tablet_manager.cc:1905] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.503233 3236 raft_consensus.cc:504] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.504987 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54f5c4b7c7a045bea1a79bc67a913f65" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:28.505690 1102 leader_election.cc:341] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.506238 1294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20278f979638419db92105e55310f605" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e"
W20260927 15:06:28.506974 1102 leader_election.cc:341] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.511423 3405 raft_consensus.cc:482] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.511693 3405 raft_consensus.cc:504] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
W20260927 15:06:28.513860 1099 leader_election.cc:341] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Not found: Tablet not found: b2d2501a9f764790818426665e7f0340
I20260927 15:06:28.514083 3405 leader_election.cc:288] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:28.515084 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2d2501a9f764790818426665e7f0340" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
W20260927 15:06:28.515761 1102 leader_election.cc:341] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.516014 1102 leader_election.cc:302] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c; no voters: 4769a710b72a4b49b816725a5921e86e, fabb59e74b7d48fa9be047d7f4c4cc38
I20260927 15:06:28.516947 3405 raft_consensus.cc:2726] T b2d2501a9f764790818426665e7f0340 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.518376 912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6b6a41e027f0448cafe3365f23103f92: Sending DeleteTablet for 3 replicas of tablet b26f0d253a7f4df780a1f91ceb7d82b8
I20260927 15:06:28.519239 912 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_69265c7fc93643c6bf2d9d5fd8feea68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260927 15:06:28.519491 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet b26f0d253a7f4df780a1f91ceb7d82b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:60504
W20260927 15:06:28.519876 912 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69265c7fc93643c6bf2d9d5fd8feea68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:28.521540 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet b26f0d253a7f4df780a1f91ceb7d82b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:54602
W20260927 15:06:28.528674 911 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b3d0b51543c4af69252e63c3fced051 consensus state has no leader
I20260927 15:06:28.529165 911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_141a41dcaf0f4d12bc45f9ea7a6a8e42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:28.529785 911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_141a41dcaf0f4d12bc45f9ea7a6a8e42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:28.530470 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet b26f0d253a7f4df780a1f91ceb7d82b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:27 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.535488 2119 ts_tablet_manager.cc:1918] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:28.547333 2119 log.cc:1196] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/7f8744e2349e49d3a821eca42c7f89a2
I20260927 15:06:28.548188 2119 ts_tablet_manager.cc:1939] T 7f8744e2349e49d3a821eca42c7f89a2 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:28.551867 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1372) took 1155 ms. Trace:
I20260927 15:06:28.552647 2119 rpcz_store.cc:276] 0927 15:06:27.396367 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:27.396417 (+ 50us) service_pool.cc:227] Handling call
0927 15:06:28.493147 (+1096730us) ts_tablet_manager.cc:1145] Deleting tablet 7f8744e2349e49d3a821eca42c7f89a2
0927 15:06:28.493264 (+ 117us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.525374 (+ 32110us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.535356 (+ 9982us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.551838 (+ 16482us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1090669}
I20260927 15:06:28.553865 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 7f8744e2349e49d3a821eca42c7f89a2 (table default.Table_2ad5d2ac920c40f197a7134129b64442 [id=4d9dd505f13d4b63ac2b4ea898c9eac0]) successfully deleted
I20260927 15:06:28.554492 2119 tablet_replica.cc:330] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:28.555269 2119 raft_consensus.cc:2229] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:28.556699 2119 pending_rounds.cc:62] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:28.556883 2119 pending_rounds.cc:68] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976424322428928 op_type: NO_OP noop_request { }
I20260927 15:06:28.557968 2119 raft_consensus.cc:2866] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:28.558470 2119 raft_consensus.cc:2258] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.557895 1552 tablet_bootstrap.cc:492] T fd1f51cb124d4d20a9d6024e6eb6810f P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:28.582362 1552 ts_tablet_manager.cc:1397] T fd1f51cb124d4d20a9d6024e6eb6810f P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.156s user 0.009s sys 0.018s
W20260927 15:06:28.582327 1376 consensus_peers.cc:487] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:28.584439 3289 raft_consensus.cc:482] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.584596 3289 raft_consensus.cc:504] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.585209 3289 leader_election.cc:288] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757), 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515)
I20260927 15:06:28.585270 1556 tablet_bootstrap.cc:492] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:28.586390 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c018f11de9842bc883409f8af35fb5f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
W20260927 15:06:28.587124 1374 leader_election.cc:341] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.587584 1556 tablet_bootstrap.cc:654] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.589663 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c018f11de9842bc883409f8af35fb5f" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.589778 3289 raft_consensus.cc:482] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.589922 3289 raft_consensus.cc:504] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:28.590507 1376 leader_election.cc:341] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.590672 1376 leader_election.cc:302] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:28.590982 1162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec3d823781234015aa8a48421a23bbd2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.591293 3374 raft_consensus.cc:2726] T 1c018f11de9842bc883409f8af35fb5f P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260927 15:06:28.591598 1374 leader_election.cc:341] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.591893 1304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec3d823781234015aa8a48421a23bbd2" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.592375 1562 ts_tablet_manager.cc:1918] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260927 15:06:28.590512 3289 leader_election.cc:288] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
W20260927 15:06:28.592724 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 23306cd9652e4d32b188f7e9e29d8452 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23306cd9652e4d32b188f7e9e29d8452 already in progress: creating tablet
W20260927 15:06:28.592757 1376 leader_election.cc:341] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.592892 1376 leader_election.cc:302] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:28.593420 3289 raft_consensus.cc:2726] T ec3d823781234015aa8a48421a23bbd2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.595986 1439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20278f979638419db92105e55310f605" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:28.597442 1439 raft_consensus.cc:3037] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
W20260927 15:06:28.597983 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet 0a1e7d78c7154345b33ac78f497d26a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a1e7d78c7154345b33ac78f497d26a4 already in progress: creating tablet
I20260927 15:06:28.601927 1439 raft_consensus.cc:2454] T 20278f979638419db92105e55310f605 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
W20260927 15:06:28.605053 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet ac384537014a4a48952d12a447e56266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac384537014a4a48952d12a447e56266 already in progress: creating tablet
I20260927 15:06:28.610946 1552 raft_consensus.cc:348] T fd1f51cb124d4d20a9d6024e6eb6810f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.611253 1552 raft_consensus.cc:374] T fd1f51cb124d4d20a9d6024e6eb6810f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.611317 1552 raft_consensus.cc:729] T fd1f51cb124d4d20a9d6024e6eb6810f P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.611492 1552 consensus_queue.cc:260] T fd1f51cb124d4d20a9d6024e6eb6810f P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.612448 1552 ts_tablet_manager.cc:1428] T fd1f51cb124d4d20a9d6024e6eb6810f P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.030s user 0.000s sys 0.002s
I20260927 15:06:28.613045 2119 ts_tablet_manager.cc:1905] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.614315 1291 raft_consensus.cc:3037] T 0141fdf4d1ef47b8b3e758ea3ff8b7c8 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:28.614336 1552 tablet_bootstrap.cc:492] T 9d4487cbbce24e60ae76ec0aca2760f4 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:28.616720 1552 tablet_bootstrap.cc:654] T 9d4487cbbce24e60ae76ec0aca2760f4 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
W20260927 15:06:28.620352 898 catalog_manager.cc:4821] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): delete failed for tablet b26f0d253a7f4df780a1f91ceb7d82b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b26f0d253a7f4df780a1f91ceb7d82b8 already in progress: creating tablet
I20260927 15:06:28.626483 914 master_service.cc:946] ReplaceTablet: received request to replace tablet 2a31738c476c459280e837ff109fd84f from {username='slave'} at 127.0.0.1:49800
W20260927 15:06:28.641618 1238 consensus_peers.cc:487] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e -> Peer fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): Couldn't send request to peer fabb59e74b7d48fa9be047d7f4c4cc38. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 289bea546c8a41bf97edfdc9a453a024. This is attempt 1: this message will repeat every 5th retry.
I20260927 15:06:28.642700 914 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_4855f60043f7400692b829b0dbc3d13a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:28.643428 914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4855f60043f7400692b829b0dbc3d13a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:28.646323 1350 heartbeater.cc:347] Connected to a master server at 127.0.201.60:46799
I20260927 15:06:28.647387 2119 ts_tablet_manager.cc:1918] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260927 15:06:28.647703 910 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_cce809a4e7644a39b4ee97078ae8fc27" } new_table_name: "default.Table_12ea724147d4455999637740c664f6ab" modify_external_catalogs: true
I20260927 15:06:28.649376 2119 log.cc:1196] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/955461f27b6444d4b4c3f9a9f629d5e3
I20260927 15:06:28.649796 2119 ts_tablet_manager.cc:1939] T 955461f27b6444d4b4c3f9a9f629d5e3 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:28.650128 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1374) took 1194 ms. Trace:
I20260927 15:06:28.650328 2119 rpcz_store.cc:276] 0927 15:06:27.455759 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:27.455907 (+ 148us) service_pool.cc:227] Handling call
0927 15:06:28.554428 (+1098521us) ts_tablet_manager.cc:1145] Deleting tablet 955461f27b6444d4b4c3f9a9f629d5e3
0927 15:06:28.554446 (+ 18us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.623066 (+ 68620us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.647284 (+ 24218us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.650114 (+ 2830us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28243,"tablet-delete.queue_time_us":1098327}
I20260927 15:06:28.651000 2119 tablet_replica.cc:330] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:28.651366 2119 raft_consensus.cc:2229] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:28.651727 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 955461f27b6444d4b4c3f9a9f629d5e3 (table default.Table_effad7577e2d439c8426666a6d741a88 [id=e0720391578a4511b5393a5d332985ce]) successfully deleted
I20260927 15:06:28.651607 1281 tablet_service.cc:1514] Processing DeleteTablet for tablet 52e7439320dd48aba25b5f7dc627964c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:23 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:28.651732 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 3540982dd7544e60af6c153fc41a412c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:13 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:28.652405 2119 raft_consensus.cc:2258] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.654737 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet fd1f51cb124d4d20a9d6024e6eb6810f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:03 UTC) from {username='slave'} at 127.0.0.1:54602
I20260927 15:06:28.655845 2119 ts_tablet_manager.cc:1905] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.660916 906 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_a3e46166877f48ad8e19f919ab365546" } new_table_name: "default.Table_7dc709e532fd4f96821bdd2fa7052c8a" modify_external_catalogs: true
I20260927 15:06:28.662883 908 catalog_manager.cc:5587] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269) does not have the latest schema for tablet 6d05f7db323e40b780b050b560e1c846 (table default.Table_2a3783599083430997da0fb4ef464c56 [id=6fe2593b379947a6ae019e3de2628c4c]). Expected version 2 got 0
I20260927 15:06:28.696794 1552 tablet_bootstrap.cc:492] T 9d4487cbbce24e60ae76ec0aca2760f4 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:28.697120 1552 ts_tablet_manager.cc:1397] T 9d4487cbbce24e60ae76ec0aca2760f4 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.083s user 0.000s sys 0.010s
I20260927 15:06:28.698175 1552 raft_consensus.cc:348] T 9d4487cbbce24e60ae76ec0aca2760f4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.698524 1552 raft_consensus.cc:374] T 9d4487cbbce24e60ae76ec0aca2760f4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.698618 1552 raft_consensus.cc:729] T 9d4487cbbce24e60ae76ec0aca2760f4 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.698875 1552 consensus_queue.cc:260] T 9d4487cbbce24e60ae76ec0aca2760f4 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.699599 1552 ts_tablet_manager.cc:1428] T 9d4487cbbce24e60ae76ec0aca2760f4 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:28.619635 1561 tablet_bootstrap.cc:492] T ec3d823781234015aa8a48421a23bbd2 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:28.700260 1561 ts_tablet_manager.cc:1397] T ec3d823781234015aa8a48421a23bbd2 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.473s user 0.105s sys 0.129s
I20260927 15:06:28.700924 1561 raft_consensus.cc:348] T ec3d823781234015aa8a48421a23bbd2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.701184 1561 raft_consensus.cc:374] T ec3d823781234015aa8a48421a23bbd2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.701273 1561 raft_consensus.cc:729] T ec3d823781234015aa8a48421a23bbd2 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.701568 1561 consensus_queue.cc:260] T ec3d823781234015aa8a48421a23bbd2 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.702123 1561 ts_tablet_manager.cc:1428] T ec3d823781234015aa8a48421a23bbd2 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:28.620071 3236 leader_election.cc:288] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Requested vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269)
I20260927 15:06:28.632874 1135 tablet_service.cc:1514] Processing DeleteTablet for tablet f0a71cf0ee554b3eafca3f054cc16b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.638252 1129 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d533883e3344eca939cd67644895148 with delete_type TABLET_DATA_DELETED (replaced by tablet 534a74d9f8e648168b87e26fb73c8b3a) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.638424 1130 tablet_service.cc:1514] Processing DeleteTablet for tablet 219639c0184f4888984fa04a1f84bd83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:04 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.639488 1141 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bdb6d04e5a94d7fbe3b27ccc0042f85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.639724 1134 tablet_service.cc:1514] Processing DeleteTablet for tablet 54f5c4b7c7a045bea1a79bc67a913f65 with delete_type TABLET_DATA_DELETED (replaced by tablet fd6a824a5a504c92992ceec1cd3eb2e7) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.639815 1143 tablet_service.cc:1514] Processing DeleteTablet for tablet e9f171fd62d644f38262a2257d47fafe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:14 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.660085 1133 tablet_service.cc:1514] Processing DeleteTablet for tablet 20278f979638419db92105e55310f605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:60504
I20260927 15:06:28.702769 1561 tablet_bootstrap.cc:492] T 85e8909687fb40fdbccad15cd99b6eaf P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:28.704156 1561 tablet_bootstrap.cc:654] T 85e8909687fb40fdbccad15cd99b6eaf P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.707110 1552 tablet_bootstrap.cc:492] T b2d2501a9f764790818426665e7f0340 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:28.707106 1562 log.cc:1196] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-0/wal/wals/2268d824f5324cd1b81879e2fe4fd027
I20260927 15:06:28.707549 1562 ts_tablet_manager.cc:1939] T 2268d824f5324cd1b81879e2fe4fd027 P c4264874db964ff2830b7894c2b3d61c: Deleting consensus metadata
I20260927 15:06:28.708312 1562 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60504 (request call id 1085) took 9228 ms. Trace:
I20260927 15:06:28.708412 1562 rpcz_store.cc:276] 0927 15:06:19.479762 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:19.479823 (+ 61us) service_pool.cc:227] Handling call
0927 15:06:28.364709 (+8884886us) ts_tablet_manager.cc:1145] Deleting tablet 2268d824f5324cd1b81879e2fe4fd027
0927 15:06:28.364720 (+ 11us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.379256 (+ 14536us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.592269 (+213013us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.708291 (+116022us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8884554}
I20260927 15:06:28.700431 3302 consensus_queue.cc:1035] T 289bea546c8a41bf97edfdc9a453a024 P 4769a710b72a4b49b816725a5921e86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:28.708899 899 catalog_manager.cc:4841] TS c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): tablet 2268d824f5324cd1b81879e2fe4fd027 (table default.Table_83597ebfdee14f58abf228d7cd16bbd3 [id=b36bff625e7a4da699490e2921c33802]) successfully deleted
I20260927 15:06:28.709203 1562 tablet_replica.cc:330] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c: stopping tablet replica
I20260927 15:06:28.709408 1562 raft_consensus.cc:2229] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:28.605067 1556 tablet_bootstrap.cc:492] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:28.713070 1556 ts_tablet_manager.cc:1397] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.128s user 0.007s sys 0.006s
I20260927 15:06:28.713358 1099 leader_election.cc:302] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:28.713809 3150 raft_consensus.cc:2781] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:28.636701 3289 consensus_queue.cc:1035] T 52a4360599644da0921de9ff0e4111c6 P fabb59e74b7d48fa9be047d7f4c4cc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260927 15:06:28.713918 3150 raft_consensus.cc:686] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:28.713797 1556 raft_consensus.cc:348] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.714030 1556 raft_consensus.cc:374] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.714115 1556 raft_consensus.cc:729] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.653332 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54f5c4b7c7a045bea1a79bc67a913f65" candidate_uuid: "c4264874db964ff2830b7894c2b3d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38"
I20260927 15:06:28.714118 3150 consensus_queue.cc:237] T 20278f979638419db92105e55310f605 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.714318 1556 consensus_queue.cc:260] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.714334 1437 raft_consensus.cc:3037] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Advancing to term 1
I20260927 15:06:28.714812 1556 ts_tablet_manager.cc:1428] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:28.715101 1556 tablet_bootstrap.cc:492] T 0d6523d56f344208abc30f0d82138998 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:28.716674 1556 tablet_bootstrap.cc:654] T 0d6523d56f344208abc30f0d82138998 P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.717245 1437 raft_consensus.cc:2454] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4264874db964ff2830b7894c2b3d61c in term 1.
I20260927 15:06:28.665230 1403 tablet_service.cc:1514] Processing DeleteTablet for tablet 54f5c4b7c7a045bea1a79bc67a913f65 with delete_type TABLET_DATA_DELETED (replaced by tablet fd6a824a5a504c92992ceec1cd3eb2e7) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.665938 1418 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3bdfede5744513aeadb22da73b6f8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:12 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.666612 1402 tablet_service.cc:1514] Processing DeleteTablet for tablet b88cb2c53be4463eb17e748d2c17f0e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:10 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.722025 3167 tablet_replica.cc:330] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:28.669190 1412 tablet_service.cc:1514] Processing DeleteTablet for tablet 05d525c1128e4042aa97ff786ffa7ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.669607 1420 tablet_service.cc:1514] Processing DeleteTablet for tablet ec3d823781234015aa8a48421a23bbd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.722254 3167 raft_consensus.cc:2229] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:28.670066 1409 tablet_service.cc:1514] Processing DeleteTablet for tablet 723df898361144aeb16065868885d120 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.670495 1408 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c018f11de9842bc883409f8af35fb5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.722429 3167 raft_consensus.cc:2258] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.677501 1404 tablet_service.cc:1514] Processing DeleteTablet for tablet d9c032a06c0b497fa21a3553375978ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:24 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.677989 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 611e63080dcb474c8dde370c54a0e777 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:16 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.722122 1562 raft_consensus.cc:2258] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.723003 3167 ts_tablet_manager.cc:1905] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.723393 1562 ts_tablet_manager.cc:1905] T b9a97e3e6a5749feb4dd5f835d9c01ac P c4264874db964ff2830b7894c2b3d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.678256 1401 tablet_service.cc:1514] Processing DeleteTablet for tablet 20278f979638419db92105e55310f605 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.678478 1414 tablet_service.cc:1514] Processing DeleteTablet for tablet 90619b7804324c9589b53342e2f6d0e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:07 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.678903 1406 tablet_service.cc:1514] Processing DeleteTablet for tablet f86725bd5d5247faa0dff164857629d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.679329 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 85e8909687fb40fdbccad15cd99b6eaf with delete_type TABLET_DATA_DELETED (replaced by tablet 5e04612637ac41c0a3b89b642823e9a1) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.679751 1405 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d167c390ed546e09f31f1e08988500c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:15 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.680121 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 81f65ad693894e7c8b575cd8e1942c14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:09 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.728833 908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_d65a14e2888f47459443b35bf1ffad1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:28.729621 908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d65a14e2888f47459443b35bf1ffad1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:28.730547 1099 leader_election.cc:302] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c4264874db964ff2830b7894c2b3d61c, fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e
I20260927 15:06:28.737412 3325 raft_consensus.cc:2781] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260927 15:06:28.737604 3325 raft_consensus.cc:686] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [term 1 LEADER]: Becoming Leader. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Running, Role: LEADER
I20260927 15:06:28.737830 3325 consensus_queue.cc:237] T 54f5c4b7c7a045bea1a79bc67a913f65 P c4264874db964ff2830b7894c2b3d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.747047 3167 ts_tablet_manager.cc:1918] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:28.747224 3167 log.cc:1196] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/54f5c4b7c7a045bea1a79bc67a913f65
I20260927 15:06:28.747561 3167 ts_tablet_manager.cc:1939] T 54f5c4b7c7a045bea1a79bc67a913f65 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
W20260927 15:06:28.752097 905 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30186548510642fab1533ab7183fa7dd consensus state has no leader
I20260927 15:06:28.753398 1561 tablet_bootstrap.cc:492] T 85e8909687fb40fdbccad15cd99b6eaf P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:28.753556 1561 ts_tablet_manager.cc:1397] T 85e8909687fb40fdbccad15cd99b6eaf P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.001s
I20260927 15:06:28.754309 1561 raft_consensus.cc:348] T 85e8909687fb40fdbccad15cd99b6eaf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.754561 1561 raft_consensus.cc:374] T 85e8909687fb40fdbccad15cd99b6eaf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.754631 1561 raft_consensus.cc:729] T 85e8909687fb40fdbccad15cd99b6eaf P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.754894 1561 consensus_queue.cc:260] T 85e8909687fb40fdbccad15cd99b6eaf P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.755393 1561 ts_tablet_manager.cc:1428] T 85e8909687fb40fdbccad15cd99b6eaf P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260927 15:06:28.755718 1561 tablet_bootstrap.cc:492] T 921db5dbe31a4d0381bdd823cb497424 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:28.757212 1561 tablet_bootstrap.cc:654] T 921db5dbe31a4d0381bdd823cb497424 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.761835 3167 tablet_replica.cc:330] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:28.762090 3167 raft_consensus.cc:2229] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:28.762252 3167 raft_consensus.cc:2258] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.764875 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 54f5c4b7c7a045bea1a79bc67a913f65 (table default.Table_dcbcc1860c1b43909fbfb98553932758 [id=8e3c809eca024dd0a069ad056b040354]) successfully deleted
I20260927 15:06:28.762785 3167 ts_tablet_manager.cc:1905] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.778259 1561 tablet_bootstrap.cc:492] T 921db5dbe31a4d0381bdd823cb497424 P c4264874db964ff2830b7894c2b3d61c: No bootstrap required, opened a new log
I20260927 15:06:28.780323 2119 ts_tablet_manager.cc:1918] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:28.780627 2119 log.cc:1196] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/769e9b5c08cd44cc8a0d681500d64f54
I20260927 15:06:28.781122 1561 ts_tablet_manager.cc:1397] T 921db5dbe31a4d0381bdd823cb497424 P c4264874db964ff2830b7894c2b3d61c: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.001s
I20260927 15:06:28.782456 1556 tablet_bootstrap.cc:492] T 0d6523d56f344208abc30f0d82138998 P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:28.782666 1556 ts_tablet_manager.cc:1397] T 0d6523d56f344208abc30f0d82138998 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.068s user 0.000s sys 0.007s
I20260927 15:06:28.782968 1552 tablet_bootstrap.cc:654] T b2d2501a9f764790818426665e7f0340 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.783452 1556 raft_consensus.cc:348] T 0d6523d56f344208abc30f0d82138998 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.783782 1556 raft_consensus.cc:374] T 0d6523d56f344208abc30f0d82138998 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.783912 1556 raft_consensus.cc:729] T 0d6523d56f344208abc30f0d82138998 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.784230 2119 ts_tablet_manager.cc:1939] T 769e9b5c08cd44cc8a0d681500d64f54 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
I20260927 15:06:28.784191 1556 consensus_queue.cc:260] T 0d6523d56f344208abc30f0d82138998 P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.785290 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1373) took 1329 ms. Trace:
I20260927 15:06:28.785442 2119 rpcz_store.cc:276] 0927 15:06:27.455667 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:27.455963 (+ 296us) service_pool.cc:227] Handling call
0927 15:06:28.650961 (+1194998us) ts_tablet_manager.cc:1145] Deleting tablet 769e9b5c08cd44cc8a0d681500d64f54
0927 15:06:28.650970 (+ 9us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.707577 (+ 56607us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.780177 (+ 72600us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.785269 (+ 5092us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1194852}
I20260927 15:06:28.786257 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 769e9b5c08cd44cc8a0d681500d64f54 (table default.Table_144247c8f6c749539a8c431dd3e74d17 [id=e8ef09e7d3114b19a5e62a4ff883166e]) successfully deleted
I20260927 15:06:28.787330 2119 tablet_replica.cc:330] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:28.787185 1556 ts_tablet_manager.cc:1428] T 0d6523d56f344208abc30f0d82138998 P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260927 15:06:28.787942 1556 tablet_bootstrap.cc:492] T 643ec85d098444d6b082fe4038c50c4d P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:28.790930 1556 tablet_bootstrap.cc:654] T 643ec85d098444d6b082fe4038c50c4d P fabb59e74b7d48fa9be047d7f4c4cc38: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.791117 2119 raft_consensus.cc:2229] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:28.791349 2119 raft_consensus.cc:2258] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.792029 2119 ts_tablet_manager.cc:1905] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.792521 1561 raft_consensus.cc:348] T 921db5dbe31a4d0381bdd823cb497424 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.793339 1561 raft_consensus.cc:374] T 921db5dbe31a4d0381bdd823cb497424 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.793701 1561 raft_consensus.cc:729] T 921db5dbe31a4d0381bdd823cb497424 P c4264874db964ff2830b7894c2b3d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4264874db964ff2830b7894c2b3d61c, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.794793 1561 consensus_queue.cc:260] T 921db5dbe31a4d0381bdd823cb497424 P c4264874db964ff2830b7894c2b3d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
W20260927 15:06:28.796977 1102 consensus_peers.cc:487] T d9fecfb2325046f98e69797ff8342892 P c4264874db964ff2830b7894c2b3d61c -> Peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Couldn't send request to peer 4769a710b72a4b49b816725a5921e86e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260927 15:06:28.798938 1561 ts_tablet_manager.cc:1428] T 921db5dbe31a4d0381bdd823cb497424 P c4264874db964ff2830b7894c2b3d61c: Time spent starting tablet: real 0.010s user 0.003s sys 0.001s
I20260927 15:06:28.800275 1561 tablet_bootstrap.cc:492] T 15609a2240ff42bfb30c3a318ce7ef91 P c4264874db964ff2830b7894c2b3d61c: Bootstrap starting.
I20260927 15:06:28.804906 1552 tablet_bootstrap.cc:492] T b2d2501a9f764790818426665e7f0340 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:28.805109 1552 ts_tablet_manager.cc:1397] T b2d2501a9f764790818426665e7f0340 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.098s user 0.001s sys 0.003s
I20260927 15:06:28.805920 1552 raft_consensus.cc:348] T b2d2501a9f764790818426665e7f0340 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.806181 1552 raft_consensus.cc:374] T b2d2501a9f764790818426665e7f0340 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.806265 1552 raft_consensus.cc:729] T b2d2501a9f764790818426665e7f0340 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.806530 1552 consensus_queue.cc:260] T b2d2501a9f764790818426665e7f0340 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.807148 1552 ts_tablet_manager.cc:1428] T b2d2501a9f764790818426665e7f0340 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260927 15:06:28.807750 3167 ts_tablet_manager.cc:1918] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260927 15:06:28.807803 1552 tablet_bootstrap.cc:492] T 171ba98418b34aa283b7a7b243678fa9 P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:28.807917 3167 log.cc:1196] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-2/wal/wals/6f3bdfede5744513aeadb22da73b6f8a
I20260927 15:06:28.808288 3167 ts_tablet_manager.cc:1939] T 6f3bdfede5744513aeadb22da73b6f8a P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting consensus metadata
I20260927 15:06:28.808805 3167 tablet_replica.cc:330] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38: stopping tablet replica
I20260927 15:06:28.808924 898 catalog_manager.cc:4841] TS fabb59e74b7d48fa9be047d7f4c4cc38 (127.0.201.3:41269): tablet 6f3bdfede5744513aeadb22da73b6f8a (table default.Table_108c4b5538b94b6fad6c4f46eb9a2b1b [id=441cd1970e024331bea46979f73efac4]) successfully deleted
I20260927 15:06:28.809024 3167 raft_consensus.cc:2229] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260927 15:06:28.809221 3167 raft_consensus.cc:2258] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260927 15:06:28.809888 1552 tablet_bootstrap.cc:654] T 171ba98418b34aa283b7a7b243678fa9 P 4769a710b72a4b49b816725a5921e86e: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.811987 1561 tablet_bootstrap.cc:654] T 15609a2240ff42bfb30c3a318ce7ef91 P c4264874db964ff2830b7894c2b3d61c: Neither blocks nor log segments found. Creating new log.
I20260927 15:06:28.814491 1556 tablet_bootstrap.cc:492] T 643ec85d098444d6b082fe4038c50c4d P fabb59e74b7d48fa9be047d7f4c4cc38: No bootstrap required, opened a new log
I20260927 15:06:28.814731 1556 ts_tablet_manager.cc:1397] T 643ec85d098444d6b082fe4038c50c4d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.003s
I20260927 15:06:28.818166 1552 tablet_bootstrap.cc:492] T 171ba98418b34aa283b7a7b243678fa9 P 4769a710b72a4b49b816725a5921e86e: No bootstrap required, opened a new log
I20260927 15:06:28.819790 1552 ts_tablet_manager.cc:1397] T 171ba98418b34aa283b7a7b243678fa9 P 4769a710b72a4b49b816725a5921e86e: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.005s
I20260927 15:06:28.820721 1552 raft_consensus.cc:348] T 171ba98418b34aa283b7a7b243678fa9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.826861 1556 raft_consensus.cc:348] T 643ec85d098444d6b082fe4038c50c4d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.828100 1556 raft_consensus.cc:374] T 643ec85d098444d6b082fe4038c50c4d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.828536 1556 raft_consensus.cc:729] T 643ec85d098444d6b082fe4038c50c4d P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabb59e74b7d48fa9be047d7f4c4cc38, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.828685 1552 raft_consensus.cc:374] T 171ba98418b34aa283b7a7b243678fa9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260927 15:06:28.829037 1556 consensus_queue.cc:260] T 643ec85d098444d6b082fe4038c50c4d P fabb59e74b7d48fa9be047d7f4c4cc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.829393 907 master_service.cc:946] ReplaceTablet: received request to replace tablet f5520c8eb0be4c7db426d9e22003544f from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:28.829631 1552 raft_consensus.cc:729] T 171ba98418b34aa283b7a7b243678fa9 P 4769a710b72a4b49b816725a5921e86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4769a710b72a4b49b816725a5921e86e, State: Initialized, Role: FOLLOWER
I20260927 15:06:28.830063 1552 consensus_queue.cc:260] T 171ba98418b34aa283b7a7b243678fa9 P 4769a710b72a4b49b816725a5921e86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } } peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } }
I20260927 15:06:28.830472 1556 ts_tablet_manager.cc:1428] T 643ec85d098444d6b082fe4038c50c4d P fabb59e74b7d48fa9be047d7f4c4cc38: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260927 15:06:28.830719 1552 ts_tablet_manager.cc:1428] T 171ba98418b34aa283b7a7b243678fa9 P 4769a710b72a4b49b816725a5921e86e: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260927 15:06:28.832535 3167 ts_tablet_manager.cc:1905] T b88cb2c53be4463eb17e748d2c17f0e2 P fabb59e74b7d48fa9be047d7f4c4cc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260927 15:06:28.832648 909 master_service.cc:946] ReplaceTablet: received request to replace tablet ee27f67bc245495a9e29bcac3e7d3846 from {username='slave'} at 127.0.0.1:49800
I20260927 15:06:28.832979 1417 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a9c96abcfd347a9881b99df093da490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='slave'} at 127.0.0.1:49234
I20260927 15:06:28.833341 909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b325959fd7c4c07a329ca3d6d65f01b" } modify_external_catalogs: true
I20260927 15:06:28.833552 1552 tablet_bootstrap.cc:492] T a97f72ddef5346c297d73589e926260c P 4769a710b72a4b49b816725a5921e86e: Bootstrap starting.
I20260927 15:06:28.833542 909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49800:
table { table_name: "default.Table_5b325959fd7c4c07a329ca3d6d65f01b" } modify_external_catalogs: true
I20260927 15:06:28.833897 1556 tablet_bootstrap.cc:492] T 9363b28f91804bb2a8667e0b107499a2 P fabb59e74b7d48fa9be047d7f4c4cc38: Bootstrap starting.
I20260927 15:06:28.828564 2119 ts_tablet_manager.cc:1918] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260927 15:06:28.834275 2119 log.cc:1196] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Deleting WAL directory at /tmp/dist-test-taskiBdsOQ/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790521552603112-804-0/minicluster-data/ts-1/wal/wals/08f28c023473434ba73b1142a041be97
I20260927 15:06:28.834688 3423 raft_consensus.cc:482] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260927 15:06:28.834893 3423 raft_consensus.cc:504] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4769a710b72a4b49b816725a5921e86e" member_type: VOTER last_known_addr { host: "127.0.201.2" port: 39515 } } peers { permanent_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" member_type: VOTER last_known_addr { host: "127.0.201.3" port: 41269 } } peers { permanent_uuid: "c4264874db964ff2830b7894c2b3d61c" member_type: VOTER last_known_addr { host: "127.0.201.1" port: 46757 } }
I20260927 15:06:28.835505 3423 leader_election.cc:288] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515), c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757)
I20260927 15:06:28.836133 1291 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a9c96abcfd347a9881b99df093da490" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4769a710b72a4b49b816725a5921e86e" is_pre_election: true
I20260927 15:06:28.836302 1160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a9c96abcfd347a9881b99df093da490" candidate_uuid: "fabb59e74b7d48fa9be047d7f4c4cc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4264874db964ff2830b7894c2b3d61c" is_pre_election: true
I20260927 15:06:28.836387 2119 ts_tablet_manager.cc:1939] T 08f28c023473434ba73b1142a041be97 P 4769a710b72a4b49b816725a5921e86e: Deleting consensus metadata
W20260927 15:06:28.836797 1376 leader_election.cc:341] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.837160 2119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54602 (request call id 1375) took 1374 ms. Trace:
W20260927 15:06:28.838402 1374 leader_election.cc:341] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4264874db964ff2830b7894c2b3d61c (127.0.201.1:46757): Illegal state: must be running to vote when last-logged opid is not known
I20260927 15:06:28.838534 1374 leader_election.cc:302] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fabb59e74b7d48fa9be047d7f4c4cc38; no voters: 4769a710b72a4b49b816725a5921e86e, c4264874db964ff2830b7894c2b3d61c
I20260927 15:06:28.839833 3423 raft_consensus.cc:2726] T 7a9c96abcfd347a9881b99df093da490 P fabb59e74b7d48fa9be047d7f4c4cc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260927 15:06:28.840880 905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49800:
name: "default.Table_a19729b952ea46a5978178aafde1449a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260927 15:06:28.841572 905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a19729b952ea46a5978178aafde1449a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260927 15:06:28.843164 2119 rpcz_store.cc:276] 0927 15:06:27.462911 (+ 0us) service_pool.cc:170] Inserting onto call queue
0927 15:06:27.463412 (+ 501us) service_pool.cc:227] Handling call
0927 15:06:28.786689 (+1323277us) ts_tablet_manager.cc:1145] Deleting tablet 08f28c023473434ba73b1142a041be97
0927 15:06:28.787276 (+ 587us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0927 15:06:28.795859 (+ 8583us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.828454 (+ 32595us) tablet_metadata.cc:641] Metadata flushed
0927 15:06:28.837140 (+ 8686us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1323090}
I20260927 15:06:28.844300 2119 tablet_replica.cc:330] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e: stopping tablet replica
I20260927 15:06:28.845172 2119 raft_consensus.cc:2229] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: Raft consensus shutting down.
I20260927 15:06:28.847033 2119 pending_rounds.cc:62] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e: Trying to abort 1 pending ops.
I20260927 15:06:28.849692 2119 pending_rounds.cc:68] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333976425421103104 op_type: NO_OP noop_request { }
I20260927 15:06:28.850392 901 catalog_manager.cc:4841] TS 4769a710b72a4b49b816725a5921e86e (127.0.201.2:39515): tablet 08f28c023473434ba73b1142a041be97 (table default.Table_d1231a5040be43938a3a26bc25ff741b [id=67762455acad44448ba24d18c2863816]) successfully deleted
I20260927 15:06:28.850701 2119 raft_consensus.cc:2866] T b44e2611d2bf40ae90c4fd857225e39e P 4769a710b72a4b49b816725a5921e86e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260927 15:06:28.850934 1273 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d4487cbbce24e60ae76ec0aca2760f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-27 15:06:06 UTC) from {username='